13+ Apache Synapse Jobs in India

This requirement is for Data Engineer in Gurugram for Data Analytics Project. 

 Building ETL/ELT pipelines of data from various sources using SQL/Python/Spark 

 Ensuring that data are modelled and processed according to architecture and requirements both 

functional and non-functional 

 Understanding and implementing required development guidelines, design standards and best 

practices Delivering right solution architecture, automation and technology choices 

 Working cross-functionally with enterprise architects, information security teams, and platform 

teams Suggesting and implementing architecture improvements 

 Experience with programming languages such as Python or Scala 

 Knowledge of Data Warehouse, Business Intelligence and ETL/ELT data processing issues 

 Ability to create and orchestrate ETL/ELT processes in different tools (ADF, Databricks 

Workflows) Experience working with Databricks platform: workspace, delta lake, workflows, jobs, 

Unity Catalog Understanding of SQL and relational databases 

 Practical knowledge of various relational and non-relational database engines in the cloud (Azure 

SQL Database, Azure Cosmos DB, Microsoft Fabric, Databricks) 

 Hands-on experience with data services offered by Azure cloud 

 Knowledge of Apache Spark (Databricks, Azure Synapse Spark Pools) 

 Experience in performing code review of ETL/ELT pipelines and SQL queries Analytical approach 

to problem solvin

 Hiring for Azure Data Engineers.

Location: Bangalore

Employment type: Full-time, permanent

website: www.amazech.com

Qualifications: 

B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Electrical or Electronic with good academic background.

Experience and Required Skill Sets:

•       Minimum 5 years of hands-on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse, Azure Blob, Azure Storage Explorer

•       Experience in Data warehouse/analytical systems using Azure Synapse.

Proficient in creating Azure Data Factory pipelines for ETL processing; copy activity, custom Azure development, Synapse, etc.

•       Knowledge of Azure Data Catalog, Event Grid, Service Bus, SQL, and Purview.

•       Good technical knowledge in Microsoft SQL Server BI Suite (ETL, Reporting, Analytics, Dashboards) using SSIS, SSAS, SSRS, Power BI

•       Design and develop batch and real-time streaming of data loads to data warehouse systems

 Other Requirements:

A Bachelor's or Master's degree (Engineering or computer-related degree preferred)

Strong understanding of Software Development Life Cycles including Agile/Scrum

Responsibilities: 

•       Ability to create complex, enterprise-transforming applications that meet and exceed client expectations. 

•       Responsible for the bottom line. Strong project management abilities. Ability to encourage the team to stick to timelines.

• Creating and managing ETL/ELT pipelines based on requirements
• Build PowerBI dashboards and manage datasets needed.
• Work with stakeholders to identify data structures needed for future and perform any transformations including aggregations.
• Build data cubes for real-time visualisation needs and CXO dashboards.

Required Tech Skills

• Microsoft PowerBI & DAX
• Python, Pandas, PyArrow, Jupyter Noteboks, ApacheSpark
• Azure Synapse, Azure DataBricks, Azure HDInsight, Azure Data Factory

A Business Transformation Organization that partners with businesses to co–create customer-centric hyper-personalized solutions to achieve exponential growth. Invente offers platforms and services that enable businesses to provide human-free customer experience, Business Process Automation.

Location: Hyderabad (WFO)

Budget: Open

Position: Azure Data Engineer

Experience: 5+ years of commercial experience

Responsibilities

●     Design and implement Azure data solutions using ADLS Gen 2.0, Azure Data Factory, Synapse, Databricks, SQL, and Power BI

●     Build and maintain data pipelines and ETL processes to ensure efficient data ingestion and processing

●     Develop and manage data warehouses and data lakes

●     Ensure data quality, integrity, and security

●     Implement from existing use cases required by the AI and analytics teams.

●     Collaborate with other teams to integrate data solutions with other systems and applications

●     Stay up-to-date with emerging data technologies and recommend new solutions to improve our data infrastructure

Role: Project Manager

Experience: 8-10 Years

Location: Mumbai

Company Profile:



Exponentia.ai is an AI tech organization with a presence across India, Singapore, the Middle East, and the UK. We are an innovative and disruptive organization, working on cutting-edge technology to help our clients transform into the enterprises of the future. We provide artificial intelligence-based products/platforms capable of automated cognitive decision-making to improve productivity, quality, and economics of the underlying business processes. Currently, we are rapidly expanding across machine learning, Data Engineering and Analytics functions. Exponentia.ai has developed long-term relationships with world-class clients such as PayPal, PayU, SBI Group, HDFC Life, Kotak Securities, Wockhardt and Adani Group amongst others.

One of the top partners of Data bricks, Azure, Cloudera (leading analytics player) and Qlik (leader in BI technologies), Exponentia.ai has recently been awarded the ‘Innovation Partner Award’ by Qlik and "Excellence in Business Process Automation Award" (IMEA) by Automation Anywhere.

Get to know more about us at http://www.exponentia.ai and https://in.linkedin.com/company/exponentiaai 

Role Overview:

·        Project manager shall be responsible to oversee and take responsibility for the successful delivery of a range of projects in Business Intelligence, Data warehousing, and Analytics/AI-ML.

·        Project manager is expected to manage the project and lead the teams of BI engineers, data engineers, data scientists and application developers.

Job Responsibilities:

·        Efforts estimation, creating a project plan, planning milestones, activities and tracking the progress.

·        Identify risks and issues. Come up with a mitigation plan.

·        Status reporting to both internal and external stakeholders.

·        Communicate with all stakeholders.

·        Manage end-to-end project lifecycle - requirements gathering, design, development, testing and go-live.

·        Manage end-to-end BI or data warehouse projects.

·        Must have experience in running Agile-based project development.

Technical skills

·        Experience in Business Intelligence Data warehousing or Analytics projects.

·        Understand data lake and data warehouse solutions including ETL pipelines.

·        Good to have - Knowledge of Azure blob storage, azure data factory and Synapse analytics.

·        Good to have - Knowledge of Qlik Sense or Power BI

·        Good to have - Certified in PMP/Prince 2 / Agile Project management.

·        Excellent written and verbal communication skills.

 Education:

MBA, B.E. or B. Tech. or MCA degree

Our Client enables enterprises in their digital transformation journey by offering Consulting & Implementation Services related to Data Analytics &Enterprise Performance Management (EPM).

Job Location : Noida

Position – Azure Solution Architect

Notice period- Immediate to 60 days

Experience –  6+

Job Description:

Your Role and Responsibilities

• Able to drive the technology design meetings, propose technology design and architecture
• Experienced in the design and delivery of enterprise level Highly Available solutions
• Work closely with project management teams to successfully monitor progress of implementation
• Collaborate with Pre-sales team on RFP
• Provide detailed specifications for proposed solutions
• Experienced to Migrate applications to cloud
• Experienced to create Data Lake and Data warehouse solutions
• Ability to implement the solution as per technical requirements
• Identity, authentication, security, privacy, and compliance including Active Directory modern Application Architecture (Queue’s, Micro-Services, Containers etc)

Required Technical and Professional Expertise

• Project management and leadership skills are essential.
• 4+ years of experience developing IT and cloud infrastructure (MS Azure, GPC).
• Working knowledge of MS Azure technology stack and related technology (ie. Data Factory, Data Flow, Synapse Analytics, Synapse ML, Gen2 storage, etc.).
• Master's degree in Computer Science or Software Engineering preferred.
• Current understanding of best practices regarding system security measures.
• Experience in software engineering and design architecture.
• Positive outlook in meeting challenges and working to a high level.
• Advanced understanding of business analysis techniques and processes.
• Good to have Azure ML experience

Preferred Technical and Professional Experience

• MS Azure Certification: Fundamentals, Solution Architect, Data Engineer

• 5+ years of experience in a Data Engineering role on cloud environment

• Must have good experience in Scala/PySpark (preferably on data-bricks environment)

• Extensive experience with Transact-SQL.
• Experience in Data-bricks/Spark.

• Strong experience in Dataware house projects
• Expertise in database development projects with ETL processes.
• Manage and maintain data engineering pipelines

• Develop batch processing, streaming and integration solutions
• Experienced in building and operationalizing large-scale enterprise data solutions and applications

• Using one or more of Azure data and analytics services in combination with custom solutions
• Azure Data Lake, Azure SQL DW (Synapse), and SQL Database products or equivalent products from other cloud services providers

• In-depth understanding of data management (e. g. permissions, security, and monitoring).
• Cloud repositories for e.g. Azure GitHub, Git
• Experience in an agile environment (Prefer Azure DevOps).

Good to have

• Manage source data access security
• Automate Azure Data Factory pipelines
• Continuous Integration/Continuous deployment (CICD) pipelines, Source Repositories
• Experience in implementing and maintaining CICD pipelines
• Power BI understanding, Delta Lake house architecture
• Knowledge of software development best practices.
• Excellent analytical and organization skills.
• Effective working in a team as well as working independently.
• Strong written and verbal communication skills.
• Expertise in database development projects and ETL processes.

Power BI Developer(Azure Developer )

Job Description:

Senior visualization engineer with understanding in Azure Data Factory & Databricks to develop and deliver solutions that enable delivery of information to audiences in support of key business processes.

Ensure code and design quality through execution of test plans and assist in development of standards & guidelines working closely with internal and external design, business and technical counterparts.

Desired Competencies:

• Strong designing concepts of data visualization centered on business user and a knack of communicating insights visually.
• Ability to produce any of the charting methods available with drill down options and action-based reporting. This includes use of right graphs for the underlying data with company themes and objects.
• Publishing reports & dashboards on reporting server and providing role-based access to users.
• Ability to create wireframes on any tool for communicating the reporting design.
• Creation of ad-hoc reports & dashboards to visually communicate data hub metrics (metadata information) for top management understanding.
• Should be able to handle huge volume of data from databases such as SQL Server, Synapse, Delta Lake or flat files and create high performance dashboards.
• Should be good in Power BI development
• Expertise in 2 or more BI (Visualization) tools in building reports and dashboards.
• Understanding of Azure components like Azure Data Factory, Data lake Store, SQL Database, Azure Databricks
• Strong knowledge in SQL queries
• Must have worked in full life-cycle development from functional design to deployment
• Intermediate understanding to format, process and transform data
• Should have working knowledge of GIT, SVN
• Good experience in establishing connection with heterogeneous sources like Hadoop, Hive, Amazon, Azure, Salesforce, SAP, HANA, API’s, various Databases etc.
• Basic understanding of data modelling and ability to combine data from multiple sources to create integrated reports

Preferred Qualifications:

• Bachelor's degree in Computer Science or Technology
• Proven success in contributing to a team-oriented environment

• Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
• Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. 
• Designing and implementing data engineering, ingestion, and transformation functions

• Experience with Azure Analysis Services
• Experience in Power BI
• Experience with third-party solutions like Attunity/Stream sets, Informatica
• Experience with PreSales activities (Responding to RFPs, Executing Quick POCs)
• Capacity Planning and Performance Tuning on Azure Stack and Spark.