Senior Azure Data Developer at a global provider of Business Process Management company · Bengaluru (Bangalore) · 4 - 10 years · ₹15L - ₹22L / yr · Posted 2 Feb 2022

Senior Azure Data Developer
at a global provider of Business Process Management company
Desired Competencies:
Ø Expertise in Azure Data Factory V2
Ø Expertise in other Azure components like Data lake Store, SQL Database, Databricks
Ø Must have working knowledge of spark programming
Ø Good exposure to Data Projects dealing with Data Design and Source to Target documentation including defining transformation rules
Ø Strong knowledge of CICD Process
Ø Experience in building power BI reports
Ø Understanding of different components like Pipelines, activities, datasets & linked services
Ø Exposure to dynamic configuration of pipelines using data sets and linked Services
Ø Experience in designing, developing and deploying pipelines to higher environments
Ø Good knowledge on File formats for flexible usage, File location Objects (SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3 etc.)
Ø Strong knowledge in SQL queries
Ø Must have worked in full life-cycle development from functional design to deployment
Ø Should have working knowledge of GIT, SVN
Ø Good experience in establishing connection with heterogeneous sources like Hadoop, Hive, Amazon, Azure, Salesforce, SAP, HANA, API’s, various Databases etc.
Ø Should have working knowledge of different resources available in Azure like Storage Account, Synapse, Azure SQL Server, Azure Data Bricks, Azure Purview
Ø Any experience related to metadata management, data modelling, and related tools (Erwin or ER Studio or others) would be preferred
Preferred Qualifications:
Ø Bachelor's degree in Computer Science or Technology
Ø Proven success in contributing to a team-oriented environment
Ø Proven ability to work creatively and analytically in a problem-solving environment
Ø Excellent communication (written and oral) and interpersonal skills
Qualifications
BE/BTECH
KEY RESPONSIBILITIES :
|
You will join a team designing and building a data warehouse covering both relational and dimensional models, developing reports, data marts and other extracts and delivering these via SSIS, SSRS, SSAS, and PowerBI. It is seen as playing a vital role in delivering a single version of the truth on Client’s data and delivering MI & BI that will feature in enabling both operational and strategic decision making. You will be able to take responsibility for projects over the entire software lifecycle and work with minimum supervision. This would include technical analysis, design, development, and test support as well as managing the delivery to production. The initial project being resourced is around the development and implementation of a Data Warehouse and associated MI/BI functions. |
|
Principal Activities: 1. Interpret written business requirements documents 2. Specify (High Level Design and Tech Spec), code and write automated unit tests for new aspects of MI/BI Service. 3. Write clear and concise supporting documentation for deliverable items. 4. Become a member of the skilled development team willing to contribute and share experiences and learn as appropriate. 5. Review and contribute to requirements documentation. 6. Provide third line support for internally developed software. 7. Create and maintain continuous deployment pipelines. 8. Help maintain Development Team standards and principles. 9. Contribute and share learning and experiences with the greater Development team. 10. Work within the company’s approved processes, including design and service transition. 11. Collaborate with other teams and departments across the firm. 12. Be willing to travel to other offices when required. |
Location – Bangalore

Similar jobs (10)
Job Description
• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-
based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major
projects every year with a focus on data engineering best practices.
• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and
Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times
within the first 6 months.
• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster
recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.
• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate
business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key
business use cases.
• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations
(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first
quarter of onboarding.
• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior
engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal
knowledge-sharing sessions per year.
• Sound knowledge of data governance practices, data quality management, and data security principles.
• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.
• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage
services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,
Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)
• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for
continuous improvement.
• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,
PowerShell, or other relevant tools.
• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting
new technologies or features to enhance the data platform.
• Document technical designs, procedures, and guidelines for data platform engineering and operations
Knowledge, Skills & Experience
Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced
degree preferred.
• Proven 6-10 years experience in playing platform engineer or admin role
• Experience with big data technologies such as Apache Spark, Hadoop, or similar
frameworks.
• Solid understanding of cloud computing concepts and experience with cloud
infrastructure management and provisioning.
• Solid understanding of network security concepts and technologies (such as
firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security
concepts and technologies (such as access controls, encryption, observability,
privacy laws/regulations, etc.)
• Experience in a Retail setup is preferred.
Required Skills The position will require someone with the following:
• Strategic Planning
Public
• Communication and Collaboration
• Problem Solving Skills A/B testing & experimentation
• SQL, BI tools, and storytelling with data
We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.
Qualifications and Skills:
- Minimum 5 years of experience as a Data Engineer
- Hands-on experience with Azure cloud-based data solutions
- Fabric experience is a must – designing, implementing, and managing data workflows and pipelines
- Expertise in database design and management, including SQL databases such as SQL Server
- Proficient in ETL (Extract, Transform, Load) design for data integration and processing
- Strong knowledge of data modeling principles and techniques
- Experience with Azure Data Factory (ADF) for orchestrating data workflows
- Ability to analyze and translate data into actionable insights, reports, and visualizations
- Proficiency in Power BI for reporting and data visualization
Desirable Skills:
- Experience with Power BI Report Builder / Reporting Services
- Knowledge of statistical analysis or Data Science
- Experience within the UK Insurance industry is a plus
- Python or R coding skills
Responsibilities:
- Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
- Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
- Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
- Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
- Implement different methods of streaming data and create reconciliations for datasets
- Build analytical models to support reporting and analytics
- Collaborate with an agile delivery team to work on the backlog of specified work
Dear Candidate,
Greeting from NAM Info Pvt Ltd.
We have a role for Data Engineer position with NAM Info.
This role will be permanent with NAM info and deploy to client
location NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA.
Work Mode: WORK FROM OFFICE
A decent hike can be provided based on current CTC
Interview Mode: Virtual
Role Descriptions:
Exp Range: 7 - 10 years
City Locations: NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA
Key Responsibilities*
Role: Data Engineer
Location: ~NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA
Skills: Digital: Databricks, Azure Data Factory
Experience Required: 8-10
Descriptions:
Good information and sound knowledge in Azure Synapse Analytics Azure Data Factory (ADF)Big Data technologies and data processing frameworks Azure Data Warehouse and associated Azure data platform services Data integration| data modelling| and performance optimization
Desire candidate
- Candidate should have valid PF.
Regards,
NAM Info
Job Description
We are looking for an experienced Azure Synapse Data Engineer with strong hands-on expertise in Azure data engineering, data warehousing, ETL/ELT, and SQL performance optimization.
Key Responsibilities
- Design, develop, and optimize solutions using Azure Synapse Analytics.
- Build and maintain data integration pipelines using Azure Data Factory (ADF) and Synapse Pipelines.
- Design and implement scalable Azure Data Lake Storage Gen2 (ADLS Gen2) architectures.
- Develop robust and high-performance ETL/ELT frameworks for enterprise data platforms.
- Monitor and troubleshoot large-scale data ingestion, transformation, and processing workloads.
- Identify and resolve performance bottlenecks across data movement and transformation processes.
- Ensure data quality, availability, reliability, and consistency across analytics platforms.
- Perform advanced SQL query analysis and optimization.
- Analyze execution plans and optimize complex analytical workloads.
- Configure and tune Synapse Dedicated SQL Pools.
- Design efficient partitioning strategies for large datasets.
- Optimize indexing, statistics, and workload distribution to improve query performance.
Mandatory Skills
- Azure Synapse Analytics
- Azure Data Factory (ADF)
- Synapse Pipelines
- ADLS Gen2
- ETL/ELT
- Strong SQL
- Synapse Dedicated SQL Pool
- SQL query/execution plan optimization
- Partitioning, indexing, and statistics
- Azure data warehouse / data lake architecture
- Performance tuning and troubleshooting
Ideal Candidate
A strong Azure Data Engineer with hands-on experience in Synapse + ADF + ADLS Gen2 + Advanced SQL + Dedicated SQL Pool performance tuning.
Job Summary
The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities
1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
3. Design and develop etl processes, data models, and data integration solutions.
4. Provide technical guidance and mentorship to the team members.
5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.
7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.
Skill Requirements
1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.
2. Strong experience with sql and oracle pl/sql for data querying and manipulation.
3. Advanced programming skills in python for scripting and data processing tasks.
4. Knowledge of data modeling, data warehousing concepts, and database design principles.
5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
6. Strong analytical and problem-solving skills with attention to detail.
7. Experience in data visualization tools and techniques is a plus.
Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.
Skill (Primary)
Data Fabric-Azure-Azure Data Factory (ADF)
Technical Lead
Job Description
Role Overview
We are seeking a highly skilled Data Engineering Lead with minimum of 5 years of hands-on experience in Azure data engineering, data warehousing, and automation-driven integration. The ideal candidate should be a proven technical lead, capable of driving end-to-end
project delivery and working closely with customer teams. This is a Work from Office / Customer Site role.
Roles and Responsibilities
• Lead the design, development, and delivery of data engineering and automation projects.
• Architect and implement ETL/ELT pipelines using Azure Data Factory.
• Design and manage enterprise data warehouses including dimensional modeling and
schema optimization.
• Manage Azure components including Storage Accounts, Data Lakes, Azure SQL, and Synapse.
• Drive automation initiatives across data ingestion and transformation workflows.
• Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
• Mentor team members and enforce engineering best practices.
• Serve as the technical anchor responsible for ensuring high-quality, on-time delivery.
Skills and Qualification
• Strong hands-on experience with Azure Data Factory, Azure Storage, Azure SQL/Synapse.
• Deep understanding of data warehousing concepts: star/snowflake schemas, fact/dimension modeling.
• Experience with automation-led data engineering solutions.
• Strong troubleshooting, optimization, and analytical skills.
• Excellent communication and stakeholder management abilities.
• Proven experience as a Technical Lead leading teams and delivery.
Must Have
• Min of 5 years of relevant data engineering experience.
• Strong Azure Data Engineering and Data Warehousing expertise.
• Proven Technical Lead experience.
• Ability to work from office and customer site.
• Strong ownership mindset with a focus on quality and delivery excellence.
Data Engineer – Microsoft Fabric
Location: Pune, India
Work Mode: Hybrid
Experience: 6+ Years
Employment Type: Full-time contactor
Compensation: As per market standards, commensurate with experience and expertise
Shift Timings: 2:00 PM – 11:00 PM IST
Notice Period: 0 – 15 days
About the Role
Jade Business Services (JBS) is seeking a Data Engineer – Microsoft Fabric to join our Pune team and work on enterprise-scale data transformation and analytics initiatives.
We are looking for a hands-on Data Engineer with strong experience in Microsoft Fabric, SQL, Python/PySpark and modern data engineering practices. The candidate will be responsible for building scalable data pipelines, implementing Lakehouse and Warehouse solutions, developing data models and supporting governed, reliable and AI-ready data platforms.
The ideal candidate should be comfortable working with architects, engineering teams and client stakeholders to translate business requirements into scalable and production-ready data solutions.
Roles and Responsibilities
- Design and develop data solutions using Microsoft Fabric, including OneLake, Lakehouse, Warehouse and Data Factory pipelines.
- Build and maintain scalable ETL/ELT pipelines for batch and incremental data processing.
- Develop data ingestion and transformation pipelines using Fabric Data Factory, SQL, Python and/or PySpark.
- Implement Medallion Architecture using Bronze, Silver and Gold layers.
- Work with Lakehouse and Fabric Warehouse for enterprise data processing and analytics.
- Develop and maintain data models, tables, views and optimized SQL queries.
- Build and support semantic models for Power BI and analytical workloads.
- Implement data quality, validation, monitoring and error-handling mechanisms.
- Work with metadata, lineage and governance requirements using Microsoft Purview.
- Implement data security, access controls and role-based permissions across data platforms.
- Support Data Product and domain-oriented data architecture principles.
- Follow DataOps practices including CI/CD, deployment, monitoring and production support.
- Troubleshoot pipeline failures, performance issues and data quality problems.
- Optimize data pipelines, queries and storage for performance and cost efficiency.
- Work closely with Data Architects and business stakeholders to understand requirements and implement technical solutions.
- Participate in technical design discussions, code reviews and architecture reviews.
- Maintain technical documentation, data flow diagrams and pipeline documentation.
- Support production deployments, incident resolution and SLA-driven data platform operations.
- Identify opportunities for automation and AI-assisted improvements across data engineering processes.
Qualifications and Skills
- 6+ years of experience in Data Engineering, Data Integration or Data Platform development.
- Strong hands-on experience with Microsoft Fabric.
- Experience with:
- Microsoft Fabric Lakehouse
- Fabric Warehouse
- OneLake
- Fabric Data Factory / Pipelines
- Semantic Models
- Strong understanding of Lakehouse and Medallion Architecture.
- Strong SQL development and query optimization skills.
- Hands-on experience with Python and/or PySpark.
- Experience developing enterprise ETL/ELT and data integration pipelines.
- Experience with batch and incremental data processing.
- Understanding of data modelling concepts including dimensional modelling.
- Knowledge of data quality, metadata, lineage and data governance.
- Working knowledge of Microsoft Purview.
- Understanding of Data Mesh and Data Product concepts.
- Experience with CI/CD, version control, monitoring and DataOps practices.
- Understanding of cloud security, access controls and data privacy.
- Good troubleshooting and problem-solving skills.
- Strong communication skills and ability to work with distributed and client-facing teams.
Preferred Skills
- Microsoft Fabric or Azure Data certifications.
- Experience migrating workloads from Azure Synapse, SQL Server, Databricks or other data platforms to Microsoft Fabric.
- Experience implementing Medallion Architecture on Microsoft Fabric.
- Experience with Power BI and semantic modelling.
- Exposure to AI/ML, Generative AI or Agentic AI use cases on enterprise data platforms.
- Experience working with Data Products or domain-oriented data solutions.
- Experience in Energy & Utilities, Healthcare, Financial Services or Insurance.
- Experience working with US or international enterprise clients.
What We Expect
The ideal candidate should be hands-on first and capable of independently building, troubleshooting and optimizing Fabric data solutions. You should be able to explain the technical decisions behind your implementation and work effectively with architects and engineering teams to deliver production-ready solutions.
Job Summary
We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.
Technical Skills
- Strong hands-on experience in Python and PySpark development.
- Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
- Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Power BI Data Modeling and Semantic Layer development.
- Proficiency in DAX (Data Analysis Expressions).
- Experience designing and managing Semantic Models in Power BI.
- Strong SQL skills and experience working with large datasets.
- Knowledge of data warehousing concepts and best practices.
Preferred Skills
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Exposure to modern data platforms like Databricks.
- Understanding of data governance and data quality frameworks.
Hiring for Data Engineer - Delivery Manager
Exp : 10 - 15 yrs
Edu : BE/B.Tech/MCA
Work Loation : Hyderabad
.Roles & Responsibilitie:
Own end-to-end delivery of data engineering programs ensuring alignment with business goals, timelines, and quality standards.
Drive execution across multiple data initiatives within Azure and Databricks environments.
Provide technical leadership in designing and implementing scalable data pipelines using Python, PySpark, and Spark.
Required Skills:
Strong experience with Databricks, PySpark, Python, and Spark.
Expertise in Azure Data Services including ADF, ADLS, and Synapse.
Proven experience in delivery management, stakeholder management, and Agile execution
Role Descriptions: Azure data engineer
SN Required Information Details
1 Role** Azure Cosmos DB Developer
2 Required Technical Skill Set** Primary - PySpark Azure Cosmos DB
Secondary -Python, Microsoft Fabric
3 No of Requirements** 4
4 Desired Experience Range** 8 to 12
5 Location of Requirement Pune
Desired Competencies (Technical/Behavioral Competency)
Must-Have**
1. Deep hands-on experience with Python,Pyspark,Spark batch,notebook in Azure
2. Experience in Cosmos DB – including data modeling, indexing, partitioning, consistency levels, and performance tuning.
3. Strong understanding of Cosmos DB APIs (Core SQL API, MongoDB API, etc.) and integration patterns.
4. Proficiency in query optimization and troubleshooting Cosmos DB performance issues.
5. Experience in data processing using PySpark and Python.
6. Familiarity with Microsoft Fabric for data engineering and analytics workflows.
7. Proficient using source code management tools such as Git or GitHub
8. Experience with Test Driven Development and / or Behavior Driven Development.
Good-to-Have 1. Exposure to data governance tools like Azure Purview.
2. Familiar with various design patterns
3. Familiar with Azure: SQL Managed Instance, Cosmos DB, Storage Services, Azure Functions
4. Global project experience, and excellent communication skills, verbal and written, and soft skills in agile projects
SN Responsibility of / Expectations from the Role
1 Design and implement scalable and high-performance solutions using Azure Cosmos DB.
2 Develop data ingestion and transformation pipelines using PySpark and Azure Data Factory.
3 Optimize Cosmos DB performance through indexing, partitioning, and query tuning.
4 Collaborate with architects and data engineers to ensure best practices in data modeling and cloud architecture.
5 Implement and maintain CI/CD pipelines for automated deployments and testing.
6 Troubleshoot and resolve technical issues related to Cosmos DB and data pipelines.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : Databricks~Digital : PySpark~Microsoft Fabric~MySQL
Experience Required: 8-10.







