DevOps/ ADB & ADF Engineer at Renowned · Bengaluru (Bangalore) · 3 - 7 years · ₹7L - ₹15L / yr · Posted 16 Mar 2022
- Azure Data Factory, Azure Data Bricks, Talend, BODS, Jenkins
- Microsoft Office (mandatory)
- Strong knowledge on Databases, Azure Synapse, data management, SQL
- Knowledge on any cloud platforms (Azure, AWS etc.,)

Similar jobs (8)
Location: Bangalore Experience: 5 to 7 years Employment type: Full-time, permanent Work Hours: General Shift (10.00 AM to 7.00 PM) website: www.amazech.com Qualifications: Minimum B.E./B.Tech, or higher in Computer Science, Information Technology, Data Engineering, or a related field, with a good academic background. Key Responsibilities: • Design, develop, and maintain end-to-end data pipelines. • Build and optimize ETL/ELT processes for large-scale data processing. • Implement Azure-based data solutions ensuring scalability and performance. • Collaborate with stakeholders to understand business data requirements. • Perform performance tuning and optimization across data platforms. • Support production environments, conduct root cause analysis, and resolve data-related issues. • Maintain comprehensive technical documentation and structured knowledge transfer documents. • Work effectively within Agile/Scrum frameworks and contribute to sprint planning and delivery. • Ensure secure and compliant data handling using Azure best practices. Required Skills & Experience • End-to-end ETL/ELT pipeline development, integration, and performance optimization • Azure Synapse, Azure Logic Apps, Azure SQL, and Azure Databricks, with a strong focus on performance tuning • Microsoft Azure services, including Storage Accounts, Key Vault, and Cognitive Services • Advanced proficiency in Python development and modern productivity tools such as GitHub Copilot and Cursor • Strong documentation discipline, including technical design documentation, and structured knowledge transfer documents • Experience operating within Agile/Scrum frameworks, including production support, root cause analysis, and effective stakeholder collaboration
We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.
Qualifications and Skills:
- Minimum 5 years of experience as a Data Engineer
- Hands-on experience with Azure cloud-based data solutions
- Expertise in database design and management, including SQL databases such as SQL Server
- Proficient in ETL (Extract, Transform, Load) design for data integration and processing
- Strong knowledge of data modeling principles and techniques
- Ability to analyze and translate data into actionable insights, reports, and visualizations
- Proficiency in Power BI for reporting and data visualization
Desirable Skills:
- Experience with Power BI Report Builder / Reporting Services
- Knowledge of statistical analysis or Data Science
- Experience within the UK Insurance industry is a plus
- Python or R coding skills
Responsibilities:
- Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
- Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
- Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
- Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
- Implement different methods of streaming data and create reconciliations for datasets
- Build analytical models to support reporting and analytics
- Collaborate with an agile delivery team to work on the backlog of specified work
Responsibilities
· Design and build data pipelines and ETL processes to move and transform data reliably across company systems
· Develop and maintain data models that support reliable, well-structured reporting and analytics
· Write and optimise SQL across data pipelines, reporting layers, and ad hoc analysis
· Build and maintain Power BI dashboards and reports that give stakeholders clear, accurate visibility into business performance
· Apply data structures and algorithms thinking to design efficient, scalable data processes
· Apply version control and CI/CD practices to data pipeline and analytics code, ensuring changes are tested and deployed safely
· Apply AI tools and literacy to accelerate data engineering, analysis, and reporting work
· Contribute to data warehouse design, database administration, or solution architecture where relevant
· Work closely with stakeholders across the business to understand reporting needs and translate them into reliable data solutions
Requirements
· Mandatory overlap with Sydney team throughout
. 3 to 6 years of relevant experience
· Strong SQL skills, comfortable writing and optimising complex queries across large datasets
· Solid experience with data modelling, structuring data for reliable and maintainable reporting
· Hands-on experience building data pipelines and ETL processes
· Experience building data visualisations and dashboards, ideally in Power BI
· Good grounding in data structures and algorithms
· Practical experience with version control (e.g. Git) and CI/CD pipelines
· Working AI literacy - comfortable using AI-assisted tools to support data engineering and analysis
· Exposure to Azure, data warehousing, database administration, or solution architecture is an advantage, not a requirement
Analytical and curious, detail-oriented, a strong problem solver who communicates well and can work independently
Strong Data Analyst Profile with Python, SQL, and data-pipeline expertise, ideally with retail / e-commerce datasets
2
Mandatory (Experience 1): Must have 4+ years of hands-on data-analyst experience, working with large datasets across areas such as sales, inventory, pricing, promotions, and customer behaviour.
3
Mandatory (Tech skill 1): Must have strong hands-on Python for data processing, transformation, automation, and analysis
4
Mandatory (Tech skill 2): Must have strong SQL skills, including complex queries, joins, aggregations, and data validation.
5
Mandatory (Tech skill 3): Must have a solid understanding of Data Lake architecture, ingestion, storage, and processing workflows
6
Mandatory (Tech skill 4): Must have hands-on experience with ETL / ELT pipelines, data integration, and transformation
7
Mandatory (Tech skill 5): Must have experience with Azure or GCP data services.
8
Mandatory (Tech skill 6): Must have understanding of or experience with Databricks and distributed data processing.
9
Mandatory (Tech skill 7): Must have knowledge of data modeling, data warehousing, and Lakehouse architecture
10
Mandatory (Tech skill 8): Must have experience with Power BI, Tableau, or Excel for reporting.
11
Mandatory (Communication): Must have strong analytical, documentation, and stakeholder-communication skills.
12
Mandatory (Education): Must hold a Bachelor’s degree in Computer Science, IT, Engineering, or a related field.
13
Mandatory (Note1): This is a 6-month contract role. Candidate must be comfortable with the contract engagement and able to join immediately (urgent — onboarding within ~a week)
Job Description
We are looking for an experienced Azure Synapse Data Engineer with strong hands-on expertise in Azure data engineering, data warehousing, ETL/ELT, and SQL performance optimization.
Key Responsibilities
- Design, develop, and optimize solutions using Azure Synapse Analytics.
- Build and maintain data integration pipelines using Azure Data Factory (ADF) and Synapse Pipelines.
- Design and implement scalable Azure Data Lake Storage Gen2 (ADLS Gen2) architectures.
- Develop robust and high-performance ETL/ELT frameworks for enterprise data platforms.
- Monitor and troubleshoot large-scale data ingestion, transformation, and processing workloads.
- Identify and resolve performance bottlenecks across data movement and transformation processes.
- Ensure data quality, availability, reliability, and consistency across analytics platforms.
- Perform advanced SQL query analysis and optimization.
- Analyze execution plans and optimize complex analytical workloads.
- Configure and tune Synapse Dedicated SQL Pools.
- Design efficient partitioning strategies for large datasets.
- Optimize indexing, statistics, and workload distribution to improve query performance.
Mandatory Skills
- Azure Synapse Analytics
- Azure Data Factory (ADF)
- Synapse Pipelines
- ADLS Gen2
- ETL/ELT
- Strong SQL
- Synapse Dedicated SQL Pool
- SQL query/execution plan optimization
- Partitioning, indexing, and statistics
- Azure data warehouse / data lake architecture
- Performance tuning and troubleshooting
Ideal Candidate
A strong Azure Data Engineer with hands-on experience in Synapse + ADF + ADLS Gen2 + Advanced SQL + Dedicated SQL Pool performance tuning.
Technical Lead
Job Description
Role Overview
We are seeking a highly skilled Data Engineering Lead with minimum of 5 years of hands-on experience in Azure data engineering, data warehousing, and automation-driven integration. The ideal candidate should be a proven technical lead, capable of driving end-to-end
project delivery and working closely with customer teams. This is a Work from Office / Customer Site role.
Roles and Responsibilities
• Lead the design, development, and delivery of data engineering and automation projects.
• Architect and implement ETL/ELT pipelines using Azure Data Factory.
• Design and manage enterprise data warehouses including dimensional modeling and
schema optimization.
• Manage Azure components including Storage Accounts, Data Lakes, Azure SQL, and Synapse.
• Drive automation initiatives across data ingestion and transformation workflows.
• Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
• Mentor team members and enforce engineering best practices.
• Serve as the technical anchor responsible for ensuring high-quality, on-time delivery.
Skills and Qualification
• Strong hands-on experience with Azure Data Factory, Azure Storage, Azure SQL/Synapse.
• Deep understanding of data warehousing concepts: star/snowflake schemas, fact/dimension modeling.
• Experience with automation-led data engineering solutions.
• Strong troubleshooting, optimization, and analytical skills.
• Excellent communication and stakeholder management abilities.
• Proven experience as a Technical Lead leading teams and delivery.
Must Have
• Min of 5 years of relevant data engineering experience.
• Strong Azure Data Engineering and Data Warehousing expertise.
• Proven Technical Lead experience.
• Ability to work from office and customer site.
• Strong ownership mindset with a focus on quality and delivery excellence.
Immediate Joining
We are looking for a Dedicated Resource on Contract for –
Role: Data Engineer
Experience: 5+ Years
Location: Remote
Duration: 3+ Months
Strong hands-on experience with Snowflake, including writing SQL queries, creating views, stored procedures, and functions.
Good knowledge of AI tools such as Claude.
Experience with ETL tools like Alteryx is good to have.
Power BI experience is good to have.
Strong communication skills.
Experience and Required Skill Sets:
1 Solid experience in software design and development using Microsoft ASP.NET framework, C#, Visual Studio, and in writing clean, readable, and easily maintainable code
2 5+ years of experience in WCF, WPF, VB.NET, SQL Server, JQuery, Angular 10 and above.
3 5+ years of experience in developing highly scalable REST/Web APIs
4 5+ years of experience in developing highly efficient SQL/NoSQL Queries
5 5+ years of experience in Relational and Document databases
6 Strong understanding of object-oriented programming and possess strong fundamental design principles for building a scalable application.
7 Experience in using the MVC framework, working knowledge in APIs, and Service Oriented Architecture
8 Strong understanding of object-oriented programming and possess strong fundamental design principles for building a scalable application.
9 Experience in Angular version 10 and above is required
10 Expert in SQL programming & Database Design (Stored procedure, Function, Trigger, Constraints, Replication)
11 Strong ability in HTML and JavaScript (AJAX, DOM)
12 Development experience with data integration technologies including REST, SOAP, JSON, XML
13 Expertise in programming and usage of any unit testing framework. Expertise in integration testing and continuous integration.
14 Experience working in a DevOps environment will be an added advantage.
Responsibilities:
• Ability to create complex, enterprise-transforming applications that meet and exceed client expectations.
• Responsible for the bottom line. Strong project management abilities. Ability to encourage the team to stick to timelines.
• Follow best-in-class coding practices and review the solutions vis-à-vis the requirements and technical specifications.
• Should demonstrate strong client interfacing capabilities like emails and calls with clients in the US/UK













