Delivery Lead - Data Engineer

Hiring for Data Engineer - Delivery Manager

Exp : 10 - 15 yrs

Edu : BE/B.Tech/MCA

Work Loation : Hyderabad

.Roles & Responsibilitie:

Own end-to-end delivery of data engineering programs ensuring alignment with business goals, timelines, and quality standards.

Drive execution across multiple data initiatives within Azure and Databricks environments.

Provide technical leadership in designing and implementing scalable data pipelines using Python, PySpark, and Spark.

Required Skills:

Strong experience with Databricks, PySpark, Python, and Spark.

Expertise in Azure Data Services including ADF, ADLS, and Synapse.

Proven experience in delivery management, stakeholder management, and Agile execution

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

10+ years of experience in Data Architecture, Data Engineering, or Data Platforms

• Strong expertise in IBM DB2 / On-Prem Relational Databases

• Strong expertise in PostgreSQL

• Hands-on experience with the Azure Data Ecosystem, including:

▪ Azure Data Factory (ADF)

▪ Azure Data Lake Storage Gen2 (ADLS Gen2)

▪ Azure Databricks / Synapse Analytics

▪ Azure Event Hub / Service Bus

▪ Azure Functions

Solution Architect – AZURE Data Engineering

Job Overview

We are looking for an experienced Solution Architect – Data Engineering with strong expertise in designing data solutions and hands-on experience with Azure, Synapse, PySpark, Data Warehousing, and Data Lakes. The ideal candidate should have strong architectural and data engineering knowledge.

Key Responsibilities

• Design and implement scalable data architecture and solutions.
• Develop and manage Data Warehouse and Data Lake architectures.
• Design data platforms using Medallion Architecture.
• Lead Data Engineering and ETL activities.
• Work with Azure Synapse Analytics for data processing and analytics.
• Develop data solutions using PySpark / Apache Spark.
• Define and implement data validation and data quality processes.
• Collaborate with business, data, and technology teams to deliver effective data solutions.

Required Skills

• Strong experience in Solution Architecture / Data Architecture.
• Strong knowledge of Data Warehouse and Data Lake architecture.
• Good understanding of Medallion Architecture.
• Strong experience in Data Engineering and ETL.
• Hands-on experience with Microsoft Azure and Azure Synapse Analytics.
• Strong knowledge of PySpark / Apache Spark.
• Experience with Data Validation and Data Quality.
• Good communication and stakeholder management skills.
• 
  

Experience

8+ Years

Dear Candidate,

Greeting from NAM Info Pvt Ltd.

We have a role for Data Engineer position with NAM Info.

This role will be permanent with NAM info and deploy to client

location NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA.

Work Mode: WORK FROM OFFICE

A decent hike can be provided based on current CTC

Interview Mode: Virtual

Role Descriptions:

Exp Range: 7 - 10 years

City Locations: NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA

Key Responsibilities*

Role: Data Engineer

Location: ~NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA

Skills: Digital: Databricks, Azure Data Factory

Experience Required: 8-10

Descriptions:

Good information and sound knowledge in Azure Synapse Analytics Azure Data Factory (ADF)Big Data technologies and data processing frameworks Azure Data Warehouse and associated Azure data platform services Data integration| data modelling| and performance optimization

Desire candidate

• Candidate should have valid PF.

Regards,

NAM Info 

Job Description

• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-

based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major

projects every year with a focus on data engineering best practices.

• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and

Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times

within the first 6 months.

• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster

recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.

• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate

business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key

business use cases.

• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations

(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first

quarter of onboarding.

• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior

engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal

knowledge-sharing sessions per year.

• Sound knowledge of data governance practices, data quality management, and data security principles.

• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.

• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage

services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,

Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)

• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for

continuous improvement.

• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,

PowerShell, or other relevant tools.

• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting

new technologies or features to enhance the data platform.

• Document technical designs, procedures, and guidelines for data platform engineering and operations

Knowledge, Skills & Experience

Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced

degree preferred.

• Proven 6-10 years experience in playing platform engineer or admin role

• Experience with big data technologies such as Apache Spark, Hadoop, or similar

frameworks.

• Solid understanding of cloud computing concepts and experience with cloud

infrastructure management and provisioning.

• Solid understanding of network security concepts and technologies (such as

firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security

concepts and technologies (such as access controls, encryption, observability,

privacy laws/regulations, etc.)

• Experience in a Retail setup is preferred.

Required Skills The position will require someone with the following:

• Strategic Planning

Public

• Communication and Collaboration

• Problem Solving Skills A/B testing & experimentation

• SQL, BI tools, and storytelling with data

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.

Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.

Key Responsibilities:

• Design, develop, test, and maintain optimal data pipeline and ETL architectures.
• Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
• Prepare and optimize data for predictive and prescriptive modeling.
• Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
• Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
• Utilize big data tools and frameworks to optimize data acquisition and preparation.
• Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
• Develop and curate data models for analytics, dashboards, and reports.
• Conduct code reviews, maintain production-level code, and implement testing approaches.
• Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
• Drive innovation and implement efficient new approaches to data engineering tasks.

Must-Have Skills:

• Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
• 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
• 3–5 years of experience designing and implementing data warehouse solutions.
• Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
• Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
• Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
• Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
• Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
• Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
• Strong problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience in integrating ERP data into data lakes.
• Experience with traditional ETL tools (e.g., Talend, Pentaho).

Competencies:

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
• Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
• Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
• Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
• Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.

Why Join Us?

• Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
• Work on impactful projects that make a difference across industries.
• Opportunities for professional growth and continuous learning.
• Competitive salary and benefits package.

Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!

Key Responsibilities

• Lead end-to-end data migration initiatives, including assessment, planning, mapping, transformation, validation, and reconciliation.
• Define and implement data governance frameworks, standards, policies, and processes.
• Design and manage data solutions using Microsoft Azure Data Services.
• Lead development of BI dashboards, reports, KPIs, and analytics solutions.
• Work with business and technical stakeholders to understand reporting and data requirements.
• Develop and maintain data models, data pipelines, ETL/ELT processes, and reporting architecture.
• Ensure data quality, consistency, integrity, security, and compliance throughout migration and reporting processes.
• Identify data risks, dependencies, gaps, and migration challenges and drive their resolution.
• Establish data validation and reconciliation mechanisms to ensure migration accuracy.
• Provide technical leadership and guidance to data engineers, BI developers, and other project team members.
• Collaborate with application, cloud, infrastructure, and business teams during project implementation.
• Monitor data migration and BI deliverables against project timelines, quality standards, and business objectives.
• Prepare technical documentation, data dictionaries, mapping documents, governance guidelines, and project reports.

Required Skills & Experience

• 7+ years of experience in data, migration, BI, or related technology roles.
• Strong experience working on software/IT projects and managing data-related workstreams.
• Hands-on experience with Microsoft Azure Data Services.
• Strong understanding of data migration methodologies, ETL/ELT, data transformation, and reconciliation.
• Experience in Data Governance, Data Quality, Master Data, Metadata Management, and Data Security.
• Strong experience with BI reporting and dashboard development.
• Good understanding of SQL and relational databases.
• Experience with Power BI and data visualization is highly desirable.
• Knowledge of Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, or equivalent.
• Strong understanding of data architecture and data lifecycle management.
• Excellent stakeholder management, communication, analytical, and problem-solving skills.

Azure Data Factory and Azure Databricks, processing 5 million+ records/week from 4+ source systems into a governed Lakehouse. 

What You’ll Do:

In the Platform (30–40% of your time)

• Review cloud and data architectures to identify gaps and risks.
• Lead technical triage on P1 incidents — be comfortable on bridge calls and know the right questions to ask.
• Stay hands-on with automation, scripting, and platform operations; you're not above writing the runbook yourself.
• Conduct FinOps reviews including cost anomaly analysis, licence audits, and resource right-sizing, bringing a technical and commercial lens.
• Stress-test transition readiness and define the gates before services move into BAU.

Running the Service (60% of your time)

• Own SLA performance and the RAID log across multiple client engagements.
• Lead sprint retrospectives and daily stand-ups with a strong understanding of Agile ways of working.
• Create executive service review packs that are crisp, data-driven, and actionable.
• Manage the Run / Change / Project boundary and protect BAU capacity from scope creep.
• Mentor and performance-manage a team of engineers, with a strong understanding of technical quality and delivery.
• Navigate commercial structures including fixed retainers, capacity tokens, and NTE caps.

With Clients

• Build trusted relationships with CXO and VP-level stakeholders through technical credibility.
• De-escalate challenging situations with empathy, clarity, and precision.
• Run effective Executive Business Reviews (EBRs) that build client confidence and demonstrate tangible value.

What We’re Looking For

You came up through the technical side — cloud engineering, data engineering, platform, or DevOps — and over time started solving problems beyond purely technical challenges. You now want a role that explicitly combines technical depth, service delivery, operations, and client leadership.

Specifically:

• 8+ years of experience working in cloud and data environments, with meaningful experience in managed services or operational delivery.
• Hands-on expertise in at least one major platform: Azure, AWS, GCP, Snowflake, or Databricks.
• Ability to read infrastructure and diagnose issues at the code/configuration level, not just through dashboards.
• Experience managing complex client relationships, including difficult or escalated conversations.
• Practical working knowledge of ITIL (Incident, Problem, Change) and Agile methodologies.
• Commercial exposure to SOW management, scope negotiation, and capacity planning.
• Strong operational judgment developed through handling critical incidents and making decisions with incomplete information.
• Strong communication, stakeholder management, and team leadership skills.

You don't need to have had "Service Delivery Manager" in your previous title. If your background is in senior data, cloud, platform, or DevOps engineering and you've also handled operations, governance, service delivery, and client-facing responsibilities, we'd like to hear from you.

What You’ll Get

• Opportunity to work across industries, clients, and technologies.
• Exposure to global businesses and complex technology environments.
• Access to technical IP, frameworks, playbooks, and accelerators.
• Exposure to a broad ecosystem of technologies.
• Mentorship and support from experienced senior consultants and technical leaders.
• Strong learning and development support, including certifications, training, hackathons, and mentoring.
• Transparent career progression and structured performance reviews.
• Opportunities to strengthen public speaking, consulting, and leadership skills.
• Comprehensive health insurance.
• Recognition, rewards, and long-term incentives.
• A collaborative environment with regular team and social activities.

Interview Process

The interview process consists of four stages:

1. Technical Online Screening – Baseline assessment of problem-solving and technical capabilities.
2. Introductory & Cultural Assessment – Discussion around experience, career goals, and alignment.
3. Technical Assessment – Detailed evaluation of technical competency by the technical panel.
4. Final Round – Final assessment covering technical depth, leadership, and overall fit.