Lead Data Operations

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

We are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.

Qualifications and Skills:

• Minimum 5 years of experience as a Data Engineer
• Hands-on experience with Azure cloud-based data solutions
• Expertise in database design and management, including SQL databases such as SQL Server
• Proficient in ETL (Extract, Transform, Load) design for data integration and processing
• Strong knowledge of data modeling principles and techniques
• Ability to analyze and translate data into actionable insights, reports, and visualizations
• Proficiency in Power BI for reporting and data visualization

Desirable Skills:

• Experience with Power BI Report Builder / Reporting Services
• Knowledge of statistical analysis or Data Science
• Experience within the UK Insurance industry is a plus
• Python or R coding skills

Responsibilities:

• Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
• Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
• Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
• Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
• Implement different methods of streaming data and create reconciliations for datasets
• Build analytical models to support reporting and analytics
• Collaborate with an agile delivery team to work on the backlog of specified work

Technical Lead 

Job Description 

Role Overview 

We are seeking a highly skilled Data Engineering Lead with minimum of 5 years of hands-on experience in Azure data engineering, data warehousing, and automation-driven  integration. The ideal candidate should be a proven technical lead, capable of driving end-to-end 

project delivery and working closely with customer teams. This is a Work from Office / Customer Site role. 

Roles and Responsibilities 

• Lead the design, development, and delivery of data engineering and automation projects. 

• Architect and implement ETL/ELT pipelines using Azure Data Factory. 

• Design and manage enterprise data warehouses including dimensional modeling and 

schema optimization. 

• Manage Azure components including Storage Accounts, Data Lakes, Azure SQL, and Synapse. 

• Drive automation initiatives across data ingestion and transformation workflows. 

• Collaborate with business and technical stakeholders to translate requirements into scalable solutions. 

• Mentor team members and enforce engineering best practices. 

• Serve as the technical anchor responsible for ensuring high-quality, on-time delivery. 

Skills and Qualification 

• Strong hands-on experience with Azure Data Factory, Azure Storage, Azure SQL/Synapse. 

• Deep understanding of data warehousing concepts: star/snowflake schemas, fact/dimension modeling. 

• Experience with automation-led data engineering solutions. 

• Strong troubleshooting, optimization, and analytical skills. 

• Excellent communication and stakeholder management abilities. 

• Proven experience as a Technical Lead leading teams and delivery. 

Must Have 

• Min of 5 years of relevant data engineering experience. 

• Strong Azure Data Engineering and Data Warehousing expertise. 

• Proven Technical Lead experience. 

• Ability to work from office and customer site. 

• Strong ownership mindset with a focus on quality and delivery excellence.

Hiring for Data Engineer - Delivery Manager

Exp : 10 - 15 yrs

Edu : BE/B.Tech/MCA

Work Loation : Hyderabad

.Roles & Responsibilitie:

Own end-to-end delivery of data engineering programs ensuring alignment with business goals, timelines, and quality standards.

Drive execution across multiple data initiatives within Azure and Databricks environments.

Provide technical leadership in designing and implementing scalable data pipelines using Python, PySpark, and Spark.

Required Skills:

Strong experience with Databricks, PySpark, Python, and Spark.

Expertise in Azure Data Services including ADF, ADLS, and Synapse.

Proven experience in delivery management, stakeholder management, and Agile execution

15+ years of IT Delivery and Technology Services experience.

15+ years managing large offshore delivery organizations.

Proven leadership of portfolios exceeding 200+ resources.

Financial Services or Banking experience is a MUST

Extensive technical experience in Data Engineering, Data Platforms, Data Brics.

Cloud Data Transformation Programs, Data Warehousing, Azure Data Platform and compliance experience

Mandatory Skills (Must Have)

• SQL and Database Design (5+ years in enterprise data platforms)

• Python development for automation and platform services (5+ years)

• Linux administration and Shell Scripting in production environments

• Metadata-driven systems and data management platform experience

• Technical leadership of offshore or distributed development teams Wissen Technology

• System analysis, troubleshooting, and production support expertise

• Metadata onboarding, integration, and governance processes

• Stakeholder management and delivery ownership across multiple teams

Key Responsibilities

• Lead developers supporting the Pantheon Metadata platform and related services

• Own end-to-end delivery of metadata onboarding and enhancement initiatives

• Design scalable metadata management solutions and automation capabilities

• Collaborate with architecture, infrastructure, and application teams for enterprise integration

• Participate in solution design reviews and establish development best practices

• Prioritize enhancements with business stakeholders and manage delivery commitments

• Provide production support, troubleshooting, and platform stability improvements Wissen Technology

• Drive modernization initiatives related to metadata lifecycle management

We are looking for Data engineer with strong expertise in Data warehousing to join our team.

Key skills : ab initio, ssis , Informatica, Hadoop and Teradata

Location: Bangalore Experience: 5 to 7 years Employment type: Full-time, permanent Work Hours: General Shift (10.00 AM to 7.00 PM) website: www.amazech.com Qualifications: Minimum B.E./B.Tech, or higher in Computer Science, Information Technology, Data Engineering, or a related field, with a good academic background. Key Responsibilities: • Design, develop, and maintain end-to-end data pipelines. • Build and optimize ETL/ELT processes for large-scale data processing. • Implement Azure-based data solutions ensuring scalability and performance. • Collaborate with stakeholders to understand business data requirements. • Perform performance tuning and optimization across data platforms. • Support production environments, conduct root cause analysis, and resolve data-related issues. • Maintain comprehensive technical documentation and structured knowledge transfer documents. • Work effectively within Agile/Scrum frameworks and contribute to sprint planning and delivery. • Ensure secure and compliant data handling using Azure best practices. Required Skills & Experience • End-to-end ETL/ELT pipeline development, integration, and performance optimization • Azure Synapse, Azure Logic Apps, Azure SQL, and Azure Databricks, with a strong focus on performance tuning • Microsoft Azure services, including Storage Accounts, Key Vault, and Cognitive Services • Advanced proficiency in Python development and modern productivity tools such as GitHub Copilot and Cursor • Strong documentation discipline, including technical design documentation, and structured knowledge transfer documents • Experience operating within Agile/Scrum frameworks, including production support, root cause analysis, and effective stakeholder collaboration

1. Company Description:

Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.

Website: www.tatvic.com

2. Role Details

• Role: Lead Data Engineer
• Band: L4
• Department: Data Engineering
• Reporting to: L5 / Head of Delivery
• Location: Ahmedabad
• Job Type: Full Time
• Experience: 6-8 years of relevant experience
• Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.

3. Mission & Role Overview

• Mission: To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellence—specifically in BigQuery optimization and secure GCP/AWS architectures—while driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
• Role Overview: This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.

4. Key Responsibilities

• Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
• Build reusable data solutions and software components that serve multiple customers and use cases.
• Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
• Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
• Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
• Design and build production-grade software (APIs, services, internal tools) with sound engineering practices — version control, testing, CI/CD, and code review.
• Extend data platforms with AI capabilities — integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
• Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
• Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
• Document architectures, design decisions, and operations clearly and consistently.
• Coach and mentor team members, ensuring technical excellence and continuous learning.
• Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.

5. Must-Have & Good-to-Have Skills

Must-Have Skills:

• Strong understanding of clickstream data and data pipeline architecture
• Hands-on experience with cloud platforms (GCP)
• Expertise in SQL, Python, and Airflow
• Solid software engineering foundation — API design, testing, version control, and deployment practices
• Proven ability to perform exploratory data analysis and data validation
• Knowledge of cloud security, IAM, and networking best practices
• Working knowledge of building or integrating AI/LLM-based components into existing systems
• Excellent problem-solving, stakeholder management, and communication skills

Good-to-Have Skills:

• Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
• AWS Certified Data Analytics or Azure Data Engineer Associate
• Google Analytics 4 (GAIQ)
• Experience in marketing attribution, commerce data, or analytics ecosystems
• Exposure to cost optimization and cloud resource management
• Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
• Experience building automation frameworks or internal data tools

6. Not-a-Fit Criteria

• Individual Contributor Focus: Operates as the team's best individual contributor instead of building team capability or empowering L3s.
• Information Hoarding: Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
• Avoidance of Conflict: Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
• Activity Over Outcomes: Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
• Functional Siloing: Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.

Our Culture & Perks - Where Passion Meets Purpose:

• Competitive CTC: Based on experience and skillset
• Medical Insurance for you and your family
• Return-to-Work Program for New Moms — because career breaks shouldn’t break momentum
• 1 Work From Home Day/Month — flexibility when life calls
• 2 Birthday Leaves/Year — one for you, one for someone you love
• Monthly Engagement Activities — from game nights to learning sessions
• Inclusive Culture & Equal Opportunity Employer — diversity drives our innovation
• We Think Like Engineers & Athletes: we build, we iterate, we scale, we win — together
• 5-day workweek — because balance drives brilliance