Lead Data Engineer

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

Job Title : Tech Lead – Data Lake Platform

Number of Positions : 2

Experience : 7+ Years

Role Type : Technical Lead / Data Platform Lead

Domain : Data Engineering / Data Platform / AWS

About the Role :

We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.

The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.

As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.

Core Tech Stack :

AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka

Key Responsibilities :

• Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
• Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
• Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
• Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
• Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
• Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
• Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
• Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
• Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
• Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
• Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
• Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.

Must-Have Skills :

• 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
• Strong hands-on experience with AWS Data Services, including:
• Amazon S3
• AWS EMR
• AWS Glue
• Amazon Athena
• Amazon Redshift
• AWS DMS
• AWS Lambda
• Amazon RDS
• AWS IAM
• Strong production experience with Apache Airflow.
• Strong hands-on experience with Apache Spark / PySpark.
• Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
• Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
• Strong understanding of data lake architecture and enterprise data platforms.
• Proven experience leading engineers and driving technical decisions.
• Hands-on experience with production support, troubleshooting, incident management, and RCA.
• Strong understanding of data platform performance, scalability, reliability, and SLA management.

Good-to-Have Skills :

• Experience with DBT and modern data transformation practices.
• Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
• Strong knowledge of Amazon Redshift workload optimization, including :
• Distribution keys
• Sort keys
• Spectrum
• External tables
• Experience with Kafka or other streaming/data ingestion technologies.
• Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
• Experience with Lambda and API Gateway for API-based data serving.
• Experience with enterprise data governance, data quality, security, and compliance.
• Experience in BFSI / Banking / Financial Services / Insurance domain.

Ideal Candidate :

The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Position: Technical Architect – Data Engineering

Job Summary:

• We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
• The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
• The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.

Key Responsibilities

• Design enterprise-scale data lakehouse and data warehouse architectures.

• Define data ingestion, transformation, and serving architecture.

• Lead architecture discussions and technical governance.

• Design scalable ETL/ELT frameworks using Databricks and Snowflake.

• Define best practices for security, performance, CI/CD, and DevOps.

• Guide engineering teams on implementation.

• Collaborate with business, product, and data governance teams.

Must Have Skills :

• Azure or AWS

• Databricks

• Snowflake

• Data Lakehouse Architecture

• PySpark

• SQL

• Data Modelling

• ETL/ELT Architecture

• Performance Optimization

• CI/CD

• Terraform or Infrastructure as Code (preferred)

Preferred

• Insurance domain

• dbt

• Unity Catalog

• Delta Lake

• Iceberg

• Azure Data Factory / AWS Glue  

Technical Lead 

Job Description 

Role Overview 

We are seeking a highly skilled Data Engineering Lead with minimum of 5 years of hands-on experience in Azure data engineering, data warehousing, and automation-driven  integration. The ideal candidate should be a proven technical lead, capable of driving end-to-end 

project delivery and working closely with customer teams. This is a Work from Office / Customer Site role. 

Roles and Responsibilities 

• Lead the design, development, and delivery of data engineering and automation projects. 

• Architect and implement ETL/ELT pipelines using Azure Data Factory. 

• Design and manage enterprise data warehouses including dimensional modeling and 

schema optimization. 

• Manage Azure components including Storage Accounts, Data Lakes, Azure SQL, and Synapse. 

• Drive automation initiatives across data ingestion and transformation workflows. 

• Collaborate with business and technical stakeholders to translate requirements into scalable solutions. 

• Mentor team members and enforce engineering best practices. 

• Serve as the technical anchor responsible for ensuring high-quality, on-time delivery. 

Skills and Qualification 

• Strong hands-on experience with Azure Data Factory, Azure Storage, Azure SQL/Synapse. 

• Deep understanding of data warehousing concepts: star/snowflake schemas, fact/dimension modeling. 

• Experience with automation-led data engineering solutions. 

• Strong troubleshooting, optimization, and analytical skills. 

• Excellent communication and stakeholder management abilities. 

• Proven experience as a Technical Lead leading teams and delivery. 

Must Have 

• Min of 5 years of relevant data engineering experience. 

• Strong Azure Data Engineering and Data Warehousing expertise. 

• Proven Technical Lead experience. 

• Ability to work from office and customer site. 

• Strong ownership mindset with a focus on quality and delivery excellence.

Job Description

Position Title: Java Technical Lead

Position Type: Full Time, Permanent

Department: Research and Development

Reports to: R&D Manager, Indian Development Centre.

Company Background:

-CGLIA is a software development company building highly available, highly secure, cloud-based enterprise software products that helps speed the research process resulting in new drugs, new devices, and new treatments to improve the health and wellbeing of world population.

- At CGLIA, our work shows our dedication and passion for innovative quality software products that are intuitive and easy to use and exceeds every aspect of customer expectations.

- CGLIA, is the place that develops world-class professionals who would like to be innovative, creative, learn continuously, and build a solid foundation to build products that are special and delight the customer.

Job Summary:

As a Technical Manager, you will be providing the guidance to all the team members in designing, implementing and delivering the technical solutions.

Also, responsible to maintaining the existing product line with high quality and timely deliverables by working closely with product teams.

In this role, you will be hiring the new development staff, oversee each aspect of the development process, and act as a liaison between development team and upper management. Also ensures that team is fully trained and able to perform their jobs.

Should possess strong leadership skills and ability to resolve the challenges quickly.

Responsibilities:

• Participate and contribute to project planning and effort estimation.
• Demonstrate exceptional requirements gathering skills and support requirement gathering sessions.
• Contribute to technical design of business solutions.
• Support leadership team in development RFP’s and service offerings.
• Review and analyse relevant documentation to ensure the understanding of an organization function and capabilities.
• Conduct relevant research to increase understanding in support of developing comprehensive solutions.
• Comply with all the relevant policies and procedures and complete all the documents that are required.
• Conducting performance reviews, handling the employee complaints
• Willing to undertake additional tasks and responsibilities as may be reasonably expected of the role and as necessary in order to achieve the objectives of the organization.

Qualifications: (Education, Experience, Skills and Knowledge)

• Bachelor’s Degree in Computer Science or Information Technology or any equivalent degree.
• At least 8 plus years of hands on experience in developing cloud-based software along with 2 plus years of Management experience.
• Expertise with more than one of the Software Development Methodologies.
• Expertise in designing and developing cloud based high available distributed applications and must have extensive experience in object-oriented design.
• Strong hands on experience in using Java, Hibernate, Spring technology stack (Spring MVC, Spring Data, Spring Cloud, Spring Batch, Spring security etc.) along with open source technologies.
• Experience building web and mobile applications using frontend technologies Angular (Angular 1/Angular 2), Bootstrap, Material Design, UX/UI, JavaScript, HTML5, and CSS.
• Demonstrated Experience on databases like MySQL, MS SQL, PostgreSQL, and Oracle.
• An understanding on handling of large data sources. (Desirable)
• Expertise on the Code Static Analyzer tools like SonarQube, PMD and, DevOps Tools.
• Expertise in using any Unit testing Frameworks like Junit.
• Knowledge in Security related to Web Applications and mobile applications. and other open source and commercial tools.
• Demonstrable and substantial experience in leading and managing teams of software developers.
• Impeccable written English skills, and Oral communication skills along with outstanding interpersonal skills.
• Results-oriented, detail-oriented, and well organized.

Technical Manager: Requires sufficient Managerial Skills and sufficient technical skills.

Main function has to be focused on people. He or She can and should learn new things in technology, that is required for the role.

Strong Tech Lead / Staff Engineer / Lead Engineer Profiles

2

Mandatory (Experience 1) - Must have minimum 6+ years of overall Software Engineering/Development experience building production backend systems.

3

Mandatory (Experience 2) - Must have Tech Lead ownership, with experience setting technical direction, architecture, frameworks, or engineering standards used by other engineers.

4

Mandatory (Experience 3) - Must have strong hands-on Backend development experience with deep proficiency in at least one backend programming language. (Python, Java, Golang etc)

5

Mandatory (Experience 4) - Must have strong System design/distributed systems experience, including architectural trade-offs, scalability, failure modes, reliability, and long-term maintainability.

6

Mandatory (Experience 5) - Must have strong CS fundamentals in Data Structures & Algorithms, Operating Systems, and Networking, with the ability to apply them to complex backend/system problems

7

Mandatory (Experience 6) - Must have owned complex, ambiguous, or business-critical engineering problems end-to-end, demonstrating clear technical judgment, trade-offs, problem-solving, and measurable technical/business impact; not limited to feature implementation.

8

Mandatory (Experience 7) - Must have formal technical leadership experience, including mentoring Senior Engineers, conducting design/code reviews, driving engineering quality, and leading technical decisions across a team.

9

Mandatory (Experience 8) - Must be a hands-on IC + Tech Lead, with approximately 70–80% hands-on coding/engineering involvement, not a pure people-management profile.

10

Mandatory (Company) - Product Companies / Startups / B2B SaaS

11

Mandatory (Education) - CS degree or equivalent (B.Tech/B.E./B.S.)

12

Preferred (Skills) - Experience with Kafka/NATS/RabbitMQ, AWS, Docker/Kubernetes, CI/CD, observability, security/compliance, multi-tenant systems, and financial/billing platforms.

Job Title: Technical Lead

Experience: 6+ Years

Job Type: Full-Time

Department: Engineering

Job Location: Sec-62, Noida.

Job Summary

We are looking for an experienced and hands-on Technical Lead with strong software engineering expertise and a proven track record of building scalable, secure, and production-grade web applications.

The ideal candidate will have 6+ years of software development experience, strong expertise across modern frontend and backend technologies, and the ability to take end-to-end technical ownership—from architecture and development through deployment and production support.

The role requires a technically hands-on leader who can provide architectural direction, mentor developers, review code, solve complex engineering challenges, and ensure high standards of engineering quality.

Practical knowledge of AI/GenAI technologies is important. Prior experience in the Indian FinTech/BFSI ecosystem will be strongly preferred.

Key Responsibilities

• Lead the technical design, architecture, development, and delivery of web-based applications.
• Take end-to-end technical ownership of projects, ensuring scalable, maintainable, secure, and high-quality implementations.
• Work hands-on across frontend, backend, databases, APIs, cloud infrastructure, and third-party integrations.
• Define technical architecture, technology choices, coding standards, and engineering best practices.
• Conduct code reviews and ensure high standards of code quality, performance, security, and maintainability.
• Mentor developers and provide technical guidance throughout design and implementation.
• Identify technical risks, bottlenecks, scalability concerns, and architectural challenges early in the development lifecycle.
• Collaborate with Product Managers, Business Analysts, Designers, QA, DevOps, and other stakeholders to translate business requirements into effective technical solutions.

• Participate in effort estimation, sprint planning, technical discussions, and delivery planning.
• Troubleshoot complex production issues and drive root-cause analysis and permanent resolutions.
• Evaluate and introduce new technologies, frameworks, development practices, and AI-assisted engineering tools where appropriate.
• Identify opportunities to incorporate AI/GenAI capabilities into products, workflows, and internal engineering processes.
• Ensure applications follow appropriate practices for security, data privacy, authentication, authorization, logging, and monitoring.

Technical Skills & Requirements

Mandatory

• 6+ years of professional software development experience.
• Strong experience building and maintaining production-grade web applications.
• Strong proficiency in modern JavaScript/TypeScript ecosystems.
• Experience with frontend frameworks such as React.js, Next.js, Angular, Vue.js, or similar.
• Strong backend development experience using Node.js and/or other modern backend frameworks and languages.
• Strong understanding of REST APIs, microservices, API design, authentication, authorization, and third-party integrations.
• Experience with relational and/or NoSQL databases such as PostgreSQL, MySQL, MongoDB, Redis, etc.
• Good understanding of system design, distributed systems, scalability, caching, asynchronous processing, and performance optimization.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Familiarity with Docker, CI/CD pipelines, Git-based development workflows, monitoring, and modern DevOps practices.
• Strong understanding of application security and secure software development practices.

AI / GenAI Skills

The candidate should have a practical understanding of the modern AI ecosystem and its application in software products.

Experience or knowledge in the following areas will be an advantage:

• LLM-based applications and APIs
• OpenAI, Anthropic, Gemini, or similar AI platforms
• AI agents and agentic workflows
• RAG and vector databases
• Prompt engineering and structured outputs
• AI-assisted development tools
• Integration of AI capabilities into existing web applications

• Reliability, security, privacy, cost, and hallucination considerations in production AI systems

Deep AI/ML research experience is not mandatory. The candidate should, however, be comfortable understanding and integrating modern AI capabilities into software products.

FinTech / BFSI Experience – Preferred

Prior experience working with FinTech, BFSI, lending, payments, banking, insurance, credit, or financial services products in India will be strongly preferred.

Experience in any of the following areas will be particularly valuable:

• Digital lending / Loan Management Systems
• Payments and payment gateways
• Credit bureau and credit-score integrations
• KYC / eKYC and identity verification
• Account Aggregator ecosystem
• UPI / NPCI integrations
• Banking and NBFC integrations
• Financial APIs and third-party FinTech platforms
• RBI-related technology and compliance requirements
• Data security and privacy requirements for financial applications

Leadership & Soft Skills

• Proven ability to lead and mentor engineering teams.
• Strong problem-solving, debugging, and analytical capabilities.
• Ability to make sound technical and architectural decisions.
• Strong ownership mindset with accountability for project delivery.
• Ability to communicate technical concepts clearly to both technical and non-technical stakeholders.
• Comfortable working in a fast-paced environment with multiple projects and priorities.
• Ability to balance engineering quality with practical business and delivery requirements.
• Strong documentation and communication skills.

What We’re Looking For

We are looking for a hands-on Technical Lead rather than a purely managerial profile.

The ideal candidate should be able to:

• Understand business requirements and translate them into technical solutions.
• Design scalable and reliable application architecture.
• Guide and mentor engineering teams.
• Review critical code and technical implementations.
• Solve complex technical and production issues.
• Make effective technology and architecture decisions.
• Take ownership of delivering reliable products into production.

Mandatory Criteria

6+ years of software engineering experience with strong expertise in modern web technologies.

Strongly Preferred

• Experience building or leading FinTech products in India.
• Practical understanding of AI/GenAI technologies and their integration into modern software products.