Associate Instructor (SDE, DBMS),

Data Platform Engineer

Design, automate, and scale our data platform — this is an engineering role, not a traditional "DBA job.

Must-have :

• Data modeling & schema design (from first principles, not just maintenance)
• PostgreSQL (deep, hands-on — partitioning, replication, tuning)
• Any distributed NoSQL store (Cassandra, ScyllaDB, or similar wide-column/distributed DB) (real production experience)
• Python (automation & tooling, not just scripting)
• DevOps & CI/CD (building pipelines, not just using them)
• Terraform (infrastructure-as-code)

You'll:

• Design schemas, partitioning strategies, and lead the Postgres → Cassandra migration end-to-end
• Own PostgreSQL performance, replication, and zero-downtime schema changes
• Build Python-based automation to eliminate repetitive DB work
• Own CI/CD pipelines and Terraform-based infra provisioning
• Drive uptime, DR, monitoring, and incident response
• Own multi-tenant security (RLS, least-privilege access) and data governance

Experience: 4–9 years, data/database/platform engineering in demanding production environments.

Bonus: Kafka/Debezium (CDC), Redis, Flyway/Liquibase, GDPR/DPDP exposure.

Qualifications

● 3-8 years experience in Cloud Database Administration

● Proficient in PostgreSQL database management, including installation, configuration, and performance tuning.

● Experience with Amazon RDS or Cloud SQL and managing databases in cloud environments.

● Proficient in PostgreSQL/MySQL database management, including installation, configuration, and performance tuning.

● Proven experience as a Database Administrator with a focus on

PostgreSQL/MySQL.

● In-depth knowledge of database design, implementation, and management for both PostgreSQL/MySQL environments.

● Familiarity with database security, backup procedures, and performance tuning for both systems.

● Strong analytical and problem-solving skills.

● Excellent communication and collaboration abilities.

● Relevant certifications (e.g., PostgreSQL Certified Professional, MySQLDatabase Administrator) are a plus.

Skills:

● Expertise in PostgreSQL/MySQL database management systems.

● SQL programming and query optimization for both databases.

● Data modeling and database design for PostgreSQL/MySQL.

● Backup and recovery procedures for both environments.

● Performance tuning and optimization for PostgreSQL/MySQL.

● Security protocols and measures for PostgreSQL/MySQL.

● Capacity planning and scalability for both systems.

Job Description (JD) for the MySQL Database Administrator role

Experience: 4-8 Years 

Location : Mumbai 

Job Title: MySQL Database Administrator 

Responsibilities 

• Provision and configure MySQL database instances in clustered and non-clustered environments. 
• Ensure database performance, security, availability, and reliability. 
• Prepare and maintain database documentation, technical specifications, and operational procedures. 
• Perform database upgrades, backups, restoration, recovery, and migrations. 
• Monitor database and server resource utilization and perform performance tuning and optimization. 
• Manage database users, access privileges, periodic access reviews, audits, and documentation. 
• Configure, monitor, and troubleshoot MySQL replication. 
• Collaborate with application, infrastructure, development, and other stakeholder teams to resolve database-related issues. 
• Provide database and application deployment support, as required. 
• Perform database backup and restoration validation, data integrity checks, and post-migration validations. 
• Follow database change management, security, and operational best practices. 

Skills and Qualifications 

• Strong hands-on experience in MySQL database administration. 
• Good working knowledge of recent MySQL versions, preferably MySQL 8.x. 
• Understanding of MySQL storage engines, including InnoDB and MyISAM. 
• Practical experience in configuring, monitoring, and troubleshooting MySQL replication. 
• Knowledge of MySQL administration best practices, security, and high availability. 
• Proficiency in writing, analyzing, and optimising SQL queries. 
• Experience with MySQL features such as the Event Scheduler, audit logging, and performance monitoring. 
• Ability to assess database resource requirements based on application workloads and technical specifications. 
• Familiarity with other SQL and NoSQL databases, such as PostgreSQL and MongoDB. 
• Understanding of MySQL limitations compared with other relational database platforms and the ability to identify suitable workarounds. 
• Working knowledge of version control tools such as Git, SVN, or CVS. 
• Graduate degree in a relevant discipline and good verbal and written communication skills. 

Good to Have 

• Basic Linux administration, command-line troubleshooting, and Bash scripting skills. 
• Familiarity with application server frameworks such as JBoss, GlassFish, and WildFly. 

About Solutionara

Solutionara is an AI-led IT Consulting and Technology Services organization delivering enterprise transformation through Cloud, Integration, Data Engineering, Digital Experience, AI, and Enterprise Applications.

Headquartered in the United States with a Global Delivery Center (GDC) in Noida, India, Solutionara partners with enterprise organizations across retail, manufacturing, distribution, consumer goods, and other industries to design, implement, and support scalable technology solutions.

As a rapidly growing consulting organization, we foster a culture of ownership, innovation, collaboration, and continuous improvement, empowering our teams to contribute beyond their immediate responsibilities while delivering exceptional value to our global clients.

Every team member is expected to think like a consultant and business problem solver—understanding client objectives, challenging assumptions when appropriate, leveraging AI responsibly, and continuously identifying opportunities to improve quality, productivity, and customer outcomes.

AI is embedded into how we work, but it is an enabler—not a replacement for expertise, critical thinking, or accountability.

Role Overview

Solutionara is seeking a Senior Data Engineer with strong data engineering and database expertise to design, build, optimize, and support enterprise-scale data solutions.

This is a hands-on engineering position requiring strong SQL, Python, ETL/ELT, database, cloud, and troubleshooting capabilities. The engineer will work closely with technical leads and client stakeholders while taking ownership of major engineering components.

Location: Noida, India – Onsite | Employment Type: Full-Time | Experience: 6–9 Years

Key Responsibilities

Data Engineering

• Design, develop, test, deploy, and support scalable ETL/ELT pipelines.
• Build ingestion and transformation solutions across databases, APIs, files, and enterprise applications.
• Develop high-quality SQL and Python-based data processing solutions.
• Implement batch and incremental data-processing patterns.
• Develop reusable engineering components and frameworks.
• Support complex data migration and transformation activities.
• Perform source-to-target mapping and technical data analysis.
• Implement pipeline logging, monitoring, exception handling, and recovery mechanisms.

Database & Platform Engineering

• Design and optimize relational database schemas and data structures.
• Analyze and improve SQL/query performance.
• Support indexing, partitioning, storage optimization, and database performance.
• Implement appropriate database security and access controls.
• Support database monitoring, availability, backup/recovery, and operational requirements in collaboration with infrastructure/platform teams.
• Troubleshoot database and pipeline performance issues.
• Contribute to cloud data-platform configuration and optimization.

Data Quality

• Implement automated validation and data-quality controls.
• Develop reconciliation processes between source and target systems.
• Identify duplicate, incomplete, inconsistent, and invalid data.
• Implement cleansing, standardization, validation, and exception-management logic.
• Work with technical and business stakeholders to understand and implement business data rules.

Technical Delivery

• Convert technical designs into reliable production solutions.
• Participate in technical design and code reviews.
• Mentor junior/mid-level engineers.
• Support estimation and technical planning.
• Troubleshoot complex production and integration issues.
• Collaborate with technical leads, application teams, DevOps, QA, BI, and client teams.
• Document technical designs, mappings, configurations, operational procedures, and engineering decisions.

Consulting & AI-Led Working

• Understand the business purpose behind assigned engineering requirements.
• Raise risks, assumptions, dependencies, and potential improvements proactively.
• Communicate effectively with client and internal stakeholders.
• Use AI-assisted tools to improve coding, testing, analysis, documentation, and troubleshooting productivity.
• Independently verify AI-generated code and recommendations before implementation.
• Identify opportunities for engineering automation and process improvement.

Required Qualifications

• 6–9 years of experience in data engineering, database engineering, data integration, or related areas.
• Advanced SQL skills.
• Strong hands-on Python experience.
• Strong ETL/ELT development experience.
• Strong relational database knowledge, such as SQL Server, PostgreSQL, Oracle, or equivalent.
• Experience with data modeling and database design.
• Experience with AWS, Azure, or another major cloud platform.
• Experience with modern data technologies such as Databricks, Snowflake, Redshift, Synapse, Glue, ADF, Airflow, dbt, or equivalent.
• Experience with performance tuning and optimization.
• Experience with data validation and reconciliation.
• Strong troubleshooting and analytical skills.
• Ability to take ownership of engineering deliverables with limited supervision.

Preferred Qualifications

• Experience working with enterprise ERP, CRM, PIM, PLM, MES, or related systems.
• Experience with manufacturing, retail, distribution, or consumer-goods data.
• Experience with CI/CD and infrastructure/platform engineering practices.
• Experience with API and event-driven integrations.
• Previous consulting or technology-services experience.

What Success Looks Like

• Pipelines and databases perform reliably at enterprise scale.
• Engineering solutions are maintainable, reusable, and well documented.
• Data issues are detected and addressed systematically.
• Junior engineers receive effective technical guidance.
• Problems are owned through resolution rather than simply escalated.
• Engineering decisions reflect both technical requirements and client business objectives.

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Senior Database Administrator (DBA)

Database Reliability & Performance  •  Senior Individual Contributor

• Experience: 6–9 years in production database administration / engineering
• Level: Senior Individual Contributor (hands-on)
• Function: Data Platform — reliability, performance, and governance across relational and distributed SQL & NoSQL DBs.

About the Role

We are hiring a Senior Database Administrator to own the health, performance, and reliability of the data layer behind a high-scale, multi-tenant platform. Our environment spans several independent PostgreSQL database instances, a cache-first read tier, change-data-capture pipeline, analytics and archival stores. Should be capable of implementing NoSQL stores (Cassandra / ScyllaDB) & MySQL  end to end as we scale.

This is a hands-on senior IC role for someone who has run demanding production databases and wants full ownership: partitioning and maintenance, performance tuning, monitoring, uptime, disaster recovery, and the security and data-governance documentation that keeps a regulated, multi-tenant platform audit-ready. You will work closely with, and take direction from, engineering leadership — translating priorities into a well-run, well-documented data platform.

What You'll Own

PostgreSQL Depth

• Administer multiple production PostgreSQL instances (v16+), including schema/DDL review, migrations, and release coordination.
• Design and maintain table partitioning strategies (range/hash/time-based) and automate partition lifecycle — creation, retention windows, and safe drops.
• Own query and instance performance tuning: EXPLAIN/ANALYZE, indexing strategy, autovacuum/bloat management, connection pooling (e.g. PgBouncer), and parameter-group tuning.
• Execute zero-downtime schema changes using expand–migrate–contract / blue-green patterns; assess lock impact and avoid long ACCESS EXCLUSIVE locks on hot tables.
• Manage replica topology (writer/reader endpoints), replication lag, and read-scaling as load grows.
• Partner with app teams on migration tooling (e.g. Flyway) and paired forward/rollback scripts; enforce idempotent, reviewed, tested DDL.

NoSQL & Scale

• Data-model, deploy, and operate distributed NoSQL clusters — Cassandra and/or ScyllaDB — including partition/clustering key design, compaction strategy, repair, and node operations (bootstrap, decommission, scale-out).
• Lead the planned migration of high-volume payload tables from partitioned PostgreSQL to Cassandra/ScyllaDB: capacity planning, dual-write/backfill design, cutover, and validation.
• Tune distributed-store read/write paths, consistency levels, and cluster sizing for predictable latency at scale.
• Support the cache-first architecture (Redis) and change-data-capture / streaming pipelines (e.g. Kafka) that move data to analytics and cold-archival stores.

Operations, Reliability & DR

• Own database uptime and SLOs; build and maintain monitoring, alerting, and dashboards for the key signals (latency, replication lag, CPU/IO, connections, vacuum lag, error rates).
• Define and regularly test backup and disaster-recovery strategy — RPO/RTO targets, point-in-time recovery, restore drills, and cross-AZ / future multi-region readiness.
• Drive incident response for database-related issues: triage, mitigation, root-cause analysis, and follow-up actions.
• Write and maintain runbooks (partition maintenance, failover, archival, DR, migration procedures) and participate in an on-call rotation for the data layer.
• Establish production-change discipline: pre-flight and post-deploy verification, rollback criteria, and backup verification before destructive operations.

Security, Governance & Documentation

• Implement and maintain database access control — least-privilege roles, schema-scoped permissions, and row-level security (RLS) for multi-tenant isolation.
• Own data-governance documentation: PII maps, per-table retention policies, audit-readiness, and the controls behind privacy-regulation compliance (e.g. GDPR / DPDP-style erasure and legal-hold workflows).
• Author and maintain architecture decision records (ADRs), schema documentation, and monitoring/runbook docs so the data platform is legible to the wider team.
• Uphold encryption-at-rest/in-transit posture and safe handling of sensitive columns; keep the data layer aligned with the platform's compliance requirements.

Coding & Automation Bar (Required)

This role is automation-first, not click-ops. The right candidate treats repetitive database work as something to script away and can drop into application code when a problem demands it.

• Strong scripting in Python and Bash for automation of maintenance, backups, partition management, backfills, and health checks.
• Comfortable with infrastructure-as-code (e.g. Terraform) and configuration management (e.g. Ansible) for reproducible database infrastructure.
• Solid SQL and PL/pgSQL; able to read and debug application-layer database code and, worst case, write or patch application code (e.g. Python/Node/Java) to unblock a fix.
• Fluent with Git-based workflows, code review, and CI for database migrations and tooling.

Required Qualifications

• 6–9 years operating relational databases in demanding production environments, with deep PostgreSQL expertise (internals, partitioning, replication, performance tuning).
• Hands-on experience running at least one distributed NoSQL store in production — Cassandra or ScyllaDB strongly preferred (other wide-column/distributed stores considered).
• Proven ownership of backup/DR, monitoring, and incident response for production databases.
• Strong scripting/automation background (Python, Bash) and experience with IaC.
• Experience with managed cloud databases (AWS RDS or equivalent) and understanding of instance/parameter-group tuning, replicas, and failover.
• Experience designing for multi-tenancy and data isolation at scale.
• Clear written communication — able to produce runbooks, ADRs, and governance docs a team can rely on.

Nice to Have

• Experience migrating workloads from PostgreSQL to Cassandra/ScyllaDB (or similar relational-to-distributed migrations).
• Familiarity with Redis as a cache tier and with CDC / streaming pipelines (e.g. Kafka, Debezium).
• Exposure to Flyway (or Liquibase), pgTAP or similar schema testing, and PgBouncer.
• Working knowledge of privacy regulations (GDPR, India DPDP) and audit/compliance processes.

How You Work

• Ownership mindset — takes a directive and runs it to done, with sound judgment on trade-offs.
• Reliability-first and detail-oriented; disciplined about verification, rollback, and documentation.
• Collaborative in a high-performing engineering team; communicates clearly with developers and leadership.
• Pragmatic and scale-aware — designs for where the platform is going, not just where it is.

Job Title: Senior Data Engineer

Position Summary

We are seeking a highly skilled Data Engineer with strong expertise in reporting infrastructure, data modeling, and analytics platforms. This role will focus on building scalable reporting solutions, optimizing data pipelines, and enabling data-driven decision-making across the organization. The ideal candidate will have deep experience with databases, data warehousing, and complex query development. While Ruby on Rails experience is beneficial, the primary emphasis is on data engineering and reporting systems.

Key Responsibilities

• Design, develop, and maintain reporting infrastructure and data platforms.
• Build and optimize complex SQL queries, data models, and reporting datasets.
• Develop scalable ETL/ELT pipelines and data integration processes.
• Design and maintain database schemas to support analytics and reporting requirements.
• Collaborate with business stakeholders to understand reporting needs and translate them into technical solutions.
• Implement data quality, governance, and performance best practices.
• Support and enhance enterprise reporting solutions and dashboards.
• Work with large-scale datasets in cloud data warehouse environments.
• Troubleshoot reporting issues and optimize database performance.
• Partner with engineering and product teams to establish sustainable data architecture.

Must Have: Technical Skills

• PostgreSQL
• Snowflake
• Advanced SQL
• Data Modeling
• Data Warehousing
• Reporting & Analytics Infrastructure
• ETL/ELT Development
• Query Performance Tuning

Success Profile:

The ideal candidate is a data-focused engineer who enjoys working with complex datasets, designing scalable reporting solutions, and building foundational infrastructure that empowers analytics and business intelligence teams. They should be comfortable navigating databases, optimizing queries, and translating business reporting needs into robust technical implementations.

Experience Range: 5-10 years

Role Type: Individual Contributor / Senior Engineer

Primary Focus: Reporting Infrastructure, Data Engineering, Data Warehousing, and Analytics Enablement.

Overview

Planview has one mission: to build the future of connected work, from ideas to impact.

As the global leader in work and resource management, Planview helps organizations accelerate the achievement of what matters most, supporting our customers from need to speed, from passion to progress, and from overhead to optimization. We provide the industry’s most comprehensive solutions designed for strategic planning, portfolio and resource management, Lean and Agile delivery, product portfolio management, capability, technology management (enterprise architecture), innovation management, collaborative work and project management. Our connected platform of solutions underpins the business and digital transformations of more than 4,500 customers globally, including 59 of the Fortune 100.

At Planview, our people connections drive our innovation and success. Our global team of 1400+ work remotely and across our offices including Austin, Vancouver, Hod HaSharon, Bangalore, and Stockholm. We are proud of our world-class, connected culture built on our shared values, that supports our teams to be successful from anywhere.

The Opportunity

Join our product development team at Planview as a Software Engineer 2 and contribute to the Viz Core Team. This role provides an exciting opportunity to support the development of data processing pipelines and APIs that form the backbone of our software solutions. You will work collaboratively to enhance the efficiency of software delivery, developing solutions that help organizations harness and interpret workflow data.

In this role, you will

•Collaborate with senior engineers to create and refine data processing architectures that integrate with various external tools.

•Assist in analyzing problems, defining requirements, and proposing solutions that align with the team’s objectives.

•Contribute to a culture of quality and continuous improvement by providing thoughtful feedback on code and design.

•Learn and apply best practices in cloud architectures and data processing to deliver high-quality software solutions.

•Engage in an environment that values innovation and teamwork, where your contributions will positively impact the delivery of software solutions.

Who we are looking for

The ideal candidate is an emerging professional in cloud software development with a solid foundation in data processing and software systems. You thrive in collaborative environments and are eager to learn and grow within the field.

Preferred qualifications skills, knowledge, and expertise

•Degree in Computer Science, Engineering, or a related field.

•3+ years of experience with any modern programming language, focusing on back-end systems and cloud-based technologies.

•Basic understanding of data structures, algorithms, and software development methodologies.

•Familiarity with cloud platforms, particularly AWS or similar services.

Other beneficial qualifications

•Exposure to big data technologies like Spark or Apache Kafka.

•Experience with Java (v17), Scala, or other JVM programming languages.

•Familiarity with storage tools such as PostgreSQL and MongoDB.

• Understanding of continuous integration/deployment tooling such as GitHub or Jenkins.

• Awareness of Test-Driven Development practices.

• Basic knowledge of containers and orchestration tools like

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Job Description

This is a remote position.

Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.

Role Overview

If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.

What You'll Do

• Design, build, and maintain data pipelines and infrastructure using SQL and Python
• Work within Snowflake to build and optimize data models supporting business use cases
• Parse and process structured and semi-structured data (JSON, XML) from varied sources
• Diagnose issues across raw, intermediate, and summary tables
• Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
• Investigate and resolve data quality issues, including time-sensitive or urgent ones
• Identify opportunities to consolidate models and maintain a single source of truth (SSOT)

Requirements

What We're Looking For

• 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
• 2+ years of experience with Python for data engineering tasks (required)
• Experience with Snowflake or an equivalent cloud data warehouse (required)
• Experience working with Snowflake Coco or any other AI tools(required) 
• Experience parsing JSON and XML data (a plus)
• A strong eye for data quality and attention to detail
• Knowledge of Git (required)
• Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
• Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
• Experience with BI tools like Power BI(a plus, not core to this role)
• Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
• Knowledge of SSIS packages (a plus)
• Familiarity with CI/CD methodologies

Benefits

Life at Incubyte  

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 

Perks

• Dedicated learning & development budget. 
• Sponsorship for conference talks. 
• Comprehensive medical & term insurance.
• Employee-friendly leave policies. 
• Home Office fund 
• Medical Insurance

🚀 Job Title : Data Engineer – AWS, PySpark & Airflow

Experience : 5+ Years

Industry : Health Insurance / BFSI

Location : Sector 43, Gurugram, Haryana

Work Mode : Work From Office (5 Days a Week)

Employment Type : Full-Time

Role Overview :

We are looking for an experienced Data Engineer with strong hands-on expertise in AWS Data Engineering, Data Lake Architecture, Python, SQL, PySpark, and Apache Airflow.

The candidate will be responsible for designing, developing, and maintaining scalable, reliable, and high-performance data pipelines using AWS cloud technologies. The role involves building end-to-end ETL / ELT workflows, implementing data transformation and processing solutions, optimizing pipeline performance, and ensuring the reliability of production data systems.

Mandatory Skills :

AWS Data Engineering | Data Lake Architecture | Amazon S3 | AWS Glue | Amazon EMR | Athena | Redshift | Python | SQL | PySpark | Apache Spark | Apache Airflow | ETL/ELT | PostgreSQL | Data Modelling | Pipeline Optimization | Production Support | Root Cause Analysis

Key Responsibilities :

• Design, develop, and maintain end-to-end data pipelines for data ingestion, staging, transformation, curation, and consumption.
• Build and manage AWS-based data lake solutions using Amazon S3, AWS Glue, Amazon EMR, Athena, and Redshift.
• Develop, maintain, and optimize ETL / ELT pipelines using Python, SQL, Apache Spark, and PySpark.
• Implement and manage workflow orchestration using Apache Airflow, including scheduling, dependency management, retries, monitoring, and failure handling.
• Integrate data from multiple structured and semi-structured sources.
• Design and maintain data models, dimensional models, and analytical data marts.
• Work with relational databases, including PostgreSQL and Amazon RDS.
• Optimize Spark jobs, SQL queries, data transformations, and cloud resource utilization.
• Implement data quality checks, validation rules, and error-handling mechanisms.
• Monitor production data pipelines, troubleshoot failures, and perform root cause analysis (RCA).
• Ensure pipeline reliability, scalability, performance, and compliance with service-level agreements (SLAs).
• Follow data security, access management, governance, and sensitive-data protection best practices.
• Collaborate with business, analytics, and application teams to deliver effective data solutions.
• Maintain technical documentation and follow established data engineering standards.

Required Technical Skills :

• AWS Data Engineering : Strong hands-on experience with AWS-based data engineering and data lake architecture.
• AWS Services : Amazon S3, AWS Glue, Glue Data Catalog, Amazon EMR, Athena, Redshift, AWS Lambda, and IAM.
• Programming : Strong proficiency in Python and SQL.
• Big Data Processing : Hands-on experience with Apache Spark and PySpark.
• Workflow Orchestration : Experience developing and managing workflows using Apache Airflow.
• ETL/ELT Development : Experience building scalable data ingestion, transformation, and processing pipelines.
• Database Technologies : Good understanding of relational databases and PostgreSQL concepts.
• Data Modelling : Experience with data modelling, data transformation, and analytical data structures.
• Production Support : Ability to monitor pipelines, troubleshoot failures, perform RCA, and resolve production issues.
• Performance Optimization : Experience optimizing SQL queries, Spark jobs, and data processing workflows.

Good-to-Have Skills :

• Experience with AWS Database Migration Service (DMS) and Amazon RDS.
• Familiarity with dbt for data transformation and modelling.
• Knowledge of Delta Lake, Apache Iceberg, or Apache Hudi.
• Exposure to Apache Kafka and real-time data streaming.
• Familiarity with GraphQL, Hasura, or similar data-serving technologies.
• Understanding of data governance and data quality frameworks.
• Experience in the BFSI, healthcare, or health insurance domain.

Candidate Requirements :

• 5+ years of relevant experience in Data Engineering.
• Proven hands-on experience building and maintaining production-grade data pipelines on AWS.
• Strong understanding of data lake architecture and large-scale data processing.
• Practical experience with Apache Airflow and Spark / PySpark-based transformations.
• Strong programming, analytical, debugging, and problem-solving skills.
• Experience handling production incidents, pipeline failures, and performance bottlenecks.
• Ability to take ownership of deliverables and work effectively with cross-functional teams.
• Good communication, collaboration, and technical documentation skills.
• Willingness to work from the Gurugram office five days a week.

Ideal Candidate :

The ideal candidate is a hands-on Data Engineer who can independently build, optimize, and maintain AWS-based data pipelines, work with large datasets using PySpark, orchestrate workflows through Airflow, and resolve production issues in a business-critical environment.