Data Engineer

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

About LH2 AI LabsLH2 AI Labs is an applied research lab solving data platform and curation challenges for foundation model development. We serve every frontier AI lab with the mission of delivering the best data to power the best models.

Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve. This is a rare opportunity to join a company at a defining moment in AI.

About the role:

This is a full-time, hands-on role where you will own the core infrastructure and systems that enable us to discover customers' data landscape, handle sensitive data like names, address securely and to clean and catalog them into training-ready datasets.

That path covers connectors and on-prem agentic discovery components, secrets and PII scrubbing, scale and cost efficient ingestion and clearance for use in model training. You lead a small team of 3-4 engineers and raise the quality bar in your pod.

What you'll own

• Connectors and extraction - You'll build connectors for common SaaS and databases (Google Workspace, Slack, Postgres/MySQL, Jira, MongoDB) and for specific tools such as Razorpay, GreytHR, Keka, Zoho and LeadSquared. The rule is to build only where no good open-source connector or clean export exists.
• On-prem scanning - You'll build a CLI or agent that runs at the data owner's end to sample and estimate the value of their data without shipping all of it to us.
• Clearance pipeline - Secrets detection across full git history, fail-closed. PII redaction for code and conversational data, including Indian identifiers (PAN, Aadhaar, GSTIN, IFSC, UPI). Measurable recall and precision.
• Lineage - Every output record must trace back to its raw source, and every lot must be revocable.
• Delivery - Packaging, sampling for buyers, and supporting the supply and BD teams on data questions.

You have

• 8+ years in backend or data engineering, with at least 2 years leading up to 4 or more engineers.
• You've built ingestion or ETL pipelines that run in production.
• Hands-on work with sensitive data such as PII, financial or health data, including redaction, masking or access controls.
• The judgment to decide what to build and what to adopt.

Nice to have

• Experience with Presidio, gitleaks/TruffleHog, dlt or Airbyte.
• Knowledge of DPDP, GDPR, HIPAA or SOC 2.
• You've shipped software that runs in customers' environments.

This is not a pure people-management role. You'll write code, review everything, and personally own the hardest problems in the pod.

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Job Description – Data / Metadata Engineer

Position

Data / Metadata Engineer

Location

Pune

Experience

• 6–9 Years: Up to 28 LPA
• 10–17 Years: Up to 32 LPA

Notice Period

Immediate to 15 Days Joiners Preferred

Role Overview

We are looking for an experienced Data / Metadata Engineer with strong expertise in Data Engineering, Metadata Management, Data Modeling, Cloud technologies, Python/PySpark, and ETL/Data Pipelines.

The ideal candidate should have hands-on experience designing and developing data solutions, working with metadata and data models, and building scalable data pipelines on cloud platforms.

Mandatory Skills

• Strong experience in Data Engineering
• Hands-on experience in Metadata Management / Metadata Engineering
• Strong understanding of Data Modeling
• Experience with DDL and ER/Data Modeling
• Experience with Cloud technologies – Any Cloud Platform
• Strong programming experience in Python or PySpark
• Experience with ETL processes and Data Pipelines
• Good understanding of data architecture and data integration concepts

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions.
• Develop and manage data pipelines and ETL workflows.
• Work with metadata and data cataloging concepts.
• Create and maintain data models, DDLs, ER diagrams, and database structures.
• Develop data processing solutions using Python or PySpark.
• Work with cloud-based data platforms and services.
• Collaborate with Data Architects, Data Engineers, Developers, and Business teams.
• Ensure data quality, consistency, availability, and reliability across data pipelines.
• Troubleshoot and optimize existing data pipelines and data processes.
• Follow best practices for data engineering, modeling, and cloud-based implementations.

Candidate Profile

• Strong experience in Data Engineering + Metadata + Data Modeling.
• Good hands-on experience with Python/PySpark and ETL/Data Pipelines.
• Experience working with any major cloud platform.
• Strong understanding of databases, data structures, and data modeling concepts.
• Candidates who can join immediately or within 15 days are preferred.

Job Details

Role: Data / Metadata Engineer

Location: Pune

Experience: 6–17 Years

Budget: 28 LPA (6–9 Yrs) / 32 LPA (10–17 Yrs)

Notice Period: Immediate to 15 Days

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.

Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.

Key Responsibilities:

• Design, develop, test, and maintain optimal data pipeline and ETL architectures.
• Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
• Prepare and optimize data for predictive and prescriptive modeling.
• Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
• Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
• Utilize big data tools and frameworks to optimize data acquisition and preparation.
• Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
• Develop and curate data models for analytics, dashboards, and reports.
• Conduct code reviews, maintain production-level code, and implement testing approaches.
• Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
• Drive innovation and implement efficient new approaches to data engineering tasks.

Must-Have Skills:

• Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
• 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
• 3–5 years of experience designing and implementing data warehouse solutions.
• Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
• Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
• Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
• Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
• Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
• Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
• Strong problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience in integrating ERP data into data lakes.
• Experience with traditional ETL tools (e.g., Talend, Pentaho).

Competencies:

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
• Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
• Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
• Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
• Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.

Why Join Us?

• Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
• Work on impactful projects that make a difference across industries.
• Opportunities for professional growth and continuous learning.
• Competitive salary and benefits package.

Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!

About Solutionara

Solutionara is an AI-led IT Consulting and Technology Services organization delivering enterprise transformation through Cloud, Integration, Data Engineering, Digital Experience, AI, and Enterprise Applications.

Headquartered in the United States with a Global Delivery Center (GDC) in Noida, India, Solutionara partners with enterprise organizations across retail, manufacturing, distribution, consumer goods, and other industries to design, implement, and support scalable technology solutions.

As a rapidly growing consulting organization, we foster a culture of ownership, innovation, collaboration, and continuous improvement, empowering our teams to contribute beyond their immediate responsibilities while delivering exceptional value to our global clients.

Every team member is expected to think like a consultant and business problem solver—understanding client objectives, challenging assumptions when appropriate, leveraging AI responsibly, and continuously identifying opportunities to improve quality, productivity, and customer outcomes.

AI is embedded into how we work, but it is an enabler—not a replacement for expertise, critical thinking, or accountability.

Role Overview

Solutionara is seeking a Senior Data Engineer with strong data engineering and database expertise to design, build, optimize, and support enterprise-scale data solutions.

This is a hands-on engineering position requiring strong SQL, Python, ETL/ELT, database, cloud, and troubleshooting capabilities. The engineer will work closely with technical leads and client stakeholders while taking ownership of major engineering components.

Location: Noida, India – Onsite | Employment Type: Full-Time | Experience: 6–9 Years

Key Responsibilities

Data Engineering

• Design, develop, test, deploy, and support scalable ETL/ELT pipelines.
• Build ingestion and transformation solutions across databases, APIs, files, and enterprise applications.
• Develop high-quality SQL and Python-based data processing solutions.
• Implement batch and incremental data-processing patterns.
• Develop reusable engineering components and frameworks.
• Support complex data migration and transformation activities.
• Perform source-to-target mapping and technical data analysis.
• Implement pipeline logging, monitoring, exception handling, and recovery mechanisms.

Database & Platform Engineering

• Design and optimize relational database schemas and data structures.
• Analyze and improve SQL/query performance.
• Support indexing, partitioning, storage optimization, and database performance.
• Implement appropriate database security and access controls.
• Support database monitoring, availability, backup/recovery, and operational requirements in collaboration with infrastructure/platform teams.
• Troubleshoot database and pipeline performance issues.
• Contribute to cloud data-platform configuration and optimization.

Data Quality

• Implement automated validation and data-quality controls.
• Develop reconciliation processes between source and target systems.
• Identify duplicate, incomplete, inconsistent, and invalid data.
• Implement cleansing, standardization, validation, and exception-management logic.
• Work with technical and business stakeholders to understand and implement business data rules.

Technical Delivery

• Convert technical designs into reliable production solutions.
• Participate in technical design and code reviews.
• Mentor junior/mid-level engineers.
• Support estimation and technical planning.
• Troubleshoot complex production and integration issues.
• Collaborate with technical leads, application teams, DevOps, QA, BI, and client teams.
• Document technical designs, mappings, configurations, operational procedures, and engineering decisions.

Consulting & AI-Led Working

• Understand the business purpose behind assigned engineering requirements.
• Raise risks, assumptions, dependencies, and potential improvements proactively.
• Communicate effectively with client and internal stakeholders.
• Use AI-assisted tools to improve coding, testing, analysis, documentation, and troubleshooting productivity.
• Independently verify AI-generated code and recommendations before implementation.
• Identify opportunities for engineering automation and process improvement.

Required Qualifications

• 6–9 years of experience in data engineering, database engineering, data integration, or related areas.
• Advanced SQL skills.
• Strong hands-on Python experience.
• Strong ETL/ELT development experience.
• Strong relational database knowledge, such as SQL Server, PostgreSQL, Oracle, or equivalent.
• Experience with data modeling and database design.
• Experience with AWS, Azure, or another major cloud platform.
• Experience with modern data technologies such as Databricks, Snowflake, Redshift, Synapse, Glue, ADF, Airflow, dbt, or equivalent.
• Experience with performance tuning and optimization.
• Experience with data validation and reconciliation.
• Strong troubleshooting and analytical skills.
• Ability to take ownership of engineering deliverables with limited supervision.

Preferred Qualifications

• Experience working with enterprise ERP, CRM, PIM, PLM, MES, or related systems.
• Experience with manufacturing, retail, distribution, or consumer-goods data.
• Experience with CI/CD and infrastructure/platform engineering practices.
• Experience with API and event-driven integrations.
• Previous consulting or technology-services experience.

What Success Looks Like

• Pipelines and databases perform reliably at enterprise scale.
• Engineering solutions are maintainable, reusable, and well documented.
• Data issues are detected and addressed systematically.
• Junior engineers receive effective technical guidance.
• Problems are owned through resolution rather than simply escalated.
• Engineering decisions reflect both technical requirements and client business objectives.

Overview

Planview has one mission: to build the future of connected work, from ideas to impact.

As the global leader in work and resource management, Planview helps organizations accelerate the achievement of what matters most, supporting our customers from need to speed, from passion to progress, and from overhead to optimization. We provide the industry’s most comprehensive solutions designed for strategic planning, portfolio and resource management, Lean and Agile delivery, product portfolio management, capability, technology management (enterprise architecture), innovation management, collaborative work and project management. Our connected platform of solutions underpins the business and digital transformations of more than 4,500 customers globally, including 59 of the Fortune 100.

At Planview, our people connections drive our innovation and success. Our global team of 1400+ work remotely and across our offices including Austin, Vancouver, Hod HaSharon, Bangalore, and Stockholm. We are proud of our world-class, connected culture built on our shared values, that supports our teams to be successful from anywhere.

The Opportunity

Join our product development team at Planview as a Software Engineer 2 and contribute to the Viz Core Team. This role provides an exciting opportunity to support the development of data processing pipelines and APIs that form the backbone of our software solutions. You will work collaboratively to enhance the efficiency of software delivery, developing solutions that help organizations harness and interpret workflow data.

In this role, you will

•Collaborate with senior engineers to create and refine data processing architectures that integrate with various external tools.

•Assist in analyzing problems, defining requirements, and proposing solutions that align with the team’s objectives.

•Contribute to a culture of quality and continuous improvement by providing thoughtful feedback on code and design.

•Learn and apply best practices in cloud architectures and data processing to deliver high-quality software solutions.

•Engage in an environment that values innovation and teamwork, where your contributions will positively impact the delivery of software solutions.

Who we are looking for

The ideal candidate is an emerging professional in cloud software development with a solid foundation in data processing and software systems. You thrive in collaborative environments and are eager to learn and grow within the field.

Preferred qualifications skills, knowledge, and expertise

•Degree in Computer Science, Engineering, or a related field.

•3+ years of experience with any modern programming language, focusing on back-end systems and cloud-based technologies.

•Basic understanding of data structures, algorithms, and software development methodologies.

•Familiarity with cloud platforms, particularly AWS or similar services.

Other beneficial qualifications

•Exposure to big data technologies like Spark or Apache Kafka.

•Experience with Java (v17), Scala, or other JVM programming languages.

•Familiarity with storage tools such as PostgreSQL and MongoDB.

• Understanding of continuous integration/deployment tooling such as GitHub or Jenkins.

• Awareness of Test-Driven Development practices.

• Basic knowledge of containers and orchestration tools like

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.