ETL Developer at VY SYSTEMS PRIVATE LIMITED · Bengaluru (Bangalore) · 6 - 10 years · ₹5L - ₹30L / yr · Profitable · Posted 12 Oct 2026

Hiring: ETL Developer – Hadoop & PySpark
Location: Bangalore
Experience: 6–10 Years
Budget: 25–30 LPA
Work Mode: Weekdays
Job Description
We are looking for an experienced ETL Developer with strong expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
- Develop data transformation workflows using PySpark and Python.
- Work with Hadoop and other big data technologies to process and manage large datasets.
- Write complex SQL queries for data extraction, transformation, validation, and analysis.
- Implement data cleansing, data quality checks, and data validation processes.
- Develop and optimize data integration workflows for data warehousing solutions.
- Troubleshoot ETL failures, performance issues, and data discrepancies.
- Optimize PySpark jobs and SQL queries for performance and scalability.
- Collaborate with data engineers, architects, analysts, and other stakeholders to deliver reliable data solutions.
- Ensure data accuracy, consistency, and adherence to established data governance standards.
Mandatory Skills
- Strong hands-on experience in ETL development.
- Good experience with Hadoop and big data technologies.
- Proficiency in PySpark and Python programming.
- Strong SQL skills, including complex queries and data manipulation.
- Experience in data processing, data transformation, and data integration.
- Understanding of data warehousing concepts and architecture.
- Experience in developing, debugging, and optimizing ETL pipelines.
Required Experience
- 6–10 years of relevant experience in ETL development and data engineering.
- Practical experience handling large datasets using Hadoop and PySpark.
- Strong analytical, problem-solving, and troubleshooting skills.
- Ability to work independently and collaborate effectively within a team.
Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.

About VY SYSTEMS PRIVATE LIMITED
About
Vy Systems is a Global Technology consulting, Solutions, and Managed Technology Services company. We service our customers with ‘RESPONSIVENESS’ as a key factor and we believe that timely response to any transaction increases the operational efficiency and accelerates the revenue and profitability to our customers.
The Company is founded and managed by a team of professionals having more than two+ decades of global experience in the business of Technology Consulting and Services.
Tech stack
Similar jobs (10)
Dear Candidate,
Thanks for showing interest in the opportunity!!!
As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.
Job Description:
We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.
Primary & Mandatory Skills:
- ETL Development
- Hadoop / HDFS
- PySpark / Apache Spark
- Data Extraction, Transformation & Loading
- SQL and Data Processing
Good to Have:
- Hive / Spark SQL
- Data Pipeline Development
- Big Data Processing
- Python Programming
Company: Mphasis
Role: ETL Developer – Hadoop & PySpark
Experience: As per requirement
Location: Bangalore
Employment Type: Permanent
🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨
Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!
🔹 Role: Senior Data Engineer
🔹 Experience: 7+ Years
🔹 Location: Bangalore
🔹 CTC: Up to 26 LPA
🔹 Notice Period: Immediate to 10 Days Preferred
💻 Mandatory Skills
✅ PySpark
✅ Oracle SQL / PL/SQL
✅ Data Modeling & Design / Modernization
✅ Python
✅ ETL
✅ Data Pipelines
⚙️ Good to Have / Ecosystem Skills
✅ Kafka
✅ Hadoop
✅ AWS / Azure / GCP
✅ Git
✅ JIRA
📌 Key Responsibilities
• Develop and maintain scalable data pipelines using PySpark
• Work extensively with Oracle SQL/PLSQL for data processing and transformation
• Design and implement data models and data architecture
• Work on data design and modernization initiatives
• Develop and optimize ETL processes and data pipelines
• Handle large volumes of data using PySpark and Python
• Work with technologies such as Kafka, Hadoop, and Cloud platforms
• Collaborate with cross-functional teams to deliver scalable data solutions
• Use Git and JIRA for version control and project tracking
📩 Interested candidates can share their updated CV along with:
Total Experience:
Relevant PySpark Experience:
Relevant Oracle SQL/PLSQL Experience:
Data Modeling Experience:
Current Location:
Notice Period:
Current CTC:
Expected CTC:
#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners
Job Summary
We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.
Technical Skills
- Strong hands-on experience in Python and PySpark development.
- Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
- Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Power BI Data Modeling and Semantic Layer development.
- Proficiency in DAX (Data Analysis Expressions).
- Experience designing and managing Semantic Models in Power BI.
- Strong SQL skills and experience working with large datasets.
- Knowledge of data warehousing concepts and best practices.
Preferred Skills
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Exposure to modern data platforms like Databricks.
- Understanding of data governance and data quality frameworks.
Position: Backup Data ETL Developer
Experience: 6–9 Years
Location:Mumbai
Employment Type: Full-time
Job Description:
We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.
The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.
Key Skills:
Hadoop
Spark
Informatica
Snowflake
ETL Development
Data Integration
Data Transformation
Large-Scale Data Processing
ETL Workflows and Data Pipelines
Troubleshooting and Problem-Solving
Strong analytical and collaboration skills
Data Engineer Hiring Post
🚨 Hiring: Data Engineer | PySpark + Python + SQL
We are looking for experienced Data Engineers to join our team!
🔹 Experience: 5 to 9 Years
🔹 Locations: Bangalore / Hyderabad
🔹 Interview Process:
• 1st Round – Virtual
• 2nd Round – Face-to-Face (Karat Test)
🔑 Key Skills:
✅ PySpark
✅ SQL
✅ Python
✅ ETL
📩 Interested candidates can share their updated resume.
#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring
Urgent Hiring – Senior Data Engineer
We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.
Location: Pune – Magarpatta / Baner
Experience: 7–10 Years
Work Mode: 5 Days WFO
Notice Period: Immediate to 30 Days preferred
What We're Looking For
- 7+ years of hands-on experience in Data Engineering
- 5+ years of experience in Python
- 4+ years of experience in Snowflake
- 5+ years of experience in SQL
- 5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
- Hands-on experience with AWS / Azure
- Experience with Airflow or equivalent orchestration tools
- Strong experience in ETL/ELT and Data Pipelines
- Experience with APIs, JSON, XML and Webhooks
- Knowledge of CI/CD, Git and automated testing
- Exposure to dbt or similar transformation tools
- Experience in data pipeline monitoring, troubleshooting and performance optimization
Key Responsibilities
- Design, develop and maintain scalable ETL/ELT data pipelines
- Build batch, real-time and on-demand data processing workflows
- Integrate data from cloud and on-premise sources
- Ensure data quality, reliability, performance and SLA adherence
- Work closely with Data Scientists, Analysts, DevOps and Business teams
- Implement data engineering best practices, CI/CD and automated testing
- Troubleshoot pipeline issues and perform root cause analysis
- Optimize data pipelines and SQL queries for performance and cost efficiency
Why Join?
- Opportunity to work with a reputed product-based organization
- Work on modern data engineering and cloud technologies
- Exposure to large-scale data platforms and business-critical data solutions
- Collaborative and technically strong environment
Interested candidates can share their updated CV for immediate consideration.
Description
We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.
The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.
You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
- Build and optimize distributed data applications using Apache Spark and Python Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Design and manage data workflows using Apache Airflow.
- Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
- Work with large datasets to ensure data quality, consistency, reliability, and performance.
- Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, performance, and cost efficiency.
- Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.
Requirements
Candidates who demonstrate:
- 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
- Strong hands-on experience with Apache Spark and Scala.
- Experience designing, building, and maintaining large-scale ETL pipelines.
- Strong hands-on experience with AWS, particularly Amazon S3.
- Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
- Strong SQL skills and a solid understanding of distributed data processing concepts.
- Experience working with batch and/or streaming data pipelines.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
- Experience with Databricks and the broader Databricks data platform.
- Familiarity with streaming technologies such as Apache Kafka.
- Experience working on large-scale data platforms handling high-volume data workloads.
- Exposure to additional AWS data services and cloud-native data architectures.
Senior Data Engineer – PySpark & Oracle
Experience: 7+ Years
Location: Bangalore
Notice Period: Immediate to 10 Days
Key Skills:
- Strong expertise in Data Modeling, Data Design & Modernization
- Primary skills: PySpark, Oracle SQL/PLSQL
- Secondary skills: Python, ETL & Data Pipelines
- Experience with Kafka and Hadoop
- Exposure to AWS / Azure / GCP
- Good knowledge of Git and JIRA
Roles & Responsibilities:
- Design, develop, and modernize scalable data models and data architecture.
- Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
- Build and maintain robust ETL workflows and data pipelines.
- Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
- Perform data transformation, optimization, and performance tuning.
- Collaborate with technical teams on data design, development, testing, and deployment.
Data Engineer Short Hiring Post
🚨 Hiring: Data Engineer
🔹 Experience: 5–9 Years
🔹 Location: Bangalore / Hyderabad
🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling
🔹 Process: L1 Virtual → L2 F2F Karat Test
🔹 F2F: Bangalore / Hyderabad Location
🔹 Positions: Immediate requirement
⚠️ Note: Candidates must be available for F2F Karat immediately after L1.
#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners
Job Summary
Role Overview
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.
Experience with Google Cloud Platform (GCP) will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
- Develop complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain reliable data integration workflows across multiple data sources.
- Perform data cleansing, validation, transformation, and quality checks.
- Analyze data and provide insights to support business and technical requirements.
- Implement and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
- Troubleshoot data pipeline failures, performance issues, and production incidents.
- Optimize data processing workflows for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
- Follow best practices for version control, testing, documentation, and deployment.
- Contribute to cloud-based data engineering initiatives, preferably on GCP.
Required Skills
- 5–7 years of hands-on experience in Data Engineering.
- Strong programming skills in Python.
- Strong expertise in Advanced SQL and database concepts.
- Hands-on experience with ETL/ELT processes and data pipelines.
- Good understanding of Data Warehousing and Data Modeling concepts.
- Experience with CI/CD practices and tools.
- Strong understanding of DevOps principles, automation, and deployment processes.
- Strong data analytics and problem-solving skills.
- Experience working with large datasets and performance optimization.
- Good understanding of Git/version control and software development best practices.
Good to Have
- Hands-on experience with Google Cloud Platform (GCP).
- Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
- Experience with containerization/orchestration technologies such as Docker/Kubernetes.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of cloud-based data architecture and distributed data processing.
Preferred Candidate Profile
- Strong analytical and problem-solving abilities.
- Good communication and stakeholder management skills.
- Ability to work independently as well as in a collaborative team environment.
- Strong ownership of data pipelines and production systems.
- Candidates who can join at short notice are preferred.
Mandatory Skills
Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops










