Cutshort logo
For Employers
payments bank logo
Hadoop Senior Developer/Data Engineering Developer/ETL Developer
payments bank
Hadoop Senior Developer/Data Engineering Developer/ETL Developer

Hadoop Senior Developer/Data Engineering Developer/ETL Developer at payments bank · Navi Mumbai · 3 - 5 years · ₹7L - ₹18L / yr · Posted 31 Jan 2022

Mavin RPO Solutions Pvt. Ltd.'s logo

Hadoop Senior Developer/Data Engineering Developer/ETL Developer

at payments bank

3 - 5 yrs
₹7L - ₹18L / yr
Navi Mumbai
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
Shell Scripting
skill iconPython
Apache Sqoop
Cloudera
Relational Database (RDBMS)
MS-Excel
  • Proficiency in shell scripting
  • Proficiency in automation of tasks
  • Proficiency in Pyspark/Python
  • Proficiency in writing and understanding of sqoop
  • Understanding of CloudEra manager
  • Good understanding of RDBMS
  • Good understanding of Excel

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Wissen Technology
Actively reviewing applications
at Wissen Technology
4 recruiters
Bharanidharan K
Posted by Bharanidharan K
Bengaluru (Bangalore), Mumbai
6 - 12 yrs
Best in industry
databricks
PySpark
skill iconPython
SQL

Company: Wissen Technology

Position: Databricks Engineer

Experience: 6-10 Years

Location: Bengaluru/Mumbai

Employment Type: Full-time


About Wissen Technology

Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.

With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.

At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.

Key Responsibilities

  • Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
  • Develop and optimize data pipelines and workflows on Databricks.
  • Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
  • Ensure data integrity, quality, performance, and reliability across data processing pipelines.
  • Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
  • Perform data analysis and implement appropriate data validation and quality checks.
  • Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
  • Work with relational databases and develop efficient SQL queries for data extraction and transformation.
  • Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
  • Use Git/version control and follow established software development and deployment practices.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
  • Proven experience as a Databricks Developer, Data Engineer, or similar role.
  • Strong hands-on expertise in Apache Spark and PySpark.
  • Strong programming skills in Python; experience with Scala is an advantage.
  • Strong proficiency in SQL and hands-on experience with relational databases.
  • Practical experience developing and optimizing data pipelines and data processing applications.
  • Familiarity with Git and version control systems.
  • Strong understanding of data engineering concepts, data transformation, and data validation.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Read more
Wissen Technology
Actively reviewing applications
at Wissen Technology
4 recruiters
Vishakha Walunj
Posted by Vishakha Walunj
Pune, Mumbai, Bengaluru (Bangalore)
4 - 9 yrs
Best in industry
PySpark
SQL
databricks
skill iconPython
Apache Airflow
+2 more

Technical Stack

- PySpark

- Databricks

- Microsoft Azure

- SQL

- Kubernetes


Key Responsibilities & Expectations

- Must be self-driven, proactive, and capable of independently delivering high-quality solutions.

- Demonstrate strong ownership and accountability for assigned tasks and deliverables.

- Ability to work with minimal supervision while consistently meeting project objectives and quality standards.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹20L / yr
Hadoop
PySpark

Dear Candidate,

Thanks for showing interest in the opportunity!!!

As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.


Job Description:

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.

Primary & Mandatory Skills:

  • ETL Development
  • Hadoop / HDFS
  • PySpark / Apache Spark
  • Data Extraction, Transformation & Loading
  • SQL and Data Processing

Good to Have:

  • Hive / Spark SQL
  • Data Pipeline Development
  • Big Data Processing
  • Python Programming

Company: Mphasis

Role: ETL Developer – Hadoop & PySpark

Experience: As per requirement

Location: Bangalore

Employment Type: Permanent

Read more
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 10 yrs
₹2L - ₹22L / yr
ETL Development
Hadoop
PySpark
skill iconPython
SQL
+3 more

Job Description

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, PySpark, Python, and SQL. The candidate should have hands-on experience in developing data pipelines, processing and transforming large datasets, and working with data warehousing and big data technologies.

Key Responsibilities

  • Design, develop, and maintain ETL processes and data pipelines.
  • Work with Hadoop and PySpark to process and transform large volumes of data.
  • Develop and optimize Python scripts for data processing and automation.
  • Write complex SQL queries for data extraction, transformation, and validation.
  • Perform data cleansing, integration, transformation, and validation.
  • Work with data warehousing concepts and large-scale data processing systems.
  • Optimize ETL workflows for performance, scalability, and reliability.
  • Troubleshoot data pipeline failures and resolve data quality issues.
  • Collaborate with data engineers, analysts, and other technical teams.
  • Follow data governance, quality, and development best practices.

Required Skills

  • Strong experience in ETL Development – Mandatory
  • Hands-on experience with Hadoop – Mandatory
  • Strong experience in PySpark – Mandatory
  • Good programming skills in Python – Mandatory
  • Strong knowledge of SQL – Mandatory
  • Experience in Data Processing and Transformation – Mandatory
  • Knowledge of Data Warehousing – Mandatory
  • Experience with Big Data Technologies – Mandatory

Opportunity Details

Role: ETL Developer – Hadoop & PySpark

Experience: 6–10 Years

Location: Bangalore

Mandatory Skills

ETL Development | Hadoop | PySpark | Python | SQL | Data Processing & Transformation | Data Warehousing | Big Data Technologies

Read more
MNC
MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by Akilandeswari Panneerselvam
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 9 yrs
₹8L - ₹15L / yr
ETL
Informatica
Hadoop
Apache Spark
Snow flake schema

Position: Backup Data ETL Developer

Experience: 6–9 Years

Location:Mumbai

Employment Type: Full-time

Job Description:

We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.

The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.

Key Skills:

Hadoop

Spark

Informatica

Snowflake

ETL Development

Data Integration

Data Transformation

Large-Scale Data Processing

ETL Workflows and Data Pipelines

Troubleshooting and Problem-Solving

Strong analytical and collaboration skills

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹30L / yr
ETL
ETL Development
skill iconPython
PySpark

Hiring: ETL Developer – Hadoop & PySpark

Location: Bangalore

Experience: 6–10 Years

Budget: 25–30 LPA

Work Mode: Weekdays

Job Description

We are looking for an experienced ETL Developer with strong expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.

Key Responsibilities

  • Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
  • Develop data transformation workflows using PySpark and Python.
  • Work with Hadoop and other big data technologies to process and manage large datasets.
  • Write complex SQL queries for data extraction, transformation, validation, and analysis.
  • Implement data cleansing, data quality checks, and data validation processes.
  • Develop and optimize data integration workflows for data warehousing solutions.
  • Troubleshoot ETL failures, performance issues, and data discrepancies.
  • Optimize PySpark jobs and SQL queries for performance and scalability.
  • Collaborate with data engineers, architects, analysts, and other stakeholders to deliver reliable data solutions.
  • Ensure data accuracy, consistency, and adherence to established data governance standards.

Mandatory Skills

  • Strong hands-on experience in ETL development.
  • Good experience with Hadoop and big data technologies.
  • Proficiency in PySpark and Python programming.
  • Strong SQL skills, including complex queries and data manipulation.
  • Experience in data processing, data transformation, and data integration.
  • Understanding of data warehousing concepts and architecture.
  • Experience in developing, debugging, and optimizing ETL pipelines.

Required Experience

  • 6–10 years of relevant experience in ETL development and data engineering.
  • Practical experience handling large datasets using Hadoop and PySpark.
  • Strong analytical, problem-solving, and troubleshooting skills.
  • Ability to work independently and collaborate effectively within a team.


Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
Actively reviewing applications
Dharshini A
Posted by Dharshini A
Bengaluru (Bangalore)
6 - 12 yrs
₹5L - ₹20L / yr
Amazon EMR
skill iconPython
skill iconScala

We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.

Job Description

Role: Data Engineer

Location: Bangalore

Experience: 6+ Years

Key Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
  • Develop data engineering solutions using Python and Scala.
  • Process and transform large volumes of structured and unstructured data.
  • Build and optimize distributed data processing workflows for performance and scalability.
  • Work with big data technologies and cloud-based data processing environments.
  • Perform data integration, validation, transformation, and quality checks.
  • Troubleshoot data pipeline issues and optimize processing performance.
  • Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.

Required Skills:

  • Strong hands-on experience with Amazon EMR.
  • Proficiency in Python and Scala.
  • Experience in big data processing and data pipeline development.
  • Good understanding of distributed computing and data transformation techniques.
  • Experience in performance tuning and troubleshooting data processing jobs.
  • Strong analytical, problem-solving, and communication skills.


Read more
Wissen Technology
Actively reviewing applications
at Wissen Technology
4 recruiters
Monika Sekaran
Posted by Monika Sekaran
Pune, Bengaluru (Bangalore), Mumbai
4 - 8 yrs
Best in industry
skill iconPython
databricks
Apache Airflow
PySpark
Delta Lake
+1 more

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and PySpark.
  • Work extensively with Databricks and Delta Lake, including Delta tables, MERGE operations, schema evolution, Time Travel, and data optimization.
  • Develop, schedule, and monitor Apache Airflow DAGs for workflow orchestration and dependency management.
  • Work with Kubernetes for containerized application deployment, orchestration, monitoring, and troubleshooting.
  • Develop reusable and optimized Python code following software engineering best practices.
  • Optimize Spark jobs for performance, scalability, and cost efficiency.
  • Implement data quality checks, error handling, logging, and monitoring mechanisms.
  • Use Git for version control, branching, pull requests, code reviews, and collaborative development.
  • Troubleshoot pipeline failures, investigate data issues, and implement reliable solutions.
  • Collaborate with cross-functional teams to understand business requirements and deliver efficient data solutions.

Required Technical Skills

  • Python: Strong programming skills, including data manipulation, exception handling, modular programming, and debugging.
  • PySpark: Hands-on experience with Spark DataFrames, Spark SQL, joins, transformations, partitioning, and performance tuning.
  • Databricks: Strong understanding of Databricks architecture, notebooks, workflows, compute management, and job execution.
  • Delta Lake: Experience with Delta tables, ACID transactions, MERGE/UPSERT, schema enforcement, schema evolution, VACUUM, and Time Travel.
  • Apache Airflow: Experience developing DAGs, managing task dependencies, configuring retries, scheduling workflows, and troubleshooting failures.
  • Kubernetes: Practical knowledge of pods, deployments, services, ConfigMaps, Secrets, resource management, and troubleshooting containerized workloads.
  • Git: Proficiency in branching strategies, pull requests, merging, and resolving conflicts.
  • SQL: Strong SQL skills, including complex joins, CTEs, window functions, and query optimization.

Good to Have

  • Experience with Docker and containerization best practices.
  • Experience with Databricks Unity Catalog and data governance.
  • Knowledge of CI/CD pipelines and automated deployments.
  • Experience deploying and managing Airflow workloads on Kubernetes.
  • Familiarity with Kubernetes monitoring, autoscaling, and resource optimization.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Understanding of data lakehouse architecture and data modeling.
  • Experience with batch and incremental data processing.
  • Familiarity with data quality frameworks and automated testing.

Preferred Candidate Profile

  • Strong analytical and problem-solving skills.
  • Ability to independently design, develop, deploy, and troubleshoot data pipelines.
  • Good understanding of distributed data processing and container orchestration.
  • Experience working in an Agile development environment.
  • Strong communication and collaboration skills.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
7 - 13 yrs
₹10L - ₹24L / yr
skill iconPython
PySpark
Oracle
PL/SQL
Google Cloud Platform (GCP)
+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

  • Strong expertise in Data Modeling, Data Design & Modernization
  • Primary skills: PySpark, Oracle SQL/PLSQL
  • Secondary skills: Python, ETL & Data Pipelines
  • Experience with Kafka and Hadoop
  • Exposure to AWS / Azure / GCP
  • Good knowledge of Git and JIRA

Roles & Responsibilities:

  • Design, develop, and modernize scalable data models and data architecture.
  • Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
  • Build and maintain robust ETL workflows and data pipelines.
  • Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
  • Perform data transformation, optimization, and performance tuning.
  • Collaborate with technical teams on data design, development, testing, and deployment.


Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos