Data Engineer

at Career Forge

Data Engineer

Data Engineer at Career Forge · Delhi, Gurugram, Noida, Ghaziabad, Faridabad · 5 - 7 years · ₹12L - ₹15L / yr · Bootstrapped · Posted 23 Nov 2023

Data Engineer

at Career Forge

Posted by Mohammad Faiz

5 - 7 yrs

₹12L - ₹15L / yr

Delhi, Gurugram, Noida, Ghaziabad, Faridabad

Skills

Python

Apache Spark

PySpark

Data engineering

ETL

Data governance

Google Cloud Platform (GCP)

Cloud Computing

Amazon Web Services (AWS)

SQL Azure

SQL

Microsoft SQL Server

SQL server

Microsoft Windows Azure

CI/CD

🚀 Exciting Opportunity: Data Engineer Position in Gurugram 🌐

Hello

We are actively seeking a talented and experienced Data Engineer to join our dynamic team at Reality Motivational Venture in Gurugram (Gurgaon). If you're passionate about data, thrive in a collaborative environment, and possess the skills we're looking for, we want to hear from you!

Position: Data Engineer

Location: Gurugram (Gurgaon)

Experience: 5+ years

Key Skills:

- Python

- Spark, Pyspark

- Data Governance

- Cloud (AWS/Azure/GCP)

Main Responsibilities:

- Define and set up analytics environments for "Big Data" applications in collaboration with domain experts.

- Implement ETL processes for telemetry-based and stationary test data.

- Support in defining data governance, including data lifecycle management.

- Develop large-scale data processing engines and real-time search and analytics based on time series data.

- Ensure technical, methodological, and quality aspects.

- Support CI/CD processes.

- Foster know-how development and transfer, continuous improvement of leading technologies within Data Engineering.

- Collaborate with solution architects on the development of complex on-premise, hybrid, and cloud solution architectures.

Qualification Requirements:

- BSc, MSc, MEng, or PhD in Computer Science, Informatics/Telematics, Mathematics/Statistics, or a comparable engineering degree.

- Proficiency in Python and the PyData stack (Pandas/Numpy).

- Experience in high-level programming languages (C#/C++/Java).

- Familiarity with scalable processing environments like Dask (or Spark).

- Proficient in Linux and scripting languages (Bash Scripts).

- Experience in containerization and orchestration of containerized services (Kubernetes).

- Education in database technologies (SQL/OLAP and Non-SQL).

- Interest in Big Data storage technologies (Elastic, ClickHouse).

- Familiarity with Cloud technologies (Azure, AWS, GCP).

- Fluent English communication skills (speaking and writing).

- Ability to work constructively with a global team.

- Willingness to travel for business trips during development projects.

Preferable:

- Working knowledge of vehicle architectures, communication, and components.

- Experience in additional programming languages (C#/C++/Java, R, Scala, MATLAB).

- Experience in time-series processing.

How to Apply:

Interested candidates, please share your updated CV/resume with me.

Thank you for considering this exciting opportunity.

🚀 Exciting Opportunity: Data Engineer Position in Gurugram 🌐

Hello

We are actively seeking a talented and experienced Data Engineer to join our dynamic team at Reality Motivational Venture in Gurugram (Gurgaon). If you're passionate about data, thrive in a collaborative environment, and possess the skills we're looking for, we want to hear from you!

Position: Data Engineer

Location: Gurugram (Gurgaon)

Experience: 5+ years

Key Skills:

- Python

- Spark, Pyspark

- Data Governance

- Cloud (AWS/Azure/GCP)

Main Responsibilities:

- Define and set up analytics environments for "Big Data" applications in collaboration with domain experts.

- Implement ETL processes for telemetry-based and stationary test data.

- Support in defining data governance, including data lifecycle management.

- Develop large-scale data processing engines and real-time search and analytics based on time series data.

- Ensure technical, methodological, and quality aspects.

- Support CI/CD processes.

- Foster know-how development and transfer, continuous improvement of leading technologies within Data Engineering.

- Collaborate with solution architects on the development of complex on-premise, hybrid, and cloud solution architectures.

Qualification Requirements:

- BSc, MSc, MEng, or PhD in Computer Science, Informatics/Telematics, Mathematics/Statistics, or a comparable engineering degree.

- Proficiency in Python and the PyData stack (Pandas/Numpy).

- Experience in high-level programming languages (C#/C++/Java).

- Familiarity with scalable processing environments like Dask (or Spark).

- Proficient in Linux and scripting languages (Bash Scripts).

- Experience in containerization and orchestration of containerized services (Kubernetes).

- Education in database technologies (SQL/OLAP and Non-SQL).

- Interest in Big Data storage technologies (Elastic, ClickHouse).

- Familiarity with Cloud technologies (Azure, AWS, GCP).

- Fluent English communication skills (speaking and writing).

- Ability to work constructively with a global team.

- Willingness to travel for business trips during development projects.

Preferable:

- Working knowledge of vehicle architectures, communication, and components.

- Experience in additional programming languages (C#/C++/Java, R, Scala, MATLAB).

- Experience in time-series processing.

How to Apply:

Interested candidates, please share your updated CV/resume with me.

Thank you for considering this exciting opportunity.

Read more

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

companies logos

About Career Forge

Founded :

2022

Type :

Services

Size :

0-20

Stage :

Bootstrapped

About

CareerForge Comprehensive Talent Solutions Private Limited is a company duly registered under the Companies Act, 2013. It is founded by alumni of IIM, AIMA & AMU. The company envisions to serve corporate clients by providing effective and efficient training, recruiting and consulting solutions and services.

The primary pursuit of the company is to assist the clients develop the competencies of existing workforce, acquire the desired talent from the market, and receive cost-effective time-bound high quality consulting solutions to varying business processes in technical as well as operational arena such as process audits, re-engineering, compliances.

CareerForge firmly believes in fostering strategic partnerships and alliances with specialized agencies/experts as and when required on mutual benefiting and transparent terms.

In training realms, we offer a comprehensive range of services beginning with need assessment till evaluation. We also offer some popular personality assessment services too.

In recruiting, we provide permanent as well as contractual hiring solutions. We cover fresher till CXO level hiring needs of clients across the sectors. We emphasize the best match-makings in order to reduce attritions due to such reasons to bare minimum. This way, we strive to minimize the costs in terms of money, efforts and time of our clientele.

In consulting domain, we specialize in HR sub-functions including payroll, BGV, SOPs, Process Audits, Re-

CareerForge Comprehensive Talent Solutions Private Limited is a company duly registered under the Companies Act, 2013. It is founded by alumni of IIM, AIMA & AMU. The company envisions to serve corporate clients by providing effective and efficient training, recruiting and consulting solutions and services.

The primary pursuit of the company is to assist the clients develop the competencies of existing workforce, acquire the desired talent from the market, and receive cost-effective time-bound high quality consulting solutions to varying business processes in technical as well as operational arena such as process audits, re-engineering, compliances.

CareerForge firmly believes in fostering strategic partnerships and alliances with specialized agencies/experts as and when required on mutual benefiting and transparent terms.

In training realms, we offer a comprehensive range of services beginning with need assessment till evaluation. We also offer some popular personality assessment services too.

In recruiting, we provide permanent as well as contractual hiring solutions. We cover fresher till CXO level hiring needs of clients across the sectors. We emphasize the best match-makings in order to reduce attritions due to such reasons to bare minimum. This way, we strive to minimize the costs in terms of money, efforts and time of our clientele.

In consulting domain, we specialize in HR sub-functions including payroll, BGV, SOPs, Process Audits, Re-

Read more

Candid answers by the company

What does the company do?

What is the location preference of jobs?

Human Resources Services

Company social profiles

Similar jobs (10)

VY SYSTEMS PRIVATE LIMITED

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Jancy A

Posted by Jancy A

Bengaluru (Bangalore)

5 - 7 yrs

₹4L - ₹20L / yr

Data Engineer,

Python

ETL

DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
Develop complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain reliable data integration workflows across multiple data sources.
Perform data cleansing, validation, transformation, and quality checks.
Analyze data and provide insights to support business and technical requirements.
Implement and maintain CI/CD pipelines for data engineering applications.
Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
Troubleshoot data pipeline failures, performance issues, and production incidents.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
Follow best practices for version control, testing, documentation, and deployment.
Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

5–7 years of hands-on experience in Data Engineering.
Strong programming skills in Python.
Strong expertise in Advanced SQL and database concepts.
Hands-on experience with ETL/ELT processes and data pipelines.
Good understanding of Data Warehousing and Data Modeling concepts.
Experience with CI/CD practices and tools.
Strong understanding of DevOps principles, automation, and deployment processes.
Strong data analytics and problem-solving skills.
Experience working with large datasets and performance optimization.
Good understanding of Git/version control and software development best practices.

Good to Have

Hands-on experience with Google Cloud Platform (GCP).
Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
Experience with containerization/orchestration technologies such as Docker/Kubernetes.
Experience with workflow orchestration tools such as Airflow.
Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

Strong analytical and problem-solving abilities.
Good communication and stakeholder management skills.
Ability to work independently as well as in a collaborative team environment.
Strong ownership of data pipelines and production systems.
Candidates who can join at short notice are preferred.

Mandatory Skills

Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
Develop complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain reliable data integration workflows across multiple data sources.
Perform data cleansing, validation, transformation, and quality checks.
Analyze data and provide insights to support business and technical requirements.
Implement and maintain CI/CD pipelines for data engineering applications.
Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
Troubleshoot data pipeline failures, performance issues, and production incidents.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
Follow best practices for version control, testing, documentation, and deployment.
Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

5–7 years of hands-on experience in Data Engineering.
Strong programming skills in Python.
Strong expertise in Advanced SQL and database concepts.
Hands-on experience with ETL/ELT processes and data pipelines.
Good understanding of Data Warehousing and Data Modeling concepts.
Experience with CI/CD practices and tools.
Strong understanding of DevOps principles, automation, and deployment processes.
Strong data analytics and problem-solving skills.
Experience working with large datasets and performance optimization.
Good understanding of Git/version control and software development best practices.

Good to Have

Hands-on experience with Google Cloud Platform (GCP).
Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
Experience with containerization/orchestration technologies such as Docker/Kubernetes.
Experience with workflow orchestration tools such as Airflow.
Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

Strong analytical and problem-solving abilities.
Good communication and stakeholder management skills.
Ability to work independently as well as in a collaborative team environment.
Strong ownership of data pipelines and production systems.
Candidates who can join at short notice are preferred.

Mandatory Skills

Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Read more

Wissen Technology

Data Engineer

at Wissen Technology

4 recruiters

Anisha Jindal

Posted by Anisha Jindal

Bengaluru (Bangalore), Mumbai

5 - 14 yrs

Best in industry

Data engineering

Python

PySpark

DAX

PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.

Technical Skills

Strong hands-on experience in Python and PySpark development.
Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
Experience with Power BI Data Modeling and Semantic Layer development.
Proficiency in DAX (Data Analysis Expressions).
Experience designing and managing Semantic Models in Power BI.
Strong SQL skills and experience working with large datasets.
Knowledge of data warehousing concepts and best practices.

Preferred Skills

Experience with cloud platforms such as Azure, AWS, or GCP.
Exposure to modern data platforms like Databricks.
Understanding of data governance and data quality frameworks.

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.

Technical Skills

Strong hands-on experience in Python and PySpark development.
Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
Experience with Power BI Data Modeling and Semantic Layer development.
Proficiency in DAX (Data Analysis Expressions).
Experience designing and managing Semantic Models in Power BI.
Strong SQL skills and experience working with large datasets.
Knowledge of data warehousing concepts and best practices.

Preferred Skills

Experience with cloud platforms such as Azure, AWS, or GCP.
Exposure to modern data platforms like Databricks.
Understanding of data governance and data quality frameworks.

Read more

VY SYSTEMS PRIVATE LIMITED

Azure Data Engineering

at VY SYSTEMS PRIVATE LIMITED

Pavithra E

Posted by Pavithra E

Bengaluru (Bangalore), Hyderabad

9 - 15 yrs

₹8L - ₹28L / yr

Python

PySpark

SQL

Job Description – Azure Data Engineer

Role: Azure Data Engineer

Experience: 9+ Years

Location: Bangalore / Hyderabad

Notice Period: Immediate to 15 Days

Interview Process: 1st Round – Virtual | 2nd Round – F2F

Mandatory Skills

Python
PySpark
SQL
Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.

Key Responsibilities

Develop and maintain scalable data engineering solutions using Azure.
Build and optimize data processing pipelines using PySpark and Python.
Write complex SQL queries for data extraction and transformation.
Work with Azure data services and cloud-based data platforms.
Perform data processing, transformation, and integration.
Troubleshoot data pipeline and production issues.
Collaborate with technical and business teams to deliver data solutions.

Preferred: Immediate to 15 Days joiners.

Job Description – Azure Data Engineer

Role: Azure Data Engineer

Experience: 9+ Years

Location: Bangalore / Hyderabad

Notice Period: Immediate to 15 Days

Interview Process: 1st Round – Virtual | 2nd Round – F2F

Mandatory Skills

Python
PySpark
SQL
Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.

Key Responsibilities

Develop and maintain scalable data engineering solutions using Azure.
Build and optimize data processing pipelines using PySpark and Python.
Write complex SQL queries for data extraction and transformation.
Work with Azure data services and cloud-based data platforms.
Perform data processing, transformation, and integration.
Troubleshoot data pipeline and production issues.
Collaborate with technical and business teams to deliver data solutions.

Preferred: Immediate to 15 Days joiners.

Read more

TalentOne HR Consulting LLP

Senior Data Engineer

at TalentOne HR Consulting LLP

sukanya talukdar

Posted by sukanya talukdar

Pune, Nagpur

7 - 12 yrs

₹10L - ₹15L / yr

ADF

Python

snow flake

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

7+ years of hands-on experience in Data Engineering
5+ years of experience in Python
4+ years of experience in Snowflake
5+ years of experience in SQL
5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
Hands-on experience with AWS / Azure
Experience with Airflow or equivalent orchestration tools
Strong experience in ETL/ELT and Data Pipelines
Experience with APIs, JSON, XML and Webhooks
Knowledge of CI/CD, Git and automated testing
Exposure to dbt or similar transformation tools
Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

Design, develop and maintain scalable ETL/ELT data pipelines
Build batch, real-time and on-demand data processing workflows
Integrate data from cloud and on-premise sources
Ensure data quality, reliability, performance and SLA adherence
Work closely with Data Scientists, Analysts, DevOps and Business teams
Implement data engineering best practices, CI/CD and automated testing
Troubleshoot pipeline issues and perform root cause analysis
Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

Opportunity to work with a reputed product-based organization
Work on modern data engineering and cloud technologies
Exposure to large-scale data platforms and business-critical data solutions
Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

7+ years of hands-on experience in Data Engineering
5+ years of experience in Python
4+ years of experience in Snowflake
5+ years of experience in SQL
5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
Hands-on experience with AWS / Azure
Experience with Airflow or equivalent orchestration tools
Strong experience in ETL/ELT and Data Pipelines
Experience with APIs, JSON, XML and Webhooks
Knowledge of CI/CD, Git and automated testing
Exposure to dbt or similar transformation tools
Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

Design, develop and maintain scalable ETL/ELT data pipelines
Build batch, real-time and on-demand data processing workflows
Integrate data from cloud and on-premise sources
Ensure data quality, reliability, performance and SLA adherence
Work closely with Data Scientists, Analysts, DevOps and Business teams
Implement data engineering best practices, CI/CD and automated testing
Troubleshoot pipeline issues and perform root cause analysis
Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

Opportunity to work with a reputed product-based organization
Work on modern data engineering and cloud technologies
Exposure to large-scale data platforms and business-critical data solutions
Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.

Read more

VY SYSTEMS PRIVATE LIMITED

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

1 recruiter

Dharani S

Posted by Dharani S

Bengaluru (Bangalore)

5 - 9 yrs

₹3L - ₹20L / yr

Python

DevOps

PySpark

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines.
Develop data processing solutions using Python.
Write complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain data ingestion and integration workflows.
Implement data quality, validation, monitoring, and error-handling processes.
Develop and maintain CI/CD pipelines for data engineering applications.
Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
Collaborate with data analysts, data scientists, software engineers, and business teams.
Optimize data pipelines for performance, reliability, and scalability.
Troubleshoot production data issues and ensure timely resolution.
Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

Python
ETL
SQL
CI/CD
DevOps
Git / Version Control
Strong problem-solving and debugging skills

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines.
Develop data processing solutions using Python.
Write complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain data ingestion and integration workflows.
Implement data quality, validation, monitoring, and error-handling processes.
Develop and maintain CI/CD pipelines for data engineering applications.
Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
Collaborate with data analysts, data scientists, software engineers, and business teams.
Optimize data pipelines for performance, reliability, and scalability.
Troubleshoot production data issues and ensure timely resolution.
Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

Python
ETL
SQL
CI/CD
DevOps
Git / Version Control
Strong problem-solving and debugging skills

Read more

Proximity Works

Data Engineer - Data Platform Team

at Proximity Works

1 video

5 recruiters

Tushar Vaghela

Posted by Tushar Vaghela

Bengaluru (Bangalore)

5 - 10 yrs

Best in industry

Python

Scala

Apache Spark

Apache Kafka

databricks

+1 more

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
Build and optimize distributed data applications using Apache Spark and Python Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Design and manage data workflows using Apache Airflow.
Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
Work with large datasets to ensure data quality, consistency, reliability, and performance.
Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, performance, and cost efficiency.
Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
Strong hands-on experience with Apache Spark and Scala.
Experience designing, building, and maintaining large-scale ETL pipelines.
Strong hands-on experience with AWS, particularly Amazon S3.
Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
Strong SQL skills and a solid understanding of distributed data processing concepts.
Experience working with batch and/or streaming data pipelines.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with Databricks and the broader Databricks data platform.
Familiarity with streaming technologies such as Apache Kafka.
Experience working on large-scale data platforms handling high-volume data workloads.
Exposure to additional AWS data services and cloud-native data architectures.

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
Build and optimize distributed data applications using Apache Spark and Python Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Design and manage data workflows using Apache Airflow.
Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
Work with large datasets to ensure data quality, consistency, reliability, and performance.
Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, performance, and cost efficiency.
Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
Strong hands-on experience with Apache Spark and Scala.
Experience designing, building, and maintaining large-scale ETL pipelines.
Strong hands-on experience with AWS, particularly Amazon S3.
Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
Strong SQL skills and a solid understanding of distributed data processing concepts.
Experience working with batch and/or streaming data pipelines.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with Databricks and the broader Databricks data platform.
Familiarity with streaming technologies such as Apache Kafka.
Experience working on large-scale data platforms handling high-volume data workloads.
Exposure to additional AWS data services and cloud-native data architectures.

Read more

VY SYSTEMS PRIVATE LIMITED

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Jancy A

Posted by Jancy A

Bengaluru (Bangalore)

7 - 13 yrs

₹10L - ₹24L / yr

Python

PySpark

Oracle

PL/SQL

Google Cloud Platform (GCP)

+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

Strong expertise in Data Modeling, Data Design & Modernization
Primary skills: PySpark, Oracle SQL/PLSQL
Secondary skills: Python, ETL & Data Pipelines
Experience with Kafka and Hadoop
Exposure to AWS / Azure / GCP
Good knowledge of Git and JIRA

Roles & Responsibilities:

Design, develop, and modernize scalable data models and data architecture.
Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
Build and maintain robust ETL workflows and data pipelines.
Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
Perform data transformation, optimization, and performance tuning.
Collaborate with technical teams on data design, development, testing, and deployment.

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

Strong expertise in Data Modeling, Data Design & Modernization
Primary skills: PySpark, Oracle SQL/PLSQL
Secondary skills: Python, ETL & Data Pipelines
Experience with Kafka and Hadoop
Exposure to AWS / Azure / GCP
Good knowledge of Git and JIRA

Roles & Responsibilities:

Design, develop, and modernize scalable data models and data architecture.
Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
Build and maintain robust ETL workflows and data pipelines.
Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
Perform data transformation, optimization, and performance tuning.
Collaborate with technical teams on data design, development, testing, and deployment.

Read more

VY SYSTEMS PRIVATE LIMITED

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Banu S

Posted by Banu S

Hyderabad, Bengaluru (Bangalore)

5 - 12 yrs

₹4L - ₹22L / yr

Data engineering

Python

SQL

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

Design, develop, and maintain ETL/ELT data pipelines.
Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
Develop automation scripts using Python for data processing and workflow optimization.
Work with Linux environments for deployment, monitoring, and troubleshooting.
Ensure data quality, integrity, and reliability across data platforms.
Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
Implement best practices for data security, governance, and documentation.

Required Skills

Strong experience in Data Engineering concepts and ETL/ELT processes.
Proficiency in SQL, including query optimization and database design.
Strong programming skills in Python.
Hands-on experience with Linux commands, shell scripting, and system administration basics.
Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
Familiarity with Git/version control.
Strong analytical and problem-solving skills.

Preferred Skills

Experience with cloud platforms (AWS, Azure, or GCP).
Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
Experience with data warehousing solutions and big data technologies.
Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Relevant certifications in cloud or data engineering are an added advantage.

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

Design, develop, and maintain ETL/ELT data pipelines.
Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
Develop automation scripts using Python for data processing and workflow optimization.
Work with Linux environments for deployment, monitoring, and troubleshooting.
Ensure data quality, integrity, and reliability across data platforms.
Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
Implement best practices for data security, governance, and documentation.

Required Skills

Strong experience in Data Engineering concepts and ETL/ELT processes.
Proficiency in SQL, including query optimization and database design.
Strong programming skills in Python.
Hands-on experience with Linux commands, shell scripting, and system administration basics.
Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
Familiarity with Git/version control.
Strong analytical and problem-solving skills.

Preferred Skills

Experience with cloud platforms (AWS, Azure, or GCP).
Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
Experience with data warehousing solutions and big data technologies.
Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Relevant certifications in cloud or data engineering are an added advantage.

Read more

VY SYSTEMS PRIVATE LIMITED

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Pavithra E

Posted by Pavithra E

Hyderabad, Bengaluru (Bangalore)

5 - 9 yrs

₹9L - ₹20L / yr

PySpark

SQL

Python

ETL

Data Engineer Hiring Post

🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Data Engineer Hiring Post

🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Read more

VY SYSTEMS PRIVATE LIMITED

DATA ENGINEER

at VY SYSTEMS PRIVATE LIMITED

Pavithra E

Posted by Pavithra E

Bengaluru (Bangalore), Hyderabad

5 - 10 yrs

₹7L - ₹18L / yr

Python

PySpark

SQL

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨

Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!

🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred

💻 Mandatory Skills

✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines

⚙️ Good to Have / Ecosystem Skills

✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA

📌 Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking

📩 Interested candidates can share their updated CV along with:

Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:

#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨

Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!

🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred

💻 Mandatory Skills

✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines

⚙️ Good to Have / Ecosystem Skills

✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA

📌 Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking

📩 Interested candidates can share their updated CV along with:

Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:

#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

Read more

Why apply to jobs via Cutshort

people_solving_puzzle

Personalized job matches

Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.

people_verifying_people

Verified hiring teams

See actual hiring teams, find common social connections or connect with them directly.

ai_chip

Move faster with AI

We use AI to get you faster responses, recommendations and unmatched user experience.

Did not find a job you were looking for?

Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.

Get to hear about interesting companies hiring right now

Follow Cutshort

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

companies logos