Data Engineer

at prevaj consultants pvt ltd

Data Engineer

prevaj consultants pvt ltd

Company

Home

Data Engineer at prevaj consultants pvt ltd · Chennai · 5 - 15 years · ₹2L - ₹15L / yr · Profitable · Posted 2 May 2022

Data Engineer

at prevaj consultants pvt ltd

Posted by Nilofer Jamal

5 - 15 yrs

₹2L - ₹15L / yr

Chennai

Skills

Spark

Hadoop

Big Data

Data engineering

PySpark

Google Cloud Platform (GCP)

5+ years of experience building real-time and distributed system architecture, from whiteboard to production
Strong programming skills in Python, Scala and SQL.
Versatility. Experience across the entire spectrum of data engineering, including:
Data stores (e.g., AWS RDS, AWS Athena, AWS Aurora, AWS Redshift)
Data pipeline and workflow orchestration tools (e.g., Azkaban, Airflow)
Data processing technologies (e.g., Spark, Pentaho)
Deployment and monitoring large database clusters in public cloud platforms (e.g., Docker, Terraform, Datadog)
Creating ETL or ELT pipelines that transform and process petabytes of structured and unstructured data in real-time
Industry experience building and productionizing innovative end-to-end Machine Learning systems is a plus.

5+ years of experience building real-time and distributed system architecture, from whiteboard to production
Strong programming skills in Python, Scala and SQL.
Versatility. Experience across the entire spectrum of data engineering, including:
Data stores (e.g., AWS RDS, AWS Athena, AWS Aurora, AWS Redshift)
Data pipeline and workflow orchestration tools (e.g., Azkaban, Airflow)
Data processing technologies (e.g., Spark, Pentaho)
Deployment and monitoring large database clusters in public cloud platforms (e.g., Docker, Terraform, Datadog)
Creating ETL or ELT pipelines that transform and process petabytes of structured and unstructured data in real-time
Industry experience building and productionizing innovative end-to-end Machine Learning systems is a plus.

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

About prevaj consultants pvt ltd

Founded :

2012

Type :

Services

Size :

100-1000

Stage :

Profitable

About

PREVAJ is inspired by Innovation and Excellence. Our primary GOAL is "BUILDING SUCCESS FOR EVERY CUSTOMER". PREVAJ provides end-to-end software consulting, technology solutions, digital transformation to businesses through software programming, web development, quality assurance, cloud, data, Artificial Intelligence and Machine Learning. We are driven to make our clients succeed. We turn digital ideas into blockbusters. We deliver customized and measurable solutions that perform and confer bigger results. Since founding the company in 2010, we have worked with more than 400 happy clients, many of them being most forward thinking and many of whom we've partnered with for over 9 years. Our clients, made up of medium to large businesses, each face their own challenges, but all excitedly join us in the pursuit of innovative web/cloud solutions. Our clients are different, but they all share the need to have a cost-effective software solution built to generate revenue streams, establish communication channels, streamline business operations as well as to improve customer engagement and experience. HOW WE DO? We take time to learn about the clients, how they operate, why they are great, and what their goals are. We work with them to solve the challenges that prevent their business growth. We guide projects through to completion in a way that keeps clients happy – and more importantly, returning. Our project portfolio rests on a solid foundation of quality, full life cycle, significant project deliveries. We take on truly challenging projects that others won't and innovate in ways that others don't. INDUSTRIES eCommerce Retail & Distribution Law Education Real Estate Construction and Modeling Entertainment Events & Symposiums Pharma & Healthcare Software & IT Telecom

Jamal N

Connect

sanofar shifa

Connect

Company social profiles

Similar jobs (10)

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Posted by Jancy A

Bengaluru (Bangalore)

5 - 7 yrs

₹4L - ₹20L / yr

Data Engineer,

Python

ETL

DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
Develop complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain reliable data integration workflows across multiple data sources.
Perform data cleansing, validation, transformation, and quality checks.
Analyze data and provide insights to support business and technical requirements.
Implement and maintain CI/CD pipelines for data engineering applications.
Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
Troubleshoot data pipeline failures, performance issues, and production incidents.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
Follow best practices for version control, testing, documentation, and deployment.
Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

5–7 years of hands-on experience in Data Engineering.
Strong programming skills in Python.
Strong expertise in Advanced SQL and database concepts.
Hands-on experience with ETL/ELT processes and data pipelines.
Good understanding of Data Warehousing and Data Modeling concepts.
Experience with CI/CD practices and tools.
Strong understanding of DevOps principles, automation, and deployment processes.
Strong data analytics and problem-solving skills.
Experience working with large datasets and performance optimization.
Good understanding of Git/version control and software development best practices.

Good to Have

Hands-on experience with Google Cloud Platform (GCP).
Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
Experience with containerization/orchestration technologies such as Docker/Kubernetes.
Experience with workflow orchestration tools such as Airflow.
Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

Strong analytical and problem-solving abilities.
Good communication and stakeholder management skills.
Ability to work independently as well as in a collaborative team environment.
Strong ownership of data pipelines and production systems.
Candidates who can join at short notice are preferred.

Mandatory Skills

Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Job Summary

Role Overview

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
Develop complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain reliable data integration workflows across multiple data sources.
Perform data cleansing, validation, transformation, and quality checks.
Analyze data and provide insights to support business and technical requirements.
Implement and maintain CI/CD pipelines for data engineering applications.
Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
Troubleshoot data pipeline failures, performance issues, and production incidents.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
Follow best practices for version control, testing, documentation, and deployment.
Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

5–7 years of hands-on experience in Data Engineering.
Strong programming skills in Python.
Strong expertise in Advanced SQL and database concepts.
Hands-on experience with ETL/ELT processes and data pipelines.
Good understanding of Data Warehousing and Data Modeling concepts.
Experience with CI/CD practices and tools.
Strong understanding of DevOps principles, automation, and deployment processes.
Strong data analytics and problem-solving skills.
Experience working with large datasets and performance optimization.
Good understanding of Git/version control and software development best practices.

Good to Have

Hands-on experience with Google Cloud Platform (GCP).
Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
Experience with containerization/orchestration technologies such as Docker/Kubernetes.
Experience with workflow orchestration tools such as Airflow.
Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

Strong analytical and problem-solving abilities.
Good communication and stakeholder management skills.
Ability to work independently as well as in a collaborative team environment.
Strong ownership of data pipelines and production systems.
Candidates who can join at short notice are preferred.

Mandatory Skills

Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

Data Engineer - Data Platform Team

at Proximity Works

1 video

5 recruiters

Posted by Tushar Vaghela

Bengaluru (Bangalore)

5 - 10 yrs

Best in industry

Python

Scala

Apache Spark

Apache Kafka

databricks

+1 more

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
Build and optimize distributed data applications using Apache Spark and Python Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Design and manage data workflows using Apache Airflow.
Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
Work with large datasets to ensure data quality, consistency, reliability, and performance.
Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, performance, and cost efficiency.
Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
Strong hands-on experience with Apache Spark and Scala.
Experience designing, building, and maintaining large-scale ETL pipelines.
Strong hands-on experience with AWS, particularly Amazon S3.
Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
Strong SQL skills and a solid understanding of distributed data processing concepts.
Experience working with batch and/or streaming data pipelines.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with Databricks and the broader Databricks data platform.
Familiarity with streaming technologies such as Apache Kafka.
Experience working on large-scale data platforms handling high-volume data workloads.
Exposure to additional AWS data services and cloud-native data architectures.

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

Key Responsibilities

Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
Build and optimize distributed data applications using Apache Spark and Python Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Design and manage data workflows using Apache Airflow.
Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
Work with large datasets to ensure data quality, consistency, reliability, and performance.
Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, performance, and cost efficiency.
Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
Strong hands-on experience with Apache Spark and Scala.
Experience designing, building, and maintaining large-scale ETL pipelines.
Strong hands-on experience with AWS, particularly Amazon S3.
Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
Strong SQL skills and a solid understanding of distributed data processing concepts.
Experience working with batch and/or streaming data pipelines.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with Databricks and the broader Databricks data platform.
Familiarity with streaming technologies such as Apache Kafka.
Experience working on large-scale data platforms handling high-volume data workloads.
Exposure to additional AWS data services and cloud-native data architectures.

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Posted by Banu S

Hyderabad, Bengaluru (Bangalore)

5 - 12 yrs

₹4L - ₹22L / yr

Data engineering

Python

SQL

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

Design, develop, and maintain ETL/ELT data pipelines.
Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
Develop automation scripts using Python for data processing and workflow optimization.
Work with Linux environments for deployment, monitoring, and troubleshooting.
Ensure data quality, integrity, and reliability across data platforms.
Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
Implement best practices for data security, governance, and documentation.

Required Skills

Strong experience in Data Engineering concepts and ETL/ELT processes.
Proficiency in SQL, including query optimization and database design.
Strong programming skills in Python.
Hands-on experience with Linux commands, shell scripting, and system administration basics.
Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
Familiarity with Git/version control.
Strong analytical and problem-solving skills.

Preferred Skills

Experience with cloud platforms (AWS, Azure, or GCP).
Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
Experience with data warehousing solutions and big data technologies.
Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Relevant certifications in cloud or data engineering are an added advantage.

Job Summary

Key Responsibilities

Design, develop, and maintain ETL/ELT data pipelines.
Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
Develop automation scripts using Python for data processing and workflow optimization.
Work with Linux environments for deployment, monitoring, and troubleshooting.
Ensure data quality, integrity, and reliability across data platforms.
Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
Implement best practices for data security, governance, and documentation.

Required Skills

Strong experience in Data Engineering concepts and ETL/ELT processes.
Proficiency in SQL, including query optimization and database design.
Strong programming skills in Python.
Hands-on experience with Linux commands, shell scripting, and system administration basics.
Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
Familiarity with Git/version control.
Strong analytical and problem-solving skills.

Preferred Skills

Experience with cloud platforms (AWS, Azure, or GCP).
Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
Experience with data warehousing solutions and big data technologies.
Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Relevant certifications in cloud or data engineering are an added advantage.

Senior Data Engineer

at TalentOne HR Consulting LLP

Posted by sukanya talukdar

Pune, Nagpur

7 - 12 yrs

₹10L - ₹15L / yr

ADF

Python

snow flake

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

7+ years of hands-on experience in Data Engineering
5+ years of experience in Python
4+ years of experience in Snowflake
5+ years of experience in SQL
5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
Hands-on experience with AWS / Azure
Experience with Airflow or equivalent orchestration tools
Strong experience in ETL/ELT and Data Pipelines
Experience with APIs, JSON, XML and Webhooks
Knowledge of CI/CD, Git and automated testing
Exposure to dbt or similar transformation tools
Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

Design, develop and maintain scalable ETL/ELT data pipelines
Build batch, real-time and on-demand data processing workflows
Integrate data from cloud and on-premise sources
Ensure data quality, reliability, performance and SLA adherence
Work closely with Data Scientists, Analysts, DevOps and Business teams
Implement data engineering best practices, CI/CD and automated testing
Troubleshoot pipeline issues and perform root cause analysis
Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

Opportunity to work with a reputed product-based organization
Work on modern data engineering and cloud technologies
Exposure to large-scale data platforms and business-critical data solutions
Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

7+ years of hands-on experience in Data Engineering
5+ years of experience in Python
4+ years of experience in Snowflake
5+ years of experience in SQL
5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
Hands-on experience with AWS / Azure
Experience with Airflow or equivalent orchestration tools
Strong experience in ETL/ELT and Data Pipelines
Experience with APIs, JSON, XML and Webhooks
Knowledge of CI/CD, Git and automated testing
Exposure to dbt or similar transformation tools
Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

Design, develop and maintain scalable ETL/ELT data pipelines
Build batch, real-time and on-demand data processing workflows
Integrate data from cloud and on-premise sources
Ensure data quality, reliability, performance and SLA adherence
Work closely with Data Scientists, Analysts, DevOps and Business teams
Implement data engineering best practices, CI/CD and automated testing
Troubleshoot pipeline issues and perform root cause analysis
Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

Opportunity to work with a reputed product-based organization
Work on modern data engineering and cloud technologies
Exposure to large-scale data platforms and business-critical data solutions
Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

Posted by Pavithra E

Hyderabad, Pune

5 - 9 yrs

₹18L - ₹20L / yr

PySpark

SQL

Python

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Data Engineer

at VY SYSTEMS PRIVATE LIMITED

1 recruiter

Posted by Dharani S

Bengaluru (Bangalore)

5 - 9 yrs

₹3L - ₹20L / yr

Python

DevOps

PySpark

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines.
Develop data processing solutions using Python.
Write complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain data ingestion and integration workflows.
Implement data quality, validation, monitoring, and error-handling processes.
Develop and maintain CI/CD pipelines for data engineering applications.
Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
Collaborate with data analysts, data scientists, software engineers, and business teams.
Optimize data pipelines for performance, reliability, and scalability.
Troubleshoot production data issues and ensure timely resolution.
Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

Python
ETL
SQL
CI/CD
DevOps
Git / Version Control
Strong problem-solving and debugging skills

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines.
Develop data processing solutions using Python.
Write complex and optimized SQL queries, stored procedures, and data transformations.
Build and maintain data ingestion and integration workflows.
Implement data quality, validation, monitoring, and error-handling processes.
Develop and maintain CI/CD pipelines for data engineering applications.
Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
Collaborate with data analysts, data scientists, software engineers, and business teams.
Optimize data pipelines for performance, reliability, and scalability.
Troubleshoot production data issues and ensure timely resolution.
Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

Python
ETL
SQL
CI/CD
DevOps
Git / Version Control
Strong problem-solving and debugging skills

Data Engineer

at Wissen Technology

4 recruiters

Posted by Anisha Jindal

Bengaluru (Bangalore), Mumbai

5 - 14 yrs

Best in industry

Data engineering

Python

PySpark

DAX

PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.

Technical Skills

Strong hands-on experience in Python and PySpark development.
Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
Experience with Power BI Data Modeling and Semantic Layer development.
Proficiency in DAX (Data Analysis Expressions).
Experience designing and managing Semantic Models in Power BI.
Strong SQL skills and experience working with large datasets.
Knowledge of data warehousing concepts and best practices.

Preferred Skills

Experience with cloud platforms such as Azure, AWS, or GCP.
Exposure to modern data platforms like Databricks.
Understanding of data governance and data quality frameworks.

Job Summary

Technical Skills

Strong hands-on experience in Python and PySpark development.
Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
Experience with Power BI Data Modeling and Semantic Layer development.
Proficiency in DAX (Data Analysis Expressions).
Experience designing and managing Semantic Models in Power BI.
Strong SQL skills and experience working with large datasets.
Knowledge of data warehousing concepts and best practices.

Preferred Skills

Experience with cloud platforms such as Azure, AWS, or GCP.
Exposure to modern data platforms like Databricks.
Understanding of data governance and data quality frameworks.

Senior Data Engineer - AdTech (6-Month Contract)

at Proximity Works

1 video

5 recruiters

Posted by Tushar Vaghela

Remote only

5 - 10 yrs

Best in industry

ETL

Google Cloud Platform (GCP)

Kubernetes

Scala

Apache Spark

Description

We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.

You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
Build and optimize distributed data applications using Spark and Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Work with large datasets to ensure data quality, consistency, and performance.
Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, and cost efficiency.
Deploy and manage data workloads in cloud and containerized environments.
Troubleshoot production issues and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering or Big Data Engineering.
Strong hands-on experience with Apache Spark and Scala.
Experience building and maintaining ETL pipelines.
Familiarity with Google Cloud Storage (GCS).
Experience with Kubernetes (K8s).
Strong SQL skills and understanding of distributed data processing.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with AWS and cloud-native data services.
Familiarity with streaming technologies such as Kafka.
Experience working on large-scale data platforms or AdTech systems.
Exposure to orchestration tools such as Airflow.

Benefits

Best-in-class salary: We hire strong talent and compensate accordingly.
Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.

Description

Key Responsibilities

Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
Build and optimize distributed data applications using Spark and Scala.
Develop reliable, high-performance data pipelines for batch and streaming workloads.
Work with large datasets to ensure data quality, consistency, and performance.
Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
Optimize data workflows for scalability, reliability, and cost efficiency.
Deploy and manage data workloads in cloud and containerized environments.
Troubleshoot production issues and continuously improve platform performance.

Requirements

Candidates who demonstrate:

5+ years of experience in Data Engineering or Big Data Engineering.
Strong hands-on experience with Apache Spark and Scala.
Experience building and maintaining ETL pipelines.
Familiarity with Google Cloud Storage (GCS).
Experience with Kubernetes (K8s).
Strong SQL skills and understanding of distributed data processing.
Excellent debugging, problem-solving, and performance optimization skills.
Strong communication and collaboration skills.

Good to Have

Experience with AWS and cloud-native data services.
Familiarity with streaming technologies such as Kafka.
Experience working on large-scale data platforms or AdTech systems.
Exposure to orchestration tools such as Airflow.

Benefits

Best-in-class salary: We hire strong talent and compensate accordingly.
Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Azure data engineer

at VY SYSTEMS PRIVATE LIMITED

Posted by Revathi R

Bengaluru (Bangalore), Hyderabad

5 - 10 yrs

₹18L - ₹28L / yr

Python

PySpark

SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Data Engineering

at VY SYSTEMS PRIVATE LIMITED

Posted by Pavithra E

Bengaluru (Bangalore), Hyderabad

5 - 10 yrs

₹8L - ₹28L / yr

Python

PySpark

SQL

Job Description – Data Engineer

Role: Data Engineer

Experience: 9+ Years

Location: Bangalore / Hyderabad

Notice Period: Immediate to 15 Days

Interview Process: 1st Round – Virtual | 2nd Round – F2F

Mandatory Skills

Python
PySpark
SQL
Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.

Key Responsibilities

Develop and maintain scalable data engineering solutions using Azure.
Build and optimize data processing pipelines using PySpark and Python.
Write complex SQL queries for data extraction and transformation.
Work with Azure data services and cloud-based data platforms.
Perform data processing, transformation, and integration.
Troubleshoot data pipeline and production issues.
Collaborate with technical and business teams to deliver data solutions.

Preferred: Immediate to 15 Days joiners.

Job Description – Data Engineer

Role: Data Engineer

Experience: 9+ Years

Location: Bangalore / Hyderabad

Notice Period: Immediate to 15 Days

Interview Process: 1st Round – Virtual | 2nd Round – F2F

Mandatory Skills

Python
PySpark
SQL
Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.

Key Responsibilities