Cutshort logo
For Employers
Talent Pro  logo
Senior Data Engineer (Dataform, BigQuery),
Senior Data Engineer (Dataform, BigQuery),

Senior Data Engineer (Dataform, BigQuery), at Talent Pro · Bengaluru (Bangalore), Mumbai, Hyderabad, Chennai · 6 - 10 years · ₹30L - ₹50L / yr · Bootstrapped · Posted 26 Mar 2026

Talent Pro 's logo

Senior Data Engineer (Dataform, BigQuery),

Mayank choudhary's profile picture
Posted by Mayank choudhary
6 - 10 yrs
₹30L - ₹50L / yr
Bengaluru (Bangalore), Mumbai, Hyderabad, Chennai
Skills
Data engineering

Strong Data Engineer Profile

Mandatory (Experience 1) – Must have 6+ years of hands-on experience in Data Engineering, with strong ownership of end-to-end data pipeline development.

Mandatory (Experience 2) – Must have strong experience in ETL/ELT pipeline design, transformation logic, and data workflow orchestration.

Mandatory (Experience 3) – Must have hands-on experience with any one of the following: Dataform, dbt, or BigQuery, with practical exposure to data transformation, modeling, or cloud data warehousing.

Mandatory (Experience 4) – Must have working experience on any cloud platform: GCP (preferred), AWS, or Azure, including object storage (GCS, S3, ADLS).

Mandatory (Core Skill 1) – Must have strong SQL skills with experience in writing complex queries and optimizing performance.

Mandatory (Core Skill 2) – Must have programming experience in Python and/or SQL for data processing.

Mandatory (Core Skill 3) – Must have experience in building and maintaining scalable data pipelines and troubleshooting data issues.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Talent Pro

Founded :
2024
Type :
Services
Size
Stage :
Bootstrapped

About

N/A

Company social profiles

bloglinkedin

Similar jobs (10)

infomaticscorp
Actively reviewing applications
Vineeth Kumar
Posted by Vineeth Kumar
Remote only
6 - 14 yrs
Best in industry
SQL
Google Cloud Platform (GCP)
skill iconPython
Google BigQuery

Experience: 6+ years overall Data Engineering experience.

Must-have — candidates should have hands-on experience in ALL of these:

  1. GCP (Google Cloud Platform) – strong hands-on experience
  2. Python – data engineering/ETL development
  3. SQL – advanced SQL, query optimization, data transformation
  4. BigQuery – strong hands-on experience with development, optimization and data warehousing
  5. Data Engineering / ETL – building and maintaining data pipelines
  6. GCP data services – preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
  7. Data warehousing / dimensional modeling


Read more
Top MNC
Top MNC
Agency job
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Hyderabad, Bengaluru (Bangalore)
9 - 16 yrs
₹0.5L - ₹20L / yr
Google Cloud Platform (GCP)
skill iconPython
PySpark
SQL

🚀 Hiring: Senior GCP Data Engineer

We are looking for experienced Senior Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), Python, PySpark, and SQL. Candidates with team lead experience will be preferred.

📌 Job Details:

  • Role: Senior GCP Data Engineer
  • Experience: 8+ Years
  • Budget: Up to ₹30 LPA
  • Location: Bangalore / Hyderabad
  • Relocation: Candidates from Chennai and Pune willing to relocate are welcome.
  • Notice Period: Immediate to 15 days
  • Interview Process: L1 – Virtual | L2 / DM – Face-to-Face (F2F)

💻 Required Technical Skills:

  • Strong hands-on experience with GCP data engineering.
  • Excellent proficiency in Python, PySpark, and SQL.
  • Experience in designing, developing, and optimizing data pipelines.
  • Good understanding of ETL/ELT processes and large-scale data processing.
  • Experience working with cloud-based data platforms and data warehousing.
  • Strong analytical, problem-solving, and communication skills.

⭐ Preferred Skills:

  • Previous experience as a Technical Lead or leading a data engineering team.
  • Knowledge of GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Storage.


Read more
Global Analytical Company
Actively reviewing applications
Global Analytical Company
Agency job
via Bean HR Consulting by Tanuja Chauhan
Gurugram, Bengaluru (Bangalore), Pune
5 - 8 yrs
₹12L - ₹19L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
ETL
ELT
+1 more

Job Overview:


We are seeking an experienced Cloud Data Engineer to the architecture, development, Data migration, ETL pipeline in cloud and optimization of a next-generation data platform. This is a development role for an individual with over 4 years of deep data engineering and data migration, data pipeline in AWS expertise, capable of driving technical direction, and delivering high-impact solutions in a fast-paced


4+ Years of hands-on, progressive experience in Cloud Data Engineering, cloud ecosystems AWS, Data Architecture

• Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management

•  Ability to translate complex business needs into actionable technical requirements.

•  Strong troubleshooting and problem-solving skills in distributed systems.

•  Agile/Scrum teamwork capabilities and version control practices

• Insurance industry experience preferred but not mandatory

• Tools:

o Cloud Environment: AWS (S3, IAM, VPC, Glue, Lambda etc.)

o Experience with dbt Core, Iceberg, AWS Glue Catalog, AWS lambda, Redshift, Athena, Splunk, AmazonQ, AWS streaming services, Git

o Strong SQL, Pyspark and Python

Read more
QuaXigma IT solutions Private Limited
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
5 - 7 yrs
₹4L - ₹20L / yr
Data Engineer,
skill iconPython
ETL
DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
  • Develop complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain reliable data integration workflows across multiple data sources.
  • Perform data cleansing, validation, transformation, and quality checks.
  • Analyze data and provide insights to support business and technical requirements.
  • Implement and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
  • Troubleshoot data pipeline failures, performance issues, and production incidents.
  • Optimize data processing workflows for performance, scalability, and reliability.
  • Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
  • Follow best practices for version control, testing, documentation, and deployment.
  • Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

  • 5–7 years of hands-on experience in Data Engineering.
  • Strong programming skills in Python.
  • Strong expertise in Advanced SQL and database concepts.
  • Hands-on experience with ETL/ELT processes and data pipelines.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience with CI/CD practices and tools.
  • Strong understanding of DevOps principles, automation, and deployment processes.
  • Strong data analytics and problem-solving skills.
  • Experience working with large datasets and performance optimization.
  • Good understanding of Git/version control and software development best practices.

Good to Have

  • Hands-on experience with Google Cloud Platform (GCP).
  • Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
  • Experience with containerization/orchestration technologies such as Docker/Kubernetes.
  • Experience with workflow orchestration tools such as Airflow.
  • Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

  • Strong analytical and problem-solving abilities.
  • Good communication and stakeholder management skills.
  • Ability to work independently as well as in a collaborative team environment.
  • Strong ownership of data pipelines and production systems.
  • Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops


Read more
VY SYSTEMS PRIVATE LIMITED
Actively reviewing applications
Revathi R
Posted by Revathi R
Hyderabad, Bengaluru (Bangalore)
9 - 14 yrs
₹15L - ₹30L / yr
Lead Generation
skill iconPython
PySpark
SQL
PL/SQL

GCP Data engineer

Exp 9+yrs

Bangalore/Hyderabad

Lead exp+ Python + pyspark + sql or plsql

immediate to 15days joiners

Call or WhatsApp: 6 3 8 5 0 7 6 1 4 2

Read more
VY SYSTEMS PRIVATE LIMITED
Santhanalakshmi A
Posted by Santhanalakshmi A
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 12 yrs
₹8L - ₹16L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
Hiring for Product Based MNC
Actively reviewing applications
Hiring for Product Based MNC
Agency job
via TalentOne HR Consulting LLP by sukanya talukdar
Pune
7 - 12 yrs
₹22L - ₹29L / yr
Data engineering
Snow flake schema
skill iconPython
skill iconAmazon Web Services (AWS)
Azure OpenAI

Sr. Data Engineer 

 

Location: Pune

Responsibilities 

· Lead the end-to-end design and development of scalable, high-performance data pipelines and ETL/ELT frameworks aligned with modern data engineering best practices. 

· Architect complex data integration workflows that bring together structured, semi-structured, and unstructured data from both cloud and on-premise sources. 

· Build robust real-time, batch, and on-demand pipelines with built-in observability—monitoring, alerting, and automated error handling. 

· Partner with analysts, data scientists, and business leaders to define and deliver reliable data models, quality frameworks, and SLAs that power key business insights. 

· Ensure optimal pipeline performance and throughput, with clearly defined SLAs and proactive alerting for data delivery or quality issues. 

· Collaborate with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows that align with enterprise architecture standards. 

· Establish and enforce the best practices in source control, code reviews, testing automation, and continuous delivery for all data engineering components. 

· Lead root cause analysis (RCA) and preventive maintenance for critical data failures, ensuring minimal business impact and continuous service improvement. 

· Guide the team in establishing standards for data modeling, transformation logic, and governance, ensuring long-term maintainability and scalability. 

· Design and execute comprehensive testing strategies—unit, integration, and system testing—ensuring high data reliability and pipeline resilience. 

· Monitor and fine-tune data pipeline and query performance, optimizing for reliability, scalability, and cost-efficiency. 

· Create and maintain detailed technical documentation, including data architecture diagrams, process flows, and integration specifications for internal and external stakeholders. 

· Facilitate and lead discussions with business and operational teams to understand data requirements, prioritize initiatives, and drive data strategy forward. 

Qualifications 

· 7 to 10 years of hands-on experience in data engineering roles with a proven record of building scalable and secure data platforms. 

· Over 5 years of experience in scripting languages such as Python for data processing, automation, and ETL development. 

· 4+ years of experience with Snowflake, including performance tuning, security model design, and advanced SQL development. 

· 5+ years of experience with data integration tools such as Azure Data Factory, Fivetran, or Matillion. 

· 5+ years of experience in writing complex, highly optimized SQL queries on large datasets. 

· Proven experience integrating and managing APIs, JSON, XML, and webhooks for data acquisition. 

· Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools like Apache Airflow or equivalent. 

· Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). 

· Familiarity with dbt or similar transformation tools and best practices for modular transformation development. 

· Exposure to data visualization tools like Power BI for supporting downstream analytics is a plus. 

· Strong interpersonal and communication skills with the ability to lead discussions with technical and business stakeholders. 

 

Education 

Bachelor’s or Master’s degree in Computer Science/Information technology or related field. 

Equivalent academic and work experience can be considered. 

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
Data engineering
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos