Data Engineer at This is a Full time role is with our Client · Tiruchirappalli, Chennai · 5 - 10 years · ₹15L - ₹20L / yr · Posted 29 Oct 2025

Senior Data Engineer
Experience: 5+ years
Chennai/ Trichy (Hybrid)
Type: Fulltime
Skills: GCP + Airflow + Bigquery + Python + Docker
The Role
As a Senior Data Engineer, you own new initiatives, design and build world-class platforms to measure and optimize ad performance. You ensure industry-leading scalability and reliability of mission-critical systems processing billions of real-time transactions a day. You apply state-of-the-art technologies, frameworks, and strategies to address complex challenges with Big Data processing and analytics. You work closely with the talented engineers across different time zones in building industry-first solutions to measure and optimize ad performance.
What you’ll do
● Write solid code with a focus on high performance for services supporting high throughput and low latency
● Architect, design, and build big data processing platforms handling tens of TBs/Day, serve thousands of clients, and support advanced analytic workloads
● Providing meaningful and relevant feedback to junior developers and staying up-to-date with system changes
● Explore the technological landscape for new ways of producing, processing, and analyzing data to gain insights into both our users and our product features
● Design, develop, and test data-driven products, features, and APIs that scale
● Continuously improve the quality of deliverables and SDLC processes
● Operate production environments, investigate issues, assess their impact, and develop feasible solutions.
● Understand business needs and work with product owners to establish priorities
● Bridge the gap between Business / Product requirements and technical details
● Work in multi-functional agile teams with end-to-end responsibility for product development and delivery
Who you are
● 3-5+ years of programming experience in coding, object-oriented design, and/or functional programming, including Python or a related language
● Love what you do and are passionate about crafting clean code, and have a steady foundation.
● Deep understanding of distributed system technologies, standards, and protocols, and have 2+ years of experience working in distributed systems like Airflow, BigQuery, Spark, Kafka Eco System ( Kafka Connect, Kafka Streams, or Kinesis), and building data pipelines at scale.
● Excellent SQL, DBT query writing abilities, and data understanding
● Care about agile software processes, data-driven development, reliability, and responsible experimentation
● Genuine desire to automate decision-making, processes, and workflows
● Experience working with orchestration tools like Airflow
● Good understanding of semantic layers and experience in tools like LookerML, Kube
● Excellent communication skills and a team player
● Google BigQuery or Snowflake
● Cloud environment, Google Cloud Platform
● Container technologies - Docker / Kubernetes
● Ad-serving technologies and standards
● Familiarity with AI tools like Cursor AI, CoPilot.

Similar jobs (10)
Experience: 6+ years overall Data Engineering experience.
Must-have — candidates should have hands-on experience in ALL of these:
- GCP (Google Cloud Platform) – strong hands-on experience
- Python – data engineering/ETL development
- SQL – advanced SQL, query optimization, data transformation
- BigQuery – strong hands-on experience with development, optimization and data warehousing
- Data Engineering / ETL – building and maintaining data pipelines
- GCP data services – preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
- Data warehousing / dimensional modeling
GCP Data engineer
Exp 9+yrs
Bangalore/Hyderabad
Lead exp+ Python + pyspark + sql or plsql
immediate to 15days joiners
Call or WhatsApp: 6 3 8 5 0 7 6 1 4 2
🚀 Hiring: Senior GCP Data Engineer
We are looking for experienced Senior Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), Python, PySpark, and SQL. Candidates with team lead experience will be preferred.
📌 Job Details:
- Role: Senior GCP Data Engineer
- Experience: 8+ Years
- Budget: Up to ₹30 LPA
- Location: Bangalore / Hyderabad
- Relocation: Candidates from Chennai and Pune willing to relocate are welcome.
- Notice Period: Immediate to 15 days
- Interview Process: L1 – Virtual | L2 / DM – Face-to-Face (F2F)
💻 Required Technical Skills:
- Strong hands-on experience with GCP data engineering.
- Excellent proficiency in Python, PySpark, and SQL.
- Experience in designing, developing, and optimizing data pipelines.
- Good understanding of ETL/ELT processes and large-scale data processing.
- Experience working with cloud-based data platforms and data warehousing.
- Strong analytical, problem-solving, and communication skills.
⭐ Preferred Skills:
- Previous experience as a Technical Lead or leading a data engineering team.
- Knowledge of GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Storage.
GCP Data Engineer
Job Description
Experience: 4-10 Years Location: Bangalore, India Employment:
Role Overview
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
• Design, develop and maintain scalable batch and real-time data pipelines on GCP.
• Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
• Design end-to-end data integration flows across systems.
• Design scalable fact/dimension schemas in cloud data warehouses.
• Handle structured, semi-structured and unstructured data at scale.
• Implement data quality checks, security and compliance policies; protect sensitive information.
• Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
• Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
• GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
• Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
• CI/CD: Deployment using GitHub Actions and Jenkins.
• Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
• Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
• Bachelor's degree in Computer Science, IT, Engineering or a related field.
• 4-10 years of data engineering experience with hands-on GCP delivery.
• Strong problem-solving, communication and stakeholder management skills.
• GCP Professional Data Engineer certification preferred.
Sourcing Preference
• Priority 1: Internal profiles (TCSers).
• Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud
Experience Required: 6-8
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.
I’m a Google Cloud Data Engineer with 5+ years of experience in data engineering, ETL, and cloud data solutions. I specialize in BigQuery, Dataform, Cloud Composer (Airflow), SQL, and CI/CD automation.
I have hands-on experience building reusable Dataform frameworks, developing and orchestrating data pipelines, supporting cloud platform upgrades, implementing secure IAM access, and optimizing data transformation workflows. I’ve also worked on AI-assisted SQLX code generation to improve developer productivity and standardize development.
I’m passionate about building scalable, reliable, and efficient data solutions. I’m looking for opportunities where I can contribute my GCP expertise, solve real-world data challenges, collaborate with talented teams, and continue growing as a Data Engineer.
Core skills: Google Cloud Platform (GCP) | BigQuery | Dataform | Cloud Composer | Apache Airflow | SQL | Python | ETL | CI/CD | GitHub Actions | Dataplex
GCP Data engineer (L1 virtual, L2 or DM F2F )
GCP + Python + Pyspark + sql + Lead
8+yrs
Bangalore/hyderabad location ( relocation profiles also from Chennai pune location)
immediate to 15days
🚨 HIRING | Data Engineer – Amazon EMR 🔥
We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.
📌 JOB DETAILS:
💼 Experience: 6+ Years
💰 CTC: Up to 30 LPA
📍 Location: Bangalore
🔑 MANDATORY SKILLS:
• Amazon EMR
• Python
• Scala
• Data Engineering
📋 KEY REQUIREMENTS:
• 6+ years of relevant experience in Data Engineering.
• Strong hands-on experience with Amazon EMR.
• Strong programming skills in Python and Scala.
• Experience with large-scale data processing and data engineering solutions.
• Strong problem-solving and communication skills.
📩 Interested candidates can share their updated resumes:
📧 pavithra.e @vysystems. com
📞 8 9 2 5 8 0 2 4 5 7
🔄 Know someone who would be a good fit? Tag them or share this post!
#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
Job Title: GCP Data Engineer
Experience: 6–8 years
Location : Bangalore
What are they looking for?
They need a Google Cloud Platform (GCP) Data Engineer who can build and maintain data pipelines, process large volumes of data, and manage data storage using Google Cloud services.
The candidate should have hands-on experience with batch and real-time data processing, ETL workflows, and cloud data warehousing.
Mandatory / Core Skills
- Google Cloud Platform (GCP)
- Google Cloud Dataflow
- Pub/Sub
- Apache Beam
- BigQuery
- Cloud Storage / Bigtable
- Cloud Composer (Apache Airflow)
- ETL / data pipeline development
- Apache Spark / Hadoop using Dataproc
Supporting Skills
- Cloud Data Fusion
- NoSQL databases
- Data quality and governance
- Data security, access controls, and encryption
- Batch and real-time streaming
- Preparing datasets for BI, analytics, and machine learning









