GCP Data Engineer · Bengaluru (Bangalore) · 4 - 9 years · ₹10L - ₹25L / yr · Posted 13 Oct 2022

GCP Data Engineer
- Cloud: GCP
- Must have: BigQuery, Python, Vertex AI
- Nice to have Services: Data Plex
- Exp level: 5-10 years.
- Preferred Industry (nice to have): Manufacturing – B2B sales

Similar jobs (10)
Experience: 5+ Years
Employment Type: Full-Time
Role Overview
We are looking for an experienced GCP Data Engineer with 5+ years of experience in data engineering and strong hands-on expertise in Google BigQuery, Google Cloud Storage (GCS), Airflow/Cloud Composer, Python, and Vertex AI. The candidate should be capable of designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on Google Cloud Platform.
Key Skills – Mandatory
- BigQuery – Strong hands-on experience in data warehousing, SQL, optimization, and performance tuning.
- Google Cloud Storage (GCS) – Experience with data storage, file management, and integration with data pipelines.
- Airflow / Cloud Composer – Experience in developing, scheduling, monitoring, and managing data workflows.
- Python – Strong programming skills for data engineering, ETL/ELT development, automation, and pipeline implementation.
- Vertex AI – Experience working with ML/AI workflows, model integration, or data pipelines supporting AI/ML solutions.
Good to Have / Added Advantage
- Dataproc – Experience with distributed data processing and Spark-based workloads.
- Cloud Data Fusion – Experience in building and managing data integration pipelines.
- Cloud Run – Understanding of deploying and running containerized applications/services on GCP.
- Experience with ETL/ELT processes and data pipeline development.
- Knowledge of GCP data architecture and cloud-native services.
- Experience in data quality, validation, monitoring, and troubleshooting.
Responsibilities
- Design, develop, and maintain scalable GCP-based data pipelines.
- Build and optimize data solutions using BigQuery and Cloud Storage.
- Develop and manage workflows using Airflow / Cloud Composer.
- Write efficient and reusable Python code for data processing and automation.
- Support Vertex AI integrations and AI/ML data workflows.
- Monitor pipeline performance and troubleshoot data processing issues.
- Work with cross-functional teams to understand data requirements and deliver reliable solutions.
- Implement best practices for data security, quality, scalability, and performance.
You must have :
- 5+ years of overall experience in Data Engineering.
- Strong hands-on experience with BigQuery, GCS, Airflow/Cloud Composer, Python, and Vertex AI.
- Strong understanding of data engineering concepts, ETL/ELT, data pipelines, and cloud technologies.
- Dataproc, Data Fusion, and Cloud Run experience will be an added advantage.
GCP Data engineer (L1 virtual, L2 or DM F2F )
GCP + Python + Pyspark + sql + Lead
8+yrs
Bangalore/hyderabad location ( relocation profiles also from Chennai pune location)
immediate to 15days
GCP Data Engineer
Job Description
Experience: 4-10 Years Location: Bangalore, India Employment:
Role Overview
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
• Design, develop and maintain scalable batch and real-time data pipelines on GCP.
• Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
• Design end-to-end data integration flows across systems.
• Design scalable fact/dimension schemas in cloud data warehouses.
• Handle structured, semi-structured and unstructured data at scale.
• Implement data quality checks, security and compliance policies; protect sensitive information.
• Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
• Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
• GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
• Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
• CI/CD: Deployment using GitHub Actions and Jenkins.
• Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
• Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
• Bachelor's degree in Computer Science, IT, Engineering or a related field.
• 4-10 years of data engineering experience with hands-on GCP delivery.
• Strong problem-solving, communication and stakeholder management skills.
• GCP Professional Data Engineer certification preferred.
Sourcing Preference
• Priority 1: Internal profiles (TCSers).
• Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud
Experience Required: 6-8
Role Overview
We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.
Key Responsibilities
- Design and develop scalable data pipelines and ETL/ELT processes on GCP.
- Build, optimize, and maintain data solutions using Google BigQuery.
- Develop complex SQL queries for data transformation, aggregation, and analysis.
- Design efficient data models and optimize pipelines for performance, scalability, and cost.
- Integrate data from multiple sources and ensure data quality, reliability, and availability.
- Troubleshoot pipeline and data issues and drive continuous improvement.
- Collaborate with data architects, analysts, application teams, and business stakeholders.
- Follow best practices for cloud security, data governance, testing, and documentation.
Required Skills
- 8+ years of Data Engineering experience
- Strong hands-on experience with GCP, Django, and MongoDB
- Extensive experience with BigQuery
- Advanced SQL skills
- Strong understanding of ETL/ELT and data pipeline development
- Data modeling and data warehousing experience
- Experience handling large-scale datasets and performance optimization
- Strong problem-solving and communication skills
Good to Have
- GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
- Python or other data engineering languages
- Experience with data governance and security
- Agile development experience
GCP Data Engineer
Job Description
Experience: 4-10 Years Location: Bangalore, India Employment:
Role Overview
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
• Design, develop and maintain scalable batch and real-time data pipelines on GCP.
• Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
• Design end-to-end data integration flows across systems.
• Design scalable fact/dimension schemas in cloud data warehouses.
• Handle structured, semi-structured and unstructured data at scale.
• Implement data quality checks, security and compliance policies; protect sensitive information.
• Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
• Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
• GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
• Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
• CI/CD: Deployment using GitHub Actions and Jenkins.
• Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
• Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
• Bachelor's degree in Computer Science, IT, Engineering or a related field.
• 4-10 years of data engineering experience with hands-on GCP delivery.
• Strong problem-solving, communication and stakeholder management skills.
• GCP Professional Data Engineer certification preferred.
Sourcing Preference
• Priority 1: Internal profiles (TCSers).
• Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud
Experience Required: 6-8
Data Engineer
Experience - 5+ years
6-7 LPA
Remote
Duration: 1 month contract (We can take as a tentative, It can be extended)
Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.
Key Skills:
Strong hands-on experience with GCP & BigQuery
Data warehouse architecture, design and implementation
Data ingestion/integration across multiple source systems
ETL/ELT and data pipeline development
Data modelling for reporting and analytics
Experience integrating BigQuery with Power BI or similar reporting tools
Job Description – Senior GCP Data Engineer
Position: Senior GCP Data Engineer
Experience: 8+ Years
Budget: Up to 30 LPA
Location: Bangalore / Hyderabad
Relocation: Candidates from Chennai / Pune willing to relocate are also welcome.
Notice Period: Immediate to 15 Days
Interview Process:
- Round 1: Virtual Interview
- Round 2 / DM Round: Face-to-Face Interview
Required Skills
- Strong hands-on experience in GCP Data Engineering.
- Good programming experience in Python.
- Strong experience with PySpark / Apache Spark.
- Proficiency in SQL and database concepts.
- Experience in developing and maintaining data pipelines.
- Good understanding of data processing, transformation, and integration.
- Experience in handling large-scale data processing.
- Strong problem-solving and debugging skills.
- Good understanding of cloud-based data engineering concepts.
- Experience in optimizing data pipelines for performance and scalability.
Preferred Skills
- Previous experience in a Lead Data Engineer role.
- Experience in technical leadership, mentoring, and guiding team members.
- Ability to collaborate with cross-functional teams and deliver data engineering solutions.
Roles & Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP.
- Develop data processing and transformation workflows using Python and PySpark.
- Write and optimize SQL queries for efficient data processing.
- Build and maintain reliable data engineering solutions.
- Troubleshoot data pipeline issues and optimize performance.
- Ensure data quality, reliability, and scalability.
- Collaborate with stakeholders and team members to deliver project requirements.
- Lead and guide team members where applicable.
- Important: Candidates must have strong Senior Data Engineer experience. Lead experience is preferred but not mandatory.
GCP Data Engineering Lead
Experience: 9+ Years
Lead Experience: 2+ Years
Location: Bangalore / Hyderabad
Key Skills:
- Strong experience in GCP Data Engineering and BigQuery
- Hands-on experience with Oracle Exadata / PL-SQL
- Strong knowledge of PySpark / Scala and Python
- Experience with GoldenGate, Kafka and CDC
- Hands-on experience with Apache Airflow
- Good experience in CI/CD and DevOps practices
- Experience with Terraform / Infrastructure as Code
- Exposure to AI/LLM technologies and GenAI solutions
- Strong understanding of data architecture, ETL/ELT and data pipelines
Roles & Responsibilities:
- Lead the design and development of scalable GCP data engineering solutions.
- Design and implement batch and real-time data pipelines using BigQuery, PySpark, Kafka/CDC and Airflow.
- Work with Oracle Exadata/PL-SQL and GoldenGate for data integration and migration.
- Implement CI/CD pipelines and infrastructure automation using Terraform.
- Explore and integrate AI/LLM capabilities into data engineering solutions.
- Lead technical discussions, code reviews, solution design and mentor team members.
- Collaborate with business and technical teams to deliver high-quality data solutions.
Data Engineer – Contract Opportunity
We are looking for an experienced Data Engineer with 5+ years of experience to work on subscriber activation, churn, FTE, and future reporting requirements.
Key Responsibilities:
- Work on data requirements related to Subscriber Activation, Churn, FTE, and future reporting.
- Work with BigQuery as the centralized data warehouse.
- Develop and maintain data ingestion and integration pipelines across multiple source systems.
- Design and implement ETL/ELT processes.
- Develop data models for reporting and analytics.
- Integrate BigQuery with Power BI or similar reporting tools.
Required Skills:
- Strong hands-on experience with GCP & BigQuery
- Data warehouse architecture, design, and implementation
- Data ingestion/integration across multiple source systems
- ETL/ELT and data pipeline development
- Data modelling for reporting and analytics
- Experience integrating BigQuery with Power BI or similar reporting tools
Contract: 1 month initially, with potential extension
Compensation: ₹6–7 LPA
Work Mode: Remote
Important
Since this is only a 1-month contract, mention “Potential extension” rather than saying it will definitely be extended.
Experience: 6+ years overall Data Engineering experience.
Must-have — candidates should have hands-on experience in ALL of these:
- GCP (Google Cloud Platform) – strong hands-on experience
- Python – data engineering/ETL development
- SQL – advanced SQL, query optimization, data transformation
- BigQuery – strong hands-on experience with development, optimization and data warehousing
- Data Engineering / ETL – building and maintaining data pipelines
- GCP data services – preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
- Data warehousing / dimensional modeling











