GCP Data Engineer

Experience: 5+ Years

Employment Type: Full-Time

Role Overview

We are looking for an experienced GCP Data Engineer with 5+ years of experience in data engineering and strong hands-on expertise in Google BigQuery, Google Cloud Storage (GCS), Airflow/Cloud Composer, Python, and Vertex AI. The candidate should be capable of designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on Google Cloud Platform.

Key Skills – Mandatory

• BigQuery – Strong hands-on experience in data warehousing, SQL, optimization, and performance tuning.
• Google Cloud Storage (GCS) – Experience with data storage, file management, and integration with data pipelines.
• Airflow / Cloud Composer – Experience in developing, scheduling, monitoring, and managing data workflows.
• Python – Strong programming skills for data engineering, ETL/ELT development, automation, and pipeline implementation.
• Vertex AI – Experience working with ML/AI workflows, model integration, or data pipelines supporting AI/ML solutions.

Good to Have / Added Advantage

• Dataproc – Experience with distributed data processing and Spark-based workloads.
• Cloud Data Fusion – Experience in building and managing data integration pipelines.
• Cloud Run – Understanding of deploying and running containerized applications/services on GCP.
• Experience with ETL/ELT processes and data pipeline development.
• Knowledge of GCP data architecture and cloud-native services.
• Experience in data quality, validation, monitoring, and troubleshooting.

Responsibilities

• Design, develop, and maintain scalable GCP-based data pipelines.
• Build and optimize data solutions using BigQuery and Cloud Storage.
• Develop and manage workflows using Airflow / Cloud Composer.
• Write efficient and reusable Python code for data processing and automation.
• Support Vertex AI integrations and AI/ML data workflows.
• Monitor pipeline performance and troubleshoot data processing issues.
• Work with cross-functional teams to understand data requirements and deliver reliable solutions.
• Implement best practices for data security, quality, scalability, and performance.

You must have :

• 5+ years of overall experience in Data Engineering.
• Strong hands-on experience with BigQuery, GCS, Airflow/Cloud Composer, Python, and Vertex AI.
• Strong understanding of data engineering concepts, ETL/ELT, data pipelines, and cloud technologies.
• Dataproc, Data Fusion, and Cloud Run experience will be an added advantage.

Role Overview

We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on GCP.
• Build, optimize, and maintain data solutions using Google BigQuery.
• Develop complex SQL queries for data transformation, aggregation, and analysis.
• Design efficient data models and optimize pipelines for performance, scalability, and cost.
• Integrate data from multiple sources and ensure data quality, reliability, and availability.
• Troubleshoot pipeline and data issues and drive continuous improvement.
• Collaborate with data architects, analysts, application teams, and business stakeholders.
• Follow best practices for cloud security, data governance, testing, and documentation.

Required Skills

• 8+ years of Data Engineering experience
• Strong hands-on experience with GCP, Django, and MongoDB
• Extensive experience with BigQuery
• Advanced SQL skills
• Strong understanding of ETL/ELT and data pipeline development
• Data modeling and data warehousing experience
• Experience handling large-scale datasets and performance optimization
• Strong problem-solving and communication skills

Good to Have

• GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
• Python or other data engineering languages
• Experience with data governance and security
• Agile development experience

Job Description – Senior GCP Data Engineer

Position: Senior GCP Data Engineer

Experience: 8+ Years

Budget: Up to 30 LPA

Location: Bangalore / Hyderabad

Relocation: Candidates from Chennai / Pune willing to relocate are also welcome.

Notice Period: Immediate to 15 Days

Interview Process:

• Round 1: Virtual Interview
• Round 2 / DM Round: Face-to-Face Interview

Required Skills

• Strong hands-on experience in GCP Data Engineering.
• Good programming experience in Python.
• Strong experience with PySpark / Apache Spark.
• Proficiency in SQL and database concepts.
• Experience in developing and maintaining data pipelines.
• Good understanding of data processing, transformation, and integration.
• Experience in handling large-scale data processing.
• Strong problem-solving and debugging skills.
• Good understanding of cloud-based data engineering concepts.
• Experience in optimizing data pipelines for performance and scalability.

Preferred Skills

• Previous experience in a Lead Data Engineer role.
• Experience in technical leadership, mentoring, and guiding team members.
• Ability to collaborate with cross-functional teams and deliver data engineering solutions.

Roles & Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP.
• Develop data processing and transformation workflows using Python and PySpark.
• Write and optimize SQL queries for efficient data processing.
• Build and maintain reliable data engineering solutions.
• Troubleshoot data pipeline issues and optimize performance.
• Ensure data quality, reliability, and scalability.
• Collaborate with stakeholders and team members to deliver project requirements.
• Lead and guide team members where applicable.
• Important: Candidates must have strong Senior Data Engineer experience. Lead experience is preferred but not mandatory.

Experience: 6+ years overall Data Engineering experience.

Must-have — candidates should have hands-on experience in ALL of these:

1. GCP (Google Cloud Platform) – strong hands-on experience
2. Python – data engineering/ETL development
3. SQL – advanced SQL, query optimization, data transformation
4. BigQuery – strong hands-on experience with development, optimization and data warehousing
5. Data Engineering / ETL – building and maintaining data pipelines
6. GCP data services – preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
7. Data warehousing / dimensional modeling

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
• Develop complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain reliable data integration workflows across multiple data sources.
• Perform data cleansing, validation, transformation, and quality checks.
• Analyze data and provide insights to support business and technical requirements.
• Implement and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
• Troubleshoot data pipeline failures, performance issues, and production incidents.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
• Follow best practices for version control, testing, documentation, and deployment.
• Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

• 5–7 years of hands-on experience in Data Engineering.
• Strong programming skills in Python.
• Strong expertise in Advanced SQL and database concepts.
• Hands-on experience with ETL/ELT processes and data pipelines.
• Good understanding of Data Warehousing and Data Modeling concepts.
• Experience with CI/CD practices and tools.
• Strong understanding of DevOps principles, automation, and deployment processes.
• Strong data analytics and problem-solving skills.
• Experience working with large datasets and performance optimization.
• Good understanding of Git/version control and software development best practices.

Good to Have

• Hands-on experience with Google Cloud Platform (GCP).
• Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
• Experience with containerization/orchestration technologies such as Docker/Kubernetes.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

• Strong analytical and problem-solving abilities.
• Good communication and stakeholder management skills.
• Ability to work independently as well as in a collaborative team environment.
• Strong ownership of data pipelines and production systems.
• Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

🚨 Hiring: GCP Data Engineer

We are looking for experienced GCP Data Engineers to join our team!

🔹 Experience: 9+ Years

🔹 Relevant Experience: 4+ Years in GCP Data Engineering

🔹 Required Skills: GCP, Oracle PL/SQL, Python, PySpark

🔹 Location: Bangalore / Hyderabad

🔹 Notice Period: Immediate to 10 Days Preferred

Key Skills:

🔹 Strong hands-on experience in GCP Data Engineering

🔹 Good experience with PySpark & Python

🔹 Strong knowledge of Oracle PL/SQL

🔹 Experience in data processing, ETL, and data pipelines

🔹 Good understanding of cloud-based data engineering

📩 Interested candidates can share their updated CV via DM.

#Hiring #GCPDataEngineer #GCP #DataEngineering #PySpark #Python #OraclePLSQL #DataEngineer #BangaloreJobs #HyderabadJobs #ImmediateJoiner #TechJobs #ITJobs #HiringNow

Data Engineer – Contract Opportunity

We are looking for an experienced Data Engineer with 5+ years of experience to work on subscriber activation, churn, FTE, and future reporting requirements.

Key Responsibilities:

• Work on data requirements related to Subscriber Activation, Churn, FTE, and future reporting.
• Work with BigQuery as the centralized data warehouse.
• Develop and maintain data ingestion and integration pipelines across multiple source systems.
• Design and implement ETL/ELT processes.
• Develop data models for reporting and analytics.
• Integrate BigQuery with Power BI or similar reporting tools.

Required Skills:

• Strong hands-on experience with GCP & BigQuery
• Data warehouse architecture, design, and implementation
• Data ingestion/integration across multiple source systems
• ETL/ELT and data pipeline development
• Data modelling for reporting and analytics
• Experience integrating BigQuery with Power BI or similar reporting tools

Contract: 1 month initially, with potential extension

Compensation: ₹6–7 LPA

Work Mode: Remote

Important

Since this is only a 1-month contract, mention “Potential extension” rather than saying it will definitely be extended.

GCP Data Engineering Lead

Experience: 9+ Years

Lead Experience: 2+ Years

Location: Bangalore / Hyderabad

Key Skills:

• Strong experience in GCP Data Engineering and BigQuery
• Hands-on experience with Oracle Exadata / PL-SQL
• Strong knowledge of PySpark / Scala and Python
• Experience with GoldenGate, Kafka and CDC
• Hands-on experience with Apache Airflow
• Good experience in CI/CD and DevOps practices
• Experience with Terraform / Infrastructure as Code
• Exposure to AI/LLM technologies and GenAI solutions
• Strong understanding of data architecture, ETL/ELT and data pipelines

Roles & Responsibilities:

• Lead the design and development of scalable GCP data engineering solutions.
• Design and implement batch and real-time data pipelines using BigQuery, PySpark, Kafka/CDC and Airflow.
• Work with Oracle Exadata/PL-SQL and GoldenGate for data integration and migration.
• Implement CI/CD pipelines and infrastructure automation using Terraform.
• Explore and integrate AI/LLM capabilities into data engineering solutions.
• Lead technical discussions, code reviews, solution design and mentor team members.
• Collaborate with business and technical teams to deliver high-quality data solutions.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

Urgent Hiring – Senior Data Engineer

We are hiring for a Senior Data Engineer for a reputed product-based company in Pune.

Location: Pune – Magarpatta / Baner

Experience: 7–10 Years

Work Mode: 5 Days WFO

Notice Period: Immediate to 30 Days preferred

What We're Looking For

• 7+ years of hands-on experience in Data Engineering
• 5+ years of experience in Python
• 4+ years of experience in Snowflake
• 5+ years of experience in SQL
• 5+ years of experience with ADF / Fivetran / Matillion or equivalent Data Integration tools
• Hands-on experience with AWS / Azure
• Experience with Airflow or equivalent orchestration tools
• Strong experience in ETL/ELT and Data Pipelines
• Experience with APIs, JSON, XML and Webhooks
• Knowledge of CI/CD, Git and automated testing
• Exposure to dbt or similar transformation tools
• Experience in data pipeline monitoring, troubleshooting and performance optimization

Key Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines
• Build batch, real-time and on-demand data processing workflows
• Integrate data from cloud and on-premise sources
• Ensure data quality, reliability, performance and SLA adherence
• Work closely with Data Scientists, Analysts, DevOps and Business teams
• Implement data engineering best practices, CI/CD and automated testing
• Troubleshoot pipeline issues and perform root cause analysis
• Optimize data pipelines and SQL queries for performance and cost efficiency

Why Join?

• Opportunity to work with a reputed product-based organization
• Work on modern data engineering and cloud technologies
• Exposure to large-scale data platforms and business-critical data solutions
• Collaborative and technically strong environment

Interested candidates can share their updated CV for immediate consideration.