Data Engineer

Role Overview

We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on GCP.
• Build, optimize, and maintain data solutions using Google BigQuery.
• Develop complex SQL queries for data transformation, aggregation, and analysis.
• Design efficient data models and optimize pipelines for performance, scalability, and cost.
• Integrate data from multiple sources and ensure data quality, reliability, and availability.
• Troubleshoot pipeline and data issues and drive continuous improvement.
• Collaborate with data architects, analysts, application teams, and business stakeholders.
• Follow best practices for cloud security, data governance, testing, and documentation.

Required Skills

• 8+ years of Data Engineering experience
• Strong hands-on experience with GCP, Django, and MongoDB
• Extensive experience with BigQuery
• Advanced SQL skills
• Strong understanding of ETL/ELT and data pipeline development
• Data modeling and data warehousing experience
• Experience handling large-scale datasets and performance optimization
• Strong problem-solving and communication skills

Good to Have

• GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
• Python or other data engineering languages
• Experience with data governance and security
• Agile development experience

Experience: 6+ years overall Data Engineering experience.

Must-have — candidates should have hands-on experience in ALL of these:

1. GCP (Google Cloud Platform) – strong hands-on experience
2. Python – data engineering/ETL development
3. SQL – advanced SQL, query optimization, data transformation
4. BigQuery – strong hands-on experience with development, optimization and data warehousing
5. Data Engineering / ETL – building and maintaining data pipelines
6. GCP data services – preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
7. Data warehousing / dimensional modeling

GCP Data Engineer

Job Description

Experience: 4-10 Years Location: Bangalore, India Employment:

Role Overview

We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.

Key Responsibilities

• Design, develop and maintain scalable batch and real-time data pipelines on GCP.

• Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.

• Design end-to-end data integration flows across systems.

• Design scalable fact/dimension schemas in cloud data warehouses.

• Handle structured, semi-structured and unstructured data at scale.

• Implement data quality checks, security and compliance policies; protect sensitive information.

• Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.

• Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.

Technical Skills

• GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.

• Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.

• CI/CD: Deployment using GitHub Actions and Jenkins.

• Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.

• Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.

Qualifications

• Bachelor's degree in Computer Science, IT, Engineering or a related field.

• 4-10 years of data engineering experience with hands-on GCP delivery.

• Strong problem-solving, communication and stakeholder management skills.

• GCP Professional Data Engineer certification preferred.

Sourcing Preference

• Priority 1: Internal profiles (TCSers).

• Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.

Desirable Skills:

Keyword:

Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud

Experience Required: 6-8

🚨 Hiring: GCP Data Engineer

We are looking for experienced GCP Data Engineers to join our team!

🔹 Experience: 9+ Years

🔹 Relevant Experience: 4+ Years in GCP Data Engineering

🔹 Required Skills: GCP, Oracle PL/SQL, Python, PySpark

🔹 Location: Bangalore / Hyderabad

🔹 Notice Period: Immediate to 10 Days Preferred

Key Skills:

🔹 Strong hands-on experience in GCP Data Engineering

🔹 Good experience with PySpark & Python

🔹 Strong knowledge of Oracle PL/SQL

🔹 Experience in data processing, ETL, and data pipelines

🔹 Good understanding of cloud-based data engineering

📩 Interested candidates can share their updated CV via DM.

#Hiring #GCPDataEngineer #GCP #DataEngineering #PySpark #Python #OraclePLSQL #DataEngineer #BangaloreJobs #HyderabadJobs #ImmediateJoiner #TechJobs #ITJobs #HiringNow

🚀 Hiring: Senior GCP Data Engineer

We are looking for experienced Senior Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), Python, PySpark, and SQL. Candidates with team lead experience will be preferred.

📌 Job Details:

• Role: Senior GCP Data Engineer
• Experience: 8+ Years
• Budget: Up to ₹30 LPA
• Location: Bangalore / Hyderabad
• Relocation: Candidates from Chennai and Pune willing to relocate are welcome.
• Notice Period: Immediate to 15 days
• Interview Process: L1 – Virtual | L2 / DM – Face-to-Face (F2F)

💻 Required Technical Skills:

• Strong hands-on experience with GCP data engineering.
• Excellent proficiency in Python, PySpark, and SQL.
• Experience in designing, developing, and optimizing data pipelines.
• Good understanding of ETL/ELT processes and large-scale data processing.
• Experience working with cloud-based data platforms and data warehousing.
• Strong analytical, problem-solving, and communication skills.

⭐ Preferred Skills:

• Previous experience as a Technical Lead or leading a data engineering team.
• Knowledge of GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Storage.

Job Title : Senior Data Engineer – GCP & Apache Spark

Job Details :

• Number of Positions : 3
• Employment Type : Contract-to-Hire (C2H)
• Experience Required : 5 to 8 Years
• Location : Manyata Tech Park, Bengaluru
• Work Mode : Hybrid – 3 Days in Office per Week
• Preferred Notice Period : Immediate to 15–20 Days
• Project Duration : Initially 6–8 months, with a strong possibility of extension for long-term projects
• Relocation : Candidates from outside Bengaluru can apply if they are willing to relocate.

Role Overview :

We are looking for experienced Senior Data Engineers with strong expertise in Google Cloud Platform (GCP), Apache Spark, BigQuery, and SQL to design, develop, and maintain scalable data pipelines and distributed data processing solutions.

The ideal candidate should have hands-on experience with cloud-based data engineering, end-to-end pipeline architecture, system design, performance optimization, debugging, and CI/CD practices.

Mandatory skills :

Apache Spark (PySpark / Scala), SQL, GCP, BigQuery, GCP Dataproc, Data Pipelines, System Design, CI/CD, Debugging & Problem-Solving.

Key Responsibilities :

• Design, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and/or Scala.
• Build and optimize batch and distributed data processing workflows on GCP.
• Work extensively with BigQuery for data transformation, validation, analytics, and query optimization.
• Develop and maintain data workflows using GCP services, including Dataproc, BigQuery, and Cloud Storage.
• Design end-to-end data pipeline architectures with a focus on scalability, reliability, and performance.
• Write and optimize complex SQL queries for large-scale datasets.
• Troubleshoot and resolve data processing issues, pipeline failures, and performance bottlenecks.
• Implement CI/CD practices for data engineering workflows, testing, and deployments.
• Monitor pipeline performance and identify opportunities for continuous improvement.
• Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
• Participate in code reviews, testing, production deployments, and production support.

Mandatory Skills :

• Strong hands-on experience with Apache Spark, including PySpark and/or Scala.
• Strong SQL skills and experience working with large-scale datasets.
• Hands-on experience with Google Cloud Platform (GCP).
• Practical experience with BigQuery and data warehousing concepts.
• Working knowledge of GCP Dataproc.
• Strong understanding of data pipelines, end-to-end workflows, and system design.
• Practical experience with CI/CD and deployment processes.
• Excellent debugging, troubleshooting, and problem-solving skills.

Preferred Skills :

• Experience with Apache Airflow, Google Cloud Composer, or similar orchestration tools.
• Knowledge of Kafka or other streaming and messaging technologies.
• Proficiency in Python for data engineering and automation.
• Experience with Git-based development workflows.
• Knowledge of Linux/Unix environments and shell scripting.
• Familiarity with monitoring, logging, data quality, and governance practices.

Required Qualifications :

• 5 to 8 years of experience in Data Engineering, Big Data Engineering, or a related field.
• Proven experience developing and maintaining scalable data pipelines.
• Strong understanding of distributed data processing and cloud-based data architecture.
• Ability to troubleshoot complex technical issues and optimize pipeline performance.
• Strong communication, collaboration, and ownership skills.

Interview Process :

Round 1 : AI-Based Interview

• Candidates must complete the AI interview as soon as possible after receiving the invitation.

Round 2 : Virtual Interview Drive

• Interviews are planned for the upcoming drive; exact dates will be communicated separately.

Round 3 : Online Client Interview

• Shortlisted candidates will attend the online interview.
• Candidates must be available throughout the day on the scheduled interview date.

Job Summary

We are seeking a highly skilled GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), Python, ETL, and modern data engineering technologies. The ideal candidate should have hands-on experience designing and building scalable data pipelines using BigQuery, Dataflow, Pub/Sub, Airflow, and modern data lake technologies such as Apache Iceberg or Delta Lake.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform.
• Build and optimize data processing workflows using Python and Google Cloud Dataflow (Apache Beam).
• Develop and manage large-scale analytical data models in BigQuery.
• Implement event-driven data ingestion using Google Cloud Pub/Sub.
• Create, schedule, and monitor workflows using Apache Airflow and Autosys.
• Design and implement modern data lake architectures using Apache Iceberg or Delta Lake.
• Optimize query performance, storage, and compute costs in GCP.
• Ensure data quality, governance, security, and compliance across data platforms.
• Collaborate with Data Scientists, Analysts, and Application teams to deliver scalable data solutions.
• Troubleshoot production issues and continuously improve pipeline reliability and performance.

Mandatory Skills

• Strong hands-on experience with Google Cloud Platform (GCP).
• Proficiency in Python programming.
• Experience in designing and implementing ETL/ELT pipelines.
• Strong knowledge of BigQuery.
• Experience with Google Cloud Dataflow (Apache Beam).
• Experience with Google Cloud Pub/Sub.
• Hands-on experience with Apache Airflow.
• Experience in job scheduling using Autosys.
• Experience with modern table formats such as Apache Iceberg or Delta Lake.
• Strong SQL and data modeling skills.

Preferred Skills

• Experience with Cloud Storage, Dataproc, Cloud Composer, and Cloud Functions.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with Docker and Kubernetes.
• Familiarity with Git and Agile/Scrum methodologies.
• Knowledge of data warehousing and dimensional modeling.
• Exposure to streaming and real-time data processing.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 4–8+ years of experience in Data Engineering with hands-on expertise in GCP technologies.

Required Experience

• Strong experience in developing enterprise-grade data pipelines using Python and GCP.
• Hands-on experience with BigQuery, Dataflow, Pub/Sub, and Airflow.
• Experience scheduling and monitoring batch workflows using Autosys.
• Experience implementing modern data lake architectures using Apache Iceberg or Delta Lake.
• Strong understanding of ETL best practices, performance tuning, and data optimization.
• Excellent analytical, troubleshooting, and problem-solving skills.

Mandatory Skills

• Google Cloud Platform (GCP)
• Python
• ETL
• BigQuery
• Autosys
• Apache Airflow
• Google Cloud Pub/Sub
• Google Cloud Dataflow (Apache Beam)
• Apache Iceberg / Delta Lake
• SQL & Data Modeling

GCP Data Engineer

Job Description

Experience: 4-10 Years Location: Bangalore, India Employment:

Role Overview

We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.

Key Responsibilities

• Design, develop and maintain scalable batch and real-time data pipelines on GCP.

• Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.

• Design end-to-end data integration flows across systems.

• Design scalable fact/dimension schemas in cloud data warehouses.

• Handle structured, semi-structured and unstructured data at scale.

• Implement data quality checks, security and compliance policies; protect sensitive information.

• Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.

• Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.

Technical Skills

• GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.

• Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.

• CI/CD: Deployment using GitHub Actions and Jenkins.

• Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.

• Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.

Qualifications

• Bachelor's degree in Computer Science, IT, Engineering or a related field.

• 4-10 years of data engineering experience with hands-on GCP delivery.

• Strong problem-solving, communication and stakeholder management skills.

• GCP Professional Data Engineer certification preferred.

Sourcing Preference

• Priority 1: Internal profiles (TCSers).

• Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.

Desirable Skills:

Keyword:

Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud

Experience Required: 6-8

About Solutionara

Solutionara is an AI-led IT Consulting and Technology Services organization delivering enterprise transformation through Cloud, Integration, Data Engineering, Digital Experience, AI, and Enterprise Applications.

Headquartered in the United States with a Global Delivery Center (GDC) in Noida, India, Solutionara partners with enterprise organizations across retail, manufacturing, distribution, consumer goods, and other industries to design, implement, and support scalable technology solutions.

As a rapidly growing consulting organization, we foster a culture of ownership, innovation, collaboration, and continuous improvement, empowering our teams to contribute beyond their immediate responsibilities while delivering exceptional value to our global clients.

Every team member is expected to think like a consultant and business problem solver—understanding client objectives, challenging assumptions when appropriate, leveraging AI responsibly, and continuously identifying opportunities to improve quality, productivity, and customer outcomes.

AI is embedded into how we work, but it is an enabler—not a replacement for expertise, critical thinking, or accountability.

Role Overview

Solutionara is seeking a Senior Data Engineer with strong data engineering and database expertise to design, build, optimize, and support enterprise-scale data solutions.

This is a hands-on engineering position requiring strong SQL, Python, ETL/ELT, database, cloud, and troubleshooting capabilities. The engineer will work closely with technical leads and client stakeholders while taking ownership of major engineering components.

Location: Noida, India – Onsite | Employment Type: Full-Time | Experience: 6–9 Years

Key Responsibilities

Data Engineering

• Design, develop, test, deploy, and support scalable ETL/ELT pipelines.
• Build ingestion and transformation solutions across databases, APIs, files, and enterprise applications.
• Develop high-quality SQL and Python-based data processing solutions.
• Implement batch and incremental data-processing patterns.
• Develop reusable engineering components and frameworks.
• Support complex data migration and transformation activities.
• Perform source-to-target mapping and technical data analysis.
• Implement pipeline logging, monitoring, exception handling, and recovery mechanisms.

Database & Platform Engineering

• Design and optimize relational database schemas and data structures.
• Analyze and improve SQL/query performance.
• Support indexing, partitioning, storage optimization, and database performance.
• Implement appropriate database security and access controls.
• Support database monitoring, availability, backup/recovery, and operational requirements in collaboration with infrastructure/platform teams.
• Troubleshoot database and pipeline performance issues.
• Contribute to cloud data-platform configuration and optimization.

Data Quality

• Implement automated validation and data-quality controls.
• Develop reconciliation processes between source and target systems.
• Identify duplicate, incomplete, inconsistent, and invalid data.
• Implement cleansing, standardization, validation, and exception-management logic.
• Work with technical and business stakeholders to understand and implement business data rules.

Technical Delivery

• Convert technical designs into reliable production solutions.
• Participate in technical design and code reviews.
• Mentor junior/mid-level engineers.
• Support estimation and technical planning.
• Troubleshoot complex production and integration issues.
• Collaborate with technical leads, application teams, DevOps, QA, BI, and client teams.
• Document technical designs, mappings, configurations, operational procedures, and engineering decisions.

Consulting & AI-Led Working

• Understand the business purpose behind assigned engineering requirements.
• Raise risks, assumptions, dependencies, and potential improvements proactively.
• Communicate effectively with client and internal stakeholders.
• Use AI-assisted tools to improve coding, testing, analysis, documentation, and troubleshooting productivity.
• Independently verify AI-generated code and recommendations before implementation.
• Identify opportunities for engineering automation and process improvement.

Required Qualifications

• 6–9 years of experience in data engineering, database engineering, data integration, or related areas.
• Advanced SQL skills.
• Strong hands-on Python experience.
• Strong ETL/ELT development experience.
• Strong relational database knowledge, such as SQL Server, PostgreSQL, Oracle, or equivalent.
• Experience with data modeling and database design.
• Experience with AWS, Azure, or another major cloud platform.
• Experience with modern data technologies such as Databricks, Snowflake, Redshift, Synapse, Glue, ADF, Airflow, dbt, or equivalent.
• Experience with performance tuning and optimization.
• Experience with data validation and reconciliation.
• Strong troubleshooting and analytical skills.
• Ability to take ownership of engineering deliverables with limited supervision.

Preferred Qualifications

• Experience working with enterprise ERP, CRM, PIM, PLM, MES, or related systems.
• Experience with manufacturing, retail, distribution, or consumer-goods data.
• Experience with CI/CD and infrastructure/platform engineering practices.
• Experience with API and event-driven integrations.
• Previous consulting or technology-services experience.

What Success Looks Like

• Pipelines and databases perform reliably at enterprise scale.
• Engineering solutions are maintainable, reusable, and well documented.
• Data issues are detected and addressed systematically.
• Junior engineers receive effective technical guidance.
• Problems are owned through resolution rather than simply escalated.
• Engineering decisions reflect both technical requirements and client business objectives.

GCP Data engineer

Exp 9+yrs

Bangalore/Hyderabad

Lead exp+ Python + pyspark + sql or plsql

immediate to 15days joiners

Call or WhatsApp: 6 3 8 5 0 7 6 1 4 2