Senior GCP Data Lead at Arahas Technologies Ā· Pune Ā· 3 - 8 years Ā· ā¹10L - ā¹20L / yr Ā· Profitable Ā· Posted 29 Jul 2024

Role Description
This is a full-time hybrid role as a GCP Data Engineer,. As a GCP Data Engineer, you will be responsible for managing large sets of structured and unstructured data and developing processes to convert data into insights, information, and knowledge.
Skill Name: GCP Data Engineer
Experience: 7-10 years
Notice Period: 0-15 days
Location :-Pune
If you have a passion for data engineering and possess the following , we would love to hear from you:
š¹ 7 to 10 years of experience working on Software Development Life Cycle (SDLC)
š¹ At least 4+ years of experience in Google Cloud platform, with a focus on Big Query
š¹ Proficiency in Java and Python, along with experience in Google Cloud SDK & API Scripting
š¹ Experience in the Finance/Revenue domain would be considered an added advantage
š¹ Familiarity with GCP Migration activities and the DBT Tool would also be beneficial
You will play a crucial role in developing and maintaining our data infrastructure on the Google Cloud platform.
Your expertise in SDLC, Big Query, Java, Python, and Google Cloud SDK & API Scripting will be instrumental in ensuring the smooth operation of our data systems..
Join our dynamic team and contribute to our mission of harnessing the power of data to make informed business decisions.

About Arahas Technologies
About
Similar jobs (10)
GCP Data Engineer
Job Description
Experience: 4-10 Years Location: Bangalore, India Employment:
Role Overview
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
⢠Design, develop and maintain scalable batch and real-time data pipelines on GCP.
⢠Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
⢠Design end-to-end data integration flows across systems.
⢠Design scalable fact/dimension schemas in cloud data warehouses.
⢠Handle structured, semi-structured and unstructured data at scale.
⢠Implement data quality checks, security and compliance policies; protect sensitive information.
⢠Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
⢠Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
⢠GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
⢠Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
⢠CI/CD: Deployment using GitHub Actions and Jenkins.
⢠Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
⢠Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
⢠Bachelor's degree in Computer Science, IT, Engineering or a related field.
⢠4-10 years of data engineering experience with hands-on GCP delivery.
⢠Strong problem-solving, communication and stakeholder management skills.
⢠GCP Professional Data Engineer certification preferred.
Sourcing Preference
⢠Priority 1: Internal profiles (TCSers).
⢠Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud
Experience Required: 6-8
Job Description ā Senior GCP Data Engineer
Position: Senior GCP Data Engineer
Experience: 8+ Years
Budget: Up to 30 LPA
Location: Bangalore / Hyderabad
Relocation: Candidates from Chennai / Pune willing to relocate are also welcome.
Notice Period: Immediate to 15 Days
Interview Process:
- Round 1: Virtual Interview
- Round 2 / DM Round: Face-to-Face Interview
Required Skills
- Strong hands-on experience in GCP Data Engineering.
- Good programming experience in Python.
- Strong experience with PySpark / Apache Spark.
- Proficiency in SQL and database concepts.
- Experience in developing and maintaining data pipelines.
- Good understanding of data processing, transformation, and integration.
- Experience in handling large-scale data processing.
- Strong problem-solving and debugging skills.
- Good understanding of cloud-based data engineering concepts.
- Experience in optimizing data pipelines for performance and scalability.
Preferred Skills
- Previous experience in a Lead Data Engineer role.
- Experience in technical leadership, mentoring, and guiding team members.
- Ability to collaborate with cross-functional teams and deliver data engineering solutions.
Roles & Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP.
- Develop data processing and transformation workflows using Python and PySpark.
- Write and optimize SQL queries for efficient data processing.
- Build and maintain reliable data engineering solutions.
- Troubleshoot data pipeline issues and optimize performance.
- Ensure data quality, reliability, and scalability.
- Collaborate with stakeholders and team members to deliver project requirements.
- Lead and guide team members where applicable.
- Important: Candidates must have strong Senior Data Engineer experience. Lead experience is preferred but not mandatory.
Role Overview
We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.
Key Responsibilities
- Design and develop scalable data pipelines and ETL/ELT processes on GCP.
- Build, optimize, and maintain data solutions using Google BigQuery.
- Develop complex SQL queries for data transformation, aggregation, and analysis.
- Design efficient data models and optimize pipelines for performance, scalability, and cost.
- Integrate data from multiple sources and ensure data quality, reliability, and availability.
- Troubleshoot pipeline and data issues and drive continuous improvement.
- Collaborate with data architects, analysts, application teams, and business stakeholders.
- Follow best practices for cloud security, data governance, testing, and documentation.
Required Skills
- 8+ years of Data Engineering experience
- Strong hands-on experience with GCP, Django, and MongoDB
- Extensive experience with BigQuery
- Advanced SQL skills
- Strong understanding of ETL/ELT and data pipeline development
- Data modeling and data warehousing experience
- Experience handling large-scale datasets and performance optimization
- Strong problem-solving and communication skills
Good to Have
- GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
- Python or other data engineering languages
- Experience with data governance and security
- Agile development experience
Experience: 5+ Years
Employment Type: Full-Time
Role Overview
We are looking for an experienced GCP Data Engineer with 5+ years of experience in data engineering and strong hands-on expertise in Google BigQuery, Google Cloud Storage (GCS), Airflow/Cloud Composer, Python, and Vertex AI. The candidate should be capable of designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on Google Cloud Platform.
Key Skills ā Mandatory
- BigQuery ā Strong hands-on experience in data warehousing, SQL, optimization, and performance tuning.
- Google Cloud Storage (GCS) ā Experience with data storage, file management, and integration with data pipelines.
- Airflow / Cloud Composer ā Experience in developing, scheduling, monitoring, and managing data workflows.
- Python ā Strong programming skills for data engineering, ETL/ELT development, automation, and pipeline implementation.
- Vertex AI ā Experience working with ML/AI workflows, model integration, or data pipelines supporting AI/ML solutions.
Good to Have / Added Advantage
- Dataproc ā Experience with distributed data processing and Spark-based workloads.
- Cloud Data Fusion ā Experience in building and managing data integration pipelines.
- Cloud Run ā Understanding of deploying and running containerized applications/services on GCP.
- Experience with ETL/ELT processes and data pipeline development.
- Knowledge of GCP data architecture and cloud-native services.
- Experience in data quality, validation, monitoring, and troubleshooting.
Responsibilities
- Design, develop, and maintain scalable GCP-based data pipelines.
- Build and optimize data solutions using BigQuery and Cloud Storage.
- Develop and manage workflows using Airflow / Cloud Composer.
- Write efficient and reusable Python code for data processing and automation.
- Support Vertex AI integrations and AI/ML data workflows.
- Monitor pipeline performance and troubleshoot data processing issues.
- Work with cross-functional teams to understand data requirements and deliver reliable solutions.
- Implement best practices for data security, quality, scalability, and performance.
You must have :
- 5+ years of overall experience in Data Engineering.
- Strong hands-on experience with BigQuery, GCS, Airflow/Cloud Composer, Python, and Vertex AI.
- Strong understanding of data engineering concepts, ETL/ELT, data pipelines, and cloud technologies.
- Dataproc, Data Fusion, and Cloud Run experience will be an added advantage.
GCP Data engineer (L1 virtual, L2 or DM F2F )
GCP + Python + Pyspark + sql + Lead
8+yrs
Bangalore/hyderabad location ( relocation profiles also from Chennai pune location)
immediate to 15days
š Hiring: Senior GCP Data Engineer
We are looking for experienced Senior Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), Python, PySpark, and SQL. Candidates with team lead experience will be preferred.
š Job Details:
- Role: Senior GCP Data Engineer
- Experience: 8+ Years
- Budget: Up to ā¹30 LPA
- Location: Bangalore / Hyderabad
- Relocation: Candidates from Chennai and Pune willing to relocate are welcome.
- Notice Period: Immediate to 15 days
- Interview Process: L1 ā Virtual | L2 / DM ā Face-to-Face (F2F)
š» Required Technical Skills:
- Strong hands-on experience with GCP data engineering.
- Excellent proficiency in Python, PySpark, and SQL.
- Experience in designing, developing, and optimizing data pipelines.
- Good understanding of ETL/ELT processes and large-scale data processing.
- Experience working with cloud-based data platforms and data warehousing.
- Strong analytical, problem-solving, and communication skills.
ā Preferred Skills:
- Previous experience as a Technical Lead or leading a data engineering team.
- Knowledge of GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Storage.
GCP Data Engineer
Job Description
Experience: 4-10 Years Location: Bangalore, India Employment:
Role Overview
We are seeking a GCP Data Engineer to design, build and maintain data systems on Google Cloud Platform. The role focuses on building pipelines with BigQuery, Dataflow and Pub/Sub, managing cloud storage, and enabling real-time data processing for fast, reliable analytics.
Key Responsibilities
⢠Design, develop and maintain scalable batch and real-time data pipelines on GCP.
⢠Build ETL/ELT pipelines with rollback strategies, bad-record handling and performance optimization.
⢠Design end-to-end data integration flows across systems.
⢠Design scalable fact/dimension schemas in cloud data warehouses.
⢠Handle structured, semi-structured and unstructured data at scale.
⢠Implement data quality checks, security and compliance policies; protect sensitive information.
⢠Optimize data systems by identifying bottlenecks, tuning queries and adopting new technologies.
⢠Collaborate with data scientists, analysts and business stakeholders to deliver tailored data solutions.
Technical Skills
⢠GCP Services: Cloud Run functions, Cloud Scheduler, Workflows, Pub/Sub, GCS, Dataflow, BigQuery, Cloud Build.
⢠Programming: Strong SQL / PL-SQL, Python and object-oriented languages (Java, Python); API development.
⢠CI/CD: Deployment using GitHub Actions and Jenkins.
⢠Data Modelling: Top-down and bottom-up database design, data masking, normalization, denormalization, dimensional modeling.
⢠Big Data & Streaming: Streaming architectures, NoSQL stores and key-value databases under high concurrency and volume.
Qualifications
⢠Bachelor's degree in Computer Science, IT, Engineering or a related field.
⢠4-10 years of data engineering experience with hands-on GCP delivery.
⢠Strong problem-solving, communication and stakeholder management skills.
⢠GCP Professional Data Engineer certification preferred.
Sourcing Preference
⢠Priority 1: Internal profiles (TCSers).
⢠Priority 2: If no suitable internal profile is identified, external candidates available for immediate joining.
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : NOSQL~Digital : Google Cloud
Experience Required: 6-8
Experience: 6+ years overall Data Engineering experience.
Must-have ā candidates should have hands-on experience in ALL of these:
- GCP (Google Cloud Platform) ā strong hands-on experience
- Python ā data engineering/ETL development
- SQL ā advanced SQL, query optimization, data transformation
- BigQuery ā strong hands-on experience with development, optimization and data warehousing
- Data Engineering / ETL ā building and maintaining data pipelines
- GCP data services ā preferably Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow, etc.
- Data warehousing / dimensional modeling
1. Company Description:
Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.
Website: www.tatvic.com
2. Role Details
- Role:Ā Lead Data Engineer
- Band:Ā L4
- Department:Ā Data Engineering
- Reporting to:Ā L5 / Head of Delivery
- Location:Ā Ahmedabad
- Job Type:Ā Full Time
- Experience:Ā 6-8 years of relevant experience
- Education:Ā Bachelorās or Masterās degree in Computer Science, Data Science, or a related technical field.
3. Mission & Role Overview
- Mission:Ā To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellenceāspecifically in BigQuery optimization and secure GCP/AWS architecturesāwhile driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
- Role Overview:Ā This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.
4. Key Responsibilities
- Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
- Build reusable data solutions and software components that serve multiple customers and use cases.
- Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
- Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
- Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
- Design and build production-grade software (APIs, services, internal tools) with sound engineering practices ā version control, testing, CI/CD, and code review.
- Extend data platforms with AI capabilities ā integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
- Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
- Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
- Document architectures, design decisions, and operations clearly and consistently.
- Coach and mentor team members, ensuring technical excellence and continuous learning.
- Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.
5. Must-Have & Good-to-Have Skills
Must-Have Skills:
- Strong understanding of clickstream data and data pipeline architecture
- Hands-on experience with cloud platforms (GCP)
- Expertise in SQL, Python, and Airflow
- Solid software engineering foundation ā API design, testing, version control, and deployment practices
- Proven ability to perform exploratory data analysis and data validation
- Knowledge of cloud security, IAM, and networking best practices
- Working knowledge of building or integrating AI/LLM-based components into existing systems
- Excellent problem-solving, stakeholder management, and communication skills
Good-to-Have Skills:
- Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
- AWS Certified Data Analytics or Azure Data Engineer Associate
- Google Analytics 4 (GAIQ)
- Experience in marketing attribution, commerce data, or analytics ecosystems
- Exposure to cost optimization and cloud resource management
- Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
- Experience building automation frameworks or internal data tools
6. Not-a-Fit Criteria
- Individual Contributor Focus:Ā Operates as the team's best individual contributor instead of building team capability or empowering L3s.
- Information Hoarding:Ā Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
- Avoidance of Conflict:Ā Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
- Activity Over Outcomes:Ā Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
- Functional Siloing:Ā Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.
Our Culture & Perks - Where Passion Meets Purpose:
- Competitive CTC:Ā Based on experience and skillset
- Medical Insurance for you and your family
- Return-to-Work Program for New Moms ā because career breaks shouldnāt break momentum
- 1 Work From Home Day/Month ā flexibility when life calls
- 2 Birthday Leaves/Year ā one for you, one for someone you love
- Monthly Engagement Activities ā from game nights to learning sessions
- Inclusive Culture & Equal Opportunity Employer ā diversity drives our innovation
- We Think Like Engineers & Athletes: we build, we iterate, we scale, we win ā together
- 5-day workweek ā because balance drives brilliance
Job Title: GCP Data Engineer
Experience: 6ā8 years
Location : Bangalore
What are they looking for?
They need a Google Cloud Platform (GCP) Data Engineer who can build and maintain data pipelines, process large volumes of data, and manage data storage using Google Cloud services.
The candidate should have hands-on experience with batch and real-time data processing, ETL workflows, and cloud data warehousing.
Mandatory / Core Skills
- Google Cloud Platform (GCP)
- Google Cloud Dataflow
- Pub/Sub
- Apache Beam
- BigQuery
- Cloud Storage / Bigtable
- Cloud Composer (Apache Airflow)
- ETL / data pipeline development
- Apache Spark / Hadoop using Dataproc
Supporting Skills
- Cloud Data Fusion
- NoSQL databases
- Data quality and governance
- Data security, access controls, and encryption
- Batch and real-time streaming
- Preparing datasets for BI, analytics, and machine learning










