Solutions Architect - Data Engineering at Searce Inc · Bengaluru (Bangalore), Pune, Mumbai · 6 - 15 years · Profitable · Posted 4 Jun 2026

Solutions Architect - Data Engineering
Modern tech solutions advisory & 'futurify' consulting as a Searce lead fds (‘forward deployed solver’) architecting scalable data platforms and robust data engineering solutions that power intelligent insights and fuel AI innovation.
If you’re a tech-savvy, consultative seller with the brain of a strategist, the heart of a builder, and the charisma of a storyteller — we’ve got a seat for you at the front of the table.
You're not a sales lead. You're the transformation driver.
What are we looking for
real solver?
Solver? Absolutely. But not the usual kind. We're searching for the architects of the audacious & the pioneers of the possible. If you're the type to dismantle assumptions, re-engineer ‘best practices,’ and build solutions that make the future possible NOW, then you're speaking our language.
- Improver. Solver. Futurist.
- Great sense of humor.
- ‘Possible. It is.’ Mindset.
- Compassionate collaborator. Bold experimenter. Tireless iterator.
- Natural creativity that doesn’t just challenge the norm, but solves to design what’s better.
- Thinks in systems. Solves at scale.
This Isn’t for Everyone. But if you’re the kind who questions why things are done a certain way— and then identifies 3 better ways to do it — we’d love to chat with you.
Your Responsibilities
what you will wake up to solve.
You are not just a Solutions Architect; you are a futurifier of our data universe and the primary enabler of our AI ambitions. With a deep-seated passion for data engineering, you will architect and build the foundational data infrastructure that powers the customers entire data intelligence ecosystem.
As the Directly Responsible Individual (DRI) for our enterprise-grade data platforms, you own the outcome, end-to-end. You are the definitive solver for our customer's most complex data challenges, leveraging a powerful tech stack including Snowflake, Databricks, etc. and core GCP & AWS services (BigQuery, Spanner, Airflow, Kafka). This is a hands-on-keys role where you won't just design solutions—you'll build them, break them, and perfect them.
- Solution Design & Pre-sales Excellence:Collaborate with cross-functional teams, including sales, engineering, and operations, to ensure successful project delivery.
- Design Core Data Engineering: Master data modeling, architecting high-performance data ingestion pipelines and ensuring data quality and governance throughout the data lifecycle.
- Enable Cloud & AI: Design and implement solutions utilizing core GCP data services, building foundational data platforms that efficiently support advanced analytics and AI/ML initiatives.
- Optimize Performance & Cost: Continuously optimize data architectures and implementations for performance, efficiency, and cost-effectiveness within the cloud environment.
- Bridge Business & Tech: Translate complex business requirements into clear technical designs, providing technical leadership and guidance to data engineering teams.
- Stay Ahead of the Curve: Continuously research and evaluate new data technologies, architectural patterns, and industry trends to keep our data platforms at the cutting edge.
Functional Skills:
- Enterprise Data Architecture Design: Expert ability to design holistic, scalable, and resilient data architectures for complex enterprise environments.
- Cloud Data Platform Strategy: Proven capability to strategize, design, and implement cloud-native data platforms.
- Pre-Sales & Technical Storyteller: Crafts compelling, client-ready proposals, architectural decks, and technical demonstrations. Doesn't just present; shapes the strategic technical narrative behind every proposed solution.
- Advanced Data Modelling: Mastery in designing various data models for analytical, operational, and transactional use cases.
- Data Ingestion & Pipeline Orchestration: Strong expertise in designing and optimizing robust data ingestion and transformation pipelines.
- Stakeholder Communication: Exceptional skills in articulating complex technical concepts and architectural decisions to both technical and non-technical stakeholders.
- Performance & Cost Optimization: Adept at optimizing data solutions for performance, efficiency, and cost within a cloud environment.
Tech Superpowers:
- Cloud Data Mastery: You're a wizard at leveraging public cloud data services, with deep expertise in GCP (BigQuery, Spanner, etc.) and expert proficiency in modern data warehouse solutions like Snowflake.
- Data Engineering Core: Highly skilled in designing, implementing, and managing data workflows using tools like Apache Airflow and Apache Kafka. You're also an authority on advanced data modeling and ETL/ELT patterns.
- AI/ML Data Foundation: You instinctively design data pipelines and structures that efficiently feed and empower Machine Learning and Artificial Intelligence applications.
- Programming for Data: You have a strong command over key programming languages (Python, SQL) for scripting, automation, and building data processing applications.
Experience & Relevance:
- Architectural Leadership (8+ Years): You bring extensive experience (7+ years) specifically in a Solutions Architect role, focused on data engineering and platform building.
- Cloud Data Expertise: You have a proven track record of designing and implementing production-grade data solutions leveraging major public cloud platforms, with significant experience in Google Cloud Platform (GCP).
- Data Warehousing & Data Platform: Demonstrated hands-on experience in the end-to-end design, implementation, and optimization of modern data warehouses and comprehensive data platforms.
- Databricks & BigQuery Mastery: You possess significant practical experience with Databricks as a core data warehouse and GCP BigQuery for analytical workloads.
- Data Ingestion & Orchestration: Proven experience designing and implementing complex data ingestion pipelines and workflow orchestration using tools like Airflow and real-time streaming technologies like Kafka.
- AI/ML Data Enablement: Experience in building data foundations specifically geared towards supporting Machine Learning and Artificial Intelligence initiatives.
Join the ‘real solvers’
ready to futurify?
If you are excited by the possibilities of what an AI-native engineering-led, modern tech consultancy can do to futurify businesses, apply here and experience the ‘Art of the possible’.
Don’t Just Send a Resume. Send a Statement.
So, If you are passionate about tech, future & what you read above (we really are!), apply here to experience the ‘Art of Possible’

About Searce Inc
About
What is ‘searce’
Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.
The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday.
What we do
Searce is a modern tech consulting firm that empowers clients to futurify their businesses, leveraging Cloud, AI & Analytics.
- We are a category defining niche’ cloud-native technology consulting company, specializing in modernizing (improve, automate & transform) the full-scope of infra, app, process & work
- We partner with clients in their ‘beyond x’ journey to drive intelligent, impactful & futuristic business outcomes
- We are the most preferred tech partner of choice when it comes to ‘solving for better’ for the new-age tech startups & digital enterprises, leading disruption in their industries
- Our Service Offerings: We offer Advanced Cloud, Data & App Modernization, Cloud Consulting, Management & Improvement (DevOps, SysOps & Cloud Managed Services), Applied AI & Analytics services
- As one of the top 5 niche’ full scope global partners for Google Cloud & a preferred partner for AWS, we are the most preferred ‘engineering-led’ tech company of choice when it comes to solving complex business problems.
Who we are
We are passionate improvers, solvers & futurists. Driven by our engineering excellence mindset, we care most about delivering intelligent, impactful & futuristic business outcomes. Searcians are motivated by continuous improvement & solving for better in everything we do.
At the core, a Searcian is self-driven to become better, everyday. In passionate pursuit of the finest degree of excellence we drive exceptional outcomes in everything we do.
We believe that trust is the most important value. We also believe that we need to ‘earn the trust’, everytime one engages with us. And earning trust for us is far more important than anything else. We aim to be the *most trusted* tech consulting partner for our clients.
We are HAPPIER at heart. Humble, Adaptable, Positive, Passionate, Innovative, Excellence focused, & Responsible. We live the HAPPIER Culture Code.
Being HAPPIER.
How we work
- Customers. Partners. Our aim is to build relationships with customers for life. And meaningfully improve the life of every customer.
- We do what we say. We say what we do. We are uncomfortably honest and transparent. Being genuine wins trust & makes people happier.
- Mistakes are encouraged. We make mistakes. Tons of those. Everyday. And we don’t mind apologizing to our juniors, peers or superiors. We are no ego-doers.
- Underpromise. Overdeliver. We work with a deep desire to go above and beyond in everything we do. Everytime.
So, If you are passionate about tech, future & what you read above (we really are!), apply here to experience the ‘Art of Possible’
Connect with the team
Similar jobs (10)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Position: Technical Architect – Data Engineering
Job Summary:
- We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
- The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
- The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.
Key Responsibilities
• Design enterprise-scale data lakehouse and data warehouse architectures.
• Define data ingestion, transformation, and serving architecture.
• Lead architecture discussions and technical governance.
• Design scalable ETL/ELT frameworks using Databricks and Snowflake.
• Define best practices for security, performance, CI/CD, and DevOps.
• Guide engineering teams on implementation.
• Collaborate with business, product, and data governance teams.
Must Have Skills :
• Azure or AWS
• Databricks
• Snowflake
• Data Lakehouse Architecture
• PySpark
• SQL
• Data Modelling
• ETL/ELT Architecture
• Performance Optimization
• CI/CD
• Terraform or Infrastructure as Code (preferred)
Preferred
• Insurance domain
• dbt
• Unity Catalog
• Delta Lake
• Iceberg
• Azure Data Factory / AWS Glue

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About the Role
You'll be at the forefront of designing and implementing robust data platform solutions that power advanced analytics, AI, and machine learning. Working with modern cloud technologies, you'll build scalable data foundations that enable clients to make smarter, data-driven decisions.
Key Responsibilities
- Build scalable data pipelines using Snowflake, AWS, GCP, and Databricks.
- Design and optimize data models for AI and machine learning workloads.
- Develop reliable data foundations for MLOps, governance, and data lineage.
- Integrate data from multiple sources into modern data platforms.
- Leverage Snowpark ML and Snowflake's native AI capabilities.
- Ensure data platforms are secure, scalable, and high-performing.
What We're Looking For
- 5+ years of hands-on experience with Snowflake.
- Strong proficiency in SQL and Python.
- Experience with AWS, Azure, or GCP.
- Knowledge of cloud storage services such as S3, ADLS, or GCS.
- Strong understanding of Dimensional Modeling and Data Vault.
- Experience with Scala or Java is a plus.
Tech Stack
- Data Warehouse: Snowflake
- Programming: SQL, Python, Scala (Good to Have), Java (Good to Have)
- Cloud: AWS, Azure, GCP
- Storage: S3, ADLS, GCS
- AI/ML: Snowpark ML, MLOps
Perks & Benefits
- Public Speaking & Communication Program
- Mentoring Program with Senior Support Leads
- 360° Progress Reviews
- Weekly Learning Sessions & Guilds
- Paid Certifications
- Hackathons & Innovation Days
- Recognition & Rewards Programs
- Team Socials & Annual Offsites
- Employee Assistance Program (24/7 Wellbeing Support)
The Data People Shaping Tomorrow
Our client helps organizations unlock the power of data through modern cloud, analytics, and AI solutions. We believe in creating an environment where talented technologists can learn, innovate, and make a real impact while building cutting-edge data platforms for global clients. If you're passionate about data engineering and want to work with the latest technologies in AI, cloud, and analytics, we'd love to hear from you.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
SENIOR DATA ENGINEER – DATABRICKS & SNOWFLAKE
Experience: 7+ Years
Location: Remote
Employment Type: Full-Time
Budget: Up to ₹30 LPA
Time Zone: US Eastern Time (ET)
Shift: US ET Night Shift
Job Description
We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Snowflake, Apache Spark, and AWS to design, develop, and maintain scalable data engineering solutions.
The candidate will work on integrating data from multiple sources, building modern data pipelines, developing enterprise data models, and preparing data platforms for AI/ML applications.
Experience in healthcare, scientific data, or the histopathology domain will be an added advantage.
Key Responsibilities
- Design, build, and maintain scalable data pipelines to acquire, integrate, and manage data from diverse sources such as laboratory systems, MES, clinical supply, quality systems, and external partners.
- Develop and optimize data workflows for structured and unstructured data using Python, PySpark, R, SQL, Databricks, and Snowflake.
- Design and maintain enterprise-level data models and data repositories.
- Perform ETL development, data warehousing, database design, and data integration.
- Ensure data quality, versioning, traceability, and consistency to support AI/ML readiness.
- Collaborate with stakeholders and technical teams to translate business requirements into technical solutions.
- Manage multiple projects while ensuring scalability, performance, and reliability.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks and Snowflake.
- Excellent knowledge of Apache Spark / PySpark.
- Strong experience with AWS cloud services and AWS RDS.
- Experience with Oracle and Microsoft SQL Server (MSSQL).
- Proficiency in Python, R, and SQL.
- Strong understanding of ETL, Data Warehousing (DWH), data modeling, and database design.
- Experience with dbt and cloud-based data architectures.
- Knowledge of NoSQL and graph databases.
- Strong analytical, problem-solving, and stakeholder-management skills.
- Good English communication skills (B2 level or above).
- Willingness to work in the US Eastern Time (ET) night shift.
Preferred / Good to Have
- Experience in histopathology, healthcare, life sciences, or scientific data environments.
- Knowledge of CDISC, HL7, FHIR, OMOP, DICOM, or other regulated data standards.
- Experience handling high-dimensional data, including imaging and sensor data.
- Familiarity with MLOps and machine learning model deployment workflows.
- Knowledge of Manufacturing Execution Systems (MES) and Laboratory Information Management Systems (LIMS).
- Exposure to knowledge graphs and ontology-driven architectures.
Education
Bachelor's degree in Engineering, Data Science, Life Sciences, Computer Science, or a related field. A master's degree is preferred.
Interested candidates can apply with their updated resumes.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Data Architect – Databricks & AWS
- Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
- Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
- Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
- Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
- Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
- Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
- Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
GCP Data engineer
Exp 9+yrs
Bangalore/Hyderabad
Lead exp+ Python + pyspark + sql or plsql
immediate to 15days joiners
Call or WhatsApp: 6 3 8 5 0 7 6 1 4 2
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Overview:
We are seeking an experienced Cloud Data Engineer to the architecture, development, Data migration, ETL pipeline in cloud and optimization of a next-generation data platform. This is a development role for an individual with over 4 years of deep data engineering and data migration, data pipeline in AWS expertise, capable of driving technical direction, and delivering high-impact solutions in a fast-paced
4+ Years of hands-on, progressive experience in Cloud Data Engineering, cloud ecosystems AWS, Data Architecture
• Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management
• Ability to translate complex business needs into actionable technical requirements.
• Strong troubleshooting and problem-solving skills in distributed systems.
• Agile/Scrum teamwork capabilities and version control practices
• Insurance industry experience preferred but not mandatory
• Tools:
o Cloud Environment: AWS (S3, IAM, VPC, Glue, Lambda etc.)
o Experience with dbt Core, Iceberg, AWS Glue Catalog, AWS lambda, Redshift, Athena, Splunk, AmazonQ, AWS streaming services, Git
o Strong SQL, Pyspark and Python
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Description: Associate Director-Data Engineering (Databricks Lakehouse Architect + Cloud Data Engineering Leader)
About our Client -
Client is a leading SAP consulting and digital transformation partner committed to delivering innovative, high-impact solutions across enterprise analytics, cloud, and intelligent business platforms.
As enterprises modernize their data landscapes, the role of traditional data warehousing is rapidly evolving into scalable cloud-native Data Lakehouse architectures. Applexus is expanding its modern data engineering capabilities to help customers integrate enterprise data from SAP and non-SAP ecosystems, build advanced analytics platforms, and enable future-ready AI-driven solutions.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
Role Overview:
We are looking for a hands-on Data Engineering leader who can architect modern cloud data platforms using Databricks Lakehouse and lead solution design, delivery, and engineering teams. This role requires strong technical ownership rather than a pure people management background.
Key Responsibilities:
• Architect scalable Data Lakehouse platforms
• Own solution design, estimation, architecture reviews and client discussions
• Build and optimize enterprise data pipelines
• Provide technical guidance to data engineering teams
• Establish best practices around performance, governance and architecture
Must Have - Databricks Architecture:
• Databricks Lakehouse design
• Delta Lake implementation
• Apache Spark / PySpark engineering
• Medallion architecture (Bronze/Silver/Gold layers)
• Data pipeline optimization
• Unity Catalog and data governance exposure
Cloud Platform Expertise (depth in one required):
Microsoft Azure:
• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Azure Synapse Analytics
OR
Amazon AWS:
• Databricks on AWS
• Amazon S3
• AWS Glue
• Redshift
• Athena
Good to Have:
• Snowflake
• ML Engineering exposure
• Cloud/Data Engineering certifications
Ideal Candidate:
A hands-on architect who can talk to customers, design solutions, estimate projects, guide engineers and review architecture while helping build a modern Data Engineering practice.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
If you are a hands-on Data Architect who enjoys building modern data platforms and wants to move beyond execution into solution ownership and leadership, I would love to connect.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
I’m a Google Cloud Data Engineer with 5+ years of experience in data engineering, ETL, and cloud data solutions. I specialize in BigQuery, Dataform, Cloud Composer (Airflow), SQL, and CI/CD automation.
I have hands-on experience building reusable Dataform frameworks, developing and orchestrating data pipelines, supporting cloud platform upgrades, implementing secure IAM access, and optimizing data transformation workflows. I’ve also worked on AI-assisted SQLX code generation to improve developer productivity and standardize development.
I’m passionate about building scalable, reliable, and efficient data solutions. I’m looking for opportunities where I can contribute my GCP expertise, solve real-world data challenges, collaborate with talented teams, and continue growing as a Data Engineer.
Core skills: Google Cloud Platform (GCP) | BigQuery | Dataform | Cloud Composer | Apache Airflow | SQL | Python | ETL | CI/CD | GitHub Actions | Dataplex
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Title : Senior Data Engineer – GCP & Apache Spark
Job Details :
- Number of Positions : 3
- Employment Type : Contract-to-Hire (C2H)
- Experience Required : 5 to 8 Years
- Location : Manyata Tech Park, Bengaluru
- Work Mode : Hybrid – 3 Days in Office per Week
- Preferred Notice Period : Immediate to 15–20 Days
- Project Duration : Initially 6–8 months, with a strong possibility of extension for long-term projects
- Relocation : Candidates from outside Bengaluru can apply if they are willing to relocate.
Role Overview :
We are looking for experienced Senior Data Engineers with strong expertise in Google Cloud Platform (GCP), Apache Spark, BigQuery, and SQL to design, develop, and maintain scalable data pipelines and distributed data processing solutions.
The ideal candidate should have hands-on experience with cloud-based data engineering, end-to-end pipeline architecture, system design, performance optimization, debugging, and CI/CD practices.
Mandatory skills :
Apache Spark (PySpark / Scala), SQL, GCP, BigQuery, GCP Dataproc, Data Pipelines, System Design, CI/CD, Debugging & Problem-Solving.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and/or Scala.
- Build and optimize batch and distributed data processing workflows on GCP.
- Work extensively with BigQuery for data transformation, validation, analytics, and query optimization.
- Develop and maintain data workflows using GCP services, including Dataproc, BigQuery, and Cloud Storage.
- Design end-to-end data pipeline architectures with a focus on scalability, reliability, and performance.
- Write and optimize complex SQL queries for large-scale datasets.
- Troubleshoot and resolve data processing issues, pipeline failures, and performance bottlenecks.
- Implement CI/CD practices for data engineering workflows, testing, and deployments.
- Monitor pipeline performance and identify opportunities for continuous improvement.
- Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
- Participate in code reviews, testing, production deployments, and production support.
Mandatory Skills :
- Strong hands-on experience with Apache Spark, including PySpark and/or Scala.
- Strong SQL skills and experience working with large-scale datasets.
- Hands-on experience with Google Cloud Platform (GCP).
- Practical experience with BigQuery and data warehousing concepts.
- Working knowledge of GCP Dataproc.
- Strong understanding of data pipelines, end-to-end workflows, and system design.
- Practical experience with CI/CD and deployment processes.
- Excellent debugging, troubleshooting, and problem-solving skills.
Preferred Skills :
- Experience with Apache Airflow, Google Cloud Composer, or similar orchestration tools.
- Knowledge of Kafka or other streaming and messaging technologies.
- Proficiency in Python for data engineering and automation.
- Experience with Git-based development workflows.
- Knowledge of Linux/Unix environments and shell scripting.
- Familiarity with monitoring, logging, data quality, and governance practices.
Required Qualifications :
- 5 to 8 years of experience in Data Engineering, Big Data Engineering, or a related field.
- Proven experience developing and maintaining scalable data pipelines.
- Strong understanding of distributed data processing and cloud-based data architecture.
- Ability to troubleshoot complex technical issues and optimize pipeline performance.
- Strong communication, collaboration, and ownership skills.
Interview Process :
Round 1 : AI-Based Interview
- Candidates must complete the AI interview as soon as possible after receiving the invitation.
Round 2 : Virtual Interview Drive
- Interviews are planned for the upcoming drive; exact dates will be communicated separately.
Round 3 : Online Client Interview
- Shortlisted candidates will attend the online interview.
- Candidates must be available throughout the day on the scheduled interview date.











