Lead Data Architect

1. Company Description:

Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.

Website: www.tatvic.com

2. Role Details

• Role: Lead Data Engineer
• Band: L4
• Department: Data Engineering
• Reporting to: L5 / Head of Delivery
• Location: Ahmedabad
• Job Type: Full Time
• Experience: 6-8 years of relevant experience
• Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.

3. Mission & Role Overview

• Mission: To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellence—specifically in BigQuery optimization and secure GCP/AWS architectures—while driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
• Role Overview: This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.

4. Key Responsibilities

• Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
• Build reusable data solutions and software components that serve multiple customers and use cases.
• Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
• Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
• Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
• Design and build production-grade software (APIs, services, internal tools) with sound engineering practices — version control, testing, CI/CD, and code review.
• Extend data platforms with AI capabilities — integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
• Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
• Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
• Document architectures, design decisions, and operations clearly and consistently.
• Coach and mentor team members, ensuring technical excellence and continuous learning.
• Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.

5. Must-Have & Good-to-Have Skills

Must-Have Skills:

• Strong understanding of clickstream data and data pipeline architecture
• Hands-on experience with cloud platforms (GCP)
• Expertise in SQL, Python, and Airflow
• Solid software engineering foundation — API design, testing, version control, and deployment practices
• Proven ability to perform exploratory data analysis and data validation
• Knowledge of cloud security, IAM, and networking best practices
• Working knowledge of building or integrating AI/LLM-based components into existing systems
• Excellent problem-solving, stakeholder management, and communication skills

Good-to-Have Skills:

• Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
• AWS Certified Data Analytics or Azure Data Engineer Associate
• Google Analytics 4 (GAIQ)
• Experience in marketing attribution, commerce data, or analytics ecosystems
• Exposure to cost optimization and cloud resource management
• Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
• Experience building automation frameworks or internal data tools

6. Not-a-Fit Criteria

• Individual Contributor Focus: Operates as the team's best individual contributor instead of building team capability or empowering L3s.
• Information Hoarding: Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
• Avoidance of Conflict: Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
• Activity Over Outcomes: Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
• Functional Siloing: Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.

Our Culture & Perks - Where Passion Meets Purpose:

• Competitive CTC: Based on experience and skillset
• Medical Insurance for you and your family
• Return-to-Work Program for New Moms — because career breaks shouldn’t break momentum
• 1 Work From Home Day/Month — flexibility when life calls
• 2 Birthday Leaves/Year — one for you, one for someone you love
• Monthly Engagement Activities — from game nights to learning sessions
• Inclusive Culture & Equal Opportunity Employer — diversity drives our innovation
• We Think Like Engineers & Athletes: we build, we iterate, we scale, we win — together
• 5-day workweek — because balance drives brilliance

Technical Lead 

Job Description 

Role Overview 

We are seeking a highly skilled Data Engineering Lead with minimum of 5 years of hands-on experience in Azure data engineering, data warehousing, and automation-driven  integration. The ideal candidate should be a proven technical lead, capable of driving end-to-end 

project delivery and working closely with customer teams. This is a Work from Office / Customer Site role. 

Roles and Responsibilities 

• Lead the design, development, and delivery of data engineering and automation projects. 

• Architect and implement ETL/ELT pipelines using Azure Data Factory. 

• Design and manage enterprise data warehouses including dimensional modeling and 

schema optimization. 

• Manage Azure components including Storage Accounts, Data Lakes, Azure SQL, and Synapse. 

• Drive automation initiatives across data ingestion and transformation workflows. 

• Collaborate with business and technical stakeholders to translate requirements into scalable solutions. 

• Mentor team members and enforce engineering best practices. 

• Serve as the technical anchor responsible for ensuring high-quality, on-time delivery. 

Skills and Qualification 

• Strong hands-on experience with Azure Data Factory, Azure Storage, Azure SQL/Synapse. 

• Deep understanding of data warehousing concepts: star/snowflake schemas, fact/dimension modeling. 

• Experience with automation-led data engineering solutions. 

• Strong troubleshooting, optimization, and analytical skills. 

• Excellent communication and stakeholder management abilities. 

• Proven experience as a Technical Lead leading teams and delivery. 

Must Have 

• Min of 5 years of relevant data engineering experience. 

• Strong Azure Data Engineering and Data Warehousing expertise. 

• Proven Technical Lead experience. 

• Ability to work from office and customer site. 

• Strong ownership mindset with a focus on quality and delivery excellence.

Solution Architect – AZURE Data Engineering

Job Overview

We are looking for an experienced Solution Architect – Data Engineering with strong expertise in designing data solutions and hands-on experience with Azure, Synapse, PySpark, Data Warehousing, and Data Lakes. The ideal candidate should have strong architectural and data engineering knowledge.

Key Responsibilities

• Design and implement scalable data architecture and solutions.
• Develop and manage Data Warehouse and Data Lake architectures.
• Design data platforms using Medallion Architecture.
• Lead Data Engineering and ETL activities.
• Work with Azure Synapse Analytics for data processing and analytics.
• Develop data solutions using PySpark / Apache Spark.
• Define and implement data validation and data quality processes.
• Collaborate with business, data, and technology teams to deliver effective data solutions.

Required Skills

• Strong experience in Solution Architecture / Data Architecture.
• Strong knowledge of Data Warehouse and Data Lake architecture.
• Good understanding of Medallion Architecture.
• Strong experience in Data Engineering and ETL.
• Hands-on experience with Microsoft Azure and Azure Synapse Analytics.
• Strong knowledge of PySpark / Apache Spark.
• Experience with Data Validation and Data Quality.
• Good communication and stakeholder management skills.
• 
  

Experience

8+ Years

Senior Data Engineer – Ab Initio | GCP | Spark | Agentic AI

Location: Bangalore

Experience: 5+ Years

Role: Senior Data Engineer

Work Mode: Bangalore

Job Summary

We are looking for an experienced Senior Data Engineer with strong expertise in Ab Initio, GCP, Apache Spark, and Agentic AI. The ideal candidate will have hands-on experience designing and developing scalable data engineering solutions, building data pipelines, and working with modern cloud and AI technologies.

The candidate should be comfortable working across traditional enterprise data platforms and emerging Generative AI / Agentic AI solutions.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines using Ab Initio, Spark, and GCP services.
• Develop and optimize complex ETL/ELT workflows using Ab Initio.
• Build and maintain data processing solutions using Apache Spark / PySpark.
• Develop cloud-based data solutions on Google Cloud Platform (GCP).
• Work with GCP data services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, or equivalent services.
• Perform data integration, transformation, cleansing, and validation.
• Optimize data pipelines for performance, scalability, reliability, and cost.
• Collaborate with data architects,
• 
  

GCP Data Engineering Lead

Experience: 9+ Years

Lead Experience: 2+ Years

Location: Bangalore / Hyderabad

Key Skills:

• Strong experience in GCP Data Engineering and BigQuery
• Hands-on experience with Oracle Exadata / PL-SQL
• Strong knowledge of PySpark / Scala and Python
• Experience with GoldenGate, Kafka and CDC
• Hands-on experience with Apache Airflow
• Good experience in CI/CD and DevOps practices
• Experience with Terraform / Infrastructure as Code
• Exposure to AI/LLM technologies and GenAI solutions
• Strong understanding of data architecture, ETL/ELT and data pipelines

Roles & Responsibilities:

• Lead the design and development of scalable GCP data engineering solutions.
• Design and implement batch and real-time data pipelines using BigQuery, PySpark, Kafka/CDC and Airflow.
• Work with Oracle Exadata/PL-SQL and GoldenGate for data integration and migration.
• Implement CI/CD pipelines and infrastructure automation using Terraform.
• Explore and integrate AI/LLM capabilities into data engineering solutions.
• Lead technical discussions, code reviews, solution design and mentor team members.
• Collaborate with business and technical teams to deliver high-quality data solutions.

We are looking for a Lead Data Architect to design, build, and scale our data pipelines and entity resolution systems. This role combines deep technical expertise in data engineering with hands-on experience in AI-assisted tooling, entity matching, and data integration from diverse sources. You will lead architectural decisions for our data platform, mentor engineers, and ensure our pipelines are reliable, scalable, and production-grade.

Key Responsibilities

     Architect, build, and maintain robust, scalable data pipelines that ingest, transform, and serve data from multiple internal and external sources.

     Own the end-to-end orchestration of data workflows using tools like Dagster, ensuring observability, reliability, and maintainability of pipelines.

     Design and implement entity resolution workflows — including matching, merging, and survivorship logic — using tools such as Splink, to produce clean, deduplicated, golden records.

     Build and maintain web scrapers to source data from external providers, ensuring resilience to source changes, rate limits, and data quality issues.

     Integrate and reconcile data coming from multiple, often inconsistent, sources into unified, trustworthy datasets.

     Design and maintain data models and schemas across transactional and analytical systems, ensuring consistency, scalability, and performance.

     Leverage AI/LLM-based tools and techniques to enhance data pipeline capabilities — e.g., intelligent data extraction, automated data quality checks, or AI-assisted entity matching.

     Define and enforce best practices around pipeline design, testing, monitoring, and documentation.

     Collaborate closely with data engineers, product managers, and other stakeholders to translate business requirements into scalable data architecture.

     Provide technical leadership and mentorship to the data engineering team.

Required Skills & Experience

     Strong hands-on experience building and maintaining production-grade data pipelines at scale.

     Practical experience with Dagster (or similar orchestration tools like Airflow/Prefect) for pipeline orchestration.

     Experience with Splink or similar probabilistic/deterministic record linkage tools for entity matching, merging, and survivorship.

     Strong proficiency in Python, including experience writing and maintaining web scrapers.

     Proven experience integrating and maintaining data pipelines that pull from multiple, heterogeneous data sources.

     Experience applying AI/ML tools within data engineering workflows (e.g., LLM-assisted data cleaning, extraction, or matching).

     Hands-on experience with relational and distributed databases such as PostgreSQL and Google Cloud Spanner.

     Strong understanding of data modeling principles (normalization, dimensional modeling, schema design) across OLTP and OLAP systems.

     Experience with cloud data warehousing platforms such as BigQuery, Redshift, and cloud platforms (GCP/AWS/Azure).

     Strong communication skills and experience working cross-functionally with engineering and product teams.

     Experience with distributed data processing frameworks (e.g., Spark, Dask).

     Familiarity with data governance, lineage, and cataloging tools.

     Prior experience in a lead or architect-level role guiding a data engineering team.

What We're Looking For

A technically strong, hands-on leader who can balance architectural thinking with the practical grit of debugging a flaky scraper or tuning a matching algorithm — someone who's comfortable owning both the big picture and the messy details of real-world data.

Next

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.

Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.

Key Responsibilities:

• Design, develop, test, and maintain optimal data pipeline and ETL architectures.
• Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
• Prepare and optimize data for predictive and prescriptive modeling.
• Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
• Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
• Utilize big data tools and frameworks to optimize data acquisition and preparation.
• Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
• Develop and curate data models for analytics, dashboards, and reports.
• Conduct code reviews, maintain production-level code, and implement testing approaches.
• Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
• Drive innovation and implement efficient new approaches to data engineering tasks.

Must-Have Skills:

• Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
• 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
• 3–5 years of experience designing and implementing data warehouse solutions.
• Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
• Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
• Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
• Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
• Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
• Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
• Strong problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience in integrating ERP data into data lakes.
• Experience with traditional ETL tools (e.g., Talend, Pentaho).

Competencies:

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
• Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
• Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
• Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
• Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.

Why Join Us?

• Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
• Work on impactful projects that make a difference across industries.
• Opportunities for professional growth and continuous learning.
• Competitive salary and benefits package.

Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!

Data Architect – Databricks & AWS

• Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
• Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
• Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
• Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
• Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
• Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
• Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.

About the Role

You'll be at the forefront of designing and implementing robust data platform solutions that power advanced analytics, AI, and machine learning. Working with modern cloud technologies, you'll build scalable data foundations that enable clients to make smarter, data-driven decisions.

Key Responsibilities

• Build scalable data pipelines using Snowflake, AWS, GCP, and Databricks.
• Design and optimize data models for AI and machine learning workloads.
• Develop reliable data foundations for MLOps, governance, and data lineage.
• Integrate data from multiple sources into modern data platforms.
• Leverage Snowpark ML and Snowflake's native AI capabilities.
• Ensure data platforms are secure, scalable, and high-performing.

What We're Looking For

• 5+ years of hands-on experience with Snowflake.
• Strong proficiency in SQL and Python.
• Experience with AWS, Azure, or GCP.
• Knowledge of cloud storage services such as S3, ADLS, or GCS.
• Strong understanding of Dimensional Modeling and Data Vault.
• Experience with Scala or Java is a plus.

Tech Stack

• Data Warehouse: Snowflake
• Programming: SQL, Python, Scala (Good to Have), Java (Good to Have)
• Cloud: AWS, Azure, GCP
• Storage: S3, ADLS, GCS
• AI/ML: Snowpark ML, MLOps

Perks & Benefits

• Public Speaking & Communication Program
• Mentoring Program with Senior Support Leads
• 360° Progress Reviews
• Weekly Learning Sessions & Guilds
• Paid Certifications
• Hackathons & Innovation Days
• Recognition & Rewards Programs
• Team Socials & Annual Offsites
• Employee Assistance Program (24/7 Wellbeing Support)

The Data People Shaping Tomorrow

Our client helps organizations unlock the power of data through modern cloud, analytics, and AI solutions. We believe in creating an environment where talented technologists can learn, innovate, and make a real impact while building cutting-edge data platforms for global clients. If you're passionate about data engineering and want to work with the latest technologies in AI, cloud, and analytics, we'd love to hear from you.

Position Summary

We are looking for an experienced Enterprise Architect to define and deliver enterprise-scale digital experience architectures leveraging AI/ML capabilities, data platforms, and modern cloud technologies. The role involves partnering with senior business and technology stakeholders to translate business objectives into scalable architectures, strategic roadmaps, and technology solutions.

The ideal candidate will have strong expertise in enterprise architecture, cloud-native technologies, AI-driven customer experiences, and digital marketing platforms, along with the ability to lead architecture initiatives across cross-functional teams.

Key Responsibilities

• Enterprise Strategy & Roadmaps: Define digital, data, and AI strategies, translating business vision into actionable architecture roadmaps aligned with business goals and KPIs.
• Architecture Design: Design end-to-end enterprise and solution architectures integrating digital experience platforms, customer data platforms, AI/ML capabilities, and cloud services.
• Cloud & Technology Architecture: Recommend scalable, secure, and resilient architectures using cloud-native, API-first, microservices, event-driven, and serverless principles across Azure, AWS, or other public cloud platforms.
• AI & Data Architecture: Define architectures for customer data platforms, identity and profile management, data ingestion, governance, personalization, journey orchestration, and AI-powered experiences.
• Architecture Governance: Establish architecture standards, reference architectures, governance frameworks, and operating models to ensure consistency, security, and sustainable technology adoption.
• Stakeholder Management: Collaborate with business leaders, engineering teams, data architects, developers, and data scientists to drive architecture alignment and execution.
• Executive Communication: Lead architecture workshops, visioning sessions, and roadmap presentations, communicating technical recommendations and trade-offs to senior leadership.
• Practice Development: Contribute to reusable architecture assets, mentor architects and consultants, and support presales activities, solutioning, estimations, and proposals.

Required Skills & Experience

• Proven experience in enterprise architecture, solution architecture, and developing enterprise architecture models and roadmaps.
• Strong understanding of architecture frameworks and principles, including TOGAF, SOA, and API-led architecture.
• Hands-on experience with public cloud architecture and services, particularly Microsoft Azure and/or AWS.
• Experience designing and integrating AI-powered solutions, with knowledge of LLMs, prompt engineering, RAG, and model evaluation.
• Understanding of agentic workflows, tool-using agents, and enterprise AI governance, observability, and reliability.
• Experience working with software engineers, application developers, data architects, and data science/ML teams to deliver end-to-end solutions.
• Ability to translate business requirements and strategic vision into technical architectures and implementation roadmaps.
• Strong stakeholder management, leadership, presentation, and communication skills, including experience engaging with senior executives.
• Ability to lead architecture execution across multidisciplinary teams and communicate complex technical concepts to diverse audiences.

Good to Have

• Experience with Adobe Experience Cloud, Adobe Experience Platform, or one or more digital experience solutions.
• Previous experience with other digital marketing and customer experience platforms.
• Experience with customer data platforms, personalization, omnichannel engagement, and marketing optimization initiatives.
• Experience supporting consulting engagements, presales, and enterprise transformation initiatives.

Additional Requirement

- Willingness to travel up to 50%, depending on business and client requirements.