Cutshort logo
For Employers
TalentXO logo
Data Architect (Dremio Lakehouse)
Data Architect (Dremio Lakehouse)

Data Architect (Dremio Lakehouse) at TalentXO · Bengaluru (Bangalore), Mumbai, Hyderabad, Gurugram · 5 - 17 years · ₹34L - ₹45L / yr · Profitable · Posted 31 Mar 2026

TalentXO's logo

Data Architect (Dremio Lakehouse)

tabbasum shaikh's profile picture
Posted by tabbasum shaikh
5 - 17 yrs
₹34L - ₹45L / yr
Bengaluru (Bangalore), Mumbai, Hyderabad, Gurugram
Skills
Data engineering
Dremio
cloud object storage
data engineering pipelines
Lakehouse

Role & Responsibilities

You will be responsible for architecting, implementing, and optimizing Dremio-based data lakehouse environments integrated with cloud storage, BI, and data engineering ecosystems. The role requires a strong balance of architecture design, data modeling, query optimization, and governance enablement in large-scale analytical environments.

  • Design and implement Dremio lakehouse architecture on cloud (AWS/Azure/Snowflake/Databricks ecosystem).
  • Define data ingestion, curation, and semantic modeling strategies to support analytics and AI workloads.
  • Optimize Dremio reflections, caching, and query performance for diverse data consumption patterns.
  • Collaborate with data engineering teams to integrate data sources via APIs, JDBC, Delta/Parquet, and object storage layers (S3/ADLS).
  • Establish best practices for data security, lineage, and access control aligned with enterprise governance policies.
  • Support self-service analytics by enabling governed data products and semantic layers.
  • Develop reusable design patterns, documentation, and standards for Dremio deployment, monitoring, and scaling.
  • Work closely with BI and data science teams to ensure fast, reliable, and well-modeled access to enterprise data.

Ideal Candidate

  • Bachelor’s or Master’s in Computer Science, Information Systems, or related field.
  • 5+ years in data architecture and engineering, with 3+ years in Dremio or modern lakehouse platforms.
  • Strong expertise in SQL optimization, data modeling, and performance tuning within Dremio or similar query engines (Presto, Trino, Athena).
  • Hands-on experience with cloud storage (S3, ADLS, GCS), Parquet/Delta/Iceberg formats, and distributed query planning.
  • Knowledge of data integration tools and pipelines (Airflow, DBT, Kafka, Spark, etc.).
  • Familiarity with enterprise data governance, metadata management, and role-based access control (RBAC).
  • Excellent problem-solving, documentation, and stakeholder communication skills.

Preferred:

  • Experience integrating Dremio with BI tools (Tableau, Power BI, Looker) and data catalogs (Collibra, Alation, Purview).
  • Exposure to Snowflake, Databricks, or BigQuery environments.
  • Experience in high-tech, manufacturing, or enterprise data modernization programs.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About TalentXO

Founded :
2018
Type :
Product
Size :
20-100
Stage :
Profitable

About

N/A

Company social profiles

N/A

Similar jobs (10)

Wissen Technology
at Wissen Technology
4 recruiters
Vishakha Walunj
Posted by Vishakha Walunj
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Pune
8 - 15 yrs
Best in industry
skill iconPython
PySpark
databricks
skill iconAmazon Web Services (AWS)
SQL

Data Architect – Databricks & AWS

  • Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
  • Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
  • Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
  • Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
  • Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
  • Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
  • Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.
Read more
Insurtech
Actively reviewing applications
Insurtech
Agency job
via Bean HR Consulting by Simran Kaur
Bengaluru (Bangalore), Pune, Noida, Gurugram
11 - 15 yrs
Best in industry
azure
skill iconAmazon Web Services (AWS)
snowflake
databricks
Windows Azure
+2 more

Position: Technical Architect – Data Engineering


Job Summary:

  • We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
  • The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
  • The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.


Key Responsibilities

• Design enterprise-scale data lakehouse and data warehouse architectures.

• Define data ingestion, transformation, and serving architecture.

• Lead architecture discussions and technical governance.

• Design scalable ETL/ELT frameworks using Databricks and Snowflake.

• Define best practices for security, performance, CI/CD, and DevOps.

• Guide engineering teams on implementation.

• Collaborate with business, product, and data governance teams.


Must Have Skills :

• Azure or AWS

• Databricks

• Snowflake

• Data Lakehouse Architecture

• PySpark

• SQL

• Data Modelling

• ETL/ELT Architecture

• Performance Optimization

• CI/CD

• Terraform or Infrastructure as Code (preferred)


Preferred

• Insurance domain

• dbt

• Unity Catalog

• Delta Lake

• Iceberg

• Azure Data Factory / AWS Glue  

Read more
leading SAP consulting company
Actively reviewing applications
leading SAP consulting company
Agency job
via Antal International Network by Mahboob Hussain
Thiruvananthapuram
15 - 20 yrs
₹40L - ₹50L / yr
databricks
Data engineering
Architecture
Delta Lake
Apache
+2 more

Job Description: Associate Director-Data Engineering (Databricks Lakehouse Architect + Cloud Data Engineering Leader)

 

About our Client -

Client is a leading SAP consulting and digital transformation partner committed to delivering innovative, high-impact solutions across enterprise analytics, cloud, and intelligent business platforms.

As enterprises modernize their data landscapes, the role of traditional data warehousing is rapidly evolving into scalable cloud-native Data Lakehouse architectures. Applexus is expanding its modern data engineering capabilities to help customers integrate enterprise data from SAP and non-SAP ecosystems, build advanced analytics platforms, and enable future-ready AI-driven solutions.

We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.

The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.

 

Role Overview:

We are looking for a hands-on Data Engineering leader who can architect modern cloud data platforms using Databricks Lakehouse and lead solution design, delivery, and engineering teams. This role requires strong technical ownership rather than a pure people management background.

Key Responsibilities:

• Architect scalable Data Lakehouse platforms

• Own solution design, estimation, architecture reviews and client discussions

• Build and optimize enterprise data pipelines

• Provide technical guidance to data engineering teams

• Establish best practices around performance, governance and architecture

 

Must Have - Databricks Architecture:

• Databricks Lakehouse design

• Delta Lake implementation

• Apache Spark / PySpark engineering

• Medallion architecture (Bronze/Silver/Gold layers)

• Data pipeline optimization

• Unity Catalog and data governance exposure


Cloud Platform Expertise (depth in one required):

Microsoft Azure:

• Azure Databricks

• Azure Data Factory (ADF)

• Azure Data Lake Storage (ADLS)

• Azure Synapse Analytics

OR

Amazon AWS:

• Databricks on AWS

• Amazon S3

• AWS Glue

• Redshift

• Athena

Good to Have:

• Snowflake

• ML Engineering exposure

• Cloud/Data Engineering certifications

Ideal Candidate:

A hands-on architect who can talk to customers, design solutions, estimate projects, guide engineers and review architecture while helping build a modern Data Engineering practice.

 We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.

The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.

If you are a hands-on Data Architect who enjoys building modern data platforms and wants to move beyond execution into solution ownership and leadership, I would love to connect.


Read more
Digital Marketing Company - WFH
Actively reviewing applications
Digital Marketing Company - WFH
Agency job
via Destiny HR Group Services by DestinyHR GroupServices
Remote only
8 - 15 yrs
₹18L - ₹32L / yr
skill iconPython
Cloud Computing
Snow flake schema
DevOps
SQL
+2 more

Designation: Data Architect



Reporting: VP, Engineering



Desired Experience: 12 – 18 Years



Qualification: BE/ B Tech/ M Tech/ MCA and any Graduate.



Job Location: Noida Sec-6 (Nearest Metro Station 15)



(WFH/Work from Home Available)



Total Employees: 100+ Members



Working Days: Monday to Friday



Key Responsibilities

  • Define, own, and evolve the enterprise data architecture
  • Design scalable, secure, high-performance end-to-end data platforms
  • Establish data modeling standards (conceptual, logical, physical)
  • Act as architectural authority for data pipelines, APIs, and integrations
  • Ensure platform design meets security, compliance, availability, and cost-efficiency standards
  • Define and enforce data governance, data quality, metadata, lineage, and master data principles
  • Collaborate with Data Engineers for implementation of architecture designs
  • Align data architecture with product roadmaps and business priorities
  • Define standards for data sharing, data products, and external data exposure
  • Contribute to long-term data platform roadmap and technology adoption
  • Support leadership with architecture reviews and strategic decisions

Required Experience & Technical Expertise

Experience

  • 12+ years in Data domain
  • 3–5 years as Data Architect / Lead Data Role
  • Experience designing enterprise-scale data platforms

Data Architecture & Modeling

  • Deep expertise in Data Modeling & Data Warehousing
  • Advanced SQL knowledge
  • Strong experience with Snowflake & modern cloud data stacks
  • Experience with relational and cloud-native databases

Security & Compliance

  • Knowledge of Data Security (Dynamic Masking, Row-Level Security, Access Control)
  • Strong understanding of GDPR & Data Privacy regulations

Integration & Engineering

  • Experience with streaming & event-driven architectures
  • APIs & integration patterns (REST, event-based systems)
  • Familiarity with CI/CD, DevOps & Infrastructure-as-Code in data environments
  • Architecture reviews & technology evaluations

Key Technical Skills (Must Have)

  • Snowflake
  • Matillion (or equivalent data integration tools)
  • Python
  • SQL
  • REST APIs & Event-driven integrations
  • Power BI / Qlik / Tableau
  • Experience with CRM / Marketing Automation / PIM platforms
  • Agile & Continuous Delivery practices

Personal Skills

  • Strong architectural mindset with focus on scalability
  • Collaborative leadership ability
  • Analytical and business-oriented thinking
  • Strong communication skills (technical & non-technical stakeholders)
  • Proactive, autonomous, and accountable

Why Join Us?

  • Work with best-in-class data & cloud technologies
  • Influence core data architecture of a global digital platform
  • Strong engineering culture focused on ownership & quality
  • Hybrid work model (mostly remote)
  • 25+ years of industry leadership with strong growth trajectory

 Please fill the following details:

 

1) Current CTC

 

2) Expected CTC

 

3) Notice Period

 

4) Current Location

 

5) Reason of Change

 

6) Years of Experience

 

Kindly provide us the references for the same openings.



WhatsApp your CV at 7 5 0 3 8 6 6 1 9 6

Read more
Global analytics and digital solutions company
Actively reviewing applications
Global analytics and digital solutions company
Agency job
via Bean HR Consulting by Sandeep Kothari
Gurugram, Pune, Noida, Bengaluru (Bangalore)
11 - 15 yrs
₹40L - ₹45L / yr
data Architect
Microsoft Windows Azure
databricks
Snow flake schema
SQL
+2 more

Role: Technical Architect – Data & Cloud

 

We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms. The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.

Key Responsibilities:

  • Design enterprise-scale Data Lakehouse and Data Warehouse architectures.
  • Define data ingestion, transformation, and serving architecture.
  • Lead architecture discussions and technical governance.
  • Design scalable ETL/ELT frameworks using Databricks and Snowflake.
  • Define best practices for security, performance optimization, CI/CD, and DevOps.
  • Provide technical guidance to engineering teams during implementation.
  • Collaborate with business, product, architecture, and data governance teams.

 

Must-Have Skills:

  • Azure and/or AWS
  • Databricks
  • Snowflake
  • Data Lakehouse Architecture
  • PySpark
  • SQL
  • Data Modelling
  • ETL/ELT Architecture
  • Performance Optimization
  • CI/CD
  • Terraform / Infrastructure as Code, preferred

Preferred Skills:

  • Insurance domain experience
  • dbt
  • Unity Catalog
  • Delta Lake
  • Iceberg
  • Azure Data Factory / AWS Glue
Read more
Fx31labs
Actively reviewing applications
Darshana Jadhav
Posted by Darshana Jadhav
Remote only
7 - 12 yrs
₹20L - ₹30L / yr
Data engineering
Data architecture
Data Warehouse (DWH)
Data modeling

Job Title: Senior Data Architect

Experience: 7+ Years

Location: India (Ahmedabad / Hybrid/Remote)

Job Summary

We are looking for an experienced Senior Data Architect to support the modernization and enhancement of Enterprise Analytic Data Warehouse (ADW). The candidate will be responsible for evaluating existing data architecture, designing scalable data models, assessing data integration across clinical, operational and financial domains, and establishing data governance and data quality standards.

Key Responsibilities

  • Assess and review the existing Enterprise Analytic Data Warehouse architecture, database structures and data integration processes.
  • Design and improve enterprise data models covering clinical, operational, financial and revenue-cycle information.
  • Define data architecture standards, database structures, data relationships and integration strategies.
  • Evaluate data flows between source systems and the data warehouse.
  • Design and review source-to-target mappings and data lineage.
  • Identify architectural gaps affecting data completeness, consistency, integrity and reporting accuracy.
  • Establish standardized data definitions, data governance practices and metadata management.
  • Ensure consistent patient, facility, payer and other critical identifiers across different datasets.
  • Support integration of billing, claims, payment, denial and accounts receivable (AR) data.
  • Work with SQL and Python-based data processing solutions to investigate and validate data structures.
  • Recommend improvements to warehouse scalability, performance, reliability and maintainability.
  • Develop a prioritized architecture and modernization roadmap for future implementation.
  • Coordinate with data engineers, analytics engineers and business stakeholders.

Required Technical Skills

  • Strong experience in Data Architecture and Enterprise Data Warehousing.
  • Advanced SQL and relational database concepts.
  • Experience with data modelling (conceptual, logical and physical).
  • Knowledge of ETL/ELT pipelines and data integration.
  • Experience with data profiling, data lineage and metadata management.
  • Understanding of data governance, data quality and data validation frameworks.
  • Experience working with large and complex datasets.
  • Python knowledge for data analysis and validation.
  • Experience with cloud-based data platforms or modern data warehouse technologies.

Preferred Skills

  • Experience with Databricks, Azure, AWS or similar cloud data platforms.
  • Experience with healthcare data warehouses.
  • Knowledge of clinical, financial, billing and claims datasets.
  • Understanding of HIPAA, PHI and healthcare data security principles.
  • Experience with healthcare analytics, reimbursement and revenue-cycle data.


Read more
Thomasmount Consulting
Actively reviewing applications
Shirin Shahana
Posted by Shirin Shahana
Kochi (Cochin), Thiruvananthapuram
5 - 9 yrs
₹10L - ₹20L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark

Job Summary

We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.

Key Responsibilities

  • Develop and maintain data pipelines using Python and PySpark.
  • Design and implement data lakehouse solutions on AWS.
  • Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.
  • Work with DynamoDB and other data storage technologies.
  • Monitor data pipelines and ensure data quality, performance, and reliability.
  • Collaborate with stakeholders and engineering teams to deliver data solutions.

Mandatory Skills

  • 5+ years of overall professional experience.
  • 3+ years of experience in data platforms and big data technologies.
  • Strong proficiency in Python and PySpark.
  • Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.
  • Experience designing and implementing AWS data lakehouse architectures.

Good to Have

  • Apache Spark and Apache Iceberg.
  • AWS Lambda, EventBridge, Kinesis, and Redshift.
  • Experience with real-time data pipelines and event-driven architectures.


Read more
QuaXigma IT solutions Private Limited
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Divya Sharma
Posted by Divya Sharma
Gurugram
5 - 12 yrs
₹8L - ₹16L / yr
skill iconAmazon Web Services (AWS)
Data engineering
PySpark
Apache Airflow
SQL
+4 more

Tech Lead – Data Lake Platform


Recruitment & Payroll Company: Neogencode Technologies

Job Location: Sector 43, Gurugram, Haryana

Work Mode: On-site (Work from Office)

Working Days: 5 days a week

Experience Required: 5+ years

Employment Type: Full-time

About the Opportunity

We are hiring a Tech Lead – Data Lake Platform. This opportunity involves working on an enterprise-grade AWS data lake platform supporting data engineering, analytics, reporting, and business applications.

The candidate will be employed on the payroll of Neogencode Technologies and will work at the client location in Sector 43, Gurugram.

Key Responsibilities

  • Own and design end-to-end data lake architecture, including data ingestion, staging, curated layers, and data consumption.
  • Lead data engineering pipelines using AWS services, Apache Airflow, Spark/PySpark, and dbt.
  • Manage AWS data services such as S3, EMR, Glue, Athena, Redshift, Lambda, RDS, IAM, and DMS.
  • Design and support API/data-serving solutions using PostgreSQL, Hasura GraphQL, or similar technologies.
  • Improve pipeline performance, platform reliability, monitoring, and service-level agreements (SLAs).
  • Ensure data security, access control, personally identifiable information (PII) protection, and governance.
  • Mentor data engineers, conduct code reviews, and handle production incidents and root-cause analysis.
  • Collaborate with business and application teams to deliver data and reporting solutions.

Required Skills

  • 5+ years of experience in data engineering or platform engineering, including technical leadership.
  • Strong hands-on experience with AWS data services and enterprise data lake architecture.
  • Production experience with Apache Airflow, Spark/PySpark, and SQL.
  • Strong understanding of data modeling and layered data architecture.
  • Experience with PostgreSQL and Hasura GraphQL or a similar API/data-serving layer.
  • Proven experience in technical leadership, production support, and troubleshooting.

Good to Have

  • Experience with dbt and lakehouse table formats.
  • Knowledge of Kafka or streaming data ingestion.
  • Experience with Redshift optimization and workload design.


Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Gurugram
7 - 12 yrs
₹12L - ₹18L / yr
skill iconAmazon Web Services (AWS)
Amazon S3
Amazon EMR
athena
Amazon Redshift
+17 more

Job Title : Tech Lead – Data Lake Platform

Number of Positions : 2

Experience : 7+ Years

Role Type : Technical Lead / Data Platform Lead

Domain : Data Engineering / Data Platform / AWS


About the Role :

We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.

The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.

As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.


Core Tech Stack :

AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka


Key Responsibilities :

  • Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
  • Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
  • Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
  • Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
  • Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
  • Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
  • Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
  • Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
  • Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
  • Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
  • Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
  • Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.


Must-Have Skills :

  • 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
  • Strong hands-on experience with AWS Data Services, including:
  • Amazon S3
  • AWS EMR
  • AWS Glue
  • Amazon Athena
  • Amazon Redshift
  • AWS DMS
  • AWS Lambda
  • Amazon RDS
  • AWS IAM
  • Strong production experience with Apache Airflow.
  • Strong hands-on experience with Apache Spark / PySpark.
  • Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
  • Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
  • Strong understanding of data lake architecture and enterprise data platforms.
  • Proven experience leading engineers and driving technical decisions.
  • Hands-on experience with production support, troubleshooting, incident management, and RCA.
  • Strong understanding of data platform performance, scalability, reliability, and SLA management.


Good-to-Have Skills :

  • Experience with DBT and modern data transformation practices.
  • Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
  • Strong knowledge of Amazon Redshift workload optimization, including :
  • Distribution keys
  • Sort keys
  • Spectrum
  • External tables
  • Experience with Kafka or other streaming/data ingestion technologies.
  • Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
  • Experience with Lambda and API Gateway for API-based data serving.
  • Experience with enterprise data governance, data quality, security, and compliance.
  • Experience in BFSI / Banking / Financial Services / Insurance domain.


Ideal Candidate :

The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos