Data Architect (Dremio Lakehouse) at TalentXO · Bengaluru (Bangalore), Mumbai, Hyderabad, Gurugram · 5 - 17 years · ₹34L - ₹45L / yr · Profitable · Posted 31 Mar 2026

Role & Responsibilities
You will be responsible for architecting, implementing, and optimizing Dremio-based data lakehouse environments integrated with cloud storage, BI, and data engineering ecosystems. The role requires a strong balance of architecture design, data modeling, query optimization, and governance enablement in large-scale analytical environments.
- Design and implement Dremio lakehouse architecture on cloud (AWS/Azure/Snowflake/Databricks ecosystem).
- Define data ingestion, curation, and semantic modeling strategies to support analytics and AI workloads.
- Optimize Dremio reflections, caching, and query performance for diverse data consumption patterns.
- Collaborate with data engineering teams to integrate data sources via APIs, JDBC, Delta/Parquet, and object storage layers (S3/ADLS).
- Establish best practices for data security, lineage, and access control aligned with enterprise governance policies.
- Support self-service analytics by enabling governed data products and semantic layers.
- Develop reusable design patterns, documentation, and standards for Dremio deployment, monitoring, and scaling.
- Work closely with BI and data science teams to ensure fast, reliable, and well-modeled access to enterprise data.
Ideal Candidate
- Bachelor’s or Master’s in Computer Science, Information Systems, or related field.
- 5+ years in data architecture and engineering, with 3+ years in Dremio or modern lakehouse platforms.
- Strong expertise in SQL optimization, data modeling, and performance tuning within Dremio or similar query engines (Presto, Trino, Athena).
- Hands-on experience with cloud storage (S3, ADLS, GCS), Parquet/Delta/Iceberg formats, and distributed query planning.
- Knowledge of data integration tools and pipelines (Airflow, DBT, Kafka, Spark, etc.).
- Familiarity with enterprise data governance, metadata management, and role-based access control (RBAC).
- Excellent problem-solving, documentation, and stakeholder communication skills.
Preferred:
- Experience integrating Dremio with BI tools (Tableau, Power BI, Looker) and data catalogs (Collibra, Alation, Purview).
- Exposure to Snowflake, Databricks, or BigQuery environments.
- Experience in high-tech, manufacturing, or enterprise data modernization programs.

About TalentXO
About
Company social profiles
Similar jobs (10)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Data Architect – Databricks & AWS
- Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
- Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
- Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
- Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
- Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
- Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
- Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.
Position: Technical Architect – Data Engineering
Job Summary:
- We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
- The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
- The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.
Key Responsibilities
• Design enterprise-scale data lakehouse and data warehouse architectures.
• Define data ingestion, transformation, and serving architecture.
• Lead architecture discussions and technical governance.
• Design scalable ETL/ELT frameworks using Databricks and Snowflake.
• Define best practices for security, performance, CI/CD, and DevOps.
• Guide engineering teams on implementation.
• Collaborate with business, product, and data governance teams.
Must Have Skills :
• Azure or AWS
• Databricks
• Snowflake
• Data Lakehouse Architecture
• PySpark
• SQL
• Data Modelling
• ETL/ELT Architecture
• Performance Optimization
• CI/CD
• Terraform or Infrastructure as Code (preferred)
Preferred
• Insurance domain
• dbt
• Unity Catalog
• Delta Lake
• Iceberg
• Azure Data Factory / AWS Glue

Job Description: Associate Director-Data Engineering (Databricks Lakehouse Architect + Cloud Data Engineering Leader)
About our Client -
Client is a leading SAP consulting and digital transformation partner committed to delivering innovative, high-impact solutions across enterprise analytics, cloud, and intelligent business platforms.
As enterprises modernize their data landscapes, the role of traditional data warehousing is rapidly evolving into scalable cloud-native Data Lakehouse architectures. Applexus is expanding its modern data engineering capabilities to help customers integrate enterprise data from SAP and non-SAP ecosystems, build advanced analytics platforms, and enable future-ready AI-driven solutions.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
Role Overview:
We are looking for a hands-on Data Engineering leader who can architect modern cloud data platforms using Databricks Lakehouse and lead solution design, delivery, and engineering teams. This role requires strong technical ownership rather than a pure people management background.
Key Responsibilities:
• Architect scalable Data Lakehouse platforms
• Own solution design, estimation, architecture reviews and client discussions
• Build and optimize enterprise data pipelines
• Provide technical guidance to data engineering teams
• Establish best practices around performance, governance and architecture
Must Have - Databricks Architecture:
• Databricks Lakehouse design
• Delta Lake implementation
• Apache Spark / PySpark engineering
• Medallion architecture (Bronze/Silver/Gold layers)
• Data pipeline optimization
• Unity Catalog and data governance exposure
Cloud Platform Expertise (depth in one required):
Microsoft Azure:
• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Azure Synapse Analytics
OR
Amazon AWS:
• Databricks on AWS
• Amazon S3
• AWS Glue
• Redshift
• Athena
Good to Have:
• Snowflake
• ML Engineering exposure
• Cloud/Data Engineering certifications
Ideal Candidate:
A hands-on architect who can talk to customers, design solutions, estimate projects, guide engineers and review architecture while helping build a modern Data Engineering practice.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
If you are a hands-on Data Architect who enjoys building modern data platforms and wants to move beyond execution into solution ownership and leadership, I would love to connect.

Designation: Data Architect
Reporting: VP, Engineering
Desired Experience: 12 – 18 Years
Qualification: BE/ B Tech/ M Tech/ MCA and any Graduate.
Job Location: Noida Sec-6 (Nearest Metro Station 15)
(WFH/Work from Home Available)
Total Employees: 100+ Members
Working Days: Monday to Friday
Key Responsibilities
- Define, own, and evolve the enterprise data architecture
- Design scalable, secure, high-performance end-to-end data platforms
- Establish data modeling standards (conceptual, logical, physical)
- Act as architectural authority for data pipelines, APIs, and integrations
- Ensure platform design meets security, compliance, availability, and cost-efficiency standards
- Define and enforce data governance, data quality, metadata, lineage, and master data principles
- Collaborate with Data Engineers for implementation of architecture designs
- Align data architecture with product roadmaps and business priorities
- Define standards for data sharing, data products, and external data exposure
- Contribute to long-term data platform roadmap and technology adoption
- Support leadership with architecture reviews and strategic decisions
Required Experience & Technical Expertise
Experience
- 12+ years in Data domain
- 3–5 years as Data Architect / Lead Data Role
- Experience designing enterprise-scale data platforms
Data Architecture & Modeling
- Deep expertise in Data Modeling & Data Warehousing
- Advanced SQL knowledge
- Strong experience with Snowflake & modern cloud data stacks
- Experience with relational and cloud-native databases
Security & Compliance
- Knowledge of Data Security (Dynamic Masking, Row-Level Security, Access Control)
- Strong understanding of GDPR & Data Privacy regulations
Integration & Engineering
- Experience with streaming & event-driven architectures
- APIs & integration patterns (REST, event-based systems)
- Familiarity with CI/CD, DevOps & Infrastructure-as-Code in data environments
- Architecture reviews & technology evaluations
Key Technical Skills (Must Have)
- Snowflake
- Matillion (or equivalent data integration tools)
- Python
- SQL
- REST APIs & Event-driven integrations
- Power BI / Qlik / Tableau
- Experience with CRM / Marketing Automation / PIM platforms
- Agile & Continuous Delivery practices
Personal Skills
- Strong architectural mindset with focus on scalability
- Collaborative leadership ability
- Analytical and business-oriented thinking
- Strong communication skills (technical & non-technical stakeholders)
- Proactive, autonomous, and accountable
Why Join Us?
- Work with best-in-class data & cloud technologies
- Influence core data architecture of a global digital platform
- Strong engineering culture focused on ownership & quality
- Hybrid work model (mostly remote)
- 25+ years of industry leadership with strong growth trajectory
Please fill the following details:
1) Current CTC
2) Expected CTC
3) Notice Period
4) Current Location
5) Reason of Change
6) Years of Experience
Kindly provide us the references for the same openings.
WhatsApp your CV at 7 5 0 3 8 6 6 1 9 6

Role: Technical Architect – Data & Cloud
We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms. The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
Key Responsibilities:
- Design enterprise-scale Data Lakehouse and Data Warehouse architectures.
- Define data ingestion, transformation, and serving architecture.
- Lead architecture discussions and technical governance.
- Design scalable ETL/ELT frameworks using Databricks and Snowflake.
- Define best practices for security, performance optimization, CI/CD, and DevOps.
- Provide technical guidance to engineering teams during implementation.
- Collaborate with business, product, architecture, and data governance teams.
Must-Have Skills:
- Azure and/or AWS
- Databricks
- Snowflake
- Data Lakehouse Architecture
- PySpark
- SQL
- Data Modelling
- ETL/ELT Architecture
- Performance Optimization
- CI/CD
- Terraform / Infrastructure as Code, preferred
Preferred Skills:
- Insurance domain experience
- dbt
- Unity Catalog
- Delta Lake
- Iceberg
- Azure Data Factory / AWS Glue
Job Title: Senior Data Architect
Experience: 7+ Years
Location: India (Ahmedabad / Hybrid/Remote)
Job Summary
We are looking for an experienced Senior Data Architect to support the modernization and enhancement of Enterprise Analytic Data Warehouse (ADW). The candidate will be responsible for evaluating existing data architecture, designing scalable data models, assessing data integration across clinical, operational and financial domains, and establishing data governance and data quality standards.
Key Responsibilities
- Assess and review the existing Enterprise Analytic Data Warehouse architecture, database structures and data integration processes.
- Design and improve enterprise data models covering clinical, operational, financial and revenue-cycle information.
- Define data architecture standards, database structures, data relationships and integration strategies.
- Evaluate data flows between source systems and the data warehouse.
- Design and review source-to-target mappings and data lineage.
- Identify architectural gaps affecting data completeness, consistency, integrity and reporting accuracy.
- Establish standardized data definitions, data governance practices and metadata management.
- Ensure consistent patient, facility, payer and other critical identifiers across different datasets.
- Support integration of billing, claims, payment, denial and accounts receivable (AR) data.
- Work with SQL and Python-based data processing solutions to investigate and validate data structures.
- Recommend improvements to warehouse scalability, performance, reliability and maintainability.
- Develop a prioritized architecture and modernization roadmap for future implementation.
- Coordinate with data engineers, analytics engineers and business stakeholders.
Required Technical Skills
- Strong experience in Data Architecture and Enterprise Data Warehousing.
- Advanced SQL and relational database concepts.
- Experience with data modelling (conceptual, logical and physical).
- Knowledge of ETL/ELT pipelines and data integration.
- Experience with data profiling, data lineage and metadata management.
- Understanding of data governance, data quality and data validation frameworks.
- Experience working with large and complex datasets.
- Python knowledge for data analysis and validation.
- Experience with cloud-based data platforms or modern data warehouse technologies.
Preferred Skills
- Experience with Databricks, Azure, AWS or similar cloud data platforms.
- Experience with healthcare data warehouses.
- Knowledge of clinical, financial, billing and claims datasets.
- Understanding of HIPAA, PHI and healthcare data security principles.
- Experience with healthcare analytics, reimbursement and revenue-cycle data.
Job Summary
We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.
Key Responsibilities
- Develop and maintain data pipelines using Python and PySpark.
- Design and implement data lakehouse solutions on AWS.
- Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.
- Work with DynamoDB and other data storage technologies.
- Monitor data pipelines and ensure data quality, performance, and reliability.
- Collaborate with stakeholders and engineering teams to deliver data solutions.
Mandatory Skills
- 5+ years of overall professional experience.
- 3+ years of experience in data platforms and big data technologies.
- Strong proficiency in Python and PySpark.
- Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.
- Experience designing and implementing AWS data lakehouse architectures.
Good to Have
- Apache Spark and Apache Iceberg.
- AWS Lambda, EventBridge, Kinesis, and Redshift.
- Experience with real-time data pipelines and event-driven architectures.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About Us:
The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.
Job Summary:
We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.
As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.
Key Responsibilities:
- Design, develop, test, and maintain optimal data pipeline and ETL architectures.
- Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
- Prepare and optimize data for predictive and prescriptive modeling.
- Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
- Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
- Utilize big data tools and frameworks to optimize data acquisition and preparation.
- Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
- Develop and curate data models for analytics, dashboards, and reports.
- Conduct code reviews, maintain production-level code, and implement testing approaches.
- Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
- Drive innovation and implement efficient new approaches to data engineering tasks.
Must-Have Skills:
- Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
- 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
- 3–5 years of experience designing and implementing data warehouse solutions.
- Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
- Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
- Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
- Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
- Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
- Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
- Strong problem-solving, communication, and collaboration skills.
Good-to-Have Skills:
- Experience in integrating ERP data into data lakes.
- Experience with traditional ETL tools (e.g., Talend, Pentaho).
Competencies:
- Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
- Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
- Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
- Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
- Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.
Why Join Us?
- Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
- Work on impactful projects that make a difference across industries.
- Opportunities for professional growth and continuous learning.
- Competitive salary and benefits package.
Application Details
Ready to make an impact? Apply today and become part of the QX Impact team!

Tech Lead – Data Lake Platform
Recruitment & Payroll Company: Neogencode Technologies
Job Location: Sector 43, Gurugram, Haryana
Work Mode: On-site (Work from Office)
Working Days: 5 days a week
Experience Required: 5+ years
Employment Type: Full-time
About the Opportunity
We are hiring a Tech Lead – Data Lake Platform. This opportunity involves working on an enterprise-grade AWS data lake platform supporting data engineering, analytics, reporting, and business applications.
The candidate will be employed on the payroll of Neogencode Technologies and will work at the client location in Sector 43, Gurugram.
Key Responsibilities
- Own and design end-to-end data lake architecture, including data ingestion, staging, curated layers, and data consumption.
- Lead data engineering pipelines using AWS services, Apache Airflow, Spark/PySpark, and dbt.
- Manage AWS data services such as S3, EMR, Glue, Athena, Redshift, Lambda, RDS, IAM, and DMS.
- Design and support API/data-serving solutions using PostgreSQL, Hasura GraphQL, or similar technologies.
- Improve pipeline performance, platform reliability, monitoring, and service-level agreements (SLAs).
- Ensure data security, access control, personally identifiable information (PII) protection, and governance.
- Mentor data engineers, conduct code reviews, and handle production incidents and root-cause analysis.
- Collaborate with business and application teams to deliver data and reporting solutions.
Required Skills
- 5+ years of experience in data engineering or platform engineering, including technical leadership.
- Strong hands-on experience with AWS data services and enterprise data lake architecture.
- Production experience with Apache Airflow, Spark/PySpark, and SQL.
- Strong understanding of data modeling and layered data architecture.
- Experience with PostgreSQL and Hasura GraphQL or a similar API/data-serving layer.
- Proven experience in technical leadership, production support, and troubleshooting.
Good to Have
- Experience with dbt and lakehouse table formats.
- Knowledge of Kafka or streaming data ingestion.
- Experience with Redshift optimization and workload design.

Job Title : Tech Lead – Data Lake Platform
Number of Positions : 2
Experience : 7+ Years
Role Type : Technical Lead / Data Platform Lead
Domain : Data Engineering / Data Platform / AWS
About the Role :
We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.
The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.
As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.
Core Tech Stack :
AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka
Key Responsibilities :
- Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
- Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
- Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
- Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
- Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
- Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
- Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
- Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
- Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
- Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
- Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
- Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.
Must-Have Skills :
- 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
- Strong hands-on experience with AWS Data Services, including:
- Amazon S3
- AWS EMR
- AWS Glue
- Amazon Athena
- Amazon Redshift
- AWS DMS
- AWS Lambda
- Amazon RDS
- AWS IAM
- Strong production experience with Apache Airflow.
- Strong hands-on experience with Apache Spark / PySpark.
- Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
- Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
- Strong understanding of data lake architecture and enterprise data platforms.
- Proven experience leading engineers and driving technical decisions.
- Hands-on experience with production support, troubleshooting, incident management, and RCA.
- Strong understanding of data platform performance, scalability, reliability, and SLA management.
Good-to-Have Skills :
- Experience with DBT and modern data transformation practices.
- Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
- Strong knowledge of Amazon Redshift workload optimization, including :
- Distribution keys
- Sort keys
- Spectrum
- External tables
- Experience with Kafka or other streaming/data ingestion technologies.
- Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
- Experience with Lambda and API Gateway for API-based data serving.
- Experience with enterprise data governance, data quality, security, and compliance.
- Experience in BFSI / Banking / Financial Services / Insurance domain.
Ideal Candidate :
The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.









