Solution/Technical Architect (Databricks) at Quintica · Remote, Bengaluru (Bangalore), Pune, Chennai, Nagpur · 5 - 15 years · ₹20L - ₹30L / yr · Bootstrapped · Remote friendly · Posted 22 Sep 2025

Technical Architect (Databricks)
- 10+ Years Data Engineering Experience with expertise in Databricks
- 3+ years of consulting experience
- Completed Data Engineering Professional certification & required classes
- Minimum 2-3 projects delivered with hands-on experience in Databricks
- Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark™ on Databricks
- Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines
- Familiarity with Databricks multi-hop pipeline architecture
Sr. Data Engineer (Databricks)
- 5+ Years Data Engineering Experience with expertise in Databricks
- Completed Data Engineering Associate certification & required classes
- Minimum 1 project delivered with hands-on experience in development on Databricks
- Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark™ on Databricks
- SQL delivery experience, and familiarity with Bigquery, Synapse or Redshift
- Proficient in Python, knowledge of additional databricks programming languages (Scala)

About Quintica
About
Company social profiles
Similar jobs (10)

Role: Technical Architect – Data & Cloud
We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms. The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
Key Responsibilities:
- Design enterprise-scale Data Lakehouse and Data Warehouse architectures.
- Define data ingestion, transformation, and serving architecture.
- Lead architecture discussions and technical governance.
- Design scalable ETL/ELT frameworks using Databricks and Snowflake.
- Define best practices for security, performance optimization, CI/CD, and DevOps.
- Provide technical guidance to engineering teams during implementation.
- Collaborate with business, product, architecture, and data governance teams.
Must-Have Skills:
- Azure and/or AWS
- Databricks
- Snowflake
- Data Lakehouse Architecture
- PySpark
- SQL
- Data Modelling
- ETL/ELT Architecture
- Performance Optimization
- CI/CD
- Terraform / Infrastructure as Code, preferred
Preferred Skills:
- Insurance domain experience
- dbt
- Unity Catalog
- Delta Lake
- Iceberg
- Azure Data Factory / AWS Glue
Position: Technical Architect – Data Engineering
Job Summary:
- We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
- The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
- The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.
Key Responsibilities
• Design enterprise-scale data lakehouse and data warehouse architectures.
• Define data ingestion, transformation, and serving architecture.
• Lead architecture discussions and technical governance.
• Design scalable ETL/ELT frameworks using Databricks and Snowflake.
• Define best practices for security, performance, CI/CD, and DevOps.
• Guide engineering teams on implementation.
• Collaborate with business, product, and data governance teams.
Must Have Skills :
• Azure or AWS
• Databricks
• Snowflake
• Data Lakehouse Architecture
• PySpark
• SQL
• Data Modelling
• ETL/ELT Architecture
• Performance Optimization
• CI/CD
• Terraform or Infrastructure as Code (preferred)
Preferred
• Insurance domain
• dbt
• Unity Catalog
• Delta Lake
• Iceberg
• Azure Data Factory / AWS Glue
Job Summary
We are looking for an experienced Databricks Lead to lead and manage data engineering initiatives. The ideal candidate should have strong hands-on experience with Databricks, data engineering, and cloud-based data platforms, along with the ability to guide a team, drive technical decisions, and ensure successful project delivery.
Key Responsibilities
- Lead and manage Databricks-based data engineering projects.
- Design, develop, and implement scalable data pipelines using Databricks.
- Provide technical guidance and mentorship to team members.
- Work on data ingestion, transformation, processing, and integration.
- Develop and optimize ETL/ELT workflows using PySpark and Spark SQL.
- Handle performance tuning and optimization of Databricks workloads.
- Collaborate with business stakeholders, architects, and cross-functional teams.
- Identify and resolve technical issues and ensure smooth project delivery.
- Follow best practices for data quality, security, and governance.
- Participate in technical discussions, code reviews, and solution design.
Mandatory Skills
- Strong hands-on experience with Databricks.
- Good knowledge of Apache Spark, PySpark, and Spark SQL.
- Experience in data engineering and ETL/ELT pipelines.
- Strong programming knowledge in Python and SQL.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Understanding of data lake and lakehouse architecture.
- Experience in team leadership and technical coordination.
- Strong problem-solving and communication skills.
Job Description:
We are seeking a skilled Senior Data Engineer with expertise in Databricks to join our dynamic data team. The ideal candidate will design, build, and maintain scalable data pipelines and architectures to support our organization's data-driven initiatives and leverage Databricks to process large-scale datasets, optimize data workflows, enable advanced analytics and machine learning, and integrate Power BI for data visualization and reporting.
Key Responsibilities
· 5-8 years of professional work experience in a relevant field
· Proficient in Microsoft Fabric platform, Azure Databricks, ADF, Delta Lake, SQL Data Warehouse, Unity Catalog.
· Good Experience on Microsoft Dynamics 365
· Experience/ prior knowledge on semi structure data and Structured Streaming, Azure synapse, data lake, data warehouse.
· Proficient in creating Azure Data Factory pipelines for ETL/ELT processing; copy activity, custom Azure development etc.
· Good knowledge of SQL and Python for data manipulation, transformation, and analysis
· Understand business requirements to set functional specifications for reporting applications
- Data Pipeline Development: Design, develop, and maintain robust, scalable data pipelines using Databricks, Apache Spark, and other cloud-based technologies.
- Data Integration: Ingest, transform, and integrate data from diverse sources, including APIs, databases, streaming platforms, and third-party systems, into Databricks for analytics and reporting.
- Power BI Integration: Develop and optimize data models and datasets in Databricks for use in Power BI, ensuring efficient data connections and high-quality visualizations.
- Performance Optimization: Optimize data workflows, API calls, and queries on Databricks and Power BI for performance, cost-efficiency, and scalability.
- Data Modeling: Build and maintain data models to support business requirements, ensuring data quality, consistency, and accessibility for analytics and reporting.
- Cloud Integration: Implement data solutions on cloud platforms (e.g., AWS, Azure, GCP) integrated with Databricks, Power BI, and API ecosystems.
- Security & Compliance: Implement data governance, security, and compliance best practices within Databricks, Power BI, and API environments.
- Technical Skills:
- Proficiency in Databricks, including Delta Lake, Spark SQL.
- Strong programming skills in Python, Scala, or Java.
- Experience with Apache Spark for big data processing.
- Knowledge of SQL for querying and transforming data.
- Proficiency in Power BI for creating data models, DAX queries, and interactive dashboards.
Preferred Qualifications
- Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
Experience with real-time data processing and streaming

Job Title : Senior Data Engineer – Databricks
Experience : 14 to 20 Years
Location : HSR Layout, Bangalore
Work Mode : Hybrid – 3 Days WFO
Shift : 11:30 AM – 07:30 PM IST
Positions : 2
Notice Period : Immediate Joiners Only
Interview : 1 Technical Round + 2 Client Rounds
Role Overview :
We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.
The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.
Must-Have Skills :
- 14 to 20 years of Data Engineering experience
- Databricks & Apache Spark / PySpark
- Python & SQL
- AWS Cloud
- Lakehouse Architecture
- ETL / ELT & Distributed Data Processing
- Batch & Streaming Pipelines
- Data Pipeline Optimization & Data Modeling
- CDC & Incremental Processing
- Git, CI/CD & Testing
- Data Quality, Monitoring & Observability
- Technical Leadership & Stakeholder Management
Key Responsibilities :
- Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
- Own data products from design through production.
- Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
- Optimize pipelines for performance, scalability, reliability, and cost.
- Design scalable data architectures and data models.
- Implement data quality, monitoring, lineage, and CI/CD practices.
- Lead technical discussions and mentor engineering teams.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Remain hands-on while providing technical leadership.
Ideal Candidate :
A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.
🔴 Super Urgent : Only Bangalore-based immediate joiners.
Data Architect – Databricks & AWS
- Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
- Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
- Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
- Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
- Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
- Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
- Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.

SENIOR DATA ENGINEER – DATABRICKS & SNOWFLAKE
Experience: 7+ Years
Location: Remote
Employment Type: Full-Time
Budget: Up to ₹30 LPA
Time Zone: US Eastern Time (ET)
Shift: US ET Night Shift
Job Description
We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Snowflake, Apache Spark, and AWS to design, develop, and maintain scalable data engineering solutions.
The candidate will work on integrating data from multiple sources, building modern data pipelines, developing enterprise data models, and preparing data platforms for AI/ML applications.
Experience in healthcare, scientific data, or the histopathology domain will be an added advantage.
Key Responsibilities
- Design, build, and maintain scalable data pipelines to acquire, integrate, and manage data from diverse sources such as laboratory systems, MES, clinical supply, quality systems, and external partners.
- Develop and optimize data workflows for structured and unstructured data using Python, PySpark, R, SQL, Databricks, and Snowflake.
- Design and maintain enterprise-level data models and data repositories.
- Perform ETL development, data warehousing, database design, and data integration.
- Ensure data quality, versioning, traceability, and consistency to support AI/ML readiness.
- Collaborate with stakeholders and technical teams to translate business requirements into technical solutions.
- Manage multiple projects while ensuring scalability, performance, and reliability.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks and Snowflake.
- Excellent knowledge of Apache Spark / PySpark.
- Strong experience with AWS cloud services and AWS RDS.
- Experience with Oracle and Microsoft SQL Server (MSSQL).
- Proficiency in Python, R, and SQL.
- Strong understanding of ETL, Data Warehousing (DWH), data modeling, and database design.
- Experience with dbt and cloud-based data architectures.
- Knowledge of NoSQL and graph databases.
- Strong analytical, problem-solving, and stakeholder-management skills.
- Good English communication skills (B2 level or above).
- Willingness to work in the US Eastern Time (ET) night shift.
Preferred / Good to Have
- Experience in histopathology, healthcare, life sciences, or scientific data environments.
- Knowledge of CDISC, HL7, FHIR, OMOP, DICOM, or other regulated data standards.
- Experience handling high-dimensional data, including imaging and sensor data.
- Familiarity with MLOps and machine learning model deployment workflows.
- Knowledge of Manufacturing Execution Systems (MES) and Laboratory Information Management Systems (LIMS).
- Exposure to knowledge graphs and ontology-driven architectures.
Education
Bachelor's degree in Engineering, Data Science, Life Sciences, Computer Science, or a related field. A master's degree is preferred.
Interested candidates can apply with their updated resumes.

We are looking for a Sr. Data Engineer to join our team with 4+ years of experience in SQL, PySpark, ETL, ADLS, Azure Databricks, Unity Catalog, and Azure technologies.
Responsibilities
- 3+ years of experience developing data pipelines using Python/PySpark, with proficiency in Spark SQL and Azure Databricks.
- 4+ years of experience with Azure data engineering technologies, including ADLS, Unity Catalog, Azure Data Factory, Azure Databricks, and Azure SQL/Synapse.
- 4+ years of experience with SQL.
- Experience in data modelling, including dimensional modelling, star schema and snowflake schemas.
- Proficiency in version control tools such as Git and project management tools such as Jira.
Qualifications
- Excellent verbal and written communication skills.
- UG: B.Sc, BCA, or B.Tech/B.E. in any specialization.
- Reliable internet connectivity is required.
Good to Have
- Experience working with financial data or finance-related datasets.
- Experience with Structured Streaming and Azure Event Hubs.
- Experience with Declarative Automation Bundles and Spark Declarative Pipelines (SDP).
- Azure certifications.
8-12 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
• Bachelor’s degree in computer science, Information Technology, or related field.
• Strong proficiency in PySpark, Python, SQL.
• Strong experience in data modeling, ETL/ELT pipeline development, and automation • Hands-on experience with performance tuning of data pipelines and workflow
• Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
• Experience with data modeling, ETL processes, Delta Lake and data warehousing.
• Experience on Delta Live Tables, Autoloader & Unity Catalog.
Preferred - Knowledge of the insurance industry and its data requirements.
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Excellent communication and problem-solving skills to work effectively with diverse teams
• Excellent problem-solving skills and ability to work under tight deadlines.








