Cutshort logo
For Employers
Quintica logo
Solution/Technical Architect (Databricks)
Solution/Technical Architect (Databricks)

Solution/Technical Architect (Databricks) at Quintica · Remote, Bengaluru (Bangalore), Pune, Chennai, Nagpur · 5 - 15 years · ₹20L - ₹30L / yr · Bootstrapped · Remote friendly · Posted 22 Sep 2025

Quintica's logo

Solution/Technical Architect (Databricks)

Nitin D's profile picture
Posted by Nitin D
5 - 15 yrs
₹20L - ₹30L / yr
Remote, Bengaluru (Bangalore), Pune, Chennai, Nagpur
Skills
databricks
PySpark
Apache Spark
CI/CD
Data engineering


Technical Architect (Databricks)

  • 10+ Years Data Engineering Experience with expertise in Databricks
  • 3+ years of consulting experience
  • Completed Data Engineering Professional certification & required classes
  • Minimum 2-3 projects delivered with hands-on experience in Databricks
  • Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark™ on Databricks
  • Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines
  • Familiarity with Databricks multi-hop pipeline architecture

 

 

Sr. Data Engineer (Databricks)

 

  • 5+ Years Data Engineering Experience with expertise in Databricks
  • Completed Data Engineering Associate certification & required classes
  • Minimum 1 project delivered with hands-on experience in development on Databricks
  • Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark™ on Databricks
  • SQL delivery experience, and familiarity with Bigquery, Synapse or Redshift
  • Proficient in Python, knowledge of additional databricks programming languages (Scala)


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Quintica

Founded :
2002
Type :
Products & Services
Size :
100-1000
Stage :
Bootstrapped

About

N/A

Company social profiles

N/A

Similar jobs (10)

Global analytics and digital solutions company
Actively reviewing applications
Global analytics and digital solutions company
Agency job
via Bean HR Consulting by Sandeep Kothari
Gurugram, Pune, Noida, Bengaluru (Bangalore)
11 - 15 yrs
₹40L - ₹45L / yr
data Architect
Microsoft Windows Azure
databricks
Snow flake schema
SQL
+2 more

Role: Technical Architect – Data & Cloud

 

We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms. The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.

Key Responsibilities:

  • Design enterprise-scale Data Lakehouse and Data Warehouse architectures.
  • Define data ingestion, transformation, and serving architecture.
  • Lead architecture discussions and technical governance.
  • Design scalable ETL/ELT frameworks using Databricks and Snowflake.
  • Define best practices for security, performance optimization, CI/CD, and DevOps.
  • Provide technical guidance to engineering teams during implementation.
  • Collaborate with business, product, architecture, and data governance teams.

 

Must-Have Skills:

  • Azure and/or AWS
  • Databricks
  • Snowflake
  • Data Lakehouse Architecture
  • PySpark
  • SQL
  • Data Modelling
  • ETL/ELT Architecture
  • Performance Optimization
  • CI/CD
  • Terraform / Infrastructure as Code, preferred

Preferred Skills:

  • Insurance domain experience
  • dbt
  • Unity Catalog
  • Delta Lake
  • Iceberg
  • Azure Data Factory / AWS Glue
Read more
Insurtech
Actively reviewing applications
Insurtech
Agency job
via Bean HR Consulting by Simran Kaur
Bengaluru (Bangalore), Pune, Noida, Gurugram
11 - 15 yrs
Best in industry
azure
skill iconAmazon Web Services (AWS)
snowflake
databricks
Windows Azure
+2 more

Position: Technical Architect – Data Engineering


Job Summary:

  • We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
  • The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
  • The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.


Key Responsibilities

• Design enterprise-scale data lakehouse and data warehouse architectures.

• Define data ingestion, transformation, and serving architecture.

• Lead architecture discussions and technical governance.

• Design scalable ETL/ELT frameworks using Databricks and Snowflake.

• Define best practices for security, performance, CI/CD, and DevOps.

• Guide engineering teams on implementation.

• Collaborate with business, product, and data governance teams.


Must Have Skills :

• Azure or AWS

• Databricks

• Snowflake

• Data Lakehouse Architecture

• PySpark

• SQL

• Data Modelling

• ETL/ELT Architecture

• Performance Optimization

• CI/CD

• Terraform or Infrastructure as Code (preferred)


Preferred

• Insurance domain

• dbt

• Unity Catalog

• Delta Lake

• Iceberg

• Azure Data Factory / AWS Glue  

Read more
Top MNC
Actively reviewing applications
Top MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by sandhiya lakshmi
Remote only
9 - 15 yrs
₹22L - ₹28L / yr
Data Engineer
Genie
Azure
skill iconAmazon Web Services (AWS)
SQL
+1 more

Job Summary

We are looking for an experienced Databricks Lead to lead and manage data engineering initiatives. The ideal candidate should have strong hands-on experience with Databricks, data engineering, and cloud-based data platforms, along with the ability to guide a team, drive technical decisions, and ensure successful project delivery.

Key Responsibilities

  • Lead and manage Databricks-based data engineering projects.
  • Design, develop, and implement scalable data pipelines using Databricks.
  • Provide technical guidance and mentorship to team members.
  • Work on data ingestion, transformation, processing, and integration.
  • Develop and optimize ETL/ELT workflows using PySpark and Spark SQL.
  • Handle performance tuning and optimization of Databricks workloads.
  • Collaborate with business stakeholders, architects, and cross-functional teams.
  • Identify and resolve technical issues and ensure smooth project delivery.
  • Follow best practices for data quality, security, and governance.
  • Participate in technical discussions, code reviews, and solution design.

Mandatory Skills

  • Strong hands-on experience with Databricks.
  • Good knowledge of Apache Spark, PySpark, and Spark SQL.
  • Experience in data engineering and ETL/ELT pipelines.
  • Strong programming knowledge in Python and SQL.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Understanding of data lake and lakehouse architecture.
  • Experience in team leadership and technical coordination.
  • Strong problem-solving and communication skills.


Read more
IT services and consulting organization,
IT services and consulting organization,
Agency job
via Unique Occupational by Mantasha Naaz
Bengaluru (Bangalore)
5 - 8 yrs
₹16L - ₹18L / yr
Microsoft Fabric, Data Engineer, Azure Databricks

Job Description:

We are seeking a skilled Senior Data Engineer with expertise in Databricks to join our dynamic data team. The ideal candidate will design, build, and maintain scalable data pipelines and architectures to support our organization's data-driven initiatives and leverage Databricks to process large-scale datasets, optimize data workflows, enable advanced analytics and machine learning, and integrate Power BI for data visualization and reporting.

Key Responsibilities

·        5-8 years of professional work experience in a relevant field

·        Proficient in Microsoft Fabric platform, Azure Databricks, ADF, Delta Lake, SQL Data Warehouse, Unity Catalog.

·        Good Experience on Microsoft Dynamics 365

·        Experience/ prior knowledge on semi structure data and Structured Streaming, Azure synapse, data lake, data warehouse.

·        Proficient in creating Azure Data Factory pipelines for ETL/ELT processing; copy activity, custom Azure development etc.

·        Good knowledge of SQL and Python for data manipulation, transformation, and analysis

·        Understand business requirements to set functional specifications for reporting applications

  • Data Pipeline Development: Design, develop, and maintain robust, scalable data pipelines using Databricks, Apache Spark, and other cloud-based technologies.
  • Data Integration: Ingest, transform, and integrate data from diverse sources, including APIs, databases, streaming platforms, and third-party systems, into Databricks for analytics and reporting.
  • Power BI Integration: Develop and optimize data models and datasets in Databricks for use in Power BI, ensuring efficient data connections and high-quality visualizations.
  • Performance Optimization: Optimize data workflows, API calls, and queries on Databricks and Power BI for performance, cost-efficiency, and scalability.
  • Data Modeling: Build and maintain data models to support business requirements, ensuring data quality, consistency, and accessibility for analytics and reporting.
  • Cloud Integration: Implement data solutions on cloud platforms (e.g., AWS, Azure, GCP) integrated with Databricks, Power BI, and API ecosystems.
  • Security & Compliance: Implement data governance, security, and compliance best practices within Databricks, Power BI, and API environments.
  • Technical Skills:
  • Proficiency in Databricks, including Delta Lake, Spark SQL.
  • Strong programming skills in Python, Scala, or Java.
  • Experience with Apache Spark for big data processing.
  • Knowledge of SQL for querying and transforming data.
  • Proficiency in Power BI for creating data models, DAX queries, and interactive dashboards.

Preferred Qualifications

  • Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).

Experience with real-time data processing and streaming

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Bengaluru (Bangalore)
14 - 25 yrs
₹50L - ₹70L / yr
Data engineering
databricks
Apache Spark
PySpark
skill iconPython
+19 more

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds


Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.


Must-Have Skills :

  • 14 to 20 years of Data Engineering experience
  • Databricks & Apache Spark / PySpark
  • Python & SQL
  • AWS Cloud
  • Lakehouse Architecture
  • ETL / ELT & Distributed Data Processing
  • Batch & Streaming Pipelines
  • Data Pipeline Optimization & Data Modeling
  • CDC & Incremental Processing
  • Git, CI/CD & Testing
  • Data Quality, Monitoring & Observability
  • Technical Leadership & Stakeholder Management


Key Responsibilities :

  • Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
  • Own data products from design through production.
  • Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
  • Optimize pipelines for performance, scalability, reliability, and cost.
  • Design scalable data architectures and data models.
  • Implement data quality, monitoring, lineage, and CI/CD practices.
  • Lead technical discussions and mentor engineering teams.
  • Collaborate with business stakeholders, architects, product owners, and engineering teams.
  • Remain hands-on while providing technical leadership.


Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vishakha Walunj
Posted by Vishakha Walunj
Pune
8 - 15 yrs
Best in industry
skill iconPython
PySpark
databricks
skill iconAmazon Web Services (AWS)
SQL

Data Architect – Databricks & AWS

  • Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
  • Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
  • Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
  • Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
  • Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
  • Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
  • Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Robin Silverster
Posted by Robin Silverster
Bengaluru (Bangalore)
7 - 10 yrs
₹15L - ₹40L / yr
Data engineering
skill iconPython
PySpark
Data Transformation Tool (DBT)
Apache Airflow
+2 more

About the Role

We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.

Key Responsibilities

  • Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
  • Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
  • Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
  • Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
  • Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
  • Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.

Required Skills

  • Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
  • Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
  • Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
  • Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
  • Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
  • Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
  • Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
  • Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
  • Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
  • Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.

Nice to Have

  • Hands-on exposure to Microsoft Fabric for data integration and analytics.
  • Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
  • Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
  • Domain expertise in financial services.


Read more
Cloud Sara Technologies
Actively reviewing applications
Pradeepa R
Posted by Pradeepa R
Remote only
7 - 7 yrs
₹30L - ₹30L / yr
databricks
Snowflake
Apache Spark
PySpark
AWS RDS
+4 more

SENIOR DATA ENGINEER – DATABRICKS & SNOWFLAKE

Experience: 7+ Years

Location: Remote

Employment Type: Full-Time

Budget: Up to ₹30 LPA

Time Zone: US Eastern Time (ET)

Shift: US ET Night Shift

Job Description

We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Snowflake, Apache Spark, and AWS to design, develop, and maintain scalable data engineering solutions.

The candidate will work on integrating data from multiple sources, building modern data pipelines, developing enterprise data models, and preparing data platforms for AI/ML applications.

Experience in healthcare, scientific data, or the histopathology domain will be an added advantage.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines to acquire, integrate, and manage data from diverse sources such as laboratory systems, MES, clinical supply, quality systems, and external partners.
  • Develop and optimize data workflows for structured and unstructured data using Python, PySpark, R, SQL, Databricks, and Snowflake.
  • Design and maintain enterprise-level data models and data repositories.
  • Perform ETL development, data warehousing, database design, and data integration.
  • Ensure data quality, versioning, traceability, and consistency to support AI/ML readiness.
  • Collaborate with stakeholders and technical teams to translate business requirements into technical solutions.
  • Manage multiple projects while ensuring scalability, performance, and reliability.

Required Skills

  • 7+ years of experience in Data Engineering.
  • Strong hands-on experience with Databricks and Snowflake.
  • Excellent knowledge of Apache Spark / PySpark.
  • Strong experience with AWS cloud services and AWS RDS.
  • Experience with Oracle and Microsoft SQL Server (MSSQL).
  • Proficiency in Python, R, and SQL.
  • Strong understanding of ETL, Data Warehousing (DWH), data modeling, and database design.
  • Experience with dbt and cloud-based data architectures.
  • Knowledge of NoSQL and graph databases.
  • Strong analytical, problem-solving, and stakeholder-management skills.
  • Good English communication skills (B2 level or above).
  • Willingness to work in the US Eastern Time (ET) night shift.

Preferred / Good to Have

  • Experience in histopathology, healthcare, life sciences, or scientific data environments.
  • Knowledge of CDISC, HL7, FHIR, OMOP, DICOM, or other regulated data standards.
  • Experience handling high-dimensional data, including imaging and sensor data.
  • Familiarity with MLOps and machine learning model deployment workflows.
  • Knowledge of Manufacturing Execution Systems (MES) and Laboratory Information Management Systems (LIMS).
  • Exposure to knowledge graphs and ontology-driven architectures.

Education

Bachelor's degree in Engineering, Data Science, Life Sciences, Computer Science, or a related field. A master's degree is preferred.

Interested candidates can apply with their updated resumes.

Read more
Building the Intelligence Layer for Modern Enterprises
Actively reviewing applications
"Building the Intelligence Layer for Modern Enterprises"
Exclusive
job in Cutshort Lightning by Ariba Khan
Remote only
4 - 7 yrs
Upto ₹15L / yr (Varies
)
Data Structures
Windows Azure
databricks
SQL
skill iconPython
+5 more

We are looking for a Sr. Data Engineer to join our team with 4+ years of experience in SQL, PySpark, ETL, ADLS, Azure Databricks, Unity Catalog, and Azure technologies.


Responsibilities

  • 3+ years of experience developing data pipelines using Python/PySpark, with proficiency in Spark SQL and Azure Databricks.
  • 4+ years of experience with Azure data engineering technologies, including ADLS, Unity Catalog, Azure Data Factory, Azure Databricks, and Azure SQL/Synapse.
  • 4+ years of experience with SQL.
  • Experience in data modelling, including dimensional modelling, star schema and snowflake schemas.
  • Proficiency in version control tools such as Git and project management tools such as Jira.


Qualifications

  • Excellent verbal and written communication skills.
  • UG: B.Sc, BCA, or B.Tech/B.E. in any specialization.
  • Reliable internet connectivity is required.


Good to Have

  • Experience working with financial data or finance-related datasets.
  • Experience with Structured Streaming and Azure Event Hubs.
  • Experience with Declarative Automation Bundles and Spark Declarative Pipelines (SDP).
  • Azure certifications.
Read more
Management and Analytics
Management and Analytics
Agency job
via Bean HR Consulting by SHINJANI TRIVEDI
Gurugram, Pune, Bangarmau
8 - 15 yrs
₹45L - ₹50L / yr
Windows Azure
databricks
SQL
ETL
skill iconPython
+2 more

8-12 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.

• Bachelor’s degree in computer science, Information Technology, or related field.

• Strong proficiency in PySpark, Python, SQL.

• Strong experience in data modeling, ETL/ELT pipeline development, and automation • Hands-on experience with performance tuning of data pipelines and workflow

• Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.

• Experience with data modeling, ETL processes, Delta Lake and data warehousing.

• Experience on Delta Live Tables, Autoloader & Unity Catalog.


Preferred - Knowledge of the insurance industry and its data requirements.

• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.

• Excellent communication and problem-solving skills to work effectively with diverse teams

• Excellent problem-solving skills and ability to work under tight deadlines. 

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos