VP - Data Architect (B2B SaaS) at Technology Industry · Delhi · 10 - 15 years · ₹105L - ₹140L / yr · Posted 17 Nov 2025

MANDATORY:
- Super Quality Data Architect, Data Engineering Manager / Director Profile
- Must have 12+ YOE in Data Engineering roles, with at least 2+ years in a Leadership role
- Must have 7+ YOE in hands-on Tech development with Java (Highly preferred) or Python, Node.JS, GoLang
- Must have strong experience in large data technologies, tools like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto etc.
- Strong expertise in HLD and LLD, to design scalable, maintainable data architectures.
- Must have managed a team of at least 5+ Data Engineers (Read Leadership role in CV)
- Product Companies (Prefers high-scale, data-heavy companies)
PREFERRED:
- Must be from Tier - 1 Colleges, preferred IIT
- Candidates must have spent a minimum 3 yrs in each company.
- Must have recent 4+ YOE with high-growth Product startups, and should have implemented Data Engineering systems from an early stage in the Company
ROLES & RESPONSIBILITIES:
- Lead and mentor a team of data engineers, ensuring high performance and career growth.
- Architect and optimize scalable data infrastructure, ensuring high availability and reliability.
- Drive the development and implementation of data governance frameworks and best practices.
- Work closely with cross-functional teams to define and execute a data roadmap.
- Optimize data processing workflows for performance and cost efficiency.
- Ensure data security, compliance, and quality across all data platforms.
- Foster a culture of innovation and technical excellence within the data team.
IDEAL CANDIDATE:
- 10+ years of experience in software/data engineering, with at least 3+ years in a leadership role.
- Expertise in backend development with programming languages such as Java, PHP, Python, Node.JS, GoLang, JavaScript, HTML, and CSS.
- Proficiency in SQL, Python, and Scala for data processing and analytics.
- Strong understanding of cloud platforms (AWS, GCP, or Azure) and their data services.
- Strong foundation and expertise in HLD and LLD, as well as design patterns, preferably using Spring Boot or Google Guice
- Experience in big data technologies such as Spark, Hadoop, Kafka, and distributed computing frameworks.
- Hands-on experience with data warehousing solutions such as Snowflake, Redshift, or BigQuery
- Deep knowledge of data governance, security, and compliance (GDPR, SOC2, etc.).
- Experience in NoSQL databases like Redis, Cassandra, MongoDB, and TiDB.
- Familiarity with automation and DevOps tools like Jenkins, Ansible, Docker, Kubernetes, Chef, Grafana, and ELK.
- Proven ability to drive technical strategy and align it with business objectives.
- Strong leadership, communication, and stakeholder management skills.
PREFERRED QUALIFICATIONS:
- Experience in machine learning infrastructure or MLOps is a plus.
- Exposure to real-time data processing and analytics.
- Interest in data structures, algorithm analysis and design, multicore programming, and scalable architecture.
- Prior experience in a SaaS or high-growth tech company.

Similar jobs (10)

Job Title : Senior Data Engineer – Databricks
Experience : 14 to 20 Years
Location : HSR Layout, Bangalore
Work Mode : Hybrid – 3 Days WFO
Shift : 11:30 AM – 07:30 PM IST
Positions : 2
Notice Period : Immediate Joiners Only
Interview : 1 Technical Round + 2 Client Rounds
Role Overview :
We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.
The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.
Must-Have Skills :
- 14 to 20 years of Data Engineering experience
- Databricks & Apache Spark / PySpark
- Python & SQL
- AWS Cloud
- Lakehouse Architecture
- ETL / ELT & Distributed Data Processing
- Batch & Streaming Pipelines
- Data Pipeline Optimization & Data Modeling
- CDC & Incremental Processing
- Git, CI/CD & Testing
- Data Quality, Monitoring & Observability
- Technical Leadership & Stakeholder Management
Key Responsibilities :
- Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
- Own data products from design through production.
- Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
- Optimize pipelines for performance, scalability, reliability, and cost.
- Design scalable data architectures and data models.
- Implement data quality, monitoring, lineage, and CI/CD practices.
- Lead technical discussions and mentor engineering teams.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Remain hands-on while providing technical leadership.
Ideal Candidate :
A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.
🔴 Super Urgent : Only Bangalore-based immediate joiners.

Job Title : Tech Lead – Data Lake Platform
Number of Positions : 2
Experience : 7+ Years
Role Type : Technical Lead / Data Platform Lead
Domain : Data Engineering / Data Platform / AWS
About the Role :
We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.
The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.
As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.
Core Tech Stack :
AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka
Key Responsibilities :
- Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
- Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
- Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
- Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
- Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
- Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
- Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
- Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
- Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
- Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
- Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
- Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.
Must-Have Skills :
- 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
- Strong hands-on experience with AWS Data Services, including:
- Amazon S3
- AWS EMR
- AWS Glue
- Amazon Athena
- Amazon Redshift
- AWS DMS
- AWS Lambda
- Amazon RDS
- AWS IAM
- Strong production experience with Apache Airflow.
- Strong hands-on experience with Apache Spark / PySpark.
- Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
- Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
- Strong understanding of data lake architecture and enterprise data platforms.
- Proven experience leading engineers and driving technical decisions.
- Hands-on experience with production support, troubleshooting, incident management, and RCA.
- Strong understanding of data platform performance, scalability, reliability, and SLA management.
Good-to-Have Skills :
- Experience with DBT and modern data transformation practices.
- Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
- Strong knowledge of Amazon Redshift workload optimization, including :
- Distribution keys
- Sort keys
- Spectrum
- External tables
- Experience with Kafka or other streaming/data ingestion technologies.
- Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
- Experience with Lambda and API Gateway for API-based data serving.
- Experience with enterprise data governance, data quality, security, and compliance.
- Experience in BFSI / Banking / Financial Services / Insurance domain.
Ideal Candidate :
The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Tech Lead – Data Lake Platform
Recruitment & Payroll Company: Neogencode Technologies
Job Location: Sector 43, Gurugram, Haryana
Work Mode: On-site (Work from Office)
Working Days: 5 days a week
Experience Required: 5+ years
Employment Type: Full-time
About the Opportunity
We are hiring a Tech Lead – Data Lake Platform. This opportunity involves working on an enterprise-grade AWS data lake platform supporting data engineering, analytics, reporting, and business applications.
The candidate will be employed on the payroll of Neogencode Technologies and will work at the client location in Sector 43, Gurugram.
Key Responsibilities
- Own and design end-to-end data lake architecture, including data ingestion, staging, curated layers, and data consumption.
- Lead data engineering pipelines using AWS services, Apache Airflow, Spark/PySpark, and dbt.
- Manage AWS data services such as S3, EMR, Glue, Athena, Redshift, Lambda, RDS, IAM, and DMS.
- Design and support API/data-serving solutions using PostgreSQL, Hasura GraphQL, or similar technologies.
- Improve pipeline performance, platform reliability, monitoring, and service-level agreements (SLAs).
- Ensure data security, access control, personally identifiable information (PII) protection, and governance.
- Mentor data engineers, conduct code reviews, and handle production incidents and root-cause analysis.
- Collaborate with business and application teams to deliver data and reporting solutions.
Required Skills
- 5+ years of experience in data engineering or platform engineering, including technical leadership.
- Strong hands-on experience with AWS data services and enterprise data lake architecture.
- Production experience with Apache Airflow, Spark/PySpark, and SQL.
- Strong understanding of data modeling and layered data architecture.
- Experience with PostgreSQL and Hasura GraphQL or a similar API/data-serving layer.
- Proven experience in technical leadership, production support, and troubleshooting.
Good to Have
- Experience with dbt and lakehouse table formats.
- Knowledge of Kafka or streaming data ingestion.
- Experience with Redshift optimization and workload design.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Join our product development team at Planview as a Senior Software Engineer I and become a pivotal force on the Viz Core Team. This role offers the unique opportunity to shape and lead the development of data-processing pipelines and APIs that are at the heart of our software solutions. These solutions are designed to streamline and enhance the efficiency of software delivery, resonating deeply with software engineers who strive to build better and faster.
At Planview Viz, which is powered by the innovative “Flow Framework,” you will tackle complex data challenges and develop scalable solutions within an AWS cloud environment. Your efforts will be crucial in revolutionizing how businesses harness and interpret vast amounts of workflow data, transforming it into actionable insights that propel organizational efficiency and effectiveness.
Responsibilities (What you'll do)
- Create and refine powerful data-processing architectures that integrate seamlessly with a diverse array of external tools, enhancing the way software is delivered across industries.
- Drive operational excellence by critically analyzing problems, defining requirements, and devising robust solutions that push the boundaries of technology.
- Lead and inspire a team of talented engineers, promoting a culture of ownership, meticulous attention to quality, and proactive problem-solving.
- Stay at the cutting edge of technology by updating and expanding your team’s knowledge of cloud architectures, data processing, and advanced analytics, ensuring that you and your team remain leaders in technological innovation.
- Make a direct impact on the efficiency and effectiveness of software delivery worldwide through innovation and leadership.
Qualifications (What you'll bring)
Who We’re Looking For
The ideal candidate is a seasoned professional in cloud software development with a strong foundation in data processing and scalable software systems. You thrive in collaborative environments and are passionate about advancing cloud technology and data architecture to new heights. You are a leader who enjoys mentoring, guiding, and inspiring others.
Preferred Qualifications
Skills, Knowledge, and Expertise
- A degree in Computer Science, Engineering, or a related field.
- 6+ years of experience with a modern programming language, with a focus on back-end systems and cloud-based technologies.
- Strong capability in architecting and designing robust, scalable software systems.
- Proficiency in AWS or another popular cloud platform.
Additional Qualifications
- Experience with big-data technologies such as Spark and Apache Kafka.
- Experience with Java (version 17), Scala, or other JVM programming languages.
- Experience with tools such as Amazon Redshift and MongoDB.
- Experience with continuous integration and continuous deployment tools such as GitHub, Jenkins, Travis CI, or similar platforms.
- Proficiency in test-driven development.
- Experience with containers and orchestration tools such as Kubernetes.
- Experience working on remote or distributed teams and projects.
Job Summary
We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.
Key Responsibilities
- Develop and maintain data pipelines using Python and PySpark.
- Design and implement data lakehouse solutions on AWS.
- Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.
- Work with DynamoDB and other data storage technologies.
- Monitor data pipelines and ensure data quality, performance, and reliability.
- Collaborate with stakeholders and engineering teams to deliver data solutions.
Mandatory Skills
- 5+ years of overall professional experience.
- 3+ years of experience in data platforms and big data technologies.
- Strong proficiency in Python and PySpark.
- Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.
- Experience designing and implementing AWS data lakehouse architectures.
Good to Have
- Apache Spark and Apache Iceberg.
- AWS Lambda, EventBridge, Kinesis, and Redshift.
- Experience with real-time data pipelines and event-driven architectures.
🚨 HIRING | Data Engineer – Amazon EMR 🔥
We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.
📌 JOB DETAILS:
💼 Experience: 6+ Years
💰 CTC: Up to 30 LPA
📍 Location: Bangalore
🔑 MANDATORY SKILLS:
• Amazon EMR
• Python
• Scala
• Data Engineering
📋 KEY REQUIREMENTS:
• 6+ years of relevant experience in Data Engineering.
• Strong hands-on experience with Amazon EMR.
• Strong programming skills in Python and Scala.
• Experience with large-scale data processing and data engineering solutions.
• Strong problem-solving and communication skills.
📩 Interested candidates can share their updated resumes:
📧 pavithra.e @vysystems. com
📞 8 9 2 5 8 0 2 4 5 7
🔄 Know someone who would be a good fit? Tag them or share this post!
#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow

Job Description: Associate Director-Data Engineering (Databricks Lakehouse Architect + Cloud Data Engineering Leader)
About our Client -
Client is a leading SAP consulting and digital transformation partner committed to delivering innovative, high-impact solutions across enterprise analytics, cloud, and intelligent business platforms.
As enterprises modernize their data landscapes, the role of traditional data warehousing is rapidly evolving into scalable cloud-native Data Lakehouse architectures. Applexus is expanding its modern data engineering capabilities to help customers integrate enterprise data from SAP and non-SAP ecosystems, build advanced analytics platforms, and enable future-ready AI-driven solutions.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
Role Overview:
We are looking for a hands-on Data Engineering leader who can architect modern cloud data platforms using Databricks Lakehouse and lead solution design, delivery, and engineering teams. This role requires strong technical ownership rather than a pure people management background.
Key Responsibilities:
• Architect scalable Data Lakehouse platforms
• Own solution design, estimation, architecture reviews and client discussions
• Build and optimize enterprise data pipelines
• Provide technical guidance to data engineering teams
• Establish best practices around performance, governance and architecture
Must Have - Databricks Architecture:
• Databricks Lakehouse design
• Delta Lake implementation
• Apache Spark / PySpark engineering
• Medallion architecture (Bronze/Silver/Gold layers)
• Data pipeline optimization
• Unity Catalog and data governance exposure
Cloud Platform Expertise (depth in one required):
Microsoft Azure:
• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Azure Synapse Analytics
OR
Amazon AWS:
• Databricks on AWS
• Amazon S3
• AWS Glue
• Redshift
• Athena
Good to Have:
• Snowflake
• ML Engineering exposure
• Cloud/Data Engineering certifications
Ideal Candidate:
A hands-on architect who can talk to customers, design solutions, estimate projects, guide engineers and review architecture while helping build a modern Data Engineering practice.
We are looking for an accomplished Databricks Lakehouse Architect / Cloud Data Engineering Leader who can play a key role in this transformation journey — designing modern data platforms, leading cloud data engineering initiatives, and bridging enterprise analytics with next-generation technologies.
The ideal candidate will combine strong hands-on expertise in Databricks, Spark/PySpark, Delta Lake, and Azure/AWS cloud platforms with the ability to engage customers, architect solutions, guide engineering teams, and drive successful delivery.
If you are a hands-on Data Architect who enjoys building modern data platforms and wants to move beyond execution into solution ownership and leadership, I would love to connect.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.









