Senior Data Architect at Talent Pro · Delhi · 10 - 15 years · ₹90L - ₹120L / yr · Bootstrapped · Posted 13 Jul 2025

Strong Data Architect, Lead Data Engineer, Engineering Manager / Director Profile
Mandatory (Experience 1) - Must have 10+ YOE in Data Engineering roles, with at least 2+ years in a Leadership role
Mandatory (Experience 2) - Must have 7+ YOE in hands-on Tech development with Java (Highly preferred) or Python, Node.JS, GoLang
Mandatory (Experience 3) - Must have recent 4+ YOE with high-growth Product startups, and should have implemented Data Engineering systems from an early stage in the Company
Mandatory (Experience 4) - Must have strong experience in large data technologies, tools like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto etc.
Mandatory (Experience 5) - Strong expertise in HLD and LLD, to design scalable, maintainable data architectures.
Mandatory (Team Management) - Must have managed a team of atleast 5+ Data Engineers (Read Leadership role in CV)
Mandatory (Education) - Must be from Tier - 1 Colleges, preferred IIT
Mandatory (Company) - B2B Product Companies with High data-traffic
Preferred Companies
MoEngage, Whatfix, Netcore Cloud, Clevertap, Hevo Data, Snowflake, Chargebee, Fractor.ai, Databricks, Dataweave, Wingman, Postman, Zoho, HighRadius, Freshworks, Mindtickle

Similar jobs (10)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.

Job Title : Senior Data Engineer – Databricks
Experience : 14 to 20 Years
Location : HSR Layout, Bangalore
Work Mode : Hybrid – 3 Days WFO
Shift : 11:30 AM – 07:30 PM IST
Positions : 2
Notice Period : Immediate Joiners Only
Interview : 1 Technical Round + 2 Client Rounds
Role Overview :
We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.
The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.
Must-Have Skills :
- 14 to 20 years of Data Engineering experience
- Databricks & Apache Spark / PySpark
- Python & SQL
- AWS Cloud
- Lakehouse Architecture
- ETL / ELT & Distributed Data Processing
- Batch & Streaming Pipelines
- Data Pipeline Optimization & Data Modeling
- CDC & Incremental Processing
- Git, CI/CD & Testing
- Data Quality, Monitoring & Observability
- Technical Leadership & Stakeholder Management
Key Responsibilities :
- Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
- Own data products from design through production.
- Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
- Optimize pipelines for performance, scalability, reliability, and cost.
- Design scalable data architectures and data models.
- Implement data quality, monitoring, lineage, and CI/CD practices.
- Lead technical discussions and mentor engineering teams.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Remain hands-on while providing technical leadership.
Ideal Candidate :
A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.
🔴 Super Urgent : Only Bangalore-based immediate joiners.

Job Title : Tech Lead – Data Lake Platform
Number of Positions : 2
Experience : 7+ Years
Role Type : Technical Lead / Data Platform Lead
Domain : Data Engineering / Data Platform / AWS
About the Role :
We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.
The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.
As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.
Core Tech Stack :
AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka
Key Responsibilities :
- Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
- Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
- Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
- Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
- Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
- Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
- Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
- Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
- Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
- Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
- Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
- Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.
Must-Have Skills :
- 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
- Strong hands-on experience with AWS Data Services, including:
- Amazon S3
- AWS EMR
- AWS Glue
- Amazon Athena
- Amazon Redshift
- AWS DMS
- AWS Lambda
- Amazon RDS
- AWS IAM
- Strong production experience with Apache Airflow.
- Strong hands-on experience with Apache Spark / PySpark.
- Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
- Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
- Strong understanding of data lake architecture and enterprise data platforms.
- Proven experience leading engineers and driving technical decisions.
- Hands-on experience with production support, troubleshooting, incident management, and RCA.
- Strong understanding of data platform performance, scalability, reliability, and SLA management.
Good-to-Have Skills :
- Experience with DBT and modern data transformation practices.
- Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
- Strong knowledge of Amazon Redshift workload optimization, including :
- Distribution keys
- Sort keys
- Spectrum
- External tables
- Experience with Kafka or other streaming/data ingestion technologies.
- Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
- Experience with Lambda and API Gateway for API-based data serving.
- Experience with enterprise data governance, data quality, security, and compliance.
- Experience in BFSI / Banking / Financial Services / Insurance domain.
Ideal Candidate :
The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Tech Lead – Data Lake Platform
Recruitment & Payroll Company: Neogencode Technologies
Job Location: Sector 43, Gurugram, Haryana
Work Mode: On-site (Work from Office)
Working Days: 5 days a week
Experience Required: 5+ years
Employment Type: Full-time
About the Opportunity
We are hiring a Tech Lead – Data Lake Platform. This opportunity involves working on an enterprise-grade AWS data lake platform supporting data engineering, analytics, reporting, and business applications.
The candidate will be employed on the payroll of Neogencode Technologies and will work at the client location in Sector 43, Gurugram.
Key Responsibilities
- Own and design end-to-end data lake architecture, including data ingestion, staging, curated layers, and data consumption.
- Lead data engineering pipelines using AWS services, Apache Airflow, Spark/PySpark, and dbt.
- Manage AWS data services such as S3, EMR, Glue, Athena, Redshift, Lambda, RDS, IAM, and DMS.
- Design and support API/data-serving solutions using PostgreSQL, Hasura GraphQL, or similar technologies.
- Improve pipeline performance, platform reliability, monitoring, and service-level agreements (SLAs).
- Ensure data security, access control, personally identifiable information (PII) protection, and governance.
- Mentor data engineers, conduct code reviews, and handle production incidents and root-cause analysis.
- Collaborate with business and application teams to deliver data and reporting solutions.
Required Skills
- 5+ years of experience in data engineering or platform engineering, including technical leadership.
- Strong hands-on experience with AWS data services and enterprise data lake architecture.
- Production experience with Apache Airflow, Spark/PySpark, and SQL.
- Strong understanding of data modeling and layered data architecture.
- Experience with PostgreSQL and Hasura GraphQL or a similar API/data-serving layer.
- Proven experience in technical leadership, production support, and troubleshooting.
Good to Have
- Experience with dbt and lakehouse table formats.
- Knowledge of Kafka or streaming data ingestion.
- Experience with Redshift optimization and workload design.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Data Architect – Databricks & AWS
- Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
- Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
- Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
- Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
- Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
- Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
- Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.

Key Skills:
Python & System Design: Strong expertise in Python and system design, with proven experience architecting scalable, production-grade systems.
LLM & Agentic AI: Proven experience building LLM-based and agentic systems from the ground up and evaluating them based on reproducibility, calibration, and cost.
Cloud & Data Architecture: Deep understanding of data and cloud architecture across AWS and Azure, including multi-store data design, distributed systems, streaming, security, and cost optimization.
Azure Databricks: Hands-on production experience with Azure Databricks architecture, including Unity Catalog, Delta Lake, cluster policy design, job orchestration, and Terraform provisioning.
Supply Chain & Inventory Management: Strong domain knowledge of supply chain and inventory operations, including demand planning, MRP logic, inventory parameters, and translating business planning decisions into data requirements.
System Architecture & Technical Decision-Making: Ability to make sound architectural decisions based on first principles, evaluate technical trade-offs, and avoid unnecessary complexity and abstraction.
LLM & Agentic AI: Proven experience building LLM-based and agentic systems from the ground up and evaluating them based on reproducibility, calibration, and cost.
Technical Leadership: Ability to influence teams without direct authority, establish technical standards, prepare technical specifications and documentation, and mentor team members.
Experience in pharmaceutical or regulated industries is highly valued.

SDE3 – Data Platform Engineer
Experience: 5–10 Years
Employment Type: Contract-to-Hire (3 Months)
Location: Remote initially | Pune after conversion
About the Role
We are looking for an experienced SDE3 – Data Platform Engineer with strong backend development and data engineering expertise.
The ideal candidate should have excellent programming skills in Java (preferred), Golang, or Python, along with hands-on experience building scalable data platforms, distributed systems, and data pipelines.
Key Responsibilities
- Design and develop scalable backend and data platform solutions.
- Build and optimize ETL/ELT pipelines and data ingestion systems.
- Develop APIs and backend services for data infrastructure.
- Work with Kafka, Spark, Airflow, BigQuery, and Redshift.
- Handle large-scale data processing and distributed systems.
- Optimize application performance, scalability, and reliability.
- Collaborate with engineering teams to deliver production-grade solutions.
Required Skills
- Strong programming in Java, Golang, or Python (Java preferred).
- Backend development and API development.
- Data pipelines, ETL/ELT, and data ingestion.
- Strong SQL and data modeling.
- Kafka, Spark, Airflow, BigQuery, or Redshift.
- Distributed systems and system design.
- Docker, Kubernetes, and CI/CD fundamentals.
Ideal Candidate
- Strong Backend + Data Engineering background.
- Experience building scalable data platforms.
- Excellent coding and problem-solving skills.
- Experience handling high-volume data processing.
Note: Pure Data Engineers, BI/Analytics professionals, and candidates with only SQL reporting or basic ETL experience are not suitable.
Work Arrangement
- Initial 3-month contractual period – Remote.
- Conversion based on performance.
- Post-conversion – 5 days WFO from Pune.

Designation: Data Architect
Reporting: VP, Engineering
Desired Experience: 12 – 18 Years
Qualification: BE/ B Tech/ M Tech/ MCA and any Graduate.
Job Location: Noida Sec-6 (Nearest Metro Station 15)
(WFH/Work from Home Available)
Total Employees: 100+ Members
Working Days: Monday to Friday
Key Responsibilities
- Define, own, and evolve the enterprise data architecture
- Design scalable, secure, high-performance end-to-end data platforms
- Establish data modeling standards (conceptual, logical, physical)
- Act as architectural authority for data pipelines, APIs, and integrations
- Ensure platform design meets security, compliance, availability, and cost-efficiency standards
- Define and enforce data governance, data quality, metadata, lineage, and master data principles
- Collaborate with Data Engineers for implementation of architecture designs
- Align data architecture with product roadmaps and business priorities
- Define standards for data sharing, data products, and external data exposure
- Contribute to long-term data platform roadmap and technology adoption
- Support leadership with architecture reviews and strategic decisions
Required Experience & Technical Expertise
Experience
- 12+ years in Data domain
- 3–5 years as Data Architect / Lead Data Role
- Experience designing enterprise-scale data platforms
Data Architecture & Modeling
- Deep expertise in Data Modeling & Data Warehousing
- Advanced SQL knowledge
- Strong experience with Snowflake & modern cloud data stacks
- Experience with relational and cloud-native databases
Security & Compliance
- Knowledge of Data Security (Dynamic Masking, Row-Level Security, Access Control)
- Strong understanding of GDPR & Data Privacy regulations
Integration & Engineering
- Experience with streaming & event-driven architectures
- APIs & integration patterns (REST, event-based systems)
- Familiarity with CI/CD, DevOps & Infrastructure-as-Code in data environments
- Architecture reviews & technology evaluations
Key Technical Skills (Must Have)
- Snowflake
- Matillion (or equivalent data integration tools)
- Python
- SQL
- REST APIs & Event-driven integrations
- Power BI / Qlik / Tableau
- Experience with CRM / Marketing Automation / PIM platforms
- Agile & Continuous Delivery practices
Personal Skills
- Strong architectural mindset with focus on scalability
- Collaborative leadership ability
- Analytical and business-oriented thinking
- Strong communication skills (technical & non-technical stakeholders)
- Proactive, autonomous, and accountable
Why Join Us?
- Work with best-in-class data & cloud technologies
- Influence core data architecture of a global digital platform
- Strong engineering culture focused on ownership & quality
- Hybrid work model (mostly remote)
- 25+ years of industry leadership with strong growth trajectory
Please fill the following details:
1) Current CTC
2) Expected CTC
3) Notice Period
4) Current Location
5) Reason of Change
6) Years of Experience
Kindly provide us the references for the same openings.
WhatsApp your CV at 7 5 0 3 8 6 6 1 9 6
🚨 HIRING | Data Engineer – Amazon EMR 🔥
We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.
📌 JOB DETAILS:
💼 Experience: 6+ Years
💰 CTC: Up to 30 LPA
📍 Location: Bangalore
🔑 MANDATORY SKILLS:
• Amazon EMR
• Python
• Scala
• Data Engineering
📋 KEY REQUIREMENTS:
• 6+ years of relevant experience in Data Engineering.
• Strong hands-on experience with Amazon EMR.
• Strong programming skills in Python and Scala.
• Experience with large-scale data processing and data engineering solutions.
• Strong problem-solving and communication skills.
📩 Interested candidates can share their updated resumes:
📧 pavithra.e @vysystems. com
📞 8 9 2 5 8 0 2 4 5 7
🔄 Know someone who would be a good fit? Tag them or share this post!
#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.







