Senior Data Engineer at IT Industry · Remote only · 10 - 17 years · ₹25L - ₹40L / yr · Remote only · Posted 19 Sep 2025

We’re Hiring: Senior Data Engineer | Remote (Pan India)
Are you passionate about building scalable data pipelines and optimizing data architecture? We’re looking for an experienced Senior Data Engineer (10+ years) to join our team and play a key role in shaping next-gen data systems.
What you’ll do:
✅ Design & develop robust data pipelines (ETL) using the latest Big Data tech
✅ Optimize infrastructure & automate processes for scalability
✅ Collaborate with cross-functional teams (Product, Data, Design, ML)
✅ Work with modern tools: Apache Spark, Databricks, SQL, Python/Scala/Java
Scala is mandatory
What we’re looking for:
🔹 Strong expertise in Big Data, Spark & distributed systems
🔹 Hands-on with SQL, relational DBs (Postgres/MySQL), Linux scripting
🔹 Experience with Delta Tables, Parquet, CSV, JSON
🔹 Cloud & Databricks exposure
🔹 Bonus: Machine Learning knowledge
📍 Location: Remote (Pan India)
⏰ Shift: 2:00 pm – 11:00 pm IST
💼 Type: Full-time, Permanent

Similar jobs (10)

🚀 WE ARE HIRING | JAVA + APACHE SPARK DEVELOPER 🚀
📌 Job Details:
- Position: Java + Apache Spark Developer
- Experience: 6+ Years
- Locations: Mumbai / Bangalore
- Work Mode: Hybrid (3 days onsite per week)
💻 Required Technical Skills:
- Java
- Apache Spark
- Snowflake
- Spark SQL
- Databricks
- SQL
- ETL
Interested candidates can share their updated resumes:
Email: revathi.r@ vysystems.com
WhatsApp: 6 3 8 5 0 7 6 1 4 2
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.

🚀 WE ARE HIRING | JAVA + APACHE SPARK DEVELOPER
📍 Location: Mumbai
💼 Experience: 5+ Years
🏢 Work Mode: Hybrid (3 Days Work From Office)
Are you an experienced Java + Apache Spark Developer looking for your next career opportunity? We are looking for talented professionals with strong expertise in Java, Big Data technologies, and data engineering.
🔥 Required Technical Skills:
- Strong experience in Java Development
- Hands-on experience with Apache Spark
- Good knowledge of Spark SQL
- Experience with Databricks
- Strong SQL skills
- Experience in ETL processes and data pipelines
- Understanding of distributed data processing
- Good problem-solving and analytical skills
📩 Interested candidates can share their updated resumes:
📧 Email: revathi.r @vysystems.com
📱 WhatsApp: 6 3 8 5 0 7 6 1 4 2

Job Title : Senior Data Engineer – Databricks
Experience : 14 to 20 Years
Location : HSR Layout, Bangalore
Work Mode : Hybrid – 3 Days WFO
Shift : 11:30 AM – 07:30 PM IST
Positions : 2
Notice Period : Immediate Joiners Only
Interview : 1 Technical Round + 2 Client Rounds
Role Overview :
We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.
The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.
Must-Have Skills :
- 14 to 20 years of Data Engineering experience
- Databricks & Apache Spark / PySpark
- Python & SQL
- AWS Cloud
- Lakehouse Architecture
- ETL / ELT & Distributed Data Processing
- Batch & Streaming Pipelines
- Data Pipeline Optimization & Data Modeling
- CDC & Incremental Processing
- Git, CI/CD & Testing
- Data Quality, Monitoring & Observability
- Technical Leadership & Stakeholder Management
Key Responsibilities :
- Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
- Own data products from design through production.
- Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
- Optimize pipelines for performance, scalability, reliability, and cost.
- Design scalable data architectures and data models.
- Implement data quality, monitoring, lineage, and CI/CD practices.
- Lead technical discussions and mentor engineering teams.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Remain hands-on while providing technical leadership.
Ideal Candidate :
A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.
🔴 Super Urgent : Only Bangalore-based immediate joiners.

SENIOR DATA ENGINEER – DATABRICKS & SNOWFLAKE
Experience: 7+ Years
Location: Remote
Employment Type: Full-Time
Budget: Up to ₹30 LPA
Time Zone: US Eastern Time (ET)
Shift: US ET Night Shift
Job Description
We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Snowflake, Apache Spark, and AWS to design, develop, and maintain scalable data engineering solutions.
The candidate will work on integrating data from multiple sources, building modern data pipelines, developing enterprise data models, and preparing data platforms for AI/ML applications.
Experience in healthcare, scientific data, or the histopathology domain will be an added advantage.
Key Responsibilities
- Design, build, and maintain scalable data pipelines to acquire, integrate, and manage data from diverse sources such as laboratory systems, MES, clinical supply, quality systems, and external partners.
- Develop and optimize data workflows for structured and unstructured data using Python, PySpark, R, SQL, Databricks, and Snowflake.
- Design and maintain enterprise-level data models and data repositories.
- Perform ETL development, data warehousing, database design, and data integration.
- Ensure data quality, versioning, traceability, and consistency to support AI/ML readiness.
- Collaborate with stakeholders and technical teams to translate business requirements into technical solutions.
- Manage multiple projects while ensuring scalability, performance, and reliability.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks and Snowflake.
- Excellent knowledge of Apache Spark / PySpark.
- Strong experience with AWS cloud services and AWS RDS.
- Experience with Oracle and Microsoft SQL Server (MSSQL).
- Proficiency in Python, R, and SQL.
- Strong understanding of ETL, Data Warehousing (DWH), data modeling, and database design.
- Experience with dbt and cloud-based data architectures.
- Knowledge of NoSQL and graph databases.
- Strong analytical, problem-solving, and stakeholder-management skills.
- Good English communication skills (B2 level or above).
- Willingness to work in the US Eastern Time (ET) night shift.
Preferred / Good to Have
- Experience in histopathology, healthcare, life sciences, or scientific data environments.
- Knowledge of CDISC, HL7, FHIR, OMOP, DICOM, or other regulated data standards.
- Experience handling high-dimensional data, including imaging and sensor data.
- Familiarity with MLOps and machine learning model deployment workflows.
- Knowledge of Manufacturing Execution Systems (MES) and Laboratory Information Management Systems (LIMS).
- Exposure to knowledge graphs and ontology-driven architectures.
Education
Bachelor's degree in Engineering, Data Science, Life Sciences, Computer Science, or a related field. A master's degree is preferred.
Interested candidates can apply with their updated resumes.

We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.
Experience: 4–10 Years
Must-Have Skills:
Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).
We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.
Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.
We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.
Job Description
Role: Data Engineer
Location: Bangalore
Experience: 6+ Years
Key Responsibilities:
- Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
- Develop data engineering solutions using Python and Scala.
- Process and transform large volumes of structured and unstructured data.
- Build and optimize distributed data processing workflows for performance and scalability.
- Work with big data technologies and cloud-based data processing environments.
- Perform data integration, validation, transformation, and quality checks.
- Troubleshoot data pipeline issues and optimize processing performance.
- Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.
Required Skills:
- Strong hands-on experience with Amazon EMR.
- Proficiency in Python and Scala.
- Experience in big data processing and data pipeline development.
- Good understanding of distributed computing and data transformation techniques.
- Experience in performance tuning and troubleshooting data processing jobs.
- Strong analytical, problem-solving, and communication skills.
1st virtual , 2nd round F2F -
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.






