Cutshort logo
For Employers
Merck Group logo
Data Engineer/ DevOps - Enterprise Big Data Platform
Data Engineer/ DevOps - Enterprise Big Data Platform

Data Engineer/ DevOps - Enterprise Big Data Platform at Merck Group · Bengaluru (Bangalore) · 1 - 8 years · ₹8L - ₹14L / yr · Posted 30 Dec 2022

Engeniuspark Technologies LLP's logo

Data Engineer/ DevOps - Enterprise Big Data Platform

1 - 8 yrs
₹8L - ₹14L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconPython
DevOps
skill iconAmazon Web Services (AWS)
skill iconPostgreSQL
SQL
skill iconElastic Search
skill iconHTML/CSS
skill iconJavascript
In this role, you will be part of a growing, global team of data engineers, who collaborate in DevOps mode, in order to enable Merck business with state-of-the-art technology to leverage data as an asset and to take better informed decisions.

The Merck Data Engineering Team is responsible for designing, developing, testing, and supporting automated end-to-end data pipelines and applications on Merck’s data management and global analytics platform (Palantir Foundry, Hadoop, AWS and other components).

The Foundry platform comprises multiple different technology stacks, which are hosted on Amazon Web Services (AWS) infrastructure or on-premise Merck’s own data centers. Developing pipelines and applications on Foundry requires:

• Proficiency in SQL / Java / Python (Python required; all 3 not necessary)
• Proficiency in PySpark for distributed computation
• Familiarity with Postgres and ElasticSearch
• Familiarity with HTML, CSS, and JavaScript and basic design/visual competency
• Familiarity with common databases (e.g. JDBC, mySQL, Microsoft SQL). Not all types required

This position will be project based and may work across multiple smaller projects or a single large project utilizing an agile project methodology.

Roles & Responsibilities:
• Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
• Participate in end to end project lifecycle, from requirements analysis to go-live and operations of an application
• Acts as business analyst for developing requirements for Foundry pipelines
• Review code developed by other data engineers and check against platform-specific standards, cross-cutting concerns, coding and configuration standards and functional specification of the pipeline
• Document technical work in a professional and transparent way. Create high quality technical documentation
• Work out the best possible balance between technical feasibility and business requirements (the latter can be quite strict)
• Deploy applications on Foundry platform infrastructure with clearly defined checks
• Implementation of changes and bug fixes via Merck's change management framework and according to system engineering practices (additional training will be provided)
• DevOps project setup following Agile principles (e.g. Scrum)
• Besides working on projects, act as third level support for critical applications; analyze and resolve complex incidents/problems. Debug problems across a full stack of Foundry and code based on Python, Pyspark, and Java
• Work closely with business users, data scientists/analysts to design physical data models
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Merck Group

Founded
Type
Size
Stage

About

This channel is not intended for U.S. and Canadian visitors. Merck operates in the U.S. and Canada as EMD Serono in Healthcare, MilliporeSigma in Life Science and EMD Electronics in Electronics. An unaffiliated and unrelated company, Merck & Co., Inc., Kenilworth, NJ, US holds the rights in the trademark MERCK in the U.S. and Canada. _______________________________ We are Merck, a leading global science and technology company headquartered in Germany. We are curious explorers, courageous pioneers, and ingenious inventors. Our colleagues across the globe love innovating with science and technology to enrich people's lives with our solutions in Life Science, Healthcare, and Electronics. Together, we dream big and are passionate about caring for our rich mix of people, customers, patients, and the planet. We believe in the positive power of science and technology. It has determined our actions since 1668 and inspires us to continue researching for a future worth living. As a family-owned company with over 350 years of experience, we stand for sustainability, responsibility, and innovative strength. We take pride in being a diverse and inclusive company that values and fosters the talents and abilities of our employees. That's why we are always looking for curious minds that see themselves imagining the unimaginable with us. Work your Magic and join Merck. Legal Disclaimer: www.merckgroup.com/en/legal-disclaimer.html Data Privacy Declaration: www.merckgroup.com/en/privacy-statement
Read more

Company social profiles

linkedin

Similar jobs (10)

Wissen Technology
at Wissen Technology
4 recruiters
Bharanidharan K
Posted by Bharanidharan K
Bengaluru (Bangalore), Mumbai
6 - 12 yrs
Best in industry
databricks
PySpark
skill iconPython
SQL

Company: Wissen Technology

Position: Databricks Engineer

Experience: 6-10 Years

Location: Bengaluru/Mumbai

Employment Type: Full-time


About Wissen Technology

Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.

With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.

At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.

Key Responsibilities

  • Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
  • Develop and optimize data pipelines and workflows on Databricks.
  • Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
  • Ensure data integrity, quality, performance, and reliability across data processing pipelines.
  • Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
  • Perform data analysis and implement appropriate data validation and quality checks.
  • Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
  • Work with relational databases and develop efficient SQL queries for data extraction and transformation.
  • Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
  • Use Git/version control and follow established software development and deployment practices.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
  • Proven experience as a Databricks Developer, Data Engineer, or similar role.
  • Strong hands-on expertise in Apache Spark and PySpark.
  • Strong programming skills in Python; experience with Scala is an advantage.
  • Strong proficiency in SQL and hands-on experience with relational databases.
  • Practical experience developing and optimizing data pipelines and data processing applications.
  • Familiarity with Git and version control systems.
  • Strong understanding of data engineering concepts, data transformation, and data validation.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹7L - ₹18L / yr
skill iconPython
PySpark
SQL

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨


Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!


🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred


💻 Mandatory Skills


✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines


⚙️ Good to Have / Ecosystem Skills


✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA


📌 Key Responsibilities


• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking


📩 Interested candidates can share their updated CV along with:


Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:


#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Shakthi M
Posted by Shakthi M
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Pune
3 - 6 yrs
Best in industry
skill iconJava
Spark
ETL

Must have experience in Java

Must have experience in Spark

Must have experience in ETL coding

Strong expertise in coding

Read more
VY SYSTEMS PRIVATE LIMITED
Hyderabad, Bengaluru (Bangalore)
5 - 9 yrs
₹9L - ₹20L / yr
PySpark
SQL
skill iconPython
ETL

Data Engineer Hiring Post


🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
7 - 13 yrs
₹10L - ₹24L / yr
skill iconPython
PySpark
Oracle
PL/SQL
Google Cloud Platform (GCP)
+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

  • Strong expertise in Data Modeling, Data Design & Modernization
  • Primary skills: PySpark, Oracle SQL/PLSQL
  • Secondary skills: Python, ETL & Data Pipelines
  • Experience with Kafka and Hadoop
  • Exposure to AWS / Azure / GCP
  • Good knowledge of Git and JIRA

Roles & Responsibilities:

  • Design, develop, and modernize scalable data models and data architecture.
  • Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
  • Build and maintain robust ETL workflows and data pipelines.
  • Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
  • Perform data transformation, optimization, and performance tuning.
  • Collaborate with technical teams on data design, development, testing, and deployment.


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹20L / yr
Hadoop
PySpark

Dear Candidate,

Thanks for showing interest in the opportunity!!!

As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.


Job Description:

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.

Primary & Mandatory Skills:

  • ETL Development
  • Hadoop / HDFS
  • PySpark / Apache Spark
  • Data Extraction, Transformation & Loading
  • SQL and Data Processing

Good to Have:

  • Hive / Spark SQL
  • Data Pipeline Development
  • Big Data Processing
  • Python Programming

Company: Mphasis

Role: ETL Developer – Hadoop & PySpark

Experience: As per requirement

Location: Bangalore

Employment Type: Permanent

Read more
VY SYSTEMS PRIVATE LIMITED
Hyderabad, Pune
5 - 9 yrs
₹18L - ₹20L / yr
PySpark
SQL
skill iconPython

Data Engineer Short Hiring Post


🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Read more
Improving
Leena Lahari
Posted by Leena Lahari
Remote only
4 - 8 yrs
₹10L - ₹35L / yr
skill iconPython
SQL
databricks
CI/CD
skill iconGit
+5 more

Data Engineer - Remote

Nearshore engineer on a team converting SAS code to Python and SQL on Databricks using generative AI. You will work with the existing accelerators, own deliverables end to end, and communicate directly with client and partner stakeholders.


Required for both:

4+ years of professional data or software engineering experience

Strong Python and SQL

Hands-on Databricks (Unity Catalog, Workflows, Databricks Asset Bundles)

GitLab CI/CD: pipelines, merge request workflows, automated testing

Git branching and code review discipline

Clear written and spoken English with client-facing partners

Demonstrated ownership: scoping, delivering, and flagging risk without prompting


Focus: Pipeline reliability, validation, and delivery of converted code.


Responsibilities:

Build and run the pipelines that process SAS inventories and converted outputs

Validate converted code for parity against SAS outputs (row counts, checksums, schema, data types)

Own deployment through DABs and GitLab CI/CD

Manage Unity Catalog objects, permissions, and environment promotion

Troubleshoot job failures and performance issues


Required:

Spark and Delta Lake performance tuning

Data validation and reconciliation experience

Infrastructure as code or DAB-based deployment experience


Nice to have:

SAS reading ability, healthcare data exposure, Azure.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos