Data Engineer/ DevOps - Enterprise Big Data Platform
at Merck Group
1 - 8 yrs
₹8L - ₹14L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
PythonDevOps
Amazon Web Services (AWS)
PostgreSQLSQL
Elastic Search
HTML/CSS
JavascriptIn this role, you will be part of a growing, global team of data engineers, who collaborate in DevOps mode, in order to enable Merck business with state-of-the-art technology to leverage data as an asset and to take better informed decisions.
The Merck Data Engineering Team is responsible for designing, developing, testing, and supporting automated end-to-end data pipelines and applications on Merck’s data management and global analytics platform (Palantir Foundry, Hadoop, AWS and other components).
The Foundry platform comprises multiple different technology stacks, which are hosted on Amazon Web Services (AWS) infrastructure or on-premise Merck’s own data centers. Developing pipelines and applications on Foundry requires:
• Proficiency in SQL / Java / Python (Python required; all 3 not necessary)
• Proficiency in PySpark for distributed computation
• Familiarity with Postgres and ElasticSearch
• Familiarity with HTML, CSS, and JavaScript and basic design/visual competency
• Familiarity with common databases (e.g. JDBC, mySQL, Microsoft SQL). Not all types required
This position will be project based and may work across multiple smaller projects or a single large project utilizing an agile project methodology.
Roles & Responsibilities:
• Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
• Participate in end to end project lifecycle, from requirements analysis to go-live and operations of an application
• Acts as business analyst for developing requirements for Foundry pipelines
• Review code developed by other data engineers and check against platform-specific standards, cross-cutting concerns, coding and configuration standards and functional specification of the pipeline
• Document technical work in a professional and transparent way. Create high quality technical documentation
• Work out the best possible balance between technical feasibility and business requirements (the latter can be quite strict)
• Deploy applications on Foundry platform infrastructure with clearly defined checks
• Implementation of changes and bug fixes via Merck's change management framework and according to system engineering practices (additional training will be provided)
• DevOps project setup following Agile principles (e.g. Scrum)
• Besides working on projects, act as third level support for critical applications; analyze and resolve complex incidents/problems. Debug problems across a full stack of Foundry and code based on Python, Pyspark, and Java
• Work closely with business users, data scientists/analysts to design physical data models
The Merck Data Engineering Team is responsible for designing, developing, testing, and supporting automated end-to-end data pipelines and applications on Merck’s data management and global analytics platform (Palantir Foundry, Hadoop, AWS and other components).
The Foundry platform comprises multiple different technology stacks, which are hosted on Amazon Web Services (AWS) infrastructure or on-premise Merck’s own data centers. Developing pipelines and applications on Foundry requires:
• Proficiency in SQL / Java / Python (Python required; all 3 not necessary)
• Proficiency in PySpark for distributed computation
• Familiarity with Postgres and ElasticSearch
• Familiarity with HTML, CSS, and JavaScript and basic design/visual competency
• Familiarity with common databases (e.g. JDBC, mySQL, Microsoft SQL). Not all types required
This position will be project based and may work across multiple smaller projects or a single large project utilizing an agile project methodology.
Roles & Responsibilities:
• Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
• Participate in end to end project lifecycle, from requirements analysis to go-live and operations of an application
• Acts as business analyst for developing requirements for Foundry pipelines
• Review code developed by other data engineers and check against platform-specific standards, cross-cutting concerns, coding and configuration standards and functional specification of the pipeline
• Document technical work in a professional and transparent way. Create high quality technical documentation
• Work out the best possible balance between technical feasibility and business requirements (the latter can be quite strict)
• Deploy applications on Foundry platform infrastructure with clearly defined checks
• Implementation of changes and bug fixes via Merck's change management framework and according to system engineering practices (additional training will be provided)
• DevOps project setup following Agile principles (e.g. Scrum)
• Besides working on projects, act as third level support for critical applications; analyze and resolve complex incidents/problems. Debug problems across a full stack of Foundry and code based on Python, Pyspark, and Java
• Work closely with business users, data scientists/analysts to design physical data models
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
About Merck Group
Founded
Type
Size
Stage
About
This channel is not intended for U.S. and Canadian visitors. Merck operates in the U.S. and Canada as EMD Serono in Healthcare, MilliporeSigma in Life Science and EMD Electronics in Electronics. An unaffiliated and unrelated company, Merck & Co., Inc., Kenilworth, NJ, US holds the rights in the trademark MERCK in the U.S. and Canada.
_______________________________
We are Merck, a leading global science and technology company headquartered in Germany.
We are curious explorers, courageous pioneers, and ingenious inventors. Our colleagues across the globe love innovating with science and technology to enrich people's lives with our solutions in Life Science, Healthcare, and Electronics.
Together, we dream big and are passionate about caring for our rich mix of people, customers, patients, and the planet.
We believe in the positive power of science and technology. It has determined our actions since 1668 and inspires us to continue researching for a future worth living. As a family-owned company with over 350 years of experience, we stand for sustainability, responsibility, and innovative strength.
We take pride in being a diverse and inclusive company that values and fosters the talents and abilities of our employees. That's why we are always looking for curious minds that see themselves imagining the unimaginable with us.
Work your Magic and join Merck.
Legal Disclaimer: www.merckgroup.com/en/legal-disclaimer.html
Data Privacy Declaration: www.merckgroup.com/en/privacy-statement
Read more
Company social profiles
Similar jobs
Gandhinagar
4 - 6 yrs
₹2L - ₹3.6L / yr
Negotiation
Project costing
Purchasing management
Procurement & Buying
Mechanical engineering
- Job Title :Purchase Engineer
- Experience: 4yr to 6yr
- Education: Degree in Mechanical / Electrical Engineering
- Location: Rakanpur, Gandhinagar
Requiredskills
- Experience in Specifically machine shop items for machines (like VMC, CNC) and if possible foundry knowledge will be added advantage.
- Experience in an engineering, procurement and operations.
- Effective verbal and written communication skills.
- Proficiency with personal computers and networking,specifically Microsoft Excel. Knowledge and direct experience in negotiating contracts and quotations with Contract Manufacturers and Suppliers.
- Ability to identify cost reduction opportunities.
Read more
Panchkula
1 - 1.5 yrs
₹1L - ₹2L / yr
Telesales
Sales
Communication Skills
Real Estate
Effective communication
+1 more
ob Description:
- Cold Calling.
- Pitching to the channel partners for the site visit.
- Maintaining the database of the channel partners regularly.
Key Skills:
- Good verbal communication skills in English and Hindi.
- Computer Literate.
Read more
Bengaluru (Bangalore)
1.5 - 10 yrs
₹1L - ₹15L / yr
Windows Presentation Foundation(WPF)
winform
.NETASP.NET
C# +2 more
Urgent Requirement.
Year: 2+ years
CTC: As per the company standards.
Notice Period: Immediate to 30 days/
Location: Bangalore(No WFH available)
Skills: Dot net with WPF/Winforms.
Year: 2+ years
CTC: As per the company standards.
Notice Period: Immediate to 30 days/
Location: Bangalore(No WFH available)
Skills: Dot net with WPF/Winforms.
Read more
Thiruvananthapuram
0 - 3 yrs
₹1L - ₹2.5L / yr
Sales
Communication Skills
Customer Support
Problem solving
Effective communication
MYDESIGNATION, Kerala's favourite youngster fashion brand is looking for new teammates to join our sales force. Good communication skills and previous sales experience will be an advantage.
Freshers are also welcome aboard
Salary: 212, 006 to 220, 000 based on experience
Location: Lulu Mall & Mall of Travancore Trivandrum
Read more
Hyderabad
2 - 8 yrs
₹5L - ₹15L / yr
RESTful APIs
Troubleshooting
Linux/Unix
Amazon Web Services (AWS)API
+3 more
Key Responsibilities
Taking ownership of customer issues reported and seeing problems through to
resolution
Understand, interpret, reproduce, and diagnose issues reported by the customers.
Researching, troubleshooting and identifying solutions to resolve product issues
Should be able to handle voice calls, emails and online web sessions with the
customer as part of technical troubleshooting
Should exhibit patience and empathy while working with customer with an aim to
drive positive customer experience
Following standard procedures for proper escalation of unresolved issues to the
appropriate internal teams
Following standard procedures for submitting tickets to the engineering team for
further investigation of unresolved issues
Contributing actively towards knowledge base articles
Adherence to strict SLA’s
Ready to work in early morning, general and afternoon shifts, including weekends, on
rotation basis
Should demonstrate an aptitude and appetite for learning newer technologies while
expanding on the core knowledge
Primary skills:
1-3;3-8 years of relevant experience.
Strong technical knowledge on:
Cloud Technologies – AWS, Azure etc.
Databases – SQL, Oracle, MySQL etc.
Operating Systems – Linux, Windows etc.
Networking – Basic networking concepts and troubleshooting
Programming knowledge – Java, Python (Desirable, not a must has) o Prior experience
with REST and SOAP calls.
Excellent communication skills – English written and verbal
HTTP technology and principles, including REST and SOAP principles (Required)
JSON & XML Data formats (required)
Javascript Regular Expression (Good to have)
Good understanding of networking protocols and applications (TCP/IP, proxies, load
balancing, firewalls, etc.) (Required)
Working knowledge of database technologies and SQL (Required)
In-depth familiarity of Linux (Required) (advanced user; sysadmin experience a bonus,
but not required)
Strong analytical and logical reasoning for technical troubleshooting
Ability to collaborate with cross-functional teams – Dev, QA, Infrastructure teams etc.
Should be a team player who keeps team’s success before individual achievements
Knowledge on data integration (Informatica/ Mulesoft))
Taking ownership of customer issues reported and seeing problems through to
resolution
Understand, interpret, reproduce, and diagnose issues reported by the customers.
Researching, troubleshooting and identifying solutions to resolve product issues
Should be able to handle voice calls, emails and online web sessions with the
customer as part of technical troubleshooting
Should exhibit patience and empathy while working with customer with an aim to
drive positive customer experience
Following standard procedures for proper escalation of unresolved issues to the
appropriate internal teams
Following standard procedures for submitting tickets to the engineering team for
further investigation of unresolved issues
Contributing actively towards knowledge base articles
Adherence to strict SLA’s
Ready to work in early morning, general and afternoon shifts, including weekends, on
rotation basis
Should demonstrate an aptitude and appetite for learning newer technologies while
expanding on the core knowledge
Primary skills:
1-3;3-8 years of relevant experience.
Strong technical knowledge on:
Cloud Technologies – AWS, Azure etc.
Databases – SQL, Oracle, MySQL etc.
Operating Systems – Linux, Windows etc.
Networking – Basic networking concepts and troubleshooting
Programming knowledge – Java, Python (Desirable, not a must has) o Prior experience
with REST and SOAP calls.
Excellent communication skills – English written and verbal
HTTP technology and principles, including REST and SOAP principles (Required)
JSON & XML Data formats (required)
Javascript Regular Expression (Good to have)
Good understanding of networking protocols and applications (TCP/IP, proxies, load
balancing, firewalls, etc.) (Required)
Working knowledge of database technologies and SQL (Required)
In-depth familiarity of Linux (Required) (advanced user; sysadmin experience a bonus,
but not required)
Strong analytical and logical reasoning for technical troubleshooting
Ability to collaborate with cross-functional teams – Dev, QA, Infrastructure teams etc.
Should be a team player who keeps team’s success before individual achievements
Knowledge on data integration (Informatica/ Mulesoft))
Read more
Gurugram, Mumbai, Bengaluru (Bangalore), Hyderabad
3 - 7 yrs
₹5L - ₹15L / yr
C++IPC
Socket Programming
LTE
GNU Compiler Collection
+3 more
Software Engineer – C++ (3-6 years of experience)
1. Telecom/Volte LTE 2g 3g Preferred
2. Programming knowledge of multi-threading, sockets, IPCs.
3. Well versed with std and boost libraries.
4. Working knowledge of GNU compilers, optimization techniques on Unix/Linux based systems.
5. Proficient in debugging tools like GDB/Valgrind and profiling tools like oprofile.
6. Knowledge of Diameter (AAA) Stack
- Development experience of communication protocol stacks
- Hands on experience in multi-threaded design techniques and implementation
- Good hands-on experience on data structures and algorithms
Read more
Mumbai
1 - 3 yrs
₹1L - ₹3L / yr
Image Processing
Adobe Photoshop
We're looking for a highly creative Graphic Visualiser. The candidate will be required to develop - master and adapts of Social media banners, in-app banners, website banners and other creatives.
Requirements
- A graphic design qualification or similar
- Portfolio with design projects
- Proven work experience as a graphic designer
- Working experience with image design tools (e.g. Photoshop and Adobe Illustrator)
- A keen eye for visual details
- Aesthetic skills
- Ability to meet deadlines and collaborate with team members
Benefits
Working with a team of talented designers who talk and write in design.
Read more
Bengaluru (Bangalore)
5 - 8 yrs
₹20L - ₹30L / yr
Data engineering
Data Bricks
data engineer
PySpark
ETL
+3 more
- Insurance P&C and Specialty domain experience a plus
- Experience in a cloud-based architecture preferred, such as Databricks, Azure Data Lake, Azure Data Factory, etc.
- Strong understanding of ETL fundamentals and solutions. Should be proficient in writing advanced / complex SQL, expertise in performance tuning and optimization of SQL queries required.
- Strong experience in Python/PySpark and Spark SQL
- Experience in troubleshooting data issues, analyzing end to end data pipelines, and working with various teams in resolving issues and solving complex problems.
- Strong experience developing Spark applications using PySpark and SQL for data extraction, transformation, and aggregation from multiple formats for analyzing & transforming the data to uncover insights and actionable intelligence for internal and external use
Read more
Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)
3 - 10 yrs
₹3L - ₹5L / yr
Automotive
Inside Sales
Sales
Key account management
Key responsibilities:-
• The Person should have minimum 3 years of experience in the used car industry.
• Solely responsible for meeting the monthly sales target, he will be directly reporting to the operations manager
• Manage a team of 3 sales consultants
• Coordinate with other teams for sales and post sales queries
• Resolve the customer queries/escalations at the earliest and introduce new processes to drive system efficiency
Lead a team of executives to manage procurement and sales processes for all cars.
Developing and maintain relation with new car dealers and corporate leasing companies.
Directly responsible for achieving purchase and sales targets, and 4- Pre-existing network amongst dealers(New car exchanges, local dealers, MFC, etc) and Brokers will be ideal
Should have a fair understanding of the Local used-car market, pricing and demographics.
Will be working across teams within the organization to maximize transactions.
Dynamic and aggressive attitude, hustler, team-player and fast-paced executioner
Office and Fieldwork will be equally distributed initially to build relations and network in the used car industry.
Candidate will have to build his own team in assistance with the City Manager
Read more
Pune
1 - 5 yrs
₹1L - ₹6L / yr
Magento
PHP
NodeJS (Node.js)
CakePHP• Overall Experience 2 years plus in PHP and at least 1 – 2 years Experience in Magento
• Experience with Ajax and J-Query is added advantage
• Should be comfortable working on Postgresql/Mysql database
• Should be comfortable working on Linux (Ubuntu) platform
• Worked with version control Git
• Must be comfortable with Magento Customization.
• Must be comfortable with creating & modifying existing Magento Extensions.
• Experience with Magento API would be great.
• Experience with Magento Enterprise & Community Edition would be great.
• Comfortable Working with Team Environment.
• Must have Experience working on Large Magento Projects.
• Magento Certification would be a plus.
• Strong object oriented programming and design skills
• Excellent problem solving, critical thinking, and communication skills.
• Good attitude, and team player
• Understanding of XML, JSON, HTTP, SOAP, Web Service
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort