Cutshort logo
Heavy Manufacturing, Automotive/Commercial Vehicles, Industr logo
Senior Data Engineer
Heavy Manufacturing, Automotive/Commercial Vehicles, Industr
Senior Data Engineer
Recro's logo

Senior Data Engineer

at Heavy Manufacturing, Automotive/Commercial Vehicles, Industr

Agency job
via Recro
4 - 6 yrs
₹20L - ₹30L / yr
Bengaluru (Bangalore)
Skills
PySpark
databricks
Delta Lake
ADF
Apache Kafka

About the Role

The Smart Operations (Smart Ops) division is seeking a seasoned Senior Data Engineer / Lead Data Engineer to design and scale our next-generation industrial data platform. In this role, you will architect the real-time data backbone that processes high-frequency iHistorian telemetry, IoT sensor feeds, and complex manufacturing data across global operations.

You will be the core technical owner of our Databricks Lakehouse ecosystem, responsible for building optimized, cost-efficient streaming and batch pipelines that deliver high-trust data to our Advanced Analytics, MLOps, and Business Intelligence teams.


Key Responsibilities

  • End-to-End Lakehouse Architecture: Design, implement, and scale a robust Medallion Architecture (Bronze-Silver-Gold) on Azure Databricks and Delta Lake.
  • Real-Time IoT Ingestion: Build fault-tolerant, low-latency streaming pipelines to ingest high-frequency telemetry and machine sensor data.
  • Enterprise Governance: Enforce data security, fine-grained access controls, and comprehensive lineage tracking using Unity Catalog.
  • Performance Tuning & Cost Optimization: Actively profile, tune, and optimize Spark workloads (utilizing partitioning, liquid clustering, AQE, and Photon) to drastically minimize cloud compute costs and pipeline runtimes.
  • CI/CD Automation: Modernize data platform deployments across Dev/QA/Prod environments using Infrastructure as Code (IaC) and Databricks Asset Bundles (DABs).
  • Cross-Functional Collaboration: Partner closely with manufacturing stakeholders, supply chain analysts, and data scientists to provide curated datasets for predictive maintenance, anomaly detection, and operational KPI reporting.


Technical Skills Breakdown

Mandatory Skills (Must-Haves)

  • Domain Context: Minimum 5+ years of Data Engineering experience with direct exposure to Heavy Manufacturing, Automotive/Commercial Vehicles, Industrial Automation, or Global Logistics data environments.
  • Databricks Ecosystem: Deep architectural mastery of Azure Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog governance.
  • Streaming & CDC: Proven hands-on experience engineering real-time data pipelines using Apache Kafka, Azure Event Hubs, or Spark Structured Streaming, alongside Change Data Capture (CDC) tools (e.g., Debezium).
  • Cloud Infrastructure: Strong proficiency within the Microsoft Azure stack—specifically Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Cores), Azure Key Vault, and Azure Monitor.
  • Advanced SQL & Python: Expert-level Python programming and complex SQL optimisation (advanced indexing, partition pruning, performance tuning of massive datasets).
  • DevOps Automation: Hands-on experience setting up production CI/CD pipelines using Git, Azure DevOps, GitHub Actions, or Databricks Asset Bundles (DABs).


Good to Have Skills (Nice-to-Haves)

  • Professional Certifications: Databricks Certified Data Engineer Professional (highly preferred), Databricks Certified Associate Developer for Apache Spark, or Microsoft Certified: Azure Data Engineer Associate (DP-203).
  • Industrial & ERP Systems: Familiarity with industrial data systems (SCADA, PLC, iHistorian), heavy vehicle telemetry standards (MDF/MF4 files), or deep integration experience with enterprise ERPs (SAP S/4HANA, SAP BW).
  • MLOps & GenAI: Exposure to working alongside Machine Learning pipelines, dataset feature engineering, or implementing Generative AI frameworks (RAG, Vector Databases like FAISS/Weaviate) for semantic query self-service.
  • Infrastructure as Code (IaC): Basic proficiency with Terraform for provisioning cloud data infrastructure.


Education & Qualifications

Bachelor’s or Master’s Degree in Computer Science, Information Technology, Electrical/Electronics Engineering, or a closely related technical field.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Dhule, Jalgaon, Goa, Maharastra
1 - 2 yrs
₹3.8L - ₹4L / yr
financial advisor
AMFI
mutual fund

Key Responsibilities:

·         Ability to create quality network & exposure in the local market.

·         Acquisition and managing of new as well as existing financial advisors / distributors from the market.

·         Should be AMFI Passed/or need to pass during 6 months after joining.

·         Ability to build good relationships with advisors.

·         Ability to lead the team of advisors

·         Ability to train and develop advisors for business.

·         Should have zeal to learn and then guide other advisors for different financial products.

·         Should be interested in seeing themselves as a team (Advisor) managing a profile from day 

Read more
Hyderabad
1 - 2 yrs
₹2.4L - ₹5L / yr
Data-flow analysis
Business requirements

Business Analyst - IT Solutions

Position: Business Analyst Department, Information Technology

Employment Type: Full-time

Experience Level: 1-3 years

 

Role Overview:

 

We are seeking a dynamic Business Analyst to bridge the gap between business requirements and technical solutions. This client-facing role involves analyzing business processes, gathering requirements, and ensuring successful project delivery without hands-on programming.

 

Key Responsibilities:

 

- Gather and document business requirements from clients and stakeholders

- Analyze current business processes and identify improvement opportunities

- Create detailed functional specifications and user stories

- Facilitate meetings between technical teams and business stakeholders

- Conduct user acceptance testing and training sessions

- Prepare project documentation, reports, and presentations

- Support pre-sales activities and client demonstrations

 

 

Required Qualifications:

 

- Bachelor's degree in Business, IT, or related field

- 1-3 years of experience in business analysis or similar role

- Basic understanding of software development lifecycle

- Good communication and presentation skills

- Client-facing experience preferred

- Basic knowledge of project management methodologies

 

 

Preferred Qualifications:

 

- Experience in software/technology industry

- Understanding of database concepts and system integration

- Experience with wireframing and prototyping tools

 

Read more
Altimetrik
at Altimetrik
8 recruiters
Gautham B
Posted by Gautham B
Chennai
5 - 10 yrs
₹6L - ₹20L / yr
skill iconGo Programming (Golang)
openshift
Red Hat Certified Engineer

Company: Altimetrik


MUST HAVE - SKILLS & EXPERIENCE:


- Around 4 +years of overall software development experience.


- Around 3 years of expertise in Go Language (aka GoLang) and SQL, with skills in data retrieval and manipulation.


- 3+ years of experience with JavaScript, including expertise in leveraging libraries like jQuery and Bootstrap, and proficiency in customizing CSS for styling and layout management.


- Experience in developing and managing Application Programming Interfaces (APIs).


- Development experience in a Linux/Unix environment, coupled with proficiency in bash scripting and Linux commands, provides a significant edge.


- Willingness to learn Perl as needed to migrate or support existing Perl applications.


- Currently a hands-on software developer, actively writing code and contributing to software development projects.


- Experience with tools and pipelines such as Rally, GitHub, Jenkins, Jira, etc. is desirable.


- Excellent troubleshooting, debugging, multi-tasking, analytical, and problem-solving skills are essential.


- Self-starter with good communication skills, fluent in English (written and verbal).


- Ability to quickly learn new technologies or skills is a must.


- Expertise with the RedHat OpenShift Container Platform.


- Expertise with Kubernetes.


- Expertise in IaC tools: Terraform, Ansible, Go


- Experience in Infrastructure provisioning, monitoring and Ops


- Expertise working with Docker or similar container technologies.


Location : Chennai


Years of Experience : 4 to 8 years +

Read more
NewRise Technosys PvtLtd
Rakesh D
Posted by Rakesh D
Bhopal
0 - 5 yrs
₹1L - ₹5L / yr
skill iconLaravel
skill iconVue.js

NewRise Technosys
Hiring Laravel developer


Laravel developer Duties and responsibilities

  • Develop, record, and maintain cutting edge web-based PHP applications on portal plus premium service platforms
  • Build innovative, state-of-the-art applications and collaborate with the User Experience (UX) team
  • Ensure HTML, CSS, and shared JavaScript is valid and consistent across applications
  • Prepare and maintain all applications utilizing standard development tools
  • Utilize backend data services and contribute to increasing existing data services API
  • Lead the entire web application development life cycle right from concept stage to delivery and post-launch support
Salary: 15k to 40k 
Exp: 0 - 5 yrs
Location: Bhopal 
Read more
Emtec Inc.
Remote only
8 - 12 yrs
₹15L - ₹15L / yr
Salesforce Apex
Salesforce
LWC
customisation

Job Description


• Responsible for maintaining and extending an application’s Apex services and user interfaces in

Lighting Web Components and Aura Components where necessary.

• Work with and lead a team to design and implement new capabilities according to enterprise

Apex design patterns.

• Expand and implement event-based architecture to build new features within a managed

package.

• Collaborate with business stakeholders to understand product roadmap and establish

prioritization.

• Perform standard product developer tasks such as estimating, testing, documenting, performing

peer reviews, providing support, diagnosing/resolving defects

• Own and execute managed package activities including source control, CI/CD, releases,

AppExchange security reviews, and License Management Application tasks

• Provide leadership and mentorship to development team members.

• Keen focus on building intuitive and functional Salesforce applications.


Must have skills and background:


• Bachelor’s degree in computer science, engineering, or related fields

• 7 or more years of software development experience with at least 5 years on Salesforce technologies, especially Sales Cloud and AppExchange

• Experience leading development teams.

• Experience with Flows, Apex, Lightning Web Components/Aura Components, and managed packages

• Experience with enterprise topics such as integration, asynchronous/platform events,

security/identity, and large data volumes

• Hold multiple Salesforce developer certifications – Platform App Builder, Platform Developer I, and Platform Developer II, additional Salesforce Architect Certifications a plus

• Ability to design Objects and Relationships

• Knows the security model in Salesforce.

• Understands Bulkification and can write optimized code with Apex, Triggers and SOQL


Nice to have skills and background:


• Basic Community / Experience Cloud

• Salesforce Deployment/DevOps experience

Read more
Genixo Info Solutions Private Limited
Bengaluru (Bangalore)
2 - 3 yrs
₹3L - ₹5L / yr
Graphic Designing
Design thinking
Video Editing
Adobe Premiere Pro
Adobe Photoshop
+4 more
  • Understand design specification and requirements.
  • Develop a wide range of illustrations, vectors, graphics and layouts and other designs.
  • Edit footage segments and combine the sequences of the clips for Social media platform.
  • Input effects, graphics, dialogues, and music into the videos to make them more visually appealing.
  • Discover and implement new techniques and methods to maximize the company’s efficiency.
  • Manages timelines and prioritization of workload.
  • Assist team in developing and executing communications plans.
  • Provides technical support for design and video related efforts.
  • Work effectively with the team members.
  • Minimum 1+ years of experience as a Video Editor, Video Specialist or similar role related to video editing and Graphic Designing
  • Sound working knowledge on Adobe premiere pro, Sound Editing, Adobe Photoshop, Adobe Illustrator and CorelDraw Software.
  • Excellent Experience of using video editing tools.
  • Good Time Management Skills
  • Great interpersonal and communication skills.
  • Creative Thinker
  • Proficient in Adobe After Effects.
  • Knowledge and a good understanding of motion graphics is preferred
  • Candidate must have Own laptop is mandatory along with will the supportive softwares
  • Experience- 2 to 3 years


Read more
Kaleidofin
at Kaleidofin
3 recruiters
Poornima B
Posted by Poornima B
Chennai, Bengaluru (Bangalore)
2 - 4 yrs
Best in industry
skill iconMachine Learning (ML)
skill iconPython
SQL
Customer Acquisition
Big Data
+2 more
Responsibility
  • Partnering with internal business owners (product, marketing, edit, etc.) to understand needs and develop custom analysis to optimize for user engagement and retention
  • Good understanding of the underlying business and workings of cross functional teams for successful execution
  • Design and develop analyses based on business requirement needs and challenges.
  • Leveraging statistical analysis on consumer research and data mining projects, including segmentation, clustering, factor analysis, multivariate regression, predictive modeling, etc.
  • Providing statistical analysis on custom research projects and consult on A/B testing and other statistical analysis as needed. Other reports and custom analysis as required.
  • Identify and use appropriate investigative and analytical technologies to interpret and verify results.
  • Apply and learn a wide variety of tools and languages to achieve results
  • Use best practices to develop statistical and/ or machine learning techniques to build models that address business needs.

Requirements
  • 2 - 4 years  of relevant experience in Data science.
  • Preferred education: Bachelor's degree in a technical field or equivalent experience.
  • Experience in advanced analytics, model building, statistical modeling, optimization, and machine learning algorithms.
  • Machine Learning Algorithms: Crystal clear understanding, coding, implementation, error analysis, model tuning knowledge on Linear Regression, Logistic Regression, SVM, shallow Neural Networks, clustering, Decision Trees, Random forest, XGBoost, Recommender Systems, ARIMA and Anomaly Detection. Feature selection, hyper parameters tuning, model selection and error analysis, boosting and ensemble methods.
  • Strong with programming languages like Python and data processing using SQL or equivalent and ability to experiment with newer open source tools.
  • Experience in normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis.
  • Experience designing, developing, implementing and maintaining a database and programs to manage data analysis efforts.
  • Experience with big data and cloud computing viz. Spark, Hadoop (MapReduce, PIG, HIVE).
  • Experience in risk and credit score domains preferred.
Read more
Zepto
at Zepto
1 recruiter
Agency job
via Seikor by Nikita Almeida
Bengaluru (Bangalore)
6 - 8 yrs
₹50L - ₹65L / yr
skill iconJava
skill iconPython
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
+3 more

Lead Software Engineer (Bangalore, Remote option available) 6+ years of experience 

Zepto (www.zeptonow.com)

 

Why should you look at this role?

Salary 50-65 lakh per annum

Paid leave

Sick leave

Provident Fund

 

What Else?

  • High growth startup in quick commerce space (10 min delivery)
  • Given our very high hiring bar, we offer a very competitive salary and substantial equity to create everlasting wealth for our early believers as the company grows.
  • Work on real world logistics problems & benefit from the rocket ship Zepto is!

 

Tech Team: 40-50 (200+ in few months)

 

About the Employer

Zepto is a fast-growing startup that delivers products in 10 minutes through an optimised network of dark stores that we're building across the country!

 

Just 6 months after launching, we've raised $160 million from marquee

investors in Silicon Valley and India. Our investors include Y Combinator, Nexus Venture Partners, and many more! We’ve built out one of the best startup teams in India, with Senior Executives from Uber, Flipkart, Dream11, PhonePe, Goldman Sachs, Pepperfry, and institutions like Stanford, INSEAD, IITs, and IIMs.

 

The magic of Zepto is our ability to consistently deliver 2,500+ products in 10 minutes flat. It's the core of what we do, and the reason why we’ve been able to grow so fast with phenomenal customer love. Our mission is simple: to make 10-minute delivery the new normal.

 

Funding:

Funding Zepto has raised a total of $160M in funding over 3 rounds.

Their latest funding was raised on Dec 20, 2021 from a Series C round.

 

 

Employer Reviews:

“High Ownership, Lots of Learning, Broad Roles, Accessible Leaders”

"Alot of benefits like ZeptoJoy coupon, internet bill reimbursement and cab reimbursement is also taken care of. Overtime is paid."

 

 

Reporting structure:

Software Engineer -> Sr Software Engineer -> Lead -> EM -> AD / Director / VP -> Head of Engineering -> CTO

This role would be by and large an Individual Contributor role.

 

Interview Process:

  1. Discussion on past experience and problem discussion based on projects done
  2. Low level design
  3. High level design

(One of the rounds will test scenario management via case study since it’s a managerial role) 

 

What You will do Everyday?

  • Work very closely with the Tech Leadership and lead end-to-end development.
  • Write maintainable/scalable/efficient code.
  • Design and architect technical solutions for the business problems of a very large e-commerce portal.
  • Work in cross-functional team, collaborating with peers during entire SDLC.
  • Follow coding standards, unit-testing, code reviews etc.
  • Follow release cycles and commitment to deadlines.

 

Your Superpowers

  • 6+ years of experience in building large scale applications or products.
  • A “Bring It On” attitude; bias for action; self-driven, end-to-end ownership; entrepreneurial approach; focus on operational excellence; ability to work with ambiguity.
  • Strong in problem solving skills, data structures and algorithms.
  • Very good understanding of one or more of RDBMS/NoSQL/Messaging/ Caching technologies.
  • Excellent understanding of and coding skills in following technologies: Java
  • B Tech/BE in Computer Science or equivalent from a reputed institution.

 

CLICK HERE TO APPLY: https://forms.gle/v8P54gfPvUZGeJ3u6">https://forms.gle/v8P54gfPvUZGeJ3u6

 

Read more
Schbang Digital Solutions
Aarohee Patel
Posted by Aarohee Patel
Mumbai
1 - 2 yrs
₹3L - ₹6L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconReact.js
skill iconAngular (2+)
skill iconJavascript
+4 more

Primary purpose of the role:

 

Front end development of websites and applications using CSS3, HTML5, jQuery and other skills to produce clean, functional and web compliant projects to be handed over to Back End Developers to be further worked on as well as CSS bug fixes post Back End development

 

Major responsibilities & deliverables:

 

  1. Great skills in HTML, CSS, JavaScript and cross browser implementations.
  2. Strong analytical and problem-solving skills.
  3. Experience and knowledge about the cool stuff in HTML5 and CSS3.
  4. At Least knowledge of one JavaScript framework such as VueJs, ReactJs, AngularJs
  5. Proficiency and familiarity with CSS/JavaScript frameworks and utilities such as HTML5 Boilerplate, jQuery, Modernizr, Firebug, JSLint, minification, and others. 
  6. Taking PSD files from designers, slicing and/or recreating elements via CSS to match the design perfectly
  7. Ability to make modifications to libraries in jQuery as per requirement of a project
  8. Extensive knowledge of fonts, embedding from third parties like Google, Typekit & Font Deck etc.
  9. Knowledge of optimizing CSS/JavaScript performance, by coding practices and tools.
  10. Passion and follow through for their work. Excited and curious about learning new technology, as well as the sharing of ideas. Exceptional collaboration, listening, written, and verbal communication. Able to own individual projects as well as the ability to work within a team.
  11. Awareness of current design trends in the visual arts, working knowledge of the latest computer packages and an understanding time limits which can impact on the design.
  12. Knowledge of GIT or any other version control software.

Read more
Enquero
at Enquero
2 recruiters
Nethra MP
Posted by Nethra MP
Bengaluru (Bangalore), Hyderabad
8 - 12 yrs
₹20L - ₹25L / yr
Technical Architecture
Architecture
Solution architecture
Information architecture
Java Architecture for XML Binding (JAXBJava Architecture for XML Binding...
+7 more
  • 8+ years of experience in software development
  • 4+ years of recent hands-on experience in architecting and building complex solutions that run in SaaS/PaaS environments, especially on AWS cloud leveraging SaaS based Microservices development coupled with Distributed Caching & Message Queuing.
  • Should have experience in developing solution architecture and/or evaluate architectural alternatives for private, public and hybrid cloud models, including IaaS, PaaS, and other cloud services
  • Should have excellent knowledge of cloud architecture and implementation features (OS, multi-tenancy, virtualization, orchestration, elastic scalability)
  • Should have experience with Full Stack development with experience in technology stacks/frameworks like JAVA, Springboot, Python, Redis, SQL, NoSQL and Graph DBs
  • Good to have Architected solutions that handle Big Data and should be proficient in data analytics
  • Must have Expert level proficiency in Design / Architectural patterns, data structures and algorithms
  • Must demonstrate knowledge of DevOps tool chains and processes
  • Experience in web-based application migration from on-premise to SaaS model is a big plus.
  • Experience of Integration patterns and associated best practice(e.g. Web Services, REST API's, Pub/Sub, MOM)
  • Excellent knowledge and hands-on experience in Web services related, functionally decomposed architecture, Load Balancing of Web Services and applications, designing multi-tenant systems, Clustering and sharding of data, microservices architecture / design patterns, and throttling and performance management of such services
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos