
Senior Data Engineer
at Heavy Manufacturing, Automotive/Commercial Vehicles, Industr
About the Role
The Smart Operations (Smart Ops) division is seeking a seasoned Senior Data Engineer / Lead Data Engineer to design and scale our next-generation industrial data platform. In this role, you will architect the real-time data backbone that processes high-frequency iHistorian telemetry, IoT sensor feeds, and complex manufacturing data across global operations.
You will be the core technical owner of our Databricks Lakehouse ecosystem, responsible for building optimized, cost-efficient streaming and batch pipelines that deliver high-trust data to our Advanced Analytics, MLOps, and Business Intelligence teams.
Key Responsibilities
- End-to-End Lakehouse Architecture: Design, implement, and scale a robust Medallion Architecture (Bronze-Silver-Gold) on Azure Databricks and Delta Lake.
- Real-Time IoT Ingestion: Build fault-tolerant, low-latency streaming pipelines to ingest high-frequency telemetry and machine sensor data.
- Enterprise Governance: Enforce data security, fine-grained access controls, and comprehensive lineage tracking using Unity Catalog.
- Performance Tuning & Cost Optimization: Actively profile, tune, and optimize Spark workloads (utilizing partitioning, liquid clustering, AQE, and Photon) to drastically minimize cloud compute costs and pipeline runtimes.
- CI/CD Automation: Modernize data platform deployments across Dev/QA/Prod environments using Infrastructure as Code (IaC) and Databricks Asset Bundles (DABs).
- Cross-Functional Collaboration: Partner closely with manufacturing stakeholders, supply chain analysts, and data scientists to provide curated datasets for predictive maintenance, anomaly detection, and operational KPI reporting.
Technical Skills Breakdown
Mandatory Skills (Must-Haves)
- Domain Context: Minimum 5+ years of Data Engineering experience with direct exposure to Heavy Manufacturing, Automotive/Commercial Vehicles, Industrial Automation, or Global Logistics data environments.
- Databricks Ecosystem: Deep architectural mastery of Azure Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog governance.
- Streaming & CDC: Proven hands-on experience engineering real-time data pipelines using Apache Kafka, Azure Event Hubs, or Spark Structured Streaming, alongside Change Data Capture (CDC) tools (e.g., Debezium).
- Cloud Infrastructure: Strong proficiency within the Microsoft Azure stack—specifically Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Cores), Azure Key Vault, and Azure Monitor.
- Advanced SQL & Python: Expert-level Python programming and complex SQL optimisation (advanced indexing, partition pruning, performance tuning of massive datasets).
- DevOps Automation: Hands-on experience setting up production CI/CD pipelines using Git, Azure DevOps, GitHub Actions, or Databricks Asset Bundles (DABs).
Good to Have Skills (Nice-to-Haves)
- Professional Certifications: Databricks Certified Data Engineer Professional (highly preferred), Databricks Certified Associate Developer for Apache Spark, or Microsoft Certified: Azure Data Engineer Associate (DP-203).
- Industrial & ERP Systems: Familiarity with industrial data systems (SCADA, PLC, iHistorian), heavy vehicle telemetry standards (MDF/MF4 files), or deep integration experience with enterprise ERPs (SAP S/4HANA, SAP BW).
- MLOps & GenAI: Exposure to working alongside Machine Learning pipelines, dataset feature engineering, or implementing Generative AI frameworks (RAG, Vector Databases like FAISS/Weaviate) for semantic query self-service.
- Infrastructure as Code (IaC): Basic proficiency with Terraform for provisioning cloud data infrastructure.
Education & Qualifications
• Bachelor’s or Master’s Degree in Computer Science, Information Technology, Electrical/Electronics Engineering, or a closely related technical field.

Similar jobs

Hiring for: An emerging general insurance business in India. AI-led, fast and transparent.
Role: Backend Engineer (Node.js & TypeScript) | SDE-1
Experience: 1 to 3 Years
Location(s): Mumbai - Work from office (Vikhroli)
Type: On-site / Permanent
Notice Period: Immediate to 30 days
Note: Candidates only from Strong product-based startups / product companies required
& Candidates from premier engineering institutes (IITs, NITs, BITS, IIITs, DTU, NSUT, etc.) are preferred.
We're looking for a Software Engineer who thrives on building scalable systems from the ground up, enjoys working across the stack, and wants to be part of an incredible 0 to 100 journey.
Roles and Responsibilities:
- Design and develop world-class insurance tech solutions from the ground up.
- Own features end-to-end – from API design to deployment, ensuring performance and scalability.
- Play a key role in shaping technical decisions, architecture, and best practices.
- Iterate quickly based on user feedback, balancing speed and scalability.
Required skills:
- 1+ years of experience in backend engineering.
- Proficiency in Node.js, and TypeScript, APIs, databases.
- Experience working with and building backend systems that have been used in the real world.
- Ability to navigate different stages of product development - from scrappy MVPs to scalable architectures.
- Passion for building customer-driven products and solving real-world problems. This is a rare opportunity to shape a product from the ground up, work with a stellar team, and transform the insurance space with technology. If that excites you, we’d love to chat!
Benefits:
- Greenfield Opportunity : Build scalable products from scratch in a rapidly evolving sector.
- End-to-End Ownership : Work across the stack, shaping product experiences for scale.
- Learn from the Best : Collaborate with an exceptional leadership team with deep expertise in tech and insurance.
- Impact at Scale: Be part of an early-stage team revolutionizing a trillion-dollar industry.
Position: Robotics Intern
Location: Chandkheda, Ahmedabad (Fx31Labs Office)
Duration: 3–6 Months
Stipend: Rs.5,000 / Per month
Job Description:
We are seeking a passionate Robotics Intern to join our advanced robotics team. This internship offers a fast-paced, end-to-end engineering experience involving aerial robotics, embedded systems, autonomous navigation, perception, and real-world prototype development.
This role is ideal for students and early-career engineers looking to gain practical experience in designing, building, testing, and improving autonomous robotic platforms.
Key Responsibilities:
Design & Build
- Assemble and integrate motors, ESCs, sensors, flight controllers, microcontrollers, and communication modules.
- Design and prototype electronic systems for rapid testing and development.
- Assist in mechanical assembly, wiring, and hardware integration of robotic platforms.
Embedded Systems & Control
- Develop Python and C/C++ software for sensor integration, control systems, and autonomous behaviours.
- Interface with hardware and wireless communication protocols.
- Implement safety mechanisms, telemetry systems, and fault-detection routines.
Autonomous Navigation & Perception
- Integrate sensors such as IMUs, GPS, LiDAR, cameras, depth sensors, and range finders.
- Develop and test localization, navigation, and obstacle-avoidance capabilities.
- Work with computer vision and perception pipelines for environmental awareness.
ROS 2 & SLAM
- Implement and tune SLAM and localization frameworks using ROS 2.
- Work with tools such as Cartographer, RTAB-Map, Nav2, and related autonomy stacks.
System Integration & Testing
- Integrate hardware, firmware, and software into a fully functional robotic system.
- Perform debugging, troubleshooting, and validation across electronics, software, and mechanical subsystems.
- Conduct field testing and analyse system performance.
Rapid Prototyping & Iteration
- Build, test, evaluate, and refine prototypes through iterative development cycles.
- Contribute innovative ideas to improve system reliability and performance.
Qualifications:
- Pursuing or recently completed a Bachelor's degree in Robotics, Mechatronics, Electronics, Electrical Engineering, Computer Science, Aerospace Engineering, or a related field.
- Hands-on experience with robotics, embedded systems or related projects.
- Proficiency in Python and basic C/C++ programming.
- Understanding of sensors, control systems, communication protocols, and microcontroller-based development.
- Experience with hardware assembly, wiring, debugging, and soldering.
- Comfortable working on both software and physical hardware systems.
Why Join Us?
- End-to-End Engineering Experience
- Advanced Robotics Exposure
- Learning & Mentorship
- Innovation-Driven Environment
QA Engineer (Manual + Automation – Web, API & Mobile)
Location: Surat
Job Type: Full-time
Experience: 2+ Years
Work Mode: Onsite
About the Role:
We are looking for a talented and detail-oriented QA Engineer with a strong foundation in both manual and automation testing across web, API, and mobile platforms. The ideal candidate will be responsible for designing comprehensive test strategies, writing and executing test cases, and building automation suites to ensure our products meet the highest standards of quality and performance.
Key Responsibilities:
- Design, develop, and maintain automated test scripts using JavaScript, TypeScript, Playwright, and WebdriverIO.
- Perform comprehensive manual testing for web, API, and mobile applications.
- Create and execute test cases, test plans, and test reports to ensure full test coverage.
- Build and maintain scalable automation frameworks for regression, smoke, and functional testing.
- Conduct API testing using tools such as Postman.
- Support mobile testing on Android and iOS platforms (Appium preferred).
- Execute automated test suites, analyze results, and log defects using bug-tracking tools.
- Integrate automation tests into CI/CD pipelines (e.g., Jenkins).
- Collaborate closely with developers, product owners, and QA leads to understand requirements and ensure quality delivery.
- Participate in code reviews and advocate for best testing practices.
Required Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 2+ years of experience in software QA with both manual and automation testing.
- Strong proficiency in JavaScript, TypeScript, Playwright, and API testing tools.
- Solid understanding of QA methodologies, processes, and tools.
- Experience with WebdriverIO and mobile automation concepts.
- Hands-on experience with Postman for API validation.
- Familiarity with tools such as Git, Maven, Jenkins, or similar.
- Hands-on experience with tools like Maven, Git, Jenkins, or similar.
Preferred Skills (Nice to Have):
- Experience with BDD frameworks like Cucumber.
- Exposure to Appium for mobile automation.
- Knowledge of cross-browser and mobile testing strategies.
- Basic understanding of Docker, Kubernetes, or cloud platforms (AWS/GCP).
What You’ll Gain:
- Opportunity to work across the entire QA lifecycle—from strategy to execution.
- A collaborative environment that encourages innovation, learning, and continuous improvement.
- Hands-on experience with modern QA technologies and real-world testing challenges across platforms.
Ready to build and break things to make them better?
📩 Apply now and become part of a passionate team committed to quality and excellence.
About Blostem:
Blostem is a fintech infrastructure company backed by Rainmatter (Zerodha), MobiKwik, and AC Ventures. We help fintechs embed Fixed Deposits and other financial products in 7 days — vs the traditional 9–12 months.
You'll work on real campaigns, real content, and real pipeline — not just scheduling posts.
What you'll do:
→ B2B content — LinkedIn, email, website
→ Marketing automation and CRM workflows
→ SEO, paid campaign support, and performance reporting
→ Trend-led social content that works for a professional, niche audience
What we're looking for:
We need someone who genuinely lives on the internet.
→ Deep understanding of how LinkedIn, Instagram, and YouTube algorithms work — not surface level
→ Knows what's trending before it peaks — formats, memes, audio, content styles
→ Can spot a good hook, adapt a trend for a B2B/fintech context, and execute fast
→ Understands the difference between content that gets views and content that builds trust
→ Aware of platform-native formats — carousels, short-form video, newsletters, threads
→ Has an eye for what performs in a niche, professional audience vs a mass consumer one
→ Already uses AI tools (ChatGPT, Claude, Perplexity) to research, write, and work faster
→ Writes clearly in English and understands how B2B funnels work
→ Self-starter, fast learner, comfortable in a startup
→ Uses AI for competitor research, content ideation, and summarising long-form material

Role: Python Developer (Immediate Joiner)
Location: Gurugram, India (Onsite)
Experience: 4+ years
Company: Mizzle Cloud Pvt Ltd
Working Days: 6 Days( 5 days- WFO, Sat- WFH)
Job Summary
We are seeking a skilled Python Django Developer with expertise in building robust, scalable, and efficient web applications. Must have 3+ years of core work experience. The ideal candidate will have hands-on experience with RabbitMQ, Redis, Celery, and PostgreSQL to ensure seamless background task management, caching, and database performance.
Key Responsibilities
- Develop, maintain, and enhance Django-based web applications and APIs.
- Design and implement message broker solutions using RabbitMQ to manage asynchronous communication.
- Integrate Redis for caching and session storage to optimize performance.
- Implement and manage task queues using Celery for background processes.
- Work with PostgreSQL for database design, optimization, and query tuning.
- Collaborate with front-end developers, DevOps engineers, and stakeholders to deliver high-quality software solutions.
- Write clean, modular, and well-documented code following best practices and standards.
- Debug, troubleshoot, and resolve issues across the application stack.
- Participate in code reviews, system design discussions, and team meetings.
- Ensure scalability, reliability, and security of applications.
Technical Skills:
- Must have minimum 4+ years of relevant work experience.
- Strong proficiency in Python and Django framework.
- Experience with message brokers, particularly RabbitMQ.
- Familiarity with Redis for caching and session management.
- Hands-on experience with Celery for distributed task queues.
- Proficiency in PostgreSQL, including database design and optimization.
- Knowledge of RESTful API design and development.
- Understanding of Docker and containerized applications.
Preferred Skills:
- Experience with CI/CD pipelines.
- Familiarity with cloud platforms (AWS, GCP).
- Knowledge of Django ORM and its optimizations.
- Basic understanding of front-end technologies (HTML, CSS, JavaScript).
Soft Skills:
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
- Ability to work in an agile environment and adapt to changing requirements.
Educational Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
We are looking for a focussed, energetic and motivated Senior Java Developer. You must have sufficient experience in Java Development, Spring, Spring Boot, AWS and SQS, S3. You will be challenged with complex and robust product development.
As a Senior Java Developer, you will be the most senior developer within the company working alongside other Java Developers, the Engineering Manager, and the CTO.
Senior Java Developer requirements
Solid development experience using Java, Springboot, SQS, S3 and Microservices
Experience working in Swing Java framework
Revises, updates, refactors, and debugs code
Write clear, concise and efficient code and ensure it is fully tested
Service and develop features using Java with AWS, JUnit, SQL and Spring framework
You have a good knowledge of Cloud technologies (ideally AWS)
Participate in peer coding reviews and work in a collaborative, agile environment
Demonstrate technical knowledge and expertise with a clear understanding on the products' technical composition
Senior Java Developer responsibilities
7-9 yrs minimum work experience
Excellent analytical, troubleshooting, and communication skills
Excellent attention to detail and time-management skills
Serves as an expert on developed applications
Ability to adapt and learn new product/technology is key
Collaborates with internal teams to produce software design and architecture
Knowledge of Agile frameworks (i.e. Scrum) and has worked with Jira or Spira
Attend daily stand-up meetings alongside the Scrum Master
A self-starter, hardworking and committed individual
Work UK hours - ideally 9.00am - 6pm with the expectation to work out of ours when needed
They have a funding of $1.1 M through a Series A round. Their latest funding was on Jan 6, 2016.
Location: Mumbai
Responsibilities:
-
Designing overall sales strategy in alignment with business goals & drive the execution with the help of an agile team
-
Always and continuously connecting with Institutions, Wealth Managers, Family offices, and others to pitch and make cryptocurrencies a part of their portfolio
-
Being proactive, on-ground, hustler who loves to be out of the office and being in meetings with clients for sales closures
-
Understanding Institutional needs, customising solutions, and generating demand and trade volumes, always keeping client interest as paramount & looking for new projects/partnerships to be listed on the exchange
-
At least 10 yrs of relevant experience in the sector
-
Has a demonstrated history of high alpha products and/or new and emerging asset class sales to institutional clients
-
Has proven experience in Investment/Wealth Management or Financial Services
-
Must have demonstrated ability to create sales/relationship opportunities with clients, prospects
and consultants
-
Must have excellent sales skills and in-depth product and broad knowledge in cryptocurrency
-
Has strong communication skills, as well as the ability to work well with a variety of people across the organization
Candidates working in Financial Services/ Fintech industry will be preferred
• 2+ years of professional experience working with React Native.
• Experience working with Swift, Objective C, and Java a plus but not required.
• Meaningful experience working on large, complex systems.
• Ability to take extreme ownership over your work.
• Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon, both in regard to estimates and to general process.
• Ability to identify with the goals of FullStack clients and dedicate yourself to delivering on the commitments you and your team make to them.
• An understanding of React Native best practices and a commitment to following them.
• Ability to work through new and difficult React Native issues and contribute to libraries as needed.
• Ability to create and maintain continuous integration and delivery of React Native applications.
• A positive mindset and can-do attitude.
• Attention to detail.
• English Skills (ability to effectively communicate via written and spoken English).
• You are passionate about software development...it's not just your career, it's your hobby.
• You are constantly striving to learn new things and improve.
• You follow industry news, regularly tinker with new technologies, and read books and blogs to keep your skills current.
•You work well within a team environment and enjoy working in the office with your colleagues.
● 4+ years experience in JavaScript for Scripting and UI Automation Script.
●Strong experience in working with Protractor, Super test - Mocha.
●Experienced in SQL for DB scripting and DB Operation and good knowledge in SQL Server management studio.
●Hands-on with API Automation testing using any decent tool like is by.
●Experienced in GitHub, Jenkin, TeamCity and Knowledge on Jira.
●The ability to build automation frameworks from scratch and being confident to manage all aspects of the framework
●Exposure to/working knowledge of the Agile Methodology (e.g. Kanban, Scrum)







