Cutshort logo
For Employers
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Real Estate Industry
Real Estate Industry
Agency job
Mumbai, Navi Mumbai
1 - 4 yrs
₹3L - ₹5L / yr
Sales
Real Estate
Inbound Marketing
Lead Generation
Product demonstration
+1 more

We’re Hiring: Sales Associate – Sales Development 🌟

📍 Location: Andheri East

🕒 6 Days Working | Alternate Saturday Off

💼 Exp: 1+ Year

👤 Reports To: VP – Sales


Key Responsibilities:

  • 🏢 Conduct centre tours & showcase workspace solutions
  • 📞 Manage inbound leads & follow up for conversions
  • 💰 Drive sales for Flexi Desks, Cabins & more
  • 🧾 Maintain accurate Sales MIS & reports
  • 🤝 Build partnerships with aggregators (Qdesq, MyHQ, Cofynd, etc.)
  • 💬 Ensure top-notch client service & retention

🚀 Passionate about sales & coworking spaces?

📧 Share your resume

Read more
World's largest Media Investment Company
World's largest Media Investment Company
Agency job
via Merito by Jinita Sumaria
Mumbai
9 - 15 yrs
₹27L - ₹37L / yr
Digital Marketing
Influencer Marketing
Content Strategy
Digital Planning
Performance Marketing
+1 more

Role : Lead – Influencer Marketing


Overview of job -


Our client is the world’s largest media investment company and is a part of WPP. In fact, we are responsible for one in every three ads you see globally. We are looking to hire a Partner – Influencer Marketing to join us. In this role, you will be leading the advocacy narrative for the largest FMCG organization in India. An individual with expertise in digital marketing/planning, an entrepreneurial mindset and a knack for influencer marketing are key areas of strength that will be expected of the right candidate. Ready to build the influencer marketing ecosystem for working with a team of 15+ young minds specializing in the space of digital & influencer marketing. The role entails managing and building the influencer scope for more than 50 brands.


The 5 key pillars of the job -


A) Liaison with the global team and local to maintain and further develop a strategic narrative on influencer marketing

B) Blur lines between digital planning and influencer planning to drive effectiveness

C) Develop and deliver creative - first of its kind advocacy solutions for brands

D) Create a measurable framework on influencer marketing. E) Understanding of social media, digital marketing and content marketing ecosystem will be important elements to this role.


We are currently looking for a 10+ years’ experience individual, based out of Mumbai to join us. 


Minimum qualifications:


• Graduate – Mandatory, Post graduate – Preferred

• Minimum 10+ years’ experience with 4+ years of experience in digital marketing/digital planning/performance marketing

• Should have previously managed a team

• Experience in influencer marketing, Social media, and ecommerce 

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Ranjana Nahar
Posted by Ranjana Nahar
Bengaluru (Bangalore), Pune, Gurugram
4 - 7 yrs
₹8L - ₹14L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Java developer roles will vary greatly depending on companies and job positions. Here are some typical roles and responsibilities of java developers:

  • Contribute to all stages of software development lifecycle
  • Design, implement and maintain Java-based applications that can be high-volume and low-latency
  • Analyze user requirements to define business objectives
  • Envisioning system features and functionality
  • Define application objectives and functionality
  • Ensure application designs conform with business goals
  • Develop and test software
  • Identify and resolve any technical issues arising
  • Create detailed design documentation
  • Propose changes to current Java infrastructure
  • Develop technical designs for application development
  • Develop multimedia applications
  • Write well designed, testable code
  • Conducting software analysis, programming, testing, and debugging
  • Manage Java and Java EE application development
  • Develop documentation to help users
  • Transforming requirements into stipulations
  • Prepare and produce releases of software components
  • Support continuous improvement, investigating alternatives and technologies, and presenting for architectural review


Read more
Unio labs Private Limited
Shristi Raj
Posted by Shristi Raj
Hyderabad
0 - 4 yrs
₹2L - ₹5L / yr
Sales
Client Management
Sales presentations
Corporate Communications
Lead Generation
  • Identify business opportunities
  • Visit key clients
  • Provide service demonstration
  • Create distribution network
  • Seek sales opportunities from existing and potential clients
  • Achieve targets
Read more
PCL Health
at PCL Health
1 recruiter
Ankit Saintwal
Posted by Ankit Saintwal
Noida, Gurugram
2 - 6 yrs
₹3L - ₹6L / yr
skill icon.NET
ASP.NET
skill iconC#
Microsoft Windows Azure
skill iconReact.js
+1 more

About PCL Health:

We are an age-tech startup revolutionising healthcare with real-time data. We are creating a connected-care ecosystem that uses AI-enabled Health Algorithms and medical devices (IoT & Wearables) to digitise medical information exchange. In short, we want to allow older adults to live independently at their homes and enjoy their moments while keeping everyone informed. Our mission is to provide doctors, carers and family relatives with predictive tools capable of picking up health problems before they become severe, therefore saving time, money and lives.

Senior .NET Developer’s Role:

Every member of the technology team is responsible for:

  • The availability, security, scalability, and interoperability of our platform

  • Delivering our product roadmap

  • Planning for the future

  • Generating enthusiasm and a sense of both technical and product pride

 

As a Senior .NET Developer, you play a key role in ensuring your team can efficiently turn ideas into reality. You’ll need to:

  • Write technically sound, clean, maintainable code with practical application of established patterns and practices

  • Take technical ownership of your team’s work, from its infancy through to delivering great implementation in production that pushes our standards higher and higher

  • Believe in testing and make sure your code is always tested and the quality standards are always high

  • Contribute to the definition and keep to the processes, standards and designs your team has agreed upon

  • Track the progress that you are making towards the wider goals of your team, and transparently communicate that progress to your team and Technical Lead

  • Ensure you and others are continuously improve, by proposing and implementing new processes, designs and engineering practices that make the team more effective

  • Take responsibility for supporting your changes all the way through proving they work well and continue to work well in production

Your skills and experience

Essential for this position:

  • At least 4 years of commercial experience with C# and .NET

  • At least 2 years of experience with React.js/Vue.js

  • At least 2 years of commercial experience with Microsoft Azure (or AWS)

  • Designing and developing APIs for both high availability and scalability

  • Writing automated tests (both unit and integration tests)

  • Experience with CI/CD pipelines (ideally Azure DevOps)

You would get extra points for any of the following:

  • TDD and BDD

  • Contributing to open source community

  • DevOps, monitoring and alerting

  • Experience with Health-tech, FHIR, Wearables, IoT

  • If you can join within 1 month

Read more
Kale Logistics Solutions Private Ltd
Rohit Jain
Posted by Rohit Jain
Remote, Mumbai
4 - 8 yrs
₹5L - ₹9L / yr
skill iconAngular (2+)
skill iconAngularJS (1.x)

We are looking for an Angular Developer and your primary focus will be to implement a complete user interface in the form of a mobile and web app, with a focus on performance. The main duties will include creating modules and components and coupling them together into a functional app. The artistic design will be delivered to you, together with a few wire frames templates, but your assistance will be required regarding animations, CSS, and final HTML output. You will work in a team with the back-end developer and communicate with the API using standard methods.

Responsibilities:

  • Delivering a complete front-end application
  • Ensuring high performance on mobile and desktop
  • Writing tested, idiomatic, and documented JavaScript, HTML and CSS
  • Coordinating the workflow between the graphic designer, the HTML coder, and yourself
  • Cooperating with the back-end developer in the process of building the RESTful API
  • Communicating with external web services

 

Skills and Qualifications

  • Deep knowledge of Angular practices and commonly used modules based on extensive work experience
  • Proficiency with JavaScript and HTML5
  • Creating self-contained, reusable, and testable modules and components
  • Extensive knowledge of CSS and JS methods for providing performant visual effects
  • Validating user actions on the client side and providing responsive feedback
  • Creating custom, general use modules and components which extend the elements and modules of core Angular
  • Experience with building the infrastructure for serving the front-end app and assets
Read more
Openstream Technologies
Openstream Technologies
Agency job
via Spar Technology Services by Deepika Adiga
Bengaluru (Bangalore)
4 - 8 yrs
₹10L - ₹35L / yr
skill iconNodeJS (Node.js)
Rest
Javascript
4 years backend services development with Node.js
• Experience with JavaScript frameworks (such as React, Angular) and CSS pre-processing frameworks
• Solid understanding of node event loops, sockets, connection pools, and performance tuning
• Strong computer science fundamentals in algorithms, data structures, data stores, operating systems, etc
• Good knowledge of High-performance Stream processing, Large Scale Messaging Systems
• Hands on in Architecting and developing large scale distributed systems applications with experience in Real time Transactional Systems
• Good exposure to REST, Large storage systems (RDBMS, NO SQL Stores like Cassandra/MongoDB, REDIS, etc.)
• Experience in both relational and non-relational databases
• Solid Experience in developing scalable Event driven applications
• Cloud computing experience
• Understanding of Continuous Integration & Continuous Delivery (CI/CD) in the software engineering processes
• Experience with Webpack, or other automated build tools
 
Nice to have:
- Microsoft Bot Framework
- Good exposure to Messaging (KAFKA, RABBITMQ, etc.), stream processing (SPARK, STORM etc.),
Read more
Poddar Diamond Ltd
at Poddar Diamond Ltd
1 recruiter
Kavita Yadav
Posted by Kavita Yadav
Mumbai
3 - 5 yrs
₹2.4L - ₹6L / yr
Marketing
B2B Marketing
Lead Generation
Sales

We are looking for a result-driven b2b Diamond and Diamond Jewellery Marketing for Overseas with good experience in certified and non certified loose diamonds and have knowledge of Lab Grown diamond. Candidates to be responsible for all sales job duties, from generating leads to closing sales in overseas and develop contacts from his own in USA & European. Duties and responsibilities include working closely with customers to determine their needs, answer their questions about our products and recommend the right merchandise. You should be able to promptly resolve customer complaints and ensure maximum client satisfaction. Analysis of the needs of existing/potential customers to meet their requirements.

A good understanding of Loose Diamonds, Certified Diamonds and Diamonds & Diamonds Jewellery and experience in the required field is most important. Knowledge of Natural & Lab grown diamonds. Exposure of the overseas market is also necessary.

For Overseas Diamond & Jewellery Marketing the candidates with good USA & European marketing & contacts will do. Have to work in Night and evening shift.

Read more
Wideeye
at Wideeye
2 recruiters
Prasad Zaware
Posted by Prasad Zaware
Pune
0 - 2 yrs
₹2L - ₹3L / yr
Internet of Things (IOT)
Embedded software
skill iconPython
skill iconMongoDB
Embedded C
+2 more
Responsibilities • Design & Develop work based on requirement • Report own status • Collaborate with other team members to achieve sprint goals. Required Qualifications And Experience • BE/ B.Tech in Electronics/Electrical • Good to have Knowledge on Backend Development • Strong knowledge in C/C++ and Python • Good programming & SW design skills
Read more
company logo
Pune
2 - 4 yrs
₹2L - ₹3L / yr
Finance
Accounting
Audit
Taxation
GST
  • Ensuring timely and proper Accounting of entries related to expenses and payments.(Zoho Books)
  • Ensure timely payment of Rent, Salary, Utility Bills & statutory dues
  • Ensuring Inventories are entered and invoiced in the system.
  • Funds Management and vendor’s payment. Reconciliation of Vendors ledger..
  • Follow up with Audit Team for Stores Audit, Stock Loss Recovery.
  • Stock or inventory management
  • Co-ordination with Statutory Auditors.
  • Ensure statutory compliances and timely deposit of statutory dues
  • Indirect & Direct Tax compliance
  • Submission of GST/TDS Returns on monthly, quarterly and annually
  • Invoicing, follow up with customer for payment & Reconciliation of customer account
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos