Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

jk
at jk
mithul m
Posted by mithul m
Saravanmpatti
0 - 3 yrs
₹2.5L - ₹3.5L / yr
skill iconC
skill iconPython
Teaching
Communication Skills

Company Description

Established in the year 2000, KGiSL Educational Institutions is the brainchild of Dr. Ashok Bakthavathsalam, founder and managing director of KG Information Systems Private Limited (KGISL).

Branded as the pioneers in industry-embedded education in the region, KG Group of Institutions at Saravanampatti boasts of being the only campus that fosters the perfect integration of institute – industry infrastructure in an environment of perfecting learning.


Role Description

This is a full-time, on-site role for a Program Mentor located in Coimbatore. The Program Mentor will guide and assist students in their academic and professional development. Responsibilities include mentoring students, conducting workshops, providing individual and group support, assisting with curriculum planning, and tracking mentee progress. The mentor will also collaborate with the faculty and administration to provide insights and feedback on program improvements.


Qualifications

  • Mentor students in C and Python programming concepts and best practices
  • Strong mentoring and coaching skills, with the ability to guide students toward their goals
  • Experience in planning and conducting workshops or training sessions
  • Excellent written and verbal communication skills
  • Ability to collaborate effectively with faculty, students, and stakeholders
  • Organizational and time management skills to track and support student progress
  • Prior experience in an educational or related field is advantageous
  • BE / B. Tech degree is preferred with CSE and IT background


Read more
Bengaluru (Bangalore)
4 - 6 yrs
₹20L - ₹27L / yr
SaaS
US sales

Candidate must have prior experience in B2B SaaS or Cybersecurity.

Candidate must have a minimum of 3+ years of experience selling to the US market.

Candidate must have a proven track record of closing mid-market and enterprise-level deals in a SaaS environment.

Candidate must have experience managing and achieving $300K–$500K annual revenue targets.

Candidate must have strong exposure to the full sales cycle, with emphasis on outbound acquisition and pipeline ownership.

Candidate must be a high-agency, self-driven operator with consistent quota attainment.

Candidate should not have any employment gap longer than 3 months

Read more
Payments bank
Payments bank
Agency job
Navi Mumbai, Mumbai
3 - 6 yrs
₹7L - ₹18L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+4 more
Job location- Navi Mumbai
  • Expérience to handle banking project, Complaince issue,
  • Angular JS 1.6 and above 6/7 version experience 1.5-4 years
  • WCF/WebAPI/C#.NET 4.0 and above experience 2-5 years
  • Microsoft Sql server 2008 and  above version minimum 1.5-3 years
  • Device integration experience (Biometric, MATM)
Read more
Kiara Global Services
Hyderabad
14 - 20 yrs
₹8.4L - ₹9.6L / yr
Power Systems
AutoCAD
ETAP
Renewable Energy
solar

Position Title: Sr. Manager/Manager Designs – Power Evacuation

Experience: 14 To 20 Years

Industry Type: Renewable Energy

Key Skills: AutoCAD, ETAP, Power World

Job Objectives:

  • Lead the design of efficient power evacuation systems to integrate solar power plants with the national or regional grid.
  • Design the layout of transmission lines, substations, step-up transformers, and switchgear for large-scale solar projects.
  • Perform load flow studies, short circuit studies, and other electrical analyses to ensure the robustness of evacuation systems.
  • Lead the planning, design, and implementation of power evacuation systems, ensuring they are aligned with project timelines, budgets, and specifications.
  • Coordinate with external consultants, EPC contractors, and vendors to ensure seamless execution of the power evacuation systems.
  • Ensure that all evacuation designs are compliant with local, national, and international standards (such as IEC, IEEE).
  • Lead and mentor a team of engineers and technical specialists.
  • Work closely with project managers, regulatory bodies, and other stakeholders to ensure project alignment and timely execution.


Read more
Remote only
2 - 5 yrs
₹6L - ₹10L / yr
Sales presentations
Sales and operations planning
Lead Generation
Lead management
Presentation Skills
+8 more

Qualification: MBA Marketing/ BBA/BBM or Equivalent Degree & Experience


Industry: Preferably User Experience (UX/UI), Digital Design, Software Development, IT Services, Advertising Agency or relevant domain


Primary Responsibilities

  • Do market research, competitive analysis, Prospecting & client profiling.
  • Data Mining: Finding & generating leads and converting them into the sale
  • Manage end-to-end sales process, arrange and attend meetings and explore potential business opportunities.
  • Strategically communicate, and circulate marketing & branding content
  • Client relationship management & address their requirements on time to time basis
  • Active involvement in project scoping, SLA compliance & timely invoice collection
  • Handle company promotions & social media communications, PR & Press relationship
  • Travel and attend networking events & client meetings.
  • Training & nurturing peers


Skills Requirements

  • Excellent Written & Verbal communication skills - English
  • Extremely good at Client Presentation, Pitching & Negotiations
  • Revenue Focused, Ability to meet financial goals
  • Writing content on social media, blog, press etc.
  • Time & Priority Management
  • Knowledge of SEO, SMO and SEM is plus
  • Familiar with IT terminology specifically in UI Design & Development Area.


Special Benefits

  • Attractive incentives & timely recognition
  • Collaborative & creative culture. A passionate team with diverse backgrounds & skills
  • Exposure to various challenging opportunities & mentoring from seniors.
  • Work with well respected & award-winning design studio


Read more
Troopod
at Troopod
1 recruiter
Neeraj Joshi
Posted by Neeraj Joshi
Bengaluru (Bangalore)
2 - 8 yrs
₹15L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconMongoDB
+1 more

Job Description:

Product management

  • Work closely with the product team to translate abstract business & product requirements into crisp technical specifications along with a delivery roadmap

Product Development

  • Define code architecture decisions to support a high-performance and scalable product with a minimal footprint
  • Developing the frontend/backend and APIs, primarily using the MERN stack for Troopod.
  • Delivering a robust backend platform for the product by incorporating important considerations regarding minimal downtime, high availability, data redundancy, tight security, etc. into the design
  • Preparing test cases, creating automated build and test processes, setting up systems for CI/CD, and monitoring for the product
  • Deploying on AWS using the right services for optimal performance
  • Support the Troopod mobile application in its entirety, including working on bug fixes and improving application performance, reliability, and stability
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency
  • Managing development and deployment of the product following Modular programming, proper documentation, and code versioning

Customer Success

  • Ensuring seamless use of Troopod Web-app and Mobile App by clients or internal teams and successful integration of client systems with Troopod backend and APIs wherever applicable
  • Assisting clients with necessary remote support needed for the smooth understanding of and integration with Troopod product

Team Growth

  • Contributing to the growth of the engineering team through proactive effort on knowledge growth, process improvements, and performance enhancements on existing solutions

Requirements:

Prior experience in the following things is MUST:

  • Minimum 2 years of hands-on technical development experience as a MERN stack developer
  • In-depth knowledge of NodeJS, Express or Restify
  • Experience implementing applications using ReactJS and React Native
  • Experience in creating frontend applications using HTML5, Angular, React, LESS/SASS
  • Hands-on experience with JavaScript Development on both client and server-side
  • Experience with modern frameworks and design patterns, minimum 3-year experience with MERN Full-stack paradigm
  • Should have worked on AWS(EC2), DNS, and other server features
  • Familiarity with code versioning tools (Such as Git, SVN, or Mercurial)

Bonus points:

  • Development experience for high-traffic, consumer-facing web or mobile application
  • Experience in building a chat or social media app
  • Creating secure RESTful-based web services in XML and JSON, Javascript, JQuery
  • Experience in hiring and leading a team of developers
  • Open-source contributions
  • Experience with next.js, serverless, and tailwind CSS
  • Eat, sleep, code, and repeat is a typical mantra of your life

Benefits:

  • Work in a well-funded startup with a team of 2nd-time founders from top tier colleges like BITS and NIT
  • Chance to get decent equity and become part of the founding and core team
  • Build a highly scalable product that would one day impact the lives of billions across the globe
  • Get guidance from the best product and tech folks out there at leadership positions in Dunzo, Razorpay, Haptik, etc
Read more
Cleanliness & Hygiene Intelligence company. SCL1
Cleanliness & Hygiene Intelligence company. SCL1
Agency job
via Multi Recruit by Sapna Deb
Bengaluru (Bangalore)
2 - 5 yrs
₹15L - ₹18L / yr
skill iconJava
skill iconKotlin
skill iconAndroid Development
Model-View-View-Model (MVVM)
RxJava
+1 more
  • Develop new mobile applications for enterprise as well as for end consumers
  • Translate User Stories into UI Design and Wireframe for Mobile Apps (Android and IOS)
  • Translate UI/UX designs into high-quality code
  • Architect and develop mobile applications from the scratch
  • Design, build and maintain high performance, reusable, and reliable codebase
  • Work with the Tech Lead and engineers to develop innovative solutions that meet market needs


Requirements:

  • 2-5 years of experience in building Android apps and has published one or more Android apps in the Google Play Store Fluent in Flutter, Kotlin, and Android Studio
  • Competent in producing scalable and high-quality code through automated functional and unit tests for Android applications
  • Deep understanding of standard Android design patterns and RESTful API design
  • Deep understanding of Google's design principles and interface guidelines
  • Knowledge of Continuous Integration and Delivery systems (i.e. Jenkins) and setups Experience in Git
  • Familiar with Agile practices such as Extreme Programming, Scrum, or Kanban
  • Experience in Developing Offline First Mobile App

 

Read more
A renowned private equity firm
A renowned private equity firm
Agency job
via Anther HR Solution by Nidhi Gupta
Remote only
5 - 9 yrs
₹8L - ₹16L / yr
skill iconNodeJS (Node.js)
skill iconAngular (2+)
skill iconJavascript
Fullstack Developer
skill iconAngularJS (1.x)
Greeting for the day !!!



Position: FullStack Developer

Company: A renowned private equity firm
Work from Home

You will be working as a consultant for one year contract which is renewable and proper notice period available.


JD:

As a full stack developer, the candidate needs to be a hands-on expert on the technology

stack. The candidate will work along with Product Owner, Sr. technical specialists and a

small team including some System Engineers and Application Engineers.

Below are major responsibilities as expected by us from a full stack developer:

 Development of modules, features and libraries as expected from the design,

technical documentations and direct communication.

 Troubleshooting and fixing bugs raised by test teams.

Desired attributes

 Understanding of good system design, reusable components, extensibility etc.

 Ability to read and understand new technologies from books and research papers is

desirable

 Excellent written and spoken communication skills

Must have attributes

 Tenacity in technical matters

 Analytical skills

 Quality consciousness

 Priority towards fundamentals and depths of a subject

Must have Technical Skills

 Node.js

 Angular 6 and above

 Any relational DB and MongoDB

 Frontend technologies --> HTML, CSS, JavaScript

Desired technical skills

 Additional scripting experience to automate anything during or aside development.

Key Performance Indicators

 Quality of code written, and resultant quality of modules/features developed.

 No of problem escalations resolved.

Important Points:

 Technical role in a start-up environment is a plus

 In-depth and abundant experience in our technology stack is a must have.

 A computer science degree from a good institute is a plus (as against a programming

diploma from NIIT/Aptech)

 The candidate will be in a guided role but needs to show excellence in quality of

work with least dependency to complete tasks assigned.
Read more
BlueCloud
at BlueCloud
1 recruiter
Gunjan G
Posted by Gunjan G
Pune
3 - 5 yrs
₹4L - ₹5L / yr
Customer Support
Customer Success
Customer Retention
Customer Relationship Management (CRM)


We at Zoop.one are looking for a technically savvy Customer Success executive who possesses a strong drive for results.

Duties for the Customer Success Executive will include a broad range of tasks such as maintaining ongoing customer relationships and networking, implementing success programs, contributing to sales, onboarding and training clients, and minimizing churn. You should also be able to provide insights on client-to-business interactions, improve customer experience through product support, and handle customer complaints and requests. You should be able to contribute to creating and maintaining good customer relationships and ensuring smooth onboarding.

Job Role:
Develop and manage client portfolios.
Sustain business growth and profitability by maximizing value.
Analyse customer data to improve customer experience.
Hold product demonstrations for customers.
Improve onboarding processes.
Mediate between clients and the organization.
Handle and resolve customer requests and complaints.
Minimize customer churn.
Aid in product design and product development.
Operate as the lead point of contact for all matters specific to our customers
Support and coordinate with the tech team to ensure seamless delivery to clients

What you’ll do:

Own the product knowledge base
Map customer journey and identify improvements at every stage
Maintain healthy customer engagement levels by identifying low utilization and providing solutions to further drive customer success
Develop a trusted advisor relationship with key customer stakeholders
Be the product champion, interpret customer insights to drive change in product and act as a voice of the customer to the Product team
Manage the Customer Success strategy for tracking and reporting on client health and reducing Customer Churn
Create and perform Monthly/Quarterly Business Reviews for ensuring customer retention and expansion - effectively delivering results to key stakeholders
Raise open issues with cross-functional teams and take ownership of resolving the issues in a timely manner
Constantly work towards providing innovative strategies for delivering customer delight
Engage with clients to understand the nuances of their work processes and the resulting needs and pain points.

 

Tools and Skills Required

Must Have:

Highly organized and able to multi-task.

Communication skills
Self-driven and proactive nature.
Excellent communication and interpersonal skills.
Experience in SAAS based product, CRM or ERP.
Knowledge of customer success processes.
Experience in document creation.
Patient and active listener.
Passion for service.

Have high proficiency in Microsoft Office (Excel, Word, PowerPoint)

 

Good to Have:
You should be passionate about engaging customers and expanding their use cases through our product
You have strong problem-solving skills and are great at finding creative solutions and workarounds when needed
You have good data analysis and data-driven decision-making skills
Strong project management skills

Experience:
3+ years proven track record in an enterprise account management role (Customer Success, Relationship Manager, etc.)

Strong Technical Background.

What’s attractive about us?
We offer a suite of memberships and subscriptions to spice up your lifestyle. We believe in practicing an ultimate work life balance and satisfaction. Working hard doesn’t mean clocking in extra hours, it means having a zeal to contribute the best of your talents. Our people culture helps us inculcate measures and benefits which help you feel confident and happy each day. Whether you’d like to skill up, go off the grid, attend your favourite events or be an epitome of fitness. We have you covered round and about.

  • Health Memberships 
  • Sports Subscriptions 
  • Entertainment Subscriptions 
  • Key Conferences and Event Passes
  • Learning Stipend 
  • Team Lunches and Parties 
  • Travel Reimbursements 
  • ESOPs 


That’s what we think would bloom up your personal life, as a gesture for helping us with your talents.
Join us to be a part of our Exciting journey to Build one Digital Identity Platform!!!



Read more
Paix Technology
at Paix Technology
2 recruiters
Kunal Shinde
Posted by Kunal Shinde
Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)
3 - 10 yrs
₹3L - ₹5L / yr
Automotive
Inside Sales
Sales
Key account management
Key responsibilities:- • The Person should have minimum 3 years of experience in the used car industry. • Solely responsible for meeting the monthly sales target, he will be directly reporting to the operations manager • Manage a team of 3 sales consultants • Coordinate with other teams for sales and post sales queries • Resolve the customer queries/escalations at the earliest and introduce new processes to drive system efficiency Lead a team of executives to manage procurement and sales processes for all cars. Developing and maintain relation with new car dealers and corporate leasing companies. Directly responsible for achieving purchase and sales targets, and 4- Pre-existing network amongst dealers(New car exchanges, local dealers, MFC, etc) and Brokers will be ideal Should have a fair understanding of the Local used-car market, pricing and demographics. Will be working across teams within the organization to maximize transactions. Dynamic and aggressive attitude, hustler, team-player and fast-paced executioner Office and Fieldwork will be equally distributed initially to build relations and network in the used car industry. Candidate will have to build his own team in assistance with the City Manager
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos