Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Web5 Solution
at Web5 Solution
1 candid answer
1 video
Ankit Goyat
Posted by Ankit Goyat
Gurugram
3 - 20 yrs
₹10L - ₹18L / yr
Software Development
Team Management
Team leadership
Software engineering
Software deployment
+7 more

Web5 Solution is a premier AI, Blockchain, and Tech Development firm dedicated to venture building. We partner with and empower early-stage startups to architect, build, and scale robust digital products from the ground up. We operate at the cutting edge of technology, exploring everything from decentralized networks to AI integration and Generative Engine Optimization (GEO).


Our Product Milestone: We are rapidly scaling our SaaS product, MyZia, which has successfully onboarded 100+ paid clients in just its first two months. We are looking for the right leader to take this momentum to the next level.


The Role

We are searching for a highly experienced and driven Technical Team Lead to take complete end-to-end ownership of our technology stack. You will be the driving force behind the technical strategy and execution for MyZia and other core ventures. We need a challenge taker, a goal achiever, and a true partner who deeply aligns with our vision of building scalable, high-performance tech products.


Key Responsibilities

- End-to-End Technical Leadership: Take complete ownership of the tech aspects of MyZia and emerging Web5 products, from high-level architecture to ground-level deployment.

- System Optimization & Scalability: Architect and maintain scalable systems capable of handling high transaction volumes, rigorous concurrent API hits, and massive data processing without performance bottlenecks.

- Full-Stack Excellence: Lead by example with hands-on full-stack development, conducting thorough code reviews, and maintaining the highest standards of code quality and security.

- Team Mentorship: Build, mentor, and lead a high-performing engineering team. Foster a culture of technical excellence, continuous learning, and accountability.

- Strategic Alignment: Work closely with the founders to align technical execution with business goals. Translate the overarching vision into an actionable technical roadmap.


Requirements

- Proven Experience: Extensive background in full-stack development with a strong track record of serving as a Team Lead, Senior Architect, or Lead Developer in a SaaS or product-based environment.

- Technical Mastery: Deep expertise in modern tech stacks, cloud infrastructure, and database optimization. Proven ability to handle scalable systems with extreme transactional rates and API dependencies.

- Domain Knowledge: Strong understanding of AI and Blockchain ecosystems. Familiarity with AI-driven development paradigms (like vibe coding) and implementing it right is highly advantageous.

- Problem Solving: Exceptional analytical skills with the ability to troubleshoot complex performance issues in real-time.

- Mindset: A relentless "challenge taker and goal achiever" mentality. You thrive in a fast-paced startup environment and treat the product as your own.


What We Offer

- The opportunity to be a pivotal leader in a fast-growing tech venture building firm.

- Direct impact on a rapidly scaling SaaS product (MyZia) with proven market traction.

- A dynamic, innovative environment based in Gurugram, working alongside passionate founders.

Read more
Master-O
at Master-O
1 candid answer
utkarsh baunthiyal
Posted by utkarsh baunthiyal
Gurugram
2 - 5 yrs
₹6L - ₹9L / yr
skill iconReact.js
skill iconReact Native
skill iconNodeJS (Node.js)
skill iconAmazon Web Services (AWS)
MySQL
+1 more

🚀 We're Hiring: Senior Backend Developer | Gurugram (On-site)


Looking to work with a fast-growing, tech-driven team in the SaaS space?

We’re on the lookout for a Senior Backend Developer with 2–3+ years of experience to help us build robust and scalable solutions.


🎯 What We're Looking For: ✅ Strong hands-on experience with Node.js & React

✅ Proficient in AWS (EC2, S3, Lambda, etc.)

✅ Good knowledge of MySQL


✨ Bonus: Exposure to AI/ML technologies

🏢 Preferred Industry Background: SaaS


📍 Location: Candidate should be from Delhi NCR

💰 Budget: Up to 11 LPA


If you're passionate about backend systems and want to make an impact in a high-growth environment, let’s connect!



Read more
Media
Media
Agency job
via Petras solutions by Ajantha M
Pune
7 - 11 yrs
₹25L - ₹40L / yr
skill iconData Science
skill iconMachine Learning (ML)
Natural Language Processing (NLP)

Job Description

Our Media Measurement team uses state-of-the-art technologies and rigorous methods to track who is watching what, where, and how they engage with content. Our clients can evaluate who is consuming which content across different media, platforms and devices, and know what the audience thinks about that content. As people consume media content on more channels, and through more devices, than ever before, we are proud to provide a full view on media consumption.

As Data Scientist you will have following main accountabilities: 

  • You own together with your team several of our Data Science solutions throughout the full life cycle (brainstorming, design, implementation, productization and maintenance) 
  • You develop solutions based on data science, stats and machine learning models 
  • You improve methods and tools. Contribute to our communities of practice in the area of Data Science 
  • Communicate with non-data scientists in Tech, Operations, Commercial, Product. Understand the domain and the requirements. Explain Data Science principles, concepts, algorithms, and approaches in simple words to different types of audiences 
  • Make data your best friends. Understand their strengths and use them. Be aware of their weaknesses and handle those in your solutions 
  • Screen the market for potential new Data Science approaches 
  • Foster knowledge exchange within the company. Present GfK's Data Science expertise at conferences and workshops 

Qualifications

Now you know what a Data Scientist does. What skills, qualifications & experience do you need for this job? 

  • You typically have a Master's degree or PhD that reflects modeling and statistics skills and 6+ years of experience. 
  • You enjoy communicating complex methodology and technology to tech and non tech audiences 
  • You have expert statistical / machine learning modeling skills (e.g. statistical tests, classification, predictive modelling, handling of missing data, sampling, weighting) 
  • You have experience with an analytical programming language (Python) and the respective ecosystem 

Besides the things we really expect you to have, there are some things which would be amazing if you have experience with them: 

  • Knowledge of cloud computing environments and tooling (especially AWS) 
  • Advanced software development skills (unit testing, CI/CD, Git) 
  • Basic skills regarding database handling as SQL 
  • Basic knowledge of the always evolving Data Science ecosystem and its frameworks 

Additional Information

  • Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms. 
  • Recharge and revitalize with help of wellness plans made for you and your family. 
  • Plan your future with financial wellness tools. 
  • Stay relevant and upskill yourself with career development opportunities. 

Our Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Manasi Mankas
Posted by Manasi Mankas
Bengaluru (Bangalore)
3 - 6 yrs
Best in industry
SDET
UI Automation
API Automation
Selenium
skill iconJava

Job Description - 

  1. Manual testing
  2. should be familiar Java programming languages and should have good problem-solving skills in that programming language.
  3. BDD Cucumber framework
  4. should be familiar in automation testing tool selenium.
  5. should be familiar with API testing manual and automation (widely used tools postman and rest assured library)
  6. Good Communication

Roles and Responsibilities

  • Develop and execute automation scripts for newly developed features. Modify existing framework to augment feature testing needs.
  • Continuously monitor automation test results and ensure no random test failures in automation.
  • Identify the cross-browser / platform impacts during the planning phase and ensure high test coverage.
  • Identify quality assurance process gaps and suggest actions for improvement.
  • Ensures Zero defect leakages.
  • Contribute Non-functional Testing aspects - Performance, Security, and Translation.
  • Work closely with the Development team and ensure code is delivered with high code coverage.
  • Contribute to continuous Integration and Continuous Deployment.


Read more
Jaipur
1 - 2 yrs
₹2L - ₹2.5L / yr
Communication Skills

We are looking for an experienced Sales & Marketing professional to drive B2B adoption of SkillBrew.AI.

 

You’ll own end-to-end sales and marketing efforts, collaborating with organizations, colleges, and enterprise clients, while building long-term relationships and growing the SkillBrew brand.

 

This is not just a sales role it’s a growth ownership role with high visibility and strategic impact.


Apply Using: https://app.skillbrew.ai/jobs/?id=94


Responsibilties:


Business Development and Client Acquisition

  • Identify, target, and engage B2B clients including corporates, startups, and colleges
  • Pitch SkillBrew.AI effectively to decision-makers
  • Build strong long-term relationships with clients
  • Manage full sales cycles from lead generation to closure


Marketing and Brand Growth: 

  • Collaborate with the marketing team to design campaigns targeting organizations and educational institutions
  • Represent SkillBrew.AI at conferences, webinars, and workshops
  • Track marketing ROI and refine strategies based on results
  •  

Collabration, OnwnerShip and Strategy Skills

 

Job Requirements:


  • Work closely with product and growth teams to align sales strategies with product capabilities
  • Own revenue and client acquisition targets
  • Provide market feedback to influence product roadmap
  • Demonstrate initiative and independent decision-making

 

  • 1–2 years in B2B Sales, Business Development, or EdTech/HRTech Marketing
  • Proven track record of closing deals with organizations, colleges, or enterprises
  • Excellent communication, presentation, and negotiation skills
  • Strong ownership mindset ability to run end-to-end processes independently
  • Comfortable pitching and collaborating with C-level executives
  •  

Good To Have: 

  • Existing networks in colleges, universities, or corporate L&D teams
  • Knowledge of AI-powered recruitment tools or hiring platforms

 

Read more
Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Pune
11 - 17 yrs
₹40L - ₹70L / yr
Strong Lead Search Engineer / AI-ML Leader Profile Mandatory (Experience...
  • Strong Lead Search Engineer / AI-ML Leader Profile
  • Mandatory (Experience 1) - Must have minimum 11+ years of hands-on experience in Search / Information Retrieval / NLP / Machine Learning
  • Mandatory (Experience 2) - Must have minimum 9+ YOE in backend development using languages (Python or Java)
  • Mandatory (Experience 3) - Must have Experience designing taxonomy, ontology, tags, thesaurus, and metadata models
  • Mandatory (Experience 4) - Must have Experience with Big Data frameworks (Hadoop, Spark) for search/ML workloads
  • Mandatory (Experience 5) - Must have Hands-on experience with AI/ML frameworks (TensorFlow, PyTorch, scikit-learn, Keras, Spark ML).
  • Mandatory (Experience 6) - Must have experience in designing, building, and scaling RESTful APIs and Web Services.
  • Mandatory (Experience 7) - Must have hands-on experience in statistical tools (Python, R, SAS, or open-source libraries).
  • Mandatory (Experience 8) - Must have Experience with SQL/NoSQL databases (CosmosDB, Cassandra, MongoDB).
  • Mandatory (Company) - Product Companies (Preferrably high search volumes companies like Flipkart, Amazon, Zepto, Zomato...etc)
  • Mandatory (CTC) - The CTC breakup offered will be 80% fixed, and 20% variable, as per Company policy

Preferred

  • Preferred (Experience) - Familiarity with modern frontend frameworks (React, Angular, HTML5, CSS3).
  • Preferred (Tools) - Must Hands-on with dev tools: Eclipse, Git, Gradle, Jenkins, Jira, JFrog Artifactory and web servers (Tomcat, Jetty, JBoss).
  • Preferred (Education) -BE /B.Tech /M.Tech


Read more
Bengaluru (Bangalore)
2 - 5 yrs
₹20L - ₹25L / yr
skill iconPython
  • Strong Software Development & DSA Profile
  • Mandatory (Experience): Must have 2+ YOE in Software Development (preferably in product-based companies)
  • Mandatory (Skills 1): Must have proficiency in programming languages such as C++, Java, or Python
  • Mandatory (Skills 2): Must have strong expertise in scalable systems and applied DSA in practice
  • Mandatory (Skills 3): Must have strong understanding of System Design (liek HLD, LLD, microservices, caching, database scaling)


Read more
Housing.com
at Housing.com
8 recruiters
Meenu Bharti
Posted by Meenu Bharti
Remote only
6 - 10 yrs
₹50L - ₹65L / yr
skill iconJava
Spring
Hibernate (Java)
skill iconJavascript
skill iconNodeJS (Node.js)
+4 more

What does this role hold for you…??

 

  • Help define Technical Roadmap and own the entire product delivery end to end
  • Work very closely with various business stakeholders to drive the execution of multiple business plans and technologies.
  • Improve, optimize and identify opportunities for efficient software development processes
  • Hire, Develop and Retain a strong team of engineers.
  • Keep abreast of the changes in the industry and champion new technologies and development processes within the team
  • Thinking backward from a customer POV and relentlessly pursuing the customer's cause in tech and product decisions

 

 Apply if you have…

 

  • Graduation/Post Graduation degree in Computer Science (IITs, IIITs and NITs preferred)
  • 7-10 years of strong experience in JAVA(Spring/Hibernate/JPA/REST), JavaScript,
  • NodeJS with good exposure to MySQL
  • Experience with AWS, Microservices, Caching, Performance Optimization, Nginx, Solr, Redis, Redshift
  • Experience working with agile teams and making rapid decisions in a dynamic and disruptive environment
  • 2+ years of leading and managing a team consisting of the backend, frontend and QA.
  • Hands-on writing and reviewing code
  • Exceptional design and architectural skills.
  • Strong communication skills.
  • High motivation to work in a fast-paced, dynamic, collaborative team environment

 

Know more about us…

 

Know more about us and our team, visit http://www.housing.com/">www.housing.comhttp://www.housing.com/">, http://www.proptiger.com/aboutus">www.proptiger.com & http://www.makaan.com/">www.makaan.com
Read more
Product  base IT Company
Product base IT Company
Agency job
via MNR Solutions by Sanjeev Angral
Indore
3 - 8 yrs
₹10L - ₹16L / yr
skill iconReact Native
skill iconReact.js
skill iconJavascript
TypeScript
skill iconRedux/Flux

Role

  • Work as part of a small team to build React Native iOS / Android applications.
  • Design, build and maintain excellent React Native applications with clean code.
  • Implement pixel perfect UI's that match designs.
  • Implement clean, modern, smooth animations and transitions that provide an excellent user experience.
  • Integrate third-party API's.
  • Developing new user-facing features using React Native.
  • Building reusable components and front-end libraries for future use
  • Translating designs and wire-frames into high-quality code
  • Optimising components for maximum performance across a vast array of android and ios devices.
  • Release applications to IOS and Google Play stores.
  • Work with native modules when required.

Skills

  • Strong proficiency in React Js, React Native, JavaScript, TypeScript, Object Oriented Programming - 2+ years of professional experience working with React Native
  • Deep knowledge of component state management experience (specifically in React Native)
  • Familiarity with native build tools, like XCode, Gradle
  • Good understanding of Redux
  • Ability to work through new and difficult React Native issues and contribute to libraries as needed.
  • Ability to create and maintain continuous integration and delivery of React Native applications.
  • Ability to understand business requirements and translate them into technical requirements
  • A knack for bench-marking and optimisation
Read more
Spire technologies
at Spire technologies
1 video
5 recruiters
Gowtham Dev
Posted by Gowtham Dev
Bengaluru (Bangalore)
4 - 8 yrs
₹12L - ₹25L / yr
skill iconElastic Search
skill iconJava
RESTful APIs
Hope you are doing well. I manage hiring for Spire - the global leader in Contextual Search and Analytics. I came across your profile in the portal while looking for a Lead / Sr. Search engineers. What we expect from a candidate: Experience: 5-10 years Skills Required: Elastic Search expertise minimum 2 years (Understanding of cluster management, shards, ES Mappings, Analyzers, plugins etc). Hands on with ES version 5.x and later Java and J2EE expertise Exposure to distributed and micro service architecture Design and Architecture capabelity Agile development practices Ability to understand business problems and translate them to technical solutions Ability to work in fast paced environment and to drive people Desired Skills: Expertise on designing and developing search systems Exposure to voice based search, text based search About Spire: We at Spire are redefining search and match technology to deliver contextual business outcomes, we provide contextual meaning out of ANY content whether it is text, audio or video. We have built world’s first Context Intelligence Platform offered as PaaS which can be applied to any functional domain in any industry. We are on an adventurous journey transforming businesses and human capital of global enterprise customers in North America & Europe. We are ranked the 6th Fastest Technology Company in India - Deloitte 2016. We are based in Cessna Park, Outer Ring Road, Bangalore. You can learn more about us at http://www.spiretechnologies.com/india/ and http://spiretalentship.com/. Please let me know your interest in exploring this opportunity with us.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos