Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry 's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

FreeADS
Remote only
0 - 10 yrs
₹1L - ₹3L / yr
Communication Skills

We are looking for Receptionist/ Customer care cum Business Development Executive for our E commerce business. This is remote job which can be done from home.

Read more
Gaming Company
Gaming Company
Agency job
via Jobdost by Sathish Kumar
Delhi
2 - 8 yrs
₹1L - ₹10L / yr
skill iconNodeJS (Node.js)
skill iconRedis
skill iconMongoDB
Memcached
RabbitMQ

1. Design patterns- socket communication/ micro services architecture 

2. Caching - REDIS MEMCACHED etc

3. Database - MONGO, SQL etc. min 2yrs experience with these.

4. Features created for large concurrent requests.

5. Node Js, Go lang any asynchronous programming language min 2 yrs exp with any one of them.

6. Message Queues - RABBIT MQ, Kafka etc.

7. Logging and APM (application process manager) good to have.

8. DS ALGO good to have.

Read more
Rawmart material solutions pvt ltd
Pune
2 - 5 yrs
₹3L - ₹5L / yr
Negotiation
Communication Skills
Interpersonal Skills

Job Title: Technical Sales Engineer

Location: Senapati Bapat Road, Pune

Job Type: Full-Time


Job Summary:

We are seeking a highly motivated Technical Sales Engineer to join our team. This role combines technical expertise with sales skills to provide solutions to customers and drive business growth. The ideal candidate will be responsible for understanding customer needs, presenting technical solutions, and building strong relationships to ensure customer satisfaction.


Key Responsibilities:

• Develop a deep understanding of the company’s products and services.

• Identify customer requirements and recommend appropriate technical solutions.

• Prepare and deliver technical presentations, proposals, and product demonstrations.

• Collaborate with the sales team to develop strategies for business development.

• Work closely with the engineering and product teams to provide customer feedback for product improvement.

• Assist customers with product selection, integration, and troubleshooting.

• Negotiate contracts, pricing, and terms to close deals successfully.

• Maintain relationships with existing clients and seek opportunities for upselling and cross-selling.

• Stay updated on industry trends, market developments, and competitors' products.

• Represent the company at trade shows, conferences, and networking events.


Qualifications & Skills:

• Bachelor's degree in engineering is preferred.

• Proven experience in technical sales, sales engineering, or a similar role.

• Strong understanding of technical concepts related to manufacturing products

• Excellent communication, presentation, and negotiation skills.

• Ability to build and maintain customer relationships.

• Self-motivated, goal-oriented, and able to work independently.

• Willingness to travel to meet clients and attend industry events.

Preferred Qualifications:

• Experience in the Manufacturing industry

• Previous experience working with B2B sales

Read more
VAYUZ Technologies
at VAYUZ Technologies
1 video
4 recruiters
Pooja Chauhan
Posted by Pooja Chauhan
Remote, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
0 - 2 yrs
₹1.8L - ₹3.6L / yr
MEAN stack
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconAmazon Web Services (AWS)
API
+6 more

Roles and Responsibilities
1. Ability to work on diverse backend stack such as Node JS, Java, Express JS
2. Ability to work on diverse frontend stack such as Angular 6/7/8/9, HTML5, CSS3

3. Ability to deliver quick POC’s using cutting edge technologies.

4. Preparing reports, manuals and other documentation on the status, operation and maintenance of software.

5. Design, develop, and unit test applications in accordance with established standards

6. Developing, refining, and tuning integrations between applications. Analysing and resolving technical and application problems.

7. Ability to debug application.

8. Should have complete knowledge on developing RESTful Services.

9. Should be able to also work in agile development methodology.
10. Work with designated JavaScript framework to design, develop, and debug web applications
11. Can work on Angular and Integrate backend services
12. Work with the team to manage, optimize, and customize multiple web applications
13. Manage end to end module lifecycle management of the product
14. Push and pull codes via Git repository


Competency Requirements

1. Experience in NodeJS, Java and development using AngularJS

2. Experience in front end frameworks such as Angular.js, Bootstrap, Foundation etc

3. Experience in client/server application development

4. Knowledge of agile development methodologies

5. Knowledge of unit testing theory

5. Knowledge of AWS cloud

Read more
Adcanopus Digital Media Pvt. Ltd.
Remote only
2 - 4 yrs
₹4L - ₹6L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconReact.js

Profile : Backend Developer

Candidates from Tamil Nadu region only.

Immediate Joiners

Work from Home


Responsibilities:

  • Node JS, MongoDB, React JS - Mandatory skills.
  • Proficiency with Back-end development and scripting including: HTML, JavaScript, Jquery, JSON, CSS, AJAX, Nodejs
  • Hands-on experience with web application architecture and relational database design
  • Familiarity with the XAMP environment (Windows, Apache, MySQL, PHP)
  • Experience building sites to function cross-platform and cross-browser
  • Experience building database-driven applications and web sites
  • Experience using PHP MVC frameworks required. Experience with Code Igniter is mandatory.
  • Experience on Restful Api.


Desired Attributes:

  • Node JS, MongoDB, React JS - Mandatory skills.
  • Min. 2 years of software development experience or equivalent, including Object Oriented design and PHP Development.
  • Software Technologies : PHP, Node Js
  • Database : MySQL, MongoDB
  • PHP Frameworks : Codeignator/Laravel/Yii/Cake PHP
  • Nodejs Framework : Express/Hapi.js/Any Framworks
  • Server : Basic Linux Commands
  • Frontend Technologies : Jquery/Javascript, AJAX, HTML, CSS, Angular Js
  • Other skills : REST API, Payment Gateway Integration, XML Web services, CURL


Preferred Qualifications:

· Bachelor's or Master's degree in Computer Science or related field


Interested candidates can apply ASAP or share their resumes at aditik at adcanopus.com.

Read more
Client of People First Consultants
Client of People First Consultants
Agency job
Bengaluru (Bangalore), Chennai
10 - 15 yrs
₹18L - ₹23L / yr
Data governance
Informatica
Informatica Data Quality

Qualifications & Skills

  • Proven track record in delivering Data Governance Solutions to a large enterprise
  • Knowledge experience in data governance frameworks, formulating data governance policy, standards and processes
  • Experience in program management and managing cross functional stakeholders from senior leadership to project manager level
  • Experience in leading a team of data governance business analysts
  • Experience in data governance tools like Informatica Data Quality, Enterprise Data Catalog, Axon, Collibra
  • Experience in metadata management, master and reference data management, data quality and data governance
Read more
Unnati Agri
Ritesh Dhakar
Posted by Ritesh Dhakar
Noida
1 - 3 yrs
₹5L - ₹15L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
Model-View-View-Model (MVVM)
RxJava
+1 more
  • Design and build advanced applications for the Android platform
  • Collaborate with cross-functional teams to define, design, and ship new features
  • Work with outside data sources and APIs
  • Unit-test code for robustness, including edge cases, usability, and general reliability
  • Work on bug fixing and improving application performance
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency
Read more
Confidential
Confidential
Agency job
via Petals Careers by Cibi Thomas
Remote only
2 - 4 yrs
₹10L - ₹25L / yr
Penetration testing
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
skill iconKubernetes
Backtrack
+1 more
Job Description
  • You have 2+ years of experience with production GCP/AWS; Experience with Kubernetes is a plus
  • You have conducted penetration testing using different tools like Backtrack and Metaspoilt
  • You have experience in developing security training and guiding the internal development teams
  • You design and implement best practices concerning information security
  • You can create programs to implement Identity and Access Management
  • You have to develop automated security testing.
  • You have to triage security issues and provide recommended fixes.
  • You have conducted vulnerability assessments using various open-source and commercial tools.
  • You are an excellent collaborator & communicator. You know that start-ups are a team sport.
  • You listen to others, aren’t afraid to speak your mind and always try to ask the right questions.
  • You are excited by the prospect of working in a distributed team and company.

Role: Security Engineer

Title: Security Engineer SDE1

Location: We are open to candidates working from anywhere in India/across the globe. We are fully remote.

About Us
Requirements / Responsibilities

The ability for you to make an impact and lay a foundation for the upcoming fin-tech
innovations.
A multicultural and diverse team of colleagues from all over the globe
Mission-driven and fast-paced, entrepreneurial environment
Competitive salary and flexible leave policy
A collaborative and flat company culture
What do we offer? 
What’s in it for you?
Do you truly want to make a difference and revolutionize the lives of millions of business
owners? Do you thrive in an environment where moving at light speed and embracing new
challenges every day is essential? If yes, our client is the perfect place for you!

Regards,
TA
Read more
Disruptive Electronic Accessories Brand
Disruptive Electronic Accessories Brand
Agency job
via Unnati by Astha Bharadwaj
Mumbai
3 - 6 yrs
₹12L - ₹14L / yr
Strategic sourcing
Supply Chain Management (SCM)
Sourcing management
Sourcing
Negotiation
+4 more
Here is a chance to work for a Consumer Electronics Brand, where you get to deal with some of the best channels and work with some excellent experienced minds. Read on.

 


Started in 2015, this lifestyle and accessories startup has taken over the consumer electronics sector in India. Our client has a product range that includes an extensive catalog of headphones, speakers, travel accessories, and modern earphones. It believes in providing cutting edge electronic products stamped with durability and affordability.

The brand is associated with some of the major icons across categories and tie-ups with industries covering fashion, sports, and music, of course. The founders are Marketing grads, with vast experience in the consumer lifestyle products and other major brands. With their vigorous efforts toward quality and marketing, they have been able to strike a chord with major E-commerce brands and even consumers.
 
As a Strategic Sourcing Manager, you will manage the supplier manufacturing processes to ensure they meet delivery and quality metrics. Also influencing the suppliers manufacturing processes and policies in ways that are mutually beneficial and sustainable.
 
What you will do:

  • Analyzing the marketplace to find capable manufactures who provide the best product cost, quality and delivery objectives insuring maximum bottom-line impact
  • Managing the end-to-end RFx process, Supplier selection including negotiating the best cost and contract
  • Managing the supplier relationship on an ongoing basis including holding the supplier to quality and compliance requirements
  • Developing negotiation strategies to deliver against business objectives and achieving sustainable relationships with suppliers. This includes periodic rebidding to ensure our costs remain competitive
  • Developing risk mitigation strategies including contingency plans, lead-time reductions and supply chain efficiencies
  • Being responsible for selecting suppliers that can reliably deliver products on spec at high quality levels and targeted costs.
  • Regularly monitoring key aspects of factory and supplier performance levels through a scorecard and audit process.
  • Interacting with multiple internal and external stakeholders and regularly updating leadership on progress
 

 

What you need to have:
  • 3+ years experience in strategic sourcing, supply chain management or supplier management
  • Bachelor’s degree - BE/ BTech
  • Experience in supplier negotiations
  • Understanding technical requirements and translating them to business/ sourcing parameters is a must
  • Smart, creative thinker and problem-solver, fast learner, with demonstrated initiative
  • Willingness to adapt to fast changing situations encountered in startups
  • Strong writer and communicator, excellent listener, with superior sales skills and comfort regularly interacting with strangers
Preferred Requirements
  • MBA from a reputed college
  • Experience in consumer electronics and good understanding of electronics manufacturing
  • Prior experience in setting up sourcing programs, supplier management scorecards and dashboards
Read more
fintech
fintech
Agency job
via Talentojcom by Raksha Pant
Remote only
2 - 6 yrs
₹9L - ₹30L / yr
ETL
Druid Database
skill iconJava
skill iconScala
SQL
+2 more
● Education in a science, technology, engineering, or mathematics discipline, preferably a
bachelor’s degree or equivalent experience
● Knowledge of database fundamentals and fluency in advanced SQL, including concepts
such as windowing functions
● Knowledge of popular scripting languages for data processing such as Python, as well as
familiarity with common frameworks such as Pandas
● Experience building streaming ETL pipelines with tools such as Apache Flink, Apache
Beam, Google Cloud Dataflow, DBT and equivalents
● Experience building batch ETL pipelines with tools such as Apache Airflow, Spark, DBT, or
custom scripts
● Experience working with messaging systems such as Apache Kafka (and hosted
equivalents such as Amazon MSK), Apache Pulsar
● Familiarity with BI applications such as Tableau, Looker, or Superset
● Hands on coding experience in Java or Scala
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos