Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Specializing in programmable coherent DSP solutions
Specializing in programmable coherent DSP solutions
Agency job
via Peak Hire Solutions by Dharati Thakkar
Remote only
8 - 20 yrs
₹80L - ₹99L / yr
Global marketing
Product Marketing
Marketing Strategy
Strategic planning
Demand generation
+10 more

 

JOB DETAILS:

Job Role: Director/Sr. Director of Product Marketing (Coherent DSP - Optical Communication) 

Industry: Series-D semiconductor innovator specializing in programmable coherent DSP (Digital Signal Processing) solutions Domain: Hardware/Chip Design & Embedded Software

Work Mode: Permanent Remote

Salary: Best in Industry

Experience: 8-20 years

Location: North America - Permanent Remote

 

 

What is the role?

This leader will drive our global marketing strategy and execution, owning the complete marketing function from strategic positioning to demand generation.

This role combines deep technical marketing expertise in coherent optics with proven leadership capabilities to accelerate growth in the optical communications and semiconductor markets.

This role combines proven product marketing leadership capabilities with deep technical expertise in coherent optics and leadership capabilities.  At one hand, you will be representing the organization in the optical communications and semiconductor domains, while on the other hand engaging with engineers - translating market demand, articulating technical requirements, etc.

You’ll be part of a pioneering company at the at the forefront of next-gen optical communication systems (800G, 1.6T, and beyond), working alongside seasoned industry leaders and engineers.  This is an exceptional opportunity to influence the architecture of AI connectivity and shape the technologies driving modern data infrastructure.


Who does this role report to?

This role reports to the CEO

 

What will you do?

Strategic Leadership

  • Define and execute a global marketing strategy aligned with corporate goals and product roadmap
  • Lead cross-functional initiatives to position the company as a leader in Coherent DSP and optical semiconductors
  • Collaborate with Management, Sales, Operation and Engineering to ensure alignment on messaging, roadmap, and market needs

Product and Technical Marketing

  • Own product marketing for Coherent DSP ASICs, including competitive analysis, value proposition, and differentiation, MRD and PRD
  • Develop technical collateral (white papers, datasheets, product briefs, presentations) targeting optical engineers, system architects, and CTO-level buyers
  • Engage with industry analysts and speak at key events to elevate company profile

Demand Generation & GTM

  • Design and implement go-to-market strategies including product launches, campaign planning, digital outreach, and sales enablement
  • Oversee global lead generation strategies, PR, SEO/SEM, event strategy, and partner marketing
  • Work closely with sales leadership to support account-based marketing, customer acquisition, and pipeline acceleration

Team & Budget Management

  • Build and lead a high-performance marketing team
  • Manage marketing budget and allocate resources to maximize RO

 

What skills are required?

Must Haves

  • Proven track record of bringing technical semiconductor or telecom solutions to market in a startup or high-growth company
  • Deep understanding of coherent optical systems, DSP algorithms, modulation formats, and market dynamics in the telecom and datacom sectors
  • Prior experience in writing/owning MRDs and PRDs
  • Excellent communication skills and ability to translate complex technical concepts into compelling narratives

 

Preferred

  • Experience working with hyperscalers, network OEMs, or system integrators
  • Strong leadership and team management capabilities
  • Budget management and resource allocation experience
  • Experience at both startups and large enterprises
  1. Prior role leading through a funding round, M&A, or IPO stage

 

What qualifications are required?

Must Haves

  • 10+ years of progressive marketing leadership experience, preferably in optical communications, semiconductors, or networking industries
  • 5+ years of experience specifically in coherent optics, DSP, transceivers, or photonic integrated circuits (PICs)

 

Preferred

  • MS/PhD in Electrical Engineering, Applied Physics, or related field
Read more
Bengaluru (Bangalore)
5 - 8 yrs
₹10L - ₹15L / yr
SAP
Customer Service
SAPCS

Dear Candidate,

We are urgently Hiring SAP CS - Customer Service Consultants for Bangalore Location.


Position: SAP CS - Customer Service Consultant

Location: Bangalore

Experience: 5-7 yrs

Skills: SAP Customer Service

Salary: Best in Industry (20-25% Hike on the current ctc)

Note:

only Immediate to 15 days Joiners will be preferred.

Candidates from Tier 1 companies will only be shortlisted and selected

Candidates' NP more than 30 days will get rejected while screening.

Offer shoppers will be rejected.


Best Regards,

Minakshi Soni

Executive - Talent Acquisition (L2)

Rigel Networks

Worldwide Locations: USA | HK | IN 

Read more
Remote only
7 - 9 yrs
₹20L - ₹38L / yr
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+12 more

Primary Skills

• Java EE (Servlets, JSTL, JSP, JDBC)

• Frontend frameworks (ReactJS)

• Pure JavaScript, jQuery

• Bootstrap, HTML5, CSS, SASS

• Microsoft SQL Server (writing queries, stored procedures, triggers etc.)

Read more
Fathershops
at Fathershops
6 candid answers
Shivam Nagarkoti
Posted by Shivam Nagarkoti
Dehradun
3 - 7 yrs
₹5L - ₹5L / yr
Agile/Scrum
PRINCE2
PMP
JIRA
Digital media
+5 more

About the job


FatherShops is a dynamic and innovative company seeking a highly motivated Project Manager to join our team. As a Project Manager, you will play a crucial role in overseeing project deliverables, timelines, and resources while implementing the Scrum methodology to ensure efficient project execution. If you have a proven track record in project management, a deep understanding of Scrum, and excellent client communication skills, we encourage you to apply.


Key Responsibilities:


1. Managing and Overseeing Project Deliverables: You will be responsible for ensuring that project objectives are met by effectively managing and overseeing project deliverables, timelines, and available resources.


2. Implementing Scrum Methodology: Utilize the Scrum methodology to facilitate collaboration, productivity, and efficiency within the project team.


3. Developing and Maintaining Project Schedules: Create and maintain project schedules to meet deadlines and ensure successful project completion.


4. Client Interactions: Interact with clients, understand their requirements, and maintain excellent client relationships to ensure satisfaction and project success.


5. Proficiency in Jira: Demonstrate strong proficiency in using Jira for project tracking and management to keep projects on track and organized.


6. Prince2 Certification (Optional): Possessing a Prince2 certification is a plus and will be considered an additional advantage in your application.


7. Digital Agency Background (Desirable): Prior experience in a digital agency background is highly desirable, as it will enable you to navigate the specific challenges and dynamics of the industry effectively.


Qualifications and Skills:


- Proven Experience in Project Management:You should have a track record of successful project management, demonstrating your ability to plan, execute, and close projects effectively.


- In-Depth Knowledge of Scrum Methodology:A deep understanding of Scrum principles and practices is essential for implementing this agile framework in project management.


- Strong Project Scheduling and Resource Management Skills:You should be adept at creating and managing project schedules and efficiently allocating resources.


- Excellent Client Handling and Communication Abilities: Strong interpersonal and communication skills are crucial to manage client expectations and maintain positive relationships.


- Familiarity with Jira:Experience with Jira for project tracking is essential for effective project management and collaboration.


- Prince2 Certification (Preferred but Not Mandatory):While a Prince2 certification is preferred, it is not mandatory, and relevant experience may compensate for its absence.


- Experience in a Digital Agency Background (Highly Valued): If you have prior experience in a digital agency background, your knowledge of industry-specific challenges and best practices will be highly valued.


  • At FatherShops, we value innovation, teamwork, and a commitment to delivering exceptional results. If you are a motivated Project Manager looking to join a forward-thinking company and meet the above qualifications, we encourage you to apply and be part of our exciting journey.
Read more
Pericius Technologies Pvt Ltd
Shobana K
Posted by Shobana K
Remote only
4 - 8 yrs
₹8L - ₹15L / yr
Product design
skill iconAdobe XD
Senior UX Designer (5 years relevant experience)
PROFILE
You will work in a design team and work closely with a team of software engineers, product
managers, program managers and other designers in a highly collaborative environment. The
position will give you a great opportunity to build and lead the design of products throughout
the visioning, strategy, and development life-cycle of the product. If you are passionate about
the art of dreaming and crafting delightful customer experience, delivering meaningful
customer value and not having a day go by without learning something new; come and join us.
QUALIFICATIONS
● 3-5 years of experience in UX design / interaction design / product design. Experience in
the Financial and Banking sector is a major bonus.
● Experience in creatively solving complex problems; shipping innovative and easy-to-use experience design within deadlines.
● User-centric approach to design and an understanding of how to apply research
insights to product development.
● Excellent verbal and written communication skills to get the buy-in of design and strategy
from stakeholders and users.
● Proficiency in contemporary interaction design, visualization, and rapid design
prototyping tools.
● Proven experience driving complex design issues across multi-disciplinary groups such
as Development, Test, Program Management, Research and Marketing.
● Proficiency in developing and documenting detailed user experience specifications.
● Portfolio demonstrating strategy, creative thinking as well as delivery of end-to-end
scenarios.
● Passion for collaboration and the ability to use humor and energy to keep the
momentum going!
SKILLS and TOOLS
● Must have in-depth knowledge of working with the Adobe Creative Cloud Suite (Adobe
XD, Illustrator, Photoshop, After Effects).
● Must be familiar with prototyping using InVision and Adobe XD.
● Must be familiar with choreographing UI micro-interactions, animations and video
editing.
● Experience on projects in Print (brochures, banners, advertisements, posters, mailers,
etc.) and Web (websites, banners, social media posts etc.) media is good to have.
Read more
Transform Future Consulting
Tushar Dhawan
Posted by Tushar Dhawan
Gurugram, Delhi, Noida
3 - 5 yrs
₹12L - ₹18L / yr
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconVue.js
DART
MySQL
+8 more
We are seeking a dedicated full-stack developer to join our growing startup. You will be tasked with taking the application mockups from the designer and creating fully functional mobile applications from them, including the development of all the nuances and their necessary functionality. Responsibilities include ensuring all relevant application functionality works as expected and that the application performs well to handle up to 100k+ concurrent sessions. In addition to the hands-on tasks, you will be leading a team to implement new features, as well as make modifications and fix bugs in existing code. Your duties will include designing and developing architecture frameworks, writing code to power the underlying functionality of the application, and developing tests for the code you write.
 
Responsibilities
  • Architect brand-new software solutions to fulfill project requirements
  • Create, design, and implement layouts for new and existing application features
  • Create and maintain database designs for data storage and processing
  • Maintain legacy code written by other developers, including bug fixes
  • Integrate external software libraries and APIs into existing projects
 
Job Qualifications and Skill Sets
  • Bachelor of Engineering/Technology in computer science, software engineering, programming, or equivalent
  • Proficiency with languages such as Python, Golang, and Javascript (Node.js, Vue.js)
  • Proficiency with MongoDB and MySQL
  • Proficiency with Dart/Flutter framework
  • Proficiency with AWS suite
  • Experience with Terraform preferred
  • Understanding of code deployment tools such as Jenkins, Capistrano, and ElectricFlow
  • Understanding of object-oriented programming
  • Experience with the design and implementation of APIs
  • Understanding of code versioning and management with Git
  • Track record of successfully managing multiple company or customer websites
  • Familiarity with common programming design patterns and best practices
  • Experience with common web development tools and services, such as version control software, package managers, and CI/CD pipelines
  • Excellent written and verbal communication skills
  • Excellent time-management and communication skills
  • Strong attention to detail and problem-solving skills
Read more
Eagleview
Eagleview
Agency job
via Beiing by Mukarrum Pasha
Bengaluru (Bangalore)
7 - 10 yrs
₹40L - ₹45L / yr
Engineering Management
Engineering Manager
Engineering head
Technical Architecture
Technical lead
+13 more
- As a manager, you will lead a team participating in all aspects of the software development life cycle : scoping, design, coding, testing, implementation and support.

- You will help hire, train, mentor and lead a team of highly capable engineers. You will also help in the development of the company's scalable microservices platform and geospatially-aware applications across multiple industries and form-factors.

- In this role, you must be able to multitask, quickly adapt to new development environments, learn new systems, create reliable/maintainable code, and find creative and scalable solutions to difficult and complex problems.

- You take pride and ownership in your work as well as the overall contributions of your team. You must also have the ability to take a system-wide understanding, recognize the use of system components and disparate technologies and be able to diagnose and debug components across an entire system.

- Your ability to communicate clearly and concisely (both written and verbal) is key, as is being a self-starter.

Primary Responsibilities :

- Build, train, mentor and lead a cross-functional agile team

- Help design, architect and develop advanced software solutions supporting multiple projects and initiatives

- Collaborate with product owners and/or the business on requirements definition, development of functional specifications, and design

- Collaborate on or lead the development of technical design and specifications as required

- Establish and lead best practices in software engineering

- Mentor and grow new employees on your team

Skills & Requirements :

- Bachelor's Degree required, preferably in Computer Science or a related field

- 5+ years of software development experience using JavaScript, GoLang, Node.js or another object-oriented programming language

- 3+ years as an engineering lead or manager

- Experience with cloud technologies (AWS) and containerization

- Experience with a microservices architecture

- Excellent communication, collaboration, reporting, analytical and problem-solving skills

- Experience with PostgreSQL or other Relational Databases

- Test-driven development mindset and a focus on quality, scalability and performance

- Strong programming fundamentals and ability to produce high-quality code
Read more
IdeaClicks
at IdeaClicks
1 recruiter
Santosh Deshmukh
Posted by Santosh Deshmukh
Remote only
1 - 2 yrs
₹2L - ₹2L / yr
Sales
Marketing
Digital Marketing
We are working with Doctors, Companies, Hotels, Colleges to create their Digital Promotion and generating inbound leads for tthem. We also use CRM Tool for Lead Nurturing, Lead Followup. Wehave several success stories where we are able to generate 12+ New Patients everyday for Gynecologist, 2 New Patients everyday for Dentist & Pediatrician, 250+ New Admissions for Engg College every year, 20+ New Visitors to a Non-Veg Hotel.

We now wish to scale ll these categories which are proven to be working and hence looking for Sales Person who can get us business using our success stories.
https://ideaclicks.in/success-story/digital-promotion-of-gynecologist-in-india/
Read more
TechStar Group
at TechStar Group
2 recruiters
nagamani gattu
Posted by nagamani gattu
Chennai, Hyderabad
3 - 7 yrs
₹6L - ₹22L / yr
skill iconJava
skill iconAngularJS (1.x)
skill iconJavascript
skill iconHTML/CSS
experience in java experience in Angular js experience in HTMl/CSS and javascript
Read more
CENITPRO
at CENITPRO
1 recruiter
Rumela Sarkar
Posted by Rumela Sarkar
Kolkata
1 - 2 yrs
₹2L - ₹4L / yr
Communication Skills
Back office
System Administration
We are hiring for Back Office Executive. The candidate should have fundamental learning of computer and help the other employees on their necessary job roles and responsibilities.

Job Description :

Only Female candidates are eligible
Qualification: Graduation
Age: Around 30 years.
Minimum 6 months to 1 year of experience in the related field is essential.
Having good exposure over Ms-Office.
Need administrative and organizational abilities.
Need to have excellent written and oral communication in English.
Intercultural sensitivity and multitasking capacity.
Readiness to take initiative and to solve problems.
Sociable, self-motivated and initiative taker.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos