Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry 's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
Python

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Thywed Stories
Thywed Stories
Posted by Thywed Stories
Bengaluru (Bangalore)
0 - 2 yrs
₹2L - ₹2.5L / yr
Adobe Premiere Pro
Adobe Creative Suite
Adobe After Effects
Final Cut Pro
Final Cut Pro X
+1 more

Wedding Video Editor (0-2 Years Experience)

Location: Bangalore (On-site)

Company: Thywed Stories


About Us:

Thywed Stories is a premium wedding photography and cinematography company that believes every wedding is a story waiting to be told. We craft cinematic films that capture emotions, culture, and timeless memories.


Job Description:

We're looking for a Wedding Video Editor with a passion for storytelling and a strong sense of music. The ideal candidate understands wedding films, visual flow, and can translate emotions into beautifully edited videos.


Responsibilities:

Edit wedding teasers, highlights, and full-length films with cinematic storytelling.

Understand wedding photography and film flow to maintain consistent visual style.

Choose and sync music effectively strong music sense across languages is a must.


Collaborate with cinematographers and creative directors on project timelines and aesthetics.

Assist the team on ground during wedding shoots for setup, footage management, and coordination.

Organize and manage raw footage efficiently for post-production.

Requirements:

0-2 years of experience in video editing.

Strong understanding of wedding films, storytelling, and photography aesthetics.

Proficiency in Adobe Premiere Pro, After Effects, or DaVinci Resolve.

Good sense of pacing, emotion, and soundtrack selection.

Willingness to travel and assist during wedding shoots.


What We Offer:

Exposure to premium and destination weddings.

Creative, growth-oriented work environment.

Mentorship from experienced cinematographers and editors.


Location: Bangalore (Work from Office)

Read more
xoxoday
at xoxoday
2 recruiters
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
4 - 9 yrs
₹25L - ₹25L / yr
User Experience (UX) Design
User Interface (UI) Design
Wireframing
Product design
SaaS
+3 more

What is the role? 

We are looking for an experienced and creative Freelance Product Designer to join our team!  As the Freelance designer, you will be responsible for delivering the optimal user experience  across our product portfolio spanning web and mobile apps. This is a high visibility role and  has a large contribution to the overall success of the product and customer satisfaction. The  

role requires deep collaboration with the product, technology, marketing and sales teams.  This role might include some people management responsibilities. 

Key Responsibilities 

  • Craft every detail of new and existing product features, from understanding  the customer pain point to defining wireframes, high definition prototypes and finally working with the technology team to taking it live. 
  • Partner closely with our Product, Marketing and Technology teams to understand what users need, want, and love about the product. Use the data to plan and define the optimal user experience. 
  • Create design systems that help with a common design language across the  entire product portfolio in a distributed team. 
  • Aid product marketing in telling the product stories in the best way possible  to help users in product adoption and onboarding. 
  • Build and implement processes for user testing. Take a data driven approach to decision making. 

What are we looking for? 

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do  not match all of it. We are open to promising candidates who are passionate about their  work and are team players. 

  • 4+ years of experience as a UI/UX Designer, preferably for a B2B or consumer SaaS product. 
  • Track record of building products from scratch and taking complete  ownership of design output. 
  • Take pride in whatever work you do. Feel a sense of pride in building things  that are clearly valued by the customer. Aim for pixel perfection. 
  • Believes deeply in data driven decision making and experimentation.  Understand that what is right is way more important than who is right. 
  • Excellent interpersonal and communication skills to thrive in a multidisciplinary team. 
  • Passionate about building great products that the person can be proud of.
  • Preferred Qualifications: Bachelor in Design / Master in Design from Tier 1 colleges 

Whom will you work with? 

You will closely work with technology, design, sales and customer care teams. You'll report  to head of product development. 

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

We are

Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

Way forward

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

Read more
Leading Lifestyle Retail Brand
Leading Lifestyle Retail Brand
Agency job
via Merito by Jinita Sumaria
Mumbai
9 - 14 yrs
₹25L - ₹30L / yr
Business Development
Above The Line Marketing (ATL)
Below The Line Marketing (BTL)
EBO
LFS
+2 more

Role & Responsibilities:

 

  • Owning offline/retail P&L
  • Identifying potential locations for expansion following the company’s expansion strategy
  • Liaising with various agencies in the space search
  • Carrying out a detailed feasibility study on chosen locations
  • Negotiation with the malls/agencies and finalization of related documents & pricing.
  • Creating & implementing the organization chart for the offline/retail function
  • Collaboration with the Marketing team and VM for In-store marketing/promotions and for external ATL/BTL activities
  • Generates ideas about future retail activities to ensure a cutting-edge strategy; maintains up-to-date knowledge of the marketplace, competitors, and trends
  • Takes a lead role in building a strong sales management culture with the operations team; spends time coaching store managers, identifying skills and opportunities for development; provides advice and guidance on Store manager issues when needed.
  • Maintains and constantly develops innovative and cost-effective stock generation; monitors stock weekly to achieve bottom-line sales budget against monthly targets
  • Implementation of ERP and other Technology resources for effective Business Decision Making

 

 

Expected skill sets:

  • Experience of 12 -14 years with established brand(s) in the Lifestyle Retail category.
  • Critical experience in Sales and/or Retail Operations is a must
  • Should have worked across the key retail formats viz EBO, LFS, and MBO.
  • Experienced in managing relationships at a senior level and managing a diverse (in terms of skill base and experience) team of people.
  • Must be able to demonstrate the ability to c
  • ontribute and successfully deliver against a business strategy.
  • Excellent communication skills - verbal, written to include report writing and group presentations
  • Commercially sound with a good understanding of profit and loss accounting and the influence of operating factors e.g. volume v price
  • Excellent organization skills, able to prioritize
  • A collaborative team player concerned with the team's success as well as individual performance



Why join us?

We are a young and dynamic team, so you will get to make a significant impact, learn a lot, and have fun in the process. We are building our team as well, so this is a great opportunity to quickly climb up the ladder and become among the top D2C experts in India.

We are a funded, capital-efficient business, with best-in-class D2C founders as our investors. We are rapidly growing, so you get to be a part of the hyper-growth phase and quickly grow with us.


Job Details:

  • Work timings: Mon to Sat, Work from Office role
  • Office location: Mumbai
  • CTC: As per market standard
  • Reporting: To founder
Read more
Scipy Technologies
at Scipy Technologies
2 candid answers
Rahul Bose
Posted by Rahul Bose
Thiruvananthapuram
0 - 1 yrs
₹10000 - ₹12000 / mo
Social Media Marketing (SMM)
Search Engine Optimization (SEO)
Search Engine Marketing (SEM)

We are looking for a Mid-Level Digital Marketer with a proven track record of developing and executing successful digital marketing campaigns. In this role, you will be responsible for driving traffic, increasing engagement, and generating leads across multiple digital channels. You will work closely with the content, design, and sales teams to ensure cohesive marketing strategies.

Responsibilities:

  • Develop, implement, and manage digital marketing campaigns, including SEO, SEM, social media, and email marketing.
  • Create and optimize content for websites, blogs, and social media platforms.
  • Manage and analyze the performance of PPC campaigns using Google Ads and other platforms.
  • Conduct market research to identify trends and opportunities.
  • Collaborate with the design team to create engaging visual content.
  • Monitor and report on the performance of all digital marketing campaigns.
  • Stay up-to-date with industry trends and emerging digital marketing tools.


Read more
Online Platform for Simplifying Education Payments
Online Platform for Simplifying Education Payments
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
3 - 7 yrs
₹12L - ₹25L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
Python
+2 more

About Company


We have a mission-oriented high-growth fintech startup building payment & lending products to simplify education payments. It suite of products make education payments convenient & affordable for parents while simplifying & streamlining fee collections for educational institutes. Jodo aims to be a category-defining company with a mission to be a trusted partner to parents in fulfilling their aspirations for their kids’ education.


Key Responsibilities


● Own overall quality of specific modules of payments stack

● Continuously try to automate all aspects of QA

● Develop test plans, test cases, test scripts and test reports on multiple products

● Establish and maintain QA processes, champion continuous testing/automation

● Mentor/Guide other members of the team

● Troubleshoot production defects and performance issues

● Work closely with the Product and Development teams to build world-class products.


Requirements


● 3+ years of proven experience in software testing

● 2+ years of experience in Test automation, should be able to the device and implement an automation strategy

● Good Understanding of Testing frameworks and agile methodologies ● Experience in Selenium with Java / Python or equivalent frameworks, REST API Test automation

● Knowledge of Performance / Load testing

● Detail-oriented, Excellent Analytical and Problem-solving skills

● Self-starter and ability to take the ownership

● Prior experience working in a startup environment is great to have

Read more
Remote, Bengaluru (Bangalore)
5 - 10 yrs
₹10L - ₹15L / yr
Electrical engineering
Electronic engineering

About the job

Company Overview: Abracon is a leading global supplier of Timing, Power, and RF Components, dedicated to transforming ideas into innovative products that meet the challenges of tomorrow.


Position Summary: We are seeking a skilled Product Engineer to join our Global Support Team, focusing on our Power and Magnetic product line. This role involves supporting components vital for power and filtering circuitry, including RF and Power inductors, Common mode Chokes (CMC), Transformers, Ethernet magnetics, ferrite beads, Supercapacitors and other power management components.


Work Environment: The successful candidate will be positioned as a full-time employee at Abracon’s Center of Excellence located in Bangalore, India. The candidate will have the option to engage in a hybrid work-from-home arrangement.


Growth Opportunity:



Key Responsibilities:



Qualifications:



Come join our team! Excellence through teamwork drives the company culture at Abracon. We provide opportunities and support for your professional growth and empower each other in exercising our individual strengths.


With a broad portfolio of passive and electromechanical timing, synchronization, power, connectivity and RF antenna solutions and more, Abracon helps engineers transform their ideas into products that meet future customer needs. For more information about Abracon, visit www.abracon.com

Read more
R Systems International
Noida, NCR (Delhi | Gurgaon | Noida)
5 - 10 yrs
₹5L - ₹22L / yr
Java
Microservices
Spring Boot
JPA
RabbitMQ
+1 more
looking for immediate joiner or who can join in 15-20 days
skills needed:
java
springboot
microservices
kafka/rabbitmq
jpa
Read more
company logo
Agency job
via Anetcorp Ind Pvt Ltd by Jyoti Yadav
Mohali
4 - 15 yrs
₹10L - ₹20L / yr
Docker
Kubernetes
DevOps
Amazon Web Services (AWS)
Windows Azure
+5 more

       

Sr. DevOps Engineer - L3 Support
 
Hybrid -  2-3 days from Office in Mohali
Shift: PST
 
Experience 6+
 
 

Hands on experience in:

  • Deploying, managing, securing and patching enterprise applications on large scale in Cloud preferably AWS.
  • Experience leading End-to-end DevOps projects with modern tools encompassing both Applications and Infrastructure
  • AWS Code deploy, Code build, Jenkins, Sonarqube.
  • Incident management and root cause analysis.
  • Strong understanding of immutable infrastructure and infrastructure as code concepts. Participate in capacity planning and provisioning of new resources. Importing already deployed infra into IaaC.
  • Utilizing AWS cloud services such as EC2, S3, IAM, Route53, RDS, VPC, NAT/IG Gateway, LAMBDA, Load Balancers, CloudWatch, API Gateway are some of them.
  • AWS ECS managing multi cluster container environments (ECS with EC2 and Fargate with service discovery using Route53)
  • Monitoring/analytics tools like Nagios/DataDog and logging tools like LogStash/SumoLogic
  • Simple Notification Service (SNS)
  • Version Control System: Git, Gitlab, Bitbucket
  • Participate in Security Audit of Cloud Infrastructure.
  • Exceptional documentation and communication skills.
  • Ready to work in Shift
  • Knowledge of Akamai is Plus.
  • Microsoft Azure is Plus
  • Adobe AEM is plus.
  • AWS Certified DevOps Professional is plus
Read more
Nektarai
at Nektarai
1 recruiter
Abhijeet Vijayvergiya
Posted by Abhijeet Vijayvergiya
Remote only
5 - 15 yrs
₹30L - ₹60L / yr
NodeJS (Node.js)
Node

Why this role?

Help build the future of sales: At Nektar, you will help redefine the way people sell. Across countries and industries. There are few startups with this kind of market potential.
A team with decades of domain expertise: Between them, the founders have nearly two decades of experience founding and growing startups and building and selling SaaS products globally.
Tackle our most impactful problems: Our team is still small, and people wear many hats. You’ll jump between product, design, engineering, devops and growth. You will not be bored.
Join us at a magical time: Founded and headquartered in Singapore, Nektar raised a substantial seed round from great SaaS VCs in less than 4 weeks of starting the company, giving us a massive jump start and room to focus on our product and users.

What do we do?

Nektar’s mission is to help people work smarter. Our first product is an assistant for sales teams that will help close more deals faster.

Sales organizations have spent hundreds of billions of dollars on systems of record to collect vast amounts of data. This data might produce pretty graphs on managers’ reports but it hardly ever helps the salesperson in the field move their deals forward. This is why, in 2019, less than 30% of salespeople used their organization’s CRM as intended, and 57% of the sales teams globally missed their sales quota.

This is where we’re different — we are laser-focused on the specific actions that help salespeople close deals. We’re building a real system of growth, a first of it’s kind to help salespeople become better salespeople by helping our users build productive habits, adopting best practices and eliminating friction from the sales process.

What we’re looking for?

  • We’re looking for engineers who can hit the ground running, with at least a year’s experience building production servers using Node.js. Experience with the frontend is positive but not required.
  • As an all-remote team, we require great communication skills, particularly in writing. You must be a self-motivated manager of one with the ability to work independently, take ownership and proactively seek help when required. Prior experience working remotely will be positive but is not required.
  • As a startup, we prefer generalists over specialists and product-focused engineers who can empathize with users. Experience working at a fast-growing startup would be positive but is not required.
  • Experience in sales tech will be a strong positive but is not a must.

 

How do we work?

We’re an all-remote engineering team from the beginning (yes, since before the pandemic!), and we’ve built a fantastic remote-friendly culture. We support every team member to set up a great personal workspace that fits them — whether that’s a home office, a co-working space or just hanging out at a coffee shop. We are location agnostic and you can literally choose a location that works for you . Our distributed team currently sits in Singapore, India, Vietnam, Australia and Indonesia.

We do weekly team activities, like online gaming and coffee chat to ensure that physical distance doesn’t keep us from being a close-knit team.

Nektar is a small team, and everyone’s involved in shaping the product we build. We’re still iterating and figuring out the product-market fit, so we’re not averse to throwing away code. We’d rather build a few powerful features that solve important needs than lots of features that are not as valuable.

In line with our mission — helping people work smarter — we’re always thinking about how we can work smarter ourselves. We try to avoid large and long meetings and prefer ad-hoc collaboration with one or two other people instead. We invest in continuous integration and deployment, automated testing and other tooling to eliminate friction from our engineering processes. We aim for clear written documentation and communication.

Read more
Jazeera Technologies Pvt Ltd
Sridevi Menon
Posted by Sridevi Menon
Hyderabad
3 - 7 yrs
₹6L - ₹9L / yr
User Experience (UX) Design
HTML/CSS
Sketch
User Interface (UI) Design
Wireframing
Responsibilities include: Conducting user research and testing Developing wireframes and task flows based on user needs Collaborating with Designers and Developers to create intuitive, user-friendly software Understand product specifications and user psychology Conduct concept and usability testing and gather feedback Create personas through user research and data Define the right interaction model and evaluate its success Find creative ways to solve UX problems (e.g. usability, findability) Communicate design ideas and prototypes to developers Keep abreast of competitor products and industry trends Requirements Proven experience as a UX Designer, UI Designer Strong portfolio of design projects Familiarity with interaction design and information architecture Proficient in Illustrator & Sketch Knowledge of HTML/CSS; JavaScript is a plus Company Profile: We are an IT start up in Hyderabad with parent company in the Middle East. Jazeera Paints is the parent company and a well established brand since 33 years. We do all the IT development work for Jazeera Paints and its group companies in Saudi. Employee strength in India - 30 Domain - Retail, e-commerce, hospitality, banking
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos