Cutshort logo
For Employers
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Code Calibre
Anjali Ratnakar
Posted by Anjali Ratnakar
Noida
2 - 10 yrs
₹3L - ₹12L / yr
New business development
Communication Skills
Sales presentations
Sales

Identify partnership opportunities

Develop new relationships in effort to grow business and help company expand

Maintain existing business

Think critically when planning to assure project success

Must have experience in International sales in IT services

Read more
All Indian IT Services LLP
Vaishnavi Gupta
Posted by Vaishnavi Gupta
Nagpur
2 - 5 yrs
₹2L - ₹3.5L / yr
skill iconReact.js
skill iconRedux/Flux
React
skill iconHTML/CSS
skill iconJavascript
+4 more
Required Skills-
React Components/ Highly responsive well user interface.
Develop a flexible and well structured, along with the API's

Candidate must have good skills in
HTML/CSS
JavaScript
jQuery
JavaScript Frameworks
Front End Frameworks
CSS Preprocessors
RESTful Services/APIs
Responsive/Mobile Design
Cross-Browser Development
Content Management Systems
Read more
Global e-tailer
Global e-tailer
Agency job
via Unnati by Veena Salian
Mumbai
7 - 8 yrs
₹10L - ₹12L / yr
Vendor relationships
Vendor Management
Vendor development
Category Management
Retail operations
+1 more

With 14+ years of expertise in e-commerce, our client provides AI-powered solutions for quick scale-up of brands and equips them to serve a global audience efficiently. From Texas to India, it operates from 6 different locations and processes 5 million orders annually and are amongst the top 25 sellers on Amazon and Walmart.com.


Founded by entrepreneurs with rich international experience, this leading online store of USA works with over 2000 brands which include many known brands in the US and covers almost all major categories like beauty and healthcare, electronics and gadgets, furniture, toys and apparel and others.


It has won several accolades including Inc 5000, fastest-growing companies, two years in a row.

 
As a Vendor Relation Head, you will be responsible for developing and owning the strategy for a category, and working with a high-performing vendor management team. Within this role, you will have the opportunity to establish and maintain strong vendor partnerships, manage category profitability, optimize pricing, and identify means to improve the customer experience.

What you will do:

  • Managing inputs, category profit & loss, promotion management, auditing and analysis, vendor escalations, and concise communications
  • Growing selection, improving terms and cost structures, and building long-term relationships with vendors for the sub-categories assigned
  • Demonstrating customer and category knowledge, being an advocate for a quality customer experience, and understanding the competition and industry
  • Being responsible for long term growth opportunities and risk identification, planning, communicating, and partnering with internal teams
  • Demonstrating a deep understanding of Online retail tools and becoming advocates for tool enhancements
  • Attracting talent and making the right hiring decision, setting goals, and resource planning for the team
  • Visiting trade shows in the US and other countries as per process requirements
  • Creating mechanisms to help on-board new talent to the organization by continuously building a network of talent inside and outside of the company
  • Effectively coaching and giving feedback to direct reports to help develop talent and supporting career development
  • Setting and balancing goals across the team to optimize performance against department goals and employee development
 

 

Desired Candidate Profile

What you need to have:

  • 10+ years of experience doing one of several roles: quantitative/financial analysis, retail buying, retail planning & allocation, product/project management, pricing, marketing, or e- commerce
  • Strong understanding of category, product, and vendor performance
  • Proficiency in Excel
  • Proven analytical skills
  • Proven negotiation skills
  • Proven experience leading teams & cross-functional projects
  • Influencing abilities and vendor management experience
  • Ability to think and react in a high-energy, fast-paced environment
  • Ability to operate simultaneously and effectively in both tactical and strategic modes
  • A willingness to roll up sleeves to get things done
  • Ability to work autonomously in a demanding and often ambiguous environment, with strong attention to detail and effective prioritization
  • Preferably a valid US Visa    

 

 

Read more
Create Protocol
Naveeta Agarwal
Posted by Naveeta Agarwal
Remote only
2 - 8 yrs
₹1L - ₹15L / yr
skill iconSwift
skill iconReact Native
skill iconFlutter
skill iconObjective C
skill iconiOS App Development
+1 more

About Create Protocol

CREATE PROTOCOL is a creator-focussed blockchain platform, built on Create’s optimized multi-chain NFT protocol. We are focused on building decentralized applications with creator focussed tools, to empower the creator economy and bring a CREATE TO EARN revolution.

We also have plans to launch decentralized finance solutions along with a CREATE TOKEN to govern the ecosystem.


CREATE PROTOCOL
will be a creator platform owned by Artists. They believe in a world where artists own not just their Creation/Art/Music but also the platform which facilitates the interaction with the artwork, with the fans, listeners, viewers and brands.


For more details, please visit www.createprotocol.org


We are looking for an iOS developer responsible for the development and maintenance of applications aimed at a range of iOS devices including mobile phones and tablet computers. Your primary focus will be the development of iOS applications and their integration with back-end services. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products are essential.

Responsibilities

  • Design and build applications for the iOS platform
  • Ensure the performance, quality, and responsiveness of applications
  • Collaborate with a team to define, design, and ship new features
  • Identify and correct bottlenecks and fix bugs
  • Help maintain code quality, organization, and automatization

Skills

  • Proficient with Swift, React Native and Flutter.
  • Experience with iOS frameworks such as Core Data, Core Animation, etc.
  • Experience with offline storage, threading, and performance tuning
  • Familiarity with RESTful APIs to connect iOS applications to back-end services
  • Knowledge of other web technologies and UI/UX standards
  • Understanding of Apple’s design principles and interface guidelines
  • Experience with performance and memory tuning with tools.
  • Familiarity with cloud message APIs and push notifications
  • A knack for benchmarking and optimization
  • Proficient understanding of code versioning tools.
  • Familiarity with continuous integration

What’s in it for you:

  • Work with a mission-driven startup that’s making an impact in Web3 communities.
  • Creative flexibility and creative leadership in an emerging field.
  • Work with a collaborative, supportive, fun and passionate team.
  • Work from home model.
  • Be a part of a growing mission-led business in the decentralized world.

Compensation As per market standards along with token allocation in the project .

Read more
Sales and profit
at Sales and profit
1 recruiter
Akanksha Dwivedi
Posted by Akanksha Dwivedi
Remote only
1 - 4 yrs
₹3.5L - ₹5L / yr
Recruitment
Recruitment/Talent Acquisition
Sourcing
Screening
Communication Skills
+1 more

Responsibilities :

  1. Understand the requirement from the hiring manager and document the requirements according to the Ideal Candidate Profile.
  2. Prepare and post jobs to appropriate hiring portals.
  3. Source and recruit the right sales talent through the database; Naukri, LinkedIn & social media
  4. Assess the applicant’s knowledge, soft skills, technical skills as per the requirement at hand.
  5. Act as a point of contact and provide the client and candidate with excellent hiring experience.
  6. Create influential relationship with client and candidate through the selection process.
Read more
Cloud infrastructure solutions and support company. (SE1)
Cloud infrastructure solutions and support company. (SE1)
Agency job
via Multi Recruit by Ranjini A R
Bengaluru (Bangalore)
4 - 8 yrs
₹28L - ₹36L / yr
SQL
skill iconPython
skill iconR Programming
AI Engineer
Set up
+3 more
  • Set up, manage, automate and deploy AI models in development and production infrastructure.
  • Orchestrate life cycle management of AI Models
  • Create APIs and help business customers put results of the AI models into operations
  • Develop MVP ML learning models and prototype applications applying known AI models and verify the problem/solution fit
  • Validate the AI Models
  • Make model performant (time and space) based on the business needs
  • Perform statistical analysis and fine-tuning using test results
  • Train and retrain systems when necessary
  • Extend existing ML libraries and frameworks
  • Processing, cleansing, and verifying the integrity of data used for analysis 
  • Ensuring that algorithms generate accurate user recommendations/insights/outputs
  • Keep abreast with the latest AI tools relevant to our business domain
Job Qualifications
  • Bachelor’s or master's degree in Computer Science, Statistics or related field 
  • A Master’s degree in data analytics, or similar will be advantageous.
  • 3 - 5 years of relevant experience in deploying AI models to production
  • Understanding of data structures, data modeling, and software architecture
  • Good knowledge of math, probability, statistics, and algorithms
  • Ability to write robust code in Python/ R
  • Proficiency in using query languages, such as SQL
  • Familiarity with machine learning frameworks such as PyTorch, Tensorflow and libraries such as scikit-learn
  • Worked with well know machine learning models ( SVM, clustering techniques, forecasting models, Random Forest, etc.)
  • Having knowledge in CI/CD for the building and hosting the solutions
  • We don’t expect you to be an expert or an AI researcher, but you must be able to take existing models and best practices and adapt them to our environment.
  • Adherence to compliance procedures in accordance with regulatory standards, requirements, and policies. 
  • Ability to work effectively and independently in a fast-paced agile environment with tight deadlines 
  • A flexible, pragmatic, and collaborative team player with an innate ability to engage with data architects, analysts, and scientists.







Read more
Understands the Customer Service. (CO1)
Understands the Customer Service. (CO1)
Agency job
via Multi Recruit by Harshitha U
Bengaluru (Bangalore)
5 - 10 yrs
₹6.4L - ₹8.4L / yr
Sales
Marketing
Sales Manager
Business Development Manager
  • Managing the development of sales and marketing strategy with a focus on B2C domain, also target
  • B2B sales and online optimization/conversation, which results in organization growth.
  • Searching and exploring new horizons, tapping new clients/markets. Respond to inquiry generation, quotation and negotiation, and order closure.
  • Manage and interpret both new and existing customer requirements to understand and cater to their needs.
  • Identifying potential strategic alliances and acquisitions that will support strategic growth initiatives and expand the business.
  • Managing the client/market segment/channel selection, development of penetration plans, pricing, and channel program strategies.
  • Analyze and report on key business metrics, including revenue growth, campaign statistics, click[1]through rates, and conversion rates; actionable insights, key client segments, and revenue opportunities.
  • Contributing to the Company’s growth by influencing necessary and relevant changes.
  • Undertaking additional tasks/projects/initiatives that contribute to team/organization growth.
  • Monitoring market intelligence of the industry.
  • Prepare proposals, presentations, and sales contracts.

Required Skills

  • 5- 10 years of Sales & Marketing experience in the academic publishing industry.
  • Strong experience in developing and executing sales and marketing strategies.
  • Strong experience with managing teams across geographies.
  • Proven record of delivering business growth
Read more
Affairal
at Affairal
1 video
1 recruiter
Govind Balakrishna
Posted by Govind Balakrishna
Bengaluru (Bangalore)
3 - 8 yrs
₹6L - ₹20L / yr
Software Testing (QA)
Load Testing
Performance Testing
Stress Testing
Test Planning
+3 more
Job description Looking for Senior Test Engineer in Bangalore. Responsibilities: - Develop and configure test automation networks and execute stability and performance tests. - Coordinate with product management and software and support engineers to deliver stable enterprise software products. - Develop and execute test automation through Selenium, Java/Python. - Write detailed test cases and follow sound QA practices to drive quality in Services-Oriented-Architecture (SOA) software product. - Enhance test frameworks and develop automated tests using Selenium to ensure consistency. - Estimate test accurately and coordinate with team members for work activities. - Apply, design and develop automated testing strategies and build automated testing frameworks. - Analyze and verify best automated and manual test approaches and execute acceptance, integration, installation and system testing. - Involve in product design to guarantee adherence of test coverage for meeting end user requirements. - Record test results and report and verify software bug fixes to accept automation criteria. - Coordinate with program and development management teams in product development lifecycle to conform end user product and quality requirements and shipment schedule. - Analyze performance test requirements and develop test plans and debug to understand test objective requirements. - Handle performance testing and present results for validating and analysis to Project Teams. - Answer technical issues to resolve and follow up. - Establish test strategy and manual and automated test suites. - Prepare software defect tracking and report entire project release status to stakeholders. - Must be willing to accept and influence a fast pace of organization changes. Required Skills & Experience: Experience: - Tech and Product enthusiast who has strong understanding and is willing to shape, drive and implement product design. - Min 4-8 years of experience as Sr. Test Engineer in a B2C startup / company preferably in a Marketplace startup (not mandetory) - Degree in Computer Science or equivalent education / experience. - Have successful track record of building scalable software system. Skills: - Strong Experience with Java Language - Strong experience with Selenium Web driver - Experience with Automation Testing - Working knowledge in SQL queries. - Strong conceptual and analytical skills: SQL, Problem Solving, Test case analysis - Experience with Automation test scripts. - Strong experience in Mobile Automation Testing experience using Appium. - Experience in setting up CI automation on Dockers platform. - Experience on continuous integration tools like Jenkins. - Personality: - Radical Thinker: Can envision a world, which is different than the established status quo - Clear: Has the ability to clearly articulate the solutions and also get there in most efficient way - Fearless doer: Not hesitant to get hands dirty and do whatever is necessary to ensure success - Self Motivated: Drives self and others towards success and shared vision - Communication: Excellent verbal and written communication skills. - Analytical: Identify real problems by applying logic, intuition, data & come up with solutions - Eye for Detail: You have to make every single detail perfect and limit the number for details
Read more
Pride Consultants
Nehru Place
0 - 2 yrs
₹2L - ₹3L / yr
Retail banking
Banking
Business Loans
We are a financial technology company engaged in the business of arranging funds of for SMEs and mid-corporate. It is a company managed by all Ex Bankers who have spent good amount of years in banks like RBS, Kotak Mahindra Bank, HDFC Bank and ICICI Bank.
Read more
Zepo Technologies Pvt Ltd
Nisha Nair
Posted by Nisha Nair
Bengaluru (Bangalore)
1 - 3 yrs
₹3L - ₹5L / yr
Sales
Communication Skills
Negotiation
Business Development Officer If you simply enjoy selling & believe you’re an entrepreneur-in-making– Be a Business Development Officer @ Zepo : We are looking for people who love & enjoy doing sales. The area is of B2B corporate sales. Your responsibility will be of Business Development with a dual role of marketing and sales. YOUR RESPONSIBILITY: Establish a consistent pipeline on a daily basis through lead generation Ability to pitch and present via customer meetings, telephone, web. Assisting Clients in setting up their online stores & providing them with expert opinions about market standards regarding online selling Potential of developing a territory WHO NEEDS ZEPO? All our clients are small time entrepreneurs – some really creative artists, designers, fresh grads out of NIFT / NID, brand-new startups, SMBs, etc. The best part of this job is that you are always surrounded by some super-cool & super-smart entrepreneurs. HOW DO WE PITCH ZEPO TO THEM? When we talk to a client – we do not sell them false dreams that e-commerce is “super-hot” & it will multiply their wealth.. Hell, we don’t fake big numbers ever in our client conversations. We just meet all kind of entrepreneurs – startups / designers / creators / artists & show them how e-commerce can solve a real life business problem, that even a marwari would agree. We help them understand How an online store can help them go-to-market quickly How e-commerce can help them reach beyond their geographies How online presence can help them in branding & take their brand to the next level How a personal online store will help them connect with their customers better How ecommerce can make it easy for their customers to buy their stuff.. & buy more of it! AND LASTLY.. How Zepo can help them, in their attempt at e-commerce. WHAT ARE WE LOOKING FOR IN YOU? No experience required, whatsoever. Graduation in any field Excellent written and verbal communication skills. Outgoing and ambitious personality High energy levels, CONFIDENCE, drive and resilience. Good computer knowledge, proficient at using the Internet, and demonstrable technical aptitude / inclination Simply smart, hardworking, ambitious, and quick learning person. If closing a deal gives you a high, If you are a hard core sales person who can sell and then retain clients with extremely butterful relationship management, If you’re a go-getter, who enjoys selling, with a ” never say die” attitude, and have the capability to convince, apply here for an exciting career.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos