Cutshort logo
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry 's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Hyderabad, vizag
8 - 10 yrs
₹4L - ₹7L / yr
Insurance
Vehicle insurance
Retail management
Team Management
Management agent
+1 more

Relationship Manager – Insurance Sales.

Identifying, recruiting, and onboarding new agents - POSP, ensuring they meet company standards and are properly trained. 

Achieving Sales Target

Providing ongoing training and development opportunities for agents, including product knowledge, sales techniques, and professional skills. 

Guiding agents in achieving sales targets, developing sales strategies, and identifying new business opportunities. 

Building and maintaining strong relationships with agents, providing support and addressing their needs. 

Tracking agent performance, identifying areas for improvement.

Developing and implementing strategies to grow the agency channel, expand market share, and increase profitability. 

Serving as a point of contact between the agency and the company, coordinating with various departments to support the agent network. 

 

Required skills

  • Proven working experience as an Insurance Agent or relevant experience from Insurance Broking Industry
  • Familiarity with all types of insurance plans (automobile, fire, life, property, medical etc)
  • Basic computer knowledge and statistical analysis

 

Read more
Altruist Technologies Private Limited
Altruist Technologies Private Limited
Agency job
Altruist technology PVT ltd, Tech Boulevard, 3rd floor, Plot No. 6, Sector 127, (Tower - C), Sector 127, Noida, 201303, Noida
0 - 3 yrs
₹2L - ₹3L / yr
MS-Excel
Calling
Communication Skills

🚀 Join Altruist Technologies Pvt. Ltd.

Role: Tele Sales – Customer Care Executive (Inbound + Cross-Selling)

📍 Location: Sector 127, Noida | 🕘 Shift: Day Shift

📌 Work Type: On-Site | 💼 Employment: Full-Time

👥 Openings: 600 | ⏳ Notice Period: Immediate

About the Role

We’re hiring enthusiastic individuals to be part of the Axis BPO Process at Altruist Technologies. If you’re passionate about customer service and have a knack for communication and cross-selling, this is your chance to kick-start a rewarding career.

🔹 Key Responsibilities

  • Handle inbound calls and resolve customer queries
  • Promote and cross-sell relevant products/services
  • Maintain accurate call records & reports
  • Adhere to company processes and quality standards

🔹 Eligibility

  • Education: Graduation (10+2+3)
  • Age: 18–30 years
  • Experience: 0–3 years (Freshers welcome!)
  • Languages: Fluent in English & Hindi
  • Skills: Excel, Communication, Calling

💡 Why Join Us?

✅ Growth-focused environment

✅ Skill development & career opportunities

✅ Energetic, modern workplace in Noida

Read more
e-learning platform
e-learning platform
Agency job
via Qrata by Rayal Rajan
Remote only
6 - 9 yrs
₹12L - ₹35L / yr
skill iconReact Native
skill iconSwift
skill iconObjective C
RESTful APIs
About
It is a platform to build organizational capability in line with the business
objectives of the organization, driven by global industry Professionals.
It works with leadership at enterprises to identify the gaps in skills in existing employees and develops Live Programs and delivers these programs through its Global Network of Industry Professionals.

Who we are
It has been started a team of Mckinsey/ISB alums and life-long passionate teachers, who believe that “Knowledge acquired by Professionals through years of hard work is a treasure chest,
which can help professionals shape their careers and help companies create rockstars from their existing workforce”.
We are a Series A funded startup backed by Amazing Investors like Y Combinator, GSV Ventures, and Matrix Partners.

What will you do
● Work as part of a small team, which will include AntWak tech team of React Native developers, a project manager, QA professional, and a designer to build React Native iOS / Android application
● Architect, build and maintain excellent React Native applications with clean code.
● Implement pixel perfect UI's that match designs.
● Implement clean, modern, smooth animations and transitions that provide an excellent user experience.
● Integrate third-party API's.
● Write unit and integration tests and work with native modules when required.
● Release applications to IOS and Google Play stores.
● Complete one or two week sprints and participate in sprint retrospectives and daily standups.
● Assist with building estimates.

What skills do you need?
● 2+ years of professional experience working with React Native.
● 4+ years of professional software development experience.
● Experience working with Swift, Objective C, and Java a plus but not required.
● Meaningful experience working on large, complex systems.
● An understanding of React Native best practices and a commitment to following them.
● Ability to work through new and difficult React Native issues and contribute to libraries as needed.
● Ability to create and maintain continuous integration and delivery of React Native applications.
● Should have good experience of REST API and graphQL integration
● Should have experience of working in Redux-React based environment
● Best to have working experience of NEXT Js and React with Typescript.
● You’re passionate about software development.You’re constantly striving to learn new things and improve. You follow industry news, regularly thinker with new technologies, and read books and blogs to keep your skills current.

Why you will love to work with us
We’re a medium-sized tech team that’s growing fast, so everyone that joins has a direct impact on the
direction and success of the company. Today’s hires will be tomorrow’s leaders. We strive for an open, flat, collaborative, work-hard play-hard environment.We offer competitive compensation with health insurance.
Read more
Lansum Properties
Dasari SarveswaraRao
Posted by Dasari SarveswaraRao
Hyderabad
4 - 10 yrs
₹5L - ₹10L / yr
Procurement & Buying
Purchase orders
Vendor Management
technical purchasing

*4 - 10 Years Experience

* Engineering Graduates

* Must have experience in Commercial complexes, Apartments, Hirise Building, and Gated Community.

* Position will be available or Closed by march or April Months.



Job description

The Purchase Manager will lead and oversee the procurement process for our real estate and construction projects. The ideal candidate should possess 8-15 years of procurement experience, with a strong focus on the construction and materials industry. We offer a competitive salary reflective of industry standards.

Responsibilities:

Procurement Planning:

  • Collaborate with project managers to comprehend procurement requirements.
  • Gain a thorough understanding of the requirements and technical requirements of the product or service.
  • Develop procurement plans for timely and cost-effective material, equipment, and service procurement.
  • Conduct market research to identify potential suppliers and maintain a robust supplier database.

Supplier Management:

  • Evaluate suppliers based on quality, reliability, and cost-effectiveness.
  • Negotiate and manage supplier contracts.
  • Monitor supplier performance, resolving any issues promptly.
  • Cultivate strong relationships with suppliers for material and service availability.
  • Updating of supplier database with the latest entrants and the evolving technologies relevant to the industry

Purchase Order Management:

  • Review and convert purchase requisitions into accurate and complete purchase orders.
  • Monitor and track purchase orders to ensure on-time delivery.
  • Coordinate with project teams and suppliers to resolve delivery or quality issues.

Cost Management:

  • Analyze market trends, prices, and supplier performance for cost-saving opportunities.
  • Implement cost control measures without compromising quality.
  • Conduct periodic audits for compliance with procurement policies.
  • Analyze every material or product to ensure the pricing is appropriate for the product procured.

Inventory Management:

  • Manage inventory levels for optimal stock availability.
  • Coordinate with warehouse and project teams to track and reconcile inventory.
  • Implement inventory control measures to minimize stock-outs and excess inventory.

Compliance and Documentation:

  • Ensure compliance with company policies, procurement regulations, and applicable laws.
  • Maintain accurate procurement records and documentation.
  • Prepare reports and provide updates on procurement activities to management.

Qualifications:

  • 4 - 10 years of procurement experience in the real estate or construction industry.
  • Residential purchase experience is essential.
  • Strong Proficiency in MS Office (Excel, Word).
  • Experience in preparing MIS reports as per management requirements.
  • Strong knowledge of procurement processes, vendor management, and supply chain management.
  • Excellent negotiation and communication skills.
  • Proficient in procurement software (ERP) and other relevant tools.
  • BE, BTech or Master's degree in Business Administration, Supply Chain Management, or a related field (preferred).
  • Good Analytical skills to review the quotations and understand the intricacies.
  • Financial acumen to grasp the impact of procurement decisions on the overall budget.
  • Strategic thinking to develop and implement cost-effective procurement plans that align with the organization's goals.
  • Maintaining ethical standards in procurement practices ensures transparency, fairness, and integrity, which is crucial for long-term success and cost management.
  • Being adaptable to changes in the market, industry regulations, or organizational priorities allows for agility in adjusting procurement strategies for optimal cost management.
  • Good understanding on National Building Code (NBC) of construction


Read more
KCS Technologies
Police Meghana
Posted by Police Meghana
Hyderabad
0 - 3 yrs
₹1L - ₹3L / yr
Email Marketing
Lead Generation
Communication Skills
Cold Calling
Inside Sales
+1 more

Job Description:


  • Prospecting, generating, qualifying, and following up on leads and appointment setting for the external sales team
  • Direct email marketing/cold calling to key clients and prospects
  • Collaboratively work with the sales, and marketing team to develop lead generation strategies to generate lead opportunities with prospective customers
  • Initiates lead/demand generation strategies that include inbound/outbound sales and marketing campaigns and initiatives
  • Research, track, maintain, and update leads
  • Develop a strong knowledge of the company’s products and services to facilitate the sales process
  • Achieving sales lead generation and appointment quota


Key Responsibilities:

  • Inside Sales
  • Lead Generation
  • Executive Email marketing and Cold calling
  • International sales experience preferred
  • Relevant IT/ERP sales experience preferred


Requirements:

  • Minimum 2 years of Sales experience in the US market
  • Bachelor's or relevant degree
  • Need to work in US timings
  • Immediate availability
Read more
Recro
at Recro
1 video
32 recruiters
Priyal Shenoy
Posted by Priyal Shenoy
Remote only
3 - 7 yrs
₹7L - ₹22L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+7 more

Required Skills:

 

  • 3+ years of experience with development in JAVA technology.
  • Strong Java Basics
  • SpringBoot or Spring MVC
  • Hands-on experience with Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
  • Proficient in REST API development
  • Messaging Queue (RabitMQ or Kafka)
  • Microservices
  • Any Caching Mechanism
  • Good at problem-solving

 

Good to Have Skills:

 

  • 4+ years of experience in using Java/J2EE tech stacks
  • Good understanding of data structures and algorithms.
  • Excellent analytical and problem-solving skills.
  • Ability to work in a fast-paced internet start-up environment.
  • Experience in technical mentorship/coaching is highly desirable.
  • Understanding of AI/ML algorithms is a plus.
Read more
Cast Software
at Cast Software
3 recruiters
Sibil Sagar
Posted by Sibil Sagar
Bengaluru (Bangalore)
3 - 7 yrs
₹7L - ₹18L / yr
skill iconJava
Selenium
Cucumber
Protractor
RESTful APIs
+4 more
Job definition
Working at CAST R&D means being an important part of a highly-talented, fast-paced, multicultural and Agile team based in Paris (France) and Bangalore (India). The team builds sophisticated source code analysis platform leveraging parsing, control flow, data flow and others mechanisms to fully understand the inner structure of the complex IT Systems developed and used by the Fortune 500 companies.
You, working as individual contributor, will be integrated in AIP Teams working on web portals of CAST AIP. Your teammates will be located in India and in France and you will have the opportunity to travel to France every year. You will participate into best practices definition and technology watch. Depending on will, skills and experience, you will have the opportunity to take technical lead on topics or projects.
While the domain of CAST is a niche, the position will propose you to work on software that dedicate to company Dashboards and control software, focusing on technical and creative skills.

Profile

• Experience : 3-6 years
• Proven experience in Java with Selenium, TestNG, Protratcor, Jasmine, Javascript/Typescript
• Proven experience in developing automated tests for REACTJS/HTML5 application
• Experience on Load Testing ( Locust/Jmeter/LoadNinja anyone )
• Exposure to Python ( Pytest, Pylint ) is added value
• Strong experience in designing multiple types of automation frameworks
• Development and execution of test plans and scripts • An understanding of accessing and configuring SQL Server
• Documenting test results and test reports
• Understanding of web servers like Nginx/Tomcat
• Testing on cloud environment would be an advantage
• Knowledge on performance & security testing would be plus
• Strong Problem solving skills and ability to troubleshoot applications & environment issues.
• Adaptability, ability to learn faster, Independent, responsible and diligent.
• Good team spirit and interpersonal skills, Excellent Written, Verbal, communication skills, Analytical skills & Business Thinking.
The candidate should have a passion for technology and a flexible, creative approach to problem solving. You are autonomous and take responsibility for your work.
You have knowledge in agile methodologies such as Scrum. You know about GIT and the use of continuous integration tools.
Candidate should have a bachelor or Master technical degree or equivalent experience. Strong knowledge in software engineering. Proactive Self Starter, creative thinker in designing, developing and supporting applications. Work as part of cross functional, passionate agile project teams to ensure quality is driven into the heart of the development process.
Read more
A Technology solution for an Investment platform.
A Technology solution for an Investment platform.
Agency job
via Multi Recruit by Anna S
Bengaluru (Bangalore)
5 - 8 yrs
₹18L - ₹22L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
TypeScript
  • As a Senior Software Engineer you will work closely with the Tech Lead, and the rest of the engineering team to build and scale a data-driven platform. This role will act as a great springboard to accelerate career growth & transition into a Tech Lead level role.
  • Your primary focus will be the development of server-side logic, building new services and APIs, developing UI components, supporting the maintenance of current APIs, reviewing work, and improving the performance and reliability of our systems as we rapidly scale our product and organization.
  • An effective Senior Software Engineer will be a self-motivated learner; a highly creative engineer having obsessive attention towards detail and thoroughness.

Must Haves

  • You’ve been building web applications professionally for 5+ years
  • You’re proficient in NodeJS, TypeScript, PostgreSQL, and MongoDB
  • You possess strong OOP and design pattern knowledge
  • Familiar with modern engineering practices: Code Reviews, Continuous Deployment, Automated Testing, etc
  • You write understandable, testable code with an eye towards maintainability and experienced with TDD (Test Driven Development)
  • You’ve the ability to build RESTful APIs
  • Explaining complex technical concepts to designers, support team, and fellow engineers is not a problem for you
  • Well versed with the fundamentals of computer science and distributed systems

Nice-to-haves

  • FrontEnd experience; have built applications in either: React, Vue, Angular, or Svelte
  • Startup experience, preferably a tech startup
  • Open Source contributor
  • You have experience with other programming languages -- e.g. Python, Ruby, PHP, Go, C, etc.
  • Passionate about/experienced with open source and developer tools
  • You have a bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience

Benefits

  • Feel good factor / impact driven work- Be part of the journey that is creating an impact in people’s lives after retirement. The work we do has a direct impact on the size of someone’s retirement pot
  • Ownership driven work- you own problems within the organisation and not an implementer of someone else’s idea. You have the ability to design solutions and work with multiple stakeholders to implement them
  • Job stability- ClearGlass is very well funded by top tier VCs and can provide job stability in the COVID world
  • Stock Options- we would love every employee of ClearGlass to have stock options
  • Top-of-the-line gear- to help you be super-productive while working. No one likes a slow laptop
  • Flexible work environment- we are working from home currently but will slowly move to a hybrid set-up; we offer support (incl. financial) to set-up your home office

 

Read more
SaaS in Logistics & Supply Chain Startup
SaaS in Logistics & Supply Chain Startup
NCR (Delhi | Gurgaon | Noida)
4 - 7 yrs
₹15L - ₹20L / yr
User Experience (UX) Design
ux designer
skill iconHTML/CSS
User Interface (UI) Design

Job Description

UX designers explore many different approaches to solving a specific user problem. Your broad responsibility will be to ensure that the product logically flows from one step to the next. You would be responsible for the overall feel of the product. You would be expected to define interaction models, user task flows, and UI specifications. Communicate scenarios, personas, end-to-end experiences, interaction models, and screen designs to stakeholders. Develop and maintain design wireframes, mockups, and specifications as needed.

Our team is composed of people passionate about product architecture, system design, algorithms, machine learning, big data analytics as well as some kickass developers.

Responsibilities:

  • Create user-centric designs by considering customer feedback, and usability findings
  • Use business requirements and customer research to assist in developing use cases, high-level requirements
  • Conduct usability studies and put together detailed, structured analysis of issues and potential solutions.
  • Design the UI architecture, interface, and interaction flow of web & mobile applications
  • Develop conceptual diagrams, wireframes, visual mockups and prototypes
  • Develop and maintain detailed user-interface specifications
  • Develop process flows, wireframes, and mockups to effectively conceptualise and communicate high-level design strategies and detailed interaction behaviour

Qualifications

Requirements:

  • Proven experience as a user experience designer, interaction designer or similar role
  • A portfolio or samples of work demonstrating experience creating user-centric design solutions
  • A thorough understanding of information architecture and interaction models.
  • Awareness and understanding of design guidelines such as material design, flat design etc.
  • Passion for learning and always improving yourself and the team around you
  • Bachelor's degree in design, human-computer interaction (HCI), or equivalent professional experience is a plus
  • Knowledge of web based UI development technologies such as HTML5, JavaScript, JQuery, CSS etc. is a plus

Additional Information

PERKS

  • Free breakfast, dinner and snacks at the office
  • Monthly team outings, e.g., laser tag, paintball, football, trampoline etc.
  • Quarterly team parties and annual offsite
  • Company sponsored enrolment worth 40K annually to online learning resources like Coursera, edX etc.
  • International trip vouchers for top performers
  • Company sponsored asset purchase worth 50K
  • Games in office - Mini golf, pool, foosball
  • Regular tech seminars 

Our hiring principles

  • We don't care about the stack you've worked upon, we look good understanding of fundamentals.
  • We look for depth in the work experience. Our tech stack consists of almost all the latest technologies and we expect people to learn fast and acquire sufficient depth.
  • We look for people passionate about technology and are good team players.
Read more
Black Turtle Diginovation Pvt Ltd
Anusha Dabade
Posted by Anusha Dabade
Bengaluru (Bangalore)
1 - 4 yrs
₹2L - ₹5L / yr
Shopify
skill iconRuby
skill iconHTML/CSS
Object Oriented Programming (OOPs)
Job Responsibilities

    Build custom Shopify themes and modifying existing themes depending on requirememts
    Migrating websites from other eCommerce platforms to Shopify
    Extending Shopify's functionalities using storefront APIs, liquid programming, meta fields, etc
    Integrating third-party and platform supported apps in the sites
    Work closely with clients to gather requirement, develop and deliver on the same

Required Skillsets
    Strong knowledge of liquid programming language
    Working Experience on Shopify Platform along with exposure towards application development.
    Shopify theme development and customization
    Strong knowledge of OOPs with clear concepts and work experience in HTML5, CSS3, Javascript/Jquery.
    Knowledge in other ecommerce platform like Magento, woocommerce, BigCommerce will be preferred.
    Strong hands on experience on Installing & Customization of new Shopify themes.
    Good verbal and oral communication skills
    Working with international clients would be an advantage


Strong knowledge of OOPs with clear concepts and work experience in HTML5, CSS3, Javascript/Jquery.
please extend those with the following: SASS or/ LESS Experience

also i would focus on full stack frontend web developer - building apps should be done by a proper backend developer 
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos