Cutshort logo
For Employers
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)

AI Runtime Lead (LLM DevOps, PyTorch) at IT Industry · Bengaluru (Bangalore) · 5 - 8 years · ₹12L - ₹16L / yr · Posted 6 Jan 2026

Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Blitzy
at Blitzy
2 candid answers
1 product
Taher Ujjainwala
Posted by Taher Ujjainwala
Pune
12 - 25 yrs
₹70L - ₹120L / yr (ESOP available)
skill iconPython
skill iconKubernetes
Google Cloud Platform (GCP)
skill iconAmazon Web Services (AWS)
Windows Azure
+15 more

About the Role

We are hiring Staff / Principal Engineers to take full, hands-on ownership of Blitzy's most critical production-grade systems and to deliver high-leverage features that materially improve customer outcomes and engineering velocity. This is the most senior individual contributor role at the company today.

This is not a Senior-plus role, an architecture-only role, or a promotion-track role. We are looking for someone who has already operated at Principal / Staff+ scope in a highly technical environment and expects to spend their time writing, reviewing, and shipping production code.

This role is 100% hands-on. Leverage comes from system ownership, execution quality, and durable technical decisions — not people management or process.


Responsibilities

  • Own mission-critical production systems end-to-end, ensuring correctness, scalability, performance, reliability, and operational excellence.
  • Design, build, and ship high-impact backend systems and features that improve product reliability, performance, and customer value.
  • Architect scalable services and cloud infrastructure using technologies such as Python, REST, gRPC, Kubernetes, and Terraform.
  • Identify and resolve complex technical bottlenecks that limit engineering quality, system performance, or organizational velocity.
  • Build and operate LLM-powered systems and validation loops that evaluate correctness, consistency, durability, and production performance.
  • Design and evolve data architectures incorporating relational, NoSQL, graph, and vector databases to support complex enterprise applications and semantic retrieval.
  • Modernize and improve complex enterprise systems while balancing reliability, maintainability, scalability, and delivery speed.
  • Set and uphold engineering quality standards through hands-on technical leadership, sound technical judgment, and ownership of long-term technical decisions.


Qualifications

  • Direct experience with Python as a primary programming language, backend frameworks, and microservices architectures.
  • Expertise in REST and gRPC, with proficiency in Node.js and JavaScript.
  • Proficiency in GCP, along with experience using at least one additional cloud platform such as AWS or Azure.
  • Advanced knowledge of Kubernetes and Terraform in production environments.
  • Experience operating highly available production systems, including monitoring, scalability, reliability, performance optimization, and operational tooling.
  • Strong knowledge of SQL and NoSQL databases, including PostgreSQL, MySQL, MongoDB, Cassandra, or DynamoDB.
  • Familiarity with graph databases such as Neo4j and vector databases or embedding infrastructure for semantic search and retrieval.
  • Hands-on experience building and operating LLM-powered systems in production, including evaluation, validation, regression testing, tracing, and failure analysis.
  • Working knowledge of LangSmith or comparable LLM observability and evaluation tools; familiarity with OpenAI, Anthropic, or similar model providers is a plus.
  • Ability to contribute across the full stack, with a strong understanding of frontend architecture and the ability to debug, design, and ship across frontend, backend, infrastructure, and AI systems.
  • Understanding of large-scale enterprise software systems, including architecture, integration, deployment, modernization, and long-term maintainability.
  • Proven track record of operating at Staff+, Principal Engineer, or equivalent level, independently driving complex technical initiatives and delivering high-impact outcomes with minimal supervision.


Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into enterprise grade code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups.


Our Culture

Who we are:

Led by two pioneering co-founders we are one of the fastest growing companies in the U.S., creating our own category of enterprise autonomous software development. We automate thousands of hours of software development for our customers, which includes strong representation within the Fortune 500.


How we work:

  • We move Blitzy Fast: Time is both our company’s and our clients’ most precious asset. We move quickly and decisively to innovate internally and deliver exceptional software externally.
  • Championship Mindset: We operate like a professional sports team. We win as a team by holding ourselves and each other to high standards, collaborating in-person, and remaining focused on the mission.
  • Passion for Invention: We’re pushing the frontier of what’s possible, requiring constant innovation and iteration.
  • We Work for the Customer: We focus on delivering outsized value to the customers we work with and expanding those relationships into deep, meaningful partnerships.
  • We believe in being ‘everyday athletes’: taking care of ourselves so we can bring our best minds to work. We promote great sleep, movement, and restorative activities for 


Blitzy is an equal opportunity employer committed to building a diverse and inclusive team. We believe different perspectives make us stronger.

Read more
Kody Technolab
Hinal Shah
Posted by Hinal Shah
Ahmedabad
7 - 9 yrs
₹13L - ₹30L / yr
Large Language Models (LLM)
Generative AI
GPT
BERT
LAMA
+4 more

Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have

strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and cloud-based AI deployments.


Key Responsibilities


• Design, develop, and deploy Machine Learning and Deep Learning models for classification, regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.

• Build and maintain end-to-end ML pipelines including data preprocessing, feature engineering, model training, validation, evaluation, and deployment.

• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related frameworks.

• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama, Claude, and Stable Diffusion.

• Collaborate with product, engineering, and business teams to translate requirements into scalable AI solutions.

• Optimize model performance, scalability, and reliability for production environments.

• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.

• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.


Required Qualifications


• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a related field.


• 7+ years of hands-on experience in AI/ML product development.

• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and Hugging Face.


• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.


• Strong understanding of the ML lifecycle including model training, tuning, deployment, monitoring, and optimization.

• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.


• Experience with AWS, Azure, or GCP cloud platforms.


• Strong problem-solving and analytical skills.


Preferred Skills

• Fine-tuning and deployment of Large Language Models.

• Experience with RAG (Retrieval Augmented Generation) architectures.

• Contributions to open-source AI projects or research publications.

• Knowledge of model interpretability, data annotation, and feature engineering.

• C++ experience for high-performance AI applications.



Why Join Kody Technolab Limited?

Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,

and enterprise-scale applications while collaborating with a highly skilled technology team.


Visit the Website to know more about us.

Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution

Kody Robots | Robotics Company in India for Autonomous Robots

Read more
Orenda Financial Services
at Orenda Financial Services
1 candid answer
Orenda Finserv
Posted by Orenda Finserv
Ahmedabad
3 - 5 yrs
₹7L - ₹11L / yr
skill iconMachine Learning (ML)
Model Serving
Vision Models
skill iconPython
RESTful APIs
+2 more

About the role

We are building AI systems that read, understand and act on real business documents, bank statements, financial reports, policy documents and forms and putting them into production where accuracy and cost both matters.

This is not a research role and it is not a prompt-writing role. You will own features end to end: pick and deploy open-source models, build the pipelines around them, measure whether they actually work on our documents, drive the cost per document down, and keep the whole thing running in production.

You will work closely with the engineering and product teams, and your work will be directly used by business users from day one.


What you will do

Deploy and evaluate open-source models

  • Select, deploy and benchmark open-source LLMs and vision-language models for specific, narrow use cases not general chat.
  • Build evaluation sets from real documents and define what "good" means numerically (field-level accuracy, extraction recall, hallucination rate) before shipping.
  • Run structured comparisons between models and approaches, and write up the trade-offs so the team can make a decision.
  • Apply quantization, batching and other optimizations to fit models into a sensible GPU budget.

Build and optimize AI orchestration

  • Design multi-step pipelines that combine deterministic code, ML models and LLM calls and know when not to use an LLM.
  • Optimize for latency, cost and reliability: caching, batching, request routing, fallback tiers, retries and graceful degradation.
  • Instrument pipelines so failures are visible and traceable rather than silent.

Ship to production

  • Package models and services with Docker, expose them behind clean APIs, and deploy them to our GPU and CPU infrastructure.
  • Handle the unglamorous production concerns: cold starts, timeouts, concurrency limits, versioning, rollback and monitoring.
  • Own on-call-style responsibility for the AI features you build, including cost tracking.


Must-have skills


Programming & engineering

  • Strong Python: type hints, async/await, dataclasses/Pydantic, clean module design, testing.
  • REST API development with FastAPI (or Flask/Django with a willingness to move to FastAPI).
  • Git, code review discipline, and the ability to write code someone else can maintain.
  • Comfortable in Linux and on the command line.

Machine learning fundamentals

  • Working knowledge of PyTorch and the Hugging Face ecosystem (transformers, tokenizers, accelerate).
  • Understanding of inference-time concepts: tokenization, context windows, batching, precision (FP16/BF16/INT8), memory footprint.
  • Ability to read a model card and a paper well enough to judge whether a model fits a use case.

Document processing

  • Hands-on experience with at least two of: pypdfium2, PyMuPDF, pdfplumber, pdfminer.six, Docling, Unstructured, Surya, DocTR, LayoutLM family.
  • Practical OCR experience (Tesseract, PaddleOCR, or a cloud OCR) and an understanding of when OCR is the wrong tool.
  • Experience extracting tables from PDFs and dealing with merged cells, multi-line rows, and inconsistent column layouts.


Strongly preferred

You will be a much stronger candidate with any of these. We do not expect all of them.

Model serving & optimization

  • vLLM, TGI, Ollama, llama.cpp, or Triton Inference Server.
  • Quantization formats and tooling: GGUF, AWQ, GPTQ, bitsandbytes, ONNX Runtime, INT8 export.
  • Serverless GPU platforms: Modal, RunPod, Replicate, Baseten including cold-start and container-lifecycle management.
  • LoRA / QLoRA fine-tuning with PEFT for narrow, task-specific improvements.

Vision-language models

  • Practical use of open VLMs: Qwen2.5-VL, InternVL, Granite Vision, Molmo, Phi-Vision, or similar.
  • Awareness of where VLMs hallucinate especially on numeric and financial content and patterns for constraining them (using the model for layout only, sourcing values from the text layer, constrained decoding).

Orchestration & pipelines

  • Workflow orchestration: Dagster, Airflow, Prefect, or Temporal.
  • Async job patterns: Celery, RQ, or platform-native spawn/poll patterns.
  • LLM orchestration frameworks (LangGraph, LlamaIndex, Haystack) with the judgement to know when plain Python is a better answer.
  • Structured output enforcement: Instructor, Outlines, XGrammar, JSON schema / tool-use modes.

Evaluation & observability

  • Building golden datasets and regression suites for extraction tasks.
  • Eval tooling: promptfoo, DeepEval, Ragas, or in-house harnesses.
  • LLM tracing and monitoring: Langfuse, Arize Phoenix, LangSmith, OpenTelemetry.

Nice extras

  • Rule engines and policy evaluation (Open Policy Agent / Rego, Drools, rule-engine).
  • Experience in fintech, lending, insurance or accounting documents.
  • Handling of PII and data-security practices in document pipelines.
  • Contributions to open-source ML or document-processing projects.


Why join us

  • Real production ownership from month one your work goes to actual users, not a demo.
  • Genuinely hard technical problems in document AI, not wrappers over an API.
  • Small team, short decision cycles, direct access to leadership.
  • Budget and freedom to evaluate and adopt new open-source models as they land.


To apply: send your CV along with a short note on one AI system you have taken to production what it did, what the accuracy was, and what broke.


Read more
Timble Technologies
at Timble Technologies
1 recruiter
Shefali Gupta
Posted by Shefali Gupta
Remote, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Bengaluru (Bangalore)
2 - 10 yrs
₹5L - ₹15L / yr
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
skill iconDocker
API
skill iconFlask
+4 more

Job Title: Senior AI/ML Engineer

Company: Timble Technologies Pvt. Ltd

Location: Gurugram (Hybrid)

Experience: 2 TO 5 Years


About Us

Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.

Role Overview

We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.


Key Responsibilities


·       Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).

·       GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.

·       Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.

·       MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.

·       Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.

·       Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.


Required Qualifications & Skills


·       Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.

·       Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.

·       GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.

·       Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.

·       Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.

·       Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).


Preferred Qualifications

·       Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.

·       Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).

·       Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.

Read more
Daivtech Solutions Pvt Ltd
Bengaluru (Bangalore)
5 - 10 yrs
₹10L - ₹20L / yr
skill iconFlask
skill iconDjango
FastAPI
PyTorch
TensorFlow
+13 more

Job Title: Senior AI Engineer

Experience: 5–10 years in software engineering, with 3+ years in AI/ML engineering preferred

Employment Type: Full-time

Department: Artificial Intelligence / Engineering

Location: Bangalore


We are looking for a highly skilled Senior AI Engineer to design, develop, deploy, and scale intelligent AI-powered applications and solutions. The ideal candidate will have strong expertise in machine learning, Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and production-grade software engineering.

The candidate will work closely with product managers, data scientists, software engineers, and business stakeholders to translate complex business requirements into scalable, reliable, secure, and cost-effective AI solutions.

Key Responsibilities

1. AI Solution Design and Development

  • Design, develop, and deploy end-to-end AI and machine learning solutions.
  • Build intelligent applications using LLMs, Generative AI, NLP, and deep learning techniques.
  • Develop scalable AI architectures and reusable components for enterprise applications.
  • Evaluate AI models and select appropriate approaches based on accuracy, latency, cost, and business requirements.

2. Generative AI and LLM Engineering

  • Develop LLM-powered applications using models from providers such as OpenAI, Anthropic, Google, or open-source ecosystems.
  • Design and implement RAG pipelines, document processing workflows, semantic search, and knowledge retrieval systems.
  • Build AI agents and multi-step workflows using appropriate orchestration frameworks.
  • Implement prompt engineering, structured outputs, tool calling, and context management.
  • Optimize model performance through evaluation, fine-tuning where appropriate, and inference optimization.

3. Machine Learning and Data Engineering

  • Develop and operationalize machine learning models for classification, prediction, recommendation, and other business use cases.
  • Work with structured, unstructured, and multimodal data.
  • Build data preprocessing, feature engineering, model training, and validation pipelines.
  • Apply appropriate model evaluation techniques and statistical methods.

4. Production Deployment and MLOps / LLMOps

  • Deploy AI solutions using cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
  • Build automated CI/CD pipelines for AI applications and model deployment.
  • Implement model versioning, experiment tracking, monitoring, and performance evaluation.
  • Optimize inference latency, throughput, infrastructure utilization, and operating costs.
  • Establish observability for AI applications, including token usage, retrieval quality, latency, failures, and model behavior.

5. Software Engineering and System Architecture

  • Develop production-quality applications and APIs using Python and modern backend frameworks.
  • Design RESTful APIs, asynchronous processing systems, and microservices where appropriate.
  • Integrate AI services with enterprise applications, databases, and third-party systems.
  • Use relational databases, vector databases, caching, and distributed systems effectively.
  • Apply software engineering best practices, including testing, code reviews, documentation, and design patterns.

6. Security, Quality, and Responsible AI

  • Implement safeguards against prompt injection, data leakage, insecure tool execution, and unauthorized access.
  • Apply appropriate privacy, security, and compliance controls to AI systems.
  • Evaluate hallucinations, bias, reliability, and failure modes.
  • Design human-in-the-loop workflows and fallback mechanisms for critical use cases.

7. Technical Leadership and Collaboration

  • Lead technical design discussions and mentor junior AI engineers.
  • Define engineering standards, coding practices, and AI development guidelines.
  • Collaborate with cross-functional teams to deliver measurable business outcomes.
  • Conduct code reviews, evaluate emerging technologies, and recommend practical innovations.
  • Communicate technical trade-offs and solution architecture to both technical and non-technical stakeholders.

Required Technical Skills

Programming and Backend Development

  • Strong proficiency in Python.
  • Experience with FastAPI, Flask, or Django.
  • Knowledge of REST APIs, asynchronous programming, data structures, algorithms, and software design principles.
  • Experience with Git, automated testing, and CI/CD.

AI and Machine Learning

  • Strong understanding of supervised and unsupervised learning, model evaluation, and statistical concepts.
  • Hands-on experience with PyTorch, TensorFlow, or scikit-learn.
  • Knowledge of NLP, embeddings, transformers, and deep learning fundamentals.

Generative AI and LLMs

  • Hands-on experience building production applications using LLM APIs or open-source models.
  • Strong understanding of RAG architecture, embeddings, chunking, reranking, and retrieval evaluation.
  • Experience with vector databases such as Pinecone, Weaviate, Qdrant, Milvus, or pgvector.
  • Familiarity with orchestration frameworks such as LangChain, LangChain, or comparable tools.
  • Experience with tool calling, structured generation, agent workflows, and LLM evaluation.

Cloud and Infrastructure

  • Experience with AWS, Azure, or Google Cloud.
  • Working knowledge of Docker and Kubernetes.
  • Familiarity with model serving, scalable APIs, monitoring, and production deployments.
  • Experience with MLOps or LLMOps practices.

Databases and Data Processing

  • Strong SQL skills and experience with relational databases.
  • Familiarity with NoSQL databases, data pipelines, and distributed processing.
  • Experience working with unstructured data, document ingestion, and retrieval systems.

Preferred Qualifications

  • Experience with fine-tuning, quantization, or serving open-source LLMs.
  • Experience with multimodal AI, including text, image, audio, or video.
  • Knowledge of agent evaluation, workflow orchestration, and multi-agent systems.
  • Experience with AI security, guardrails, governance, and responsible AI.
  • Experience optimizing AI workloads for latency, scalability, and cost.
  • Contributions to open-source AI projects, research, or technical publications.

Education

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Equivalent practical experience and demonstrated engineering expertise may be considered.

Key Success Metrics

  • Quality, accuracy, and reliability of deployed AI solutions.
  • Production adoption and measurable business impact.
  • Reduction in inference costs and response latency.
  • RAG retrieval quality and reduction in unsupported or incorrect responses.
  • System availability, scalability, and operational stability.
  • Delivery timelines, code quality, and technical mentoring effectiveness.
Read more
EMB Global
Rishu Dutta
Posted by Rishu Dutta
Gurugram
7 - 12 yrs
₹20L - ₹50L / yr
Retrieval Augmented Generation (RAG)
Agentic AI
Multi-agent Systems

Role Overview 

We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale. 


Key Responsibilities 

Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production. 

Write clean, tested, production-grade code and participate actively in code and design reviews. 

Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production. 


Required Qualifications 

8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs. 

Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel). 

Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers. 

Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability. 



Read more
IT Service
IT Service
Agency job
via spectrum talent management by Swati Shrivastava
Bengaluru (Bangalore)
6 - 12 yrs
₹15L - ₹25L / yr
Google Vertex AI
  • Senior Machine Learning Engineer – Vertex AI
  • Senior Generative AI Engineer – GCP
  • Google Cloud AI/ML Engineer
  • MLOps Engineer – Vertex AI
  • LLM Engineer – RAG, Gemini, and Vertex AI


Read more
Teradata
pranil gavade
Posted by pranil gavade
Bengaluru (Bangalore), Pune, Hyderabad, Mumbai
5 - 10 yrs
₹45L - ₹60L / yr
skill iconJava
skill iconGo Programming (Golang)
skill iconPython
RESTful APIs
SQL
+4 more

Solid product experience and an educational background from Tier‑1 universities are preferred.


As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities. 

In this role, you will: 

  • Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance. 
  • Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features. 
  • Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability. 
  • Work with SQL and NoSQL databases to implement efficient data models and service access patterns. 
  • Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs). 
  • Use AI powered engineering tools to improve development quality, speed, and productivity. 
  • Mentor engineers, supporting them in technical planning, implementation, and best practices. 
  • Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure. 
  • Write unit and integration tests and participate in code reviews to uphold engineering excellence. 
  • Investigate production issues, ensuring timely and effective solutions. 
  • Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies. 

Who You’ll Work With 

You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction. 

What Makes You a Qualified Candidate 

(Nonnegotiable qualifications) 

  • Bachelor’s degree in Computer Science or equivalent from a recognized institution. 
  • 5+ years of experience in backend services, distributed systems, or data platform development. 
  • Strong proficiency in Java, Go, or Python for service development. 
  • Good understanding of design principles, distributed system patterns, and service framework. 
  • Hands-on experience designing and developing RESTful APIs. 
  • Experience with SQL and NoSQL databases and data modelling. 
  • Strong debugging, problem solving, and troubleshooting skills. 
  • Experience with modern containerization and orchestration tools such as Kubernetes. 
  • Knowledge of public cloud platforms. 
  • Experience with AI productivity tools (e.g., GitHub Copilot). 
  • Ability to work independently, drive workstreams, and deliver high quality outcomes. 
  • Strong communication and collaboration skills. 

What You’ll Bring 

(Preferred qualifications) 

  • Familiarity with messaging systems such as Kafka. 
  • Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs. 
  • A track record of influencing design decisions and driving engineering best practices. 
  • The ability to mentor engineers and guide them through design, planning, and execution. 
  • A proactive mindset and comfort working in fast paced, dynamic environments. 
  • Curiosity, adaptability, and a passion for building impactful AI-driven products. 


Read more
Quanteon Solutions
at Quanteon Solutions
1 recruiter
DurgaPrasad Sannamuri
Posted by DurgaPrasad Sannamuri
Hyderabad
2 - 5 yrs
₹5L - ₹25L / yr
Prompt engineering
skill iconMachine Learning (ML)
skill iconPython
Generative AI
Open-source LLMs
+15 more

Key Responsibilities:

  • Develop and deploy machine learning, deep learning, and NLP models for various business use cases.
  • Build end-to-end ML pipelines including data preprocessing, feature engineering, training, evaluation, and production deployment.
  • Optimize model performance and ensure scalability in production environments.
  • Work closely with data scientists, product teams, and engineers to translate business requirements into AI solutions.
  • Conduct data analysis to identify trends and insights.
  • Implement MLOps practices for versioning, monitoring, and automating ML workflows.
  • Research and evaluate new AI/ML techniques, tools, and frameworks.
  • Document system architecture, model design, and development processes.


Required Skills:

  • Strong programming skills in Python (NumPy, Pandas, Scikit-learn, TensorFlow, PyTorch, Keras).
  • Hands-on experience in building and deploying, finetuning ML/DL models in production.
  • Good understanding of machine learning algorithms, neural networks, NLP, and computer vision.
  • Experience with REST APIs, Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure).
  • Working knowledge of MLOps tools such as MLflow, Airflow, DVC, or Kubeflow.
  • Familiarity with data pipelines and big data technologies (Spark, Hadoop) is a plus.
  • Strong analytical skills and ability to work with large datasets.
  • Excellent communication and problem-solving abilities.
  • Experience in deploying models using cloud services (AWS Sagemaker, GCP Vertex AI, etc.).
  • Experience in LLM fine-tuning or Generative AI, Voice AI, is an added advantage.


Educational Qualification:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, AI, Machine Learning, IT, from IIT/NIT colleges strongly preferred
Read more
Pune
3 - 6 yrs
₹27L - ₹32L / yr
Artificial Intelligence (AI)

Strong AI Engineer / Machine Learning Engineer profiles.

2

Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

3

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

4

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

5

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

6

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

7

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

8

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

9

Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.

10

Mandatory (Age) - Candidate's Age should be below 28 Years

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos