Cutshort logo
For Employers
Talent Pro  logo
AI Runtime Lead (LLM DevOps pytorch
AI Runtime Lead (LLM DevOps pytorch

AI Runtime Lead (LLM DevOps pytorch at Talent Pro · Bengaluru (Bangalore) · 4 - 8 years · ₹11L - ₹17L / yr · Bootstrapped · Posted 6 Jan 2026

Talent Pro 's logo

AI Runtime Lead (LLM DevOps pytorch

Mayank choudhary's profile picture
Posted by Mayank choudhary
4 - 8 yrs
₹11L - ₹17L / yr
Bengaluru (Bangalore)
Skills
Large Language Models (LLM)
skill iconPython

Mandatory (Experience 1) – Must have 4+ years of software engineering experience

Mandatory (Experience 2) – Must have proven1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale

Mandatory (Experience 3) – Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc

Mandatory (Experience 4) – Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability

Mandatory (Team Lead) – Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership

Mandatory (Programming Skills) – Must have strong programming skills in Python, Java, C++ , etc

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Talent Pro

Founded :
2024
Type :
Services
Size
Stage :
Bootstrapped

About

N/A

Company social profiles

bloglinkedin

Similar jobs (10)

icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Remote only
6 - 12 yrs
₹45L - ₹50L / yr
skill iconPython
skill iconReact.js
skill iconJavascript
API management
RESTful APIs

About the Role

We are seeking a hands-on Tech Lead to design, build, and integrate AI-driven systems that automate and enhance real-world business workflows. This is a high-impact role for someone who enjoys full-stack ownership — from backend AI architecture to frontend user experiences — and can align engineering decisions with measurable product outcomes.

You will begin as a strong individual contributor, independently architecting and deploying AI-powered solutions. As the product portfolio scales, you will lead a distributed team across India and Australia, acting as a System Integrator to align engineering, data, and AI contributions into cohesive production systems.

Example Project

Design and deploy a multi-agent AI system to automate critical stages of a company’s sales cycle, including:

  • Generating client proposals using historical SharePoint data and CRM insights
  • Summarizing meeting transcripts
  • Drafting follow-up communications
  • Feeding structured insights into dashboards and workflow tools

The solution will combine RAG pipelines, LLM reasoning, and React-based interfaces to deliver measurable productivity gains.

Key Responsibilities

  • Architect and implement AI workflows using LLMs, vector databases, and automation frameworks
  • Act as a System Integrator, coordinating deliverables across distributed engineering and AI teams
  • Develop frontend interfaces using React/JavaScript to enable seamless human-AI collaboration
  • Design APIs and microservices integrating AI systems with enterprise platforms (SharePoint, Teams, Databricks, Azure)
  • Drive architecture decisions balancing scalability, performance, and security
  • Collaborate with product managers, clients, and data teams to translate business use cases into production-ready systems
  • Mentor junior engineers and evolve into a broader leadership role as the team grows

Ideal Candidate Profile

Experience Requirements

  • 5+ years in full-stack development (Python backend + React/JavaScript frontend)
  • Strong experience in API and microservice integration
  • 2+ years leading technical teams and coordinating distributed engineering efforts
  • 1+ year of hands-on AI project experience (LLMs, Transformers, LangChain, OpenAI/Azure AI frameworks)
  • Prior experience in B2B SaaS environments, particularly in AI, automation, or enterprise productivity solutions

Technical Expertise

  • Designing and implementing AI workflows including RAG pipelines, vector databases, and prompt orchestration
  • Ensuring backend and AI systems are scalable, reliable, observable, and secure
  • Familiarity with enterprise integrations (SharePoint, Teams, Databricks, Azure)
  • Experience building production-grade AI systems within enterprise SaaS ecosystems




Read more
Quanteon Solutions
at Quanteon Solutions
1 recruiter
DurgaPrasad Sannamuri
Posted by DurgaPrasad Sannamuri
Hyderabad
2 - 5 yrs
₹5L - ₹25L / yr
Prompt engineering
skill iconMachine Learning (ML)
skill iconPython
Generative AI
Open-source LLMs
+15 more

Key Responsibilities:

  • Develop and deploy machine learning, deep learning, and NLP models for various business use cases.
  • Build end-to-end ML pipelines including data preprocessing, feature engineering, training, evaluation, and production deployment.
  • Optimize model performance and ensure scalability in production environments.
  • Work closely with data scientists, product teams, and engineers to translate business requirements into AI solutions.
  • Conduct data analysis to identify trends and insights.
  • Implement MLOps practices for versioning, monitoring, and automating ML workflows.
  • Research and evaluate new AI/ML techniques, tools, and frameworks.
  • Document system architecture, model design, and development processes.


Required Skills:

  • Strong programming skills in Python (NumPy, Pandas, Scikit-learn, TensorFlow, PyTorch, Keras).
  • Hands-on experience in building and deploying, finetuning ML/DL models in production.
  • Good understanding of machine learning algorithms, neural networks, NLP, and computer vision.
  • Experience with REST APIs, Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure).
  • Working knowledge of MLOps tools such as MLflow, Airflow, DVC, or Kubeflow.
  • Familiarity with data pipelines and big data technologies (Spark, Hadoop) is a plus.
  • Strong analytical skills and ability to work with large datasets.
  • Excellent communication and problem-solving abilities.
  • Experience in deploying models using cloud services (AWS Sagemaker, GCP Vertex AI, etc.).
  • Experience in LLM fine-tuning or Generative AI, Voice AI, is an added advantage.


Educational Qualification:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, AI, Machine Learning, IT, from IIT/NIT colleges strongly preferred
Read more
Teradata
pranil gavade
Posted by pranil gavade
Bengaluru (Bangalore), Pune, Hyderabad, Mumbai
5 - 10 yrs
₹45L - ₹60L / yr
skill iconJava
skill iconGo Programming (Golang)
skill iconPython
RESTful APIs
SQL
+4 more

Solid product experience and an educational background from Tier‑1 universities are preferred.


As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities. 

In this role, you will: 

  • Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance. 
  • Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features. 
  • Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability. 
  • Work with SQL and NoSQL databases to implement efficient data models and service access patterns. 
  • Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs). 
  • Use AI powered engineering tools to improve development quality, speed, and productivity. 
  • Mentor engineers, supporting them in technical planning, implementation, and best practices. 
  • Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure. 
  • Write unit and integration tests and participate in code reviews to uphold engineering excellence. 
  • Investigate production issues, ensuring timely and effective solutions. 
  • Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies. 

Who You’ll Work With 

You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction. 

What Makes You a Qualified Candidate 

(Nonnegotiable qualifications) 

  • Bachelor’s degree in Computer Science or equivalent from a recognized institution. 
  • 5+ years of experience in backend services, distributed systems, or data platform development. 
  • Strong proficiency in Java, Go, or Python for service development. 
  • Good understanding of design principles, distributed system patterns, and service framework. 
  • Hands-on experience designing and developing RESTful APIs. 
  • Experience with SQL and NoSQL databases and data modelling. 
  • Strong debugging, problem solving, and troubleshooting skills. 
  • Experience with modern containerization and orchestration tools such as Kubernetes. 
  • Knowledge of public cloud platforms. 
  • Experience with AI productivity tools (e.g., GitHub Copilot). 
  • Ability to work independently, drive workstreams, and deliver high quality outcomes. 
  • Strong communication and collaboration skills. 

What You’ll Bring 

(Preferred qualifications) 

  • Familiarity with messaging systems such as Kafka. 
  • Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs. 
  • A track record of influencing design decisions and driving engineering best practices. 
  • The ability to mentor engineers and guide them through design, planning, and execution. 
  • A proactive mindset and comfort working in fast paced, dynamic environments. 
  • Curiosity, adaptability, and a passion for building impactful AI-driven products. 


Read more
IT Service
IT Service
Agency job
via spectrum talent management by Swati Shrivastava
Bengaluru (Bangalore)
6 - 12 yrs
₹15L - ₹25L / yr
Google Vertex AI
  • Senior Machine Learning Engineer – Vertex AI
  • Senior Generative AI Engineer – GCP
  • Google Cloud AI/ML Engineer
  • MLOps Engineer – Vertex AI
  • LLM Engineer – RAG, Gemini, and Vertex AI


Read more
E2M Solutions Pvt. Ltd.
Zankhan Kukadiya
Posted by Zankhan Kukadiya
Ahmedabad
5 - 8 yrs
₹25L - ₹30L / yr
Team leadership
Systems architecture
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
skill iconDeep Learning
+5 more

About the Company:

E2M Solutions works as a trusted white-label partner for digital agencies. We support agencies with consistent and reliable delivery through services such as website design, web development, eCommerce, SEO, AI SEO, PPC, AI automation, and content writing. Founded on strong business ethics, we are an equal opportunity organization powered by 300+ experienced professionals, partnering with 400+ digital agencies across the US, UK, Canada, Europe, and Australia. At E2M, we value ownership, consistency, and people who are committed to doing meaningful work and growing together. If you’re someone who dreams big and has the gumption to make them come true, E2M has a place for you.


About the Role:

We are seeking a highly skilled Technical Lead – AI who combines deep technical expertise in AI/ML with strong leadership capabilities. The ideal candidate will be responsible for designing AI architectures, leading development teams, and ensuring the successful implementation of AI-driven solutions. This role requires a hands-on technical leader who can guide engineers, solve complex AI problems, and collaborate with cross-functional teams to translate business needs into innovative AI solutions.


Responsibilities:

Technical Leadership:

  • Lead the design and development of AI/ML solutions and intelligent automation systems.
  • Provide technical guidance and mentorship to AI engineers and developers.
  • Conduct architecture reviews, code reviews, and technical evaluations.
  • Ensure adoption of best practices in AI model development, testing, and deployment.


AI Solution Development:

  • Design and implement machine learning, deep learning, and generative AI models.
  • Develop AI-powered solutions such as chatbots, recommendation engines, NLP systems, and predictive analytics models.
  • Work on LLM-based applications, prompt engineering, and AI workflow automation.
  • Build scalable AI APIs and production-ready AI systems.


Innovation & Research:

  • Stay updated with the latest advancements in AI, Machine Learning, and Generative AI technologies.
  • Evaluate new tools, frameworks, and technologies to enhance AI capabilities within the organization.
  • Contribute to internal AI initiatives and innovation projects.


Required Qualifications:

  • 6–8 years of experience in Artificial Intelligence, Machine Learning, or Data Science.
  • At least 2 years of experience in a technical leadership or senior engineering role.
  • Proven experience building production-level AI applications.


Required Skills:

  • Strong programming experience in Python.
  • Hands-on experience with Machine Learning frameworks such as, TensorFlow, PyTorch, Scikit-learn
  • Experience working with Generative AI and Large Language Models (LLMs), LangChain, Llama Index, or similar AI orchestration frameworks.
  • Strong knowledge of Natural Language Processing (NLP).
  • Experience building AI APIs and integrating AI into applications.
  • Familiarity with vector databases, embeddings, and RAG architectures.
  • Hands on knowledge of Full Stack Development.



Read more
Incubyte
at Incubyte
4 recruiters
Sandli Srivastava
Posted by Sandli Srivastava
Remote only
3 - 6 yrs
Best in industry
skill iconPython
Artificial Intelligence (AI)
skill iconReact.js
TypeScript
skill iconJavascript

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 


Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 


Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 


Experience Level


This role is ideal for engineers with total 3+ years of experience with a proven track record of shipping complex projects successfully.

An experienced individual contributor and leader who thrives in large, complex projects with widespread impact.


What You’ll Do as a Software Craftsperson 


  • Design and build high-quality, maintainable systems using disciplined engineering practices such as TDD, continuous refactoring, and pair programming 
  • Operate in an AI-native development model, using AI as a collaborator to explore architecture and design, accelerate development, and continuously improve systems while applying strong judgment to ensure that speed never compromises quality 
  • Take end-to-end ownership of outcomes from problem understanding and system design to implementation, deployment, and operation in production 
  • Make thoughtful design decisions that balance simplicity, scalability, and long-term maintainability in real-world systems 
  • Maintain a high bar for engineering quality through rigorous testing, code reviews, and continuous feedback 
  • Investigate and resolve production issues, and implement systemic improvements to prevent recurrence 
  • Work directly with clients, navigate ambiguity, and translate business problems into well-designed technical solutions 
  • Contribute to improving team practices, tooling, and systems to raise the overall quality and effectiveness of engineering 


Requirements


What You’ll Bring 


  • 3+ years of experience building high-quality, production systems (flexible based on demonstrated capability) 
  • Strong fundamentals in software engineering, including object-oriented design, system design, and testing practices such as TDD 
  • Demonstrated ability to build simple, maintainable, and scalable systems with a focus on long-term reliability 
  • Proficiency in one or more modern technologies, Python, PHP, JavaScript, or TypeScript, with the ability to learn new technologies quickly 
  • Deep experience working with Git in collaborative environments, including managing shared codebases, conducting code reviews, and maintaining a high bar for quality 
  • Ability to operate effectively in an AI-native workflow using AI as a collaborator to explore solutions and accelerate development, while applying strong judgment to ensure correctness, quality, and maintainability 
  • Clear thinking and strong problem-solving ability, with the capacity to break down complex problems into simple, well-structured solutions 
  • A strong sense of ownership — you take responsibility for outcomes, care deeply about quality, and are not comfortable shipping work that does not meet your standards.



Benefits


Life at Incubyte 


We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 

Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 


Perks

  • Dedicated learning & development budget. 
  • Sponsorship for conference talks. 
  • Comprehensive medical & term insurance. 
  • Employee-friendly leave policies. 
  • Home Office fund 
  • Medical Insurance
Read more
Blitzy
at Blitzy
2 candid answers
1 product
Taher Ujjainwala
Posted by Taher Ujjainwala
Pune
12 - 25 yrs
₹70L - ₹120L / yr (ESOP available)
skill iconPython
skill iconKubernetes
Google Cloud Platform (GCP)
skill iconAmazon Web Services (AWS)
Windows Azure
+15 more

About the Role

We are hiring Staff / Principal Engineers to take full, hands-on ownership of Blitzy's most critical production-grade systems and to deliver high-leverage features that materially improve customer outcomes and engineering velocity. This is the most senior individual contributor role at the company today.

This is not a Senior-plus role, an architecture-only role, or a promotion-track role. We are looking for someone who has already operated at Principal / Staff+ scope in a highly technical environment and expects to spend their time writing, reviewing, and shipping production code.

This role is 100% hands-on. Leverage comes from system ownership, execution quality, and durable technical decisions — not people management or process.


Responsibilities

  • Own mission-critical production systems end-to-end, ensuring correctness, scalability, performance, reliability, and operational excellence.
  • Design, build, and ship high-impact backend systems and features that improve product reliability, performance, and customer value.
  • Architect scalable services and cloud infrastructure using technologies such as Python, REST, gRPC, Kubernetes, and Terraform.
  • Identify and resolve complex technical bottlenecks that limit engineering quality, system performance, or organizational velocity.
  • Build and operate LLM-powered systems and validation loops that evaluate correctness, consistency, durability, and production performance.
  • Design and evolve data architectures incorporating relational, NoSQL, graph, and vector databases to support complex enterprise applications and semantic retrieval.
  • Modernize and improve complex enterprise systems while balancing reliability, maintainability, scalability, and delivery speed.
  • Set and uphold engineering quality standards through hands-on technical leadership, sound technical judgment, and ownership of long-term technical decisions.


Qualifications

  • Direct experience with Python as a primary programming language, backend frameworks, and microservices architectures.
  • Expertise in REST and gRPC, with proficiency in Node.js and JavaScript.
  • Proficiency in GCP, along with experience using at least one additional cloud platform such as AWS or Azure.
  • Advanced knowledge of Kubernetes and Terraform in production environments.
  • Experience operating highly available production systems, including monitoring, scalability, reliability, performance optimization, and operational tooling.
  • Strong knowledge of SQL and NoSQL databases, including PostgreSQL, MySQL, MongoDB, Cassandra, or DynamoDB.
  • Familiarity with graph databases such as Neo4j and vector databases or embedding infrastructure for semantic search and retrieval.
  • Hands-on experience building and operating LLM-powered systems in production, including evaluation, validation, regression testing, tracing, and failure analysis.
  • Working knowledge of LangSmith or comparable LLM observability and evaluation tools; familiarity with OpenAI, Anthropic, or similar model providers is a plus.
  • Ability to contribute across the full stack, with a strong understanding of frontend architecture and the ability to debug, design, and ship across frontend, backend, infrastructure, and AI systems.
  • Understanding of large-scale enterprise software systems, including architecture, integration, deployment, modernization, and long-term maintainability.
  • Proven track record of operating at Staff+, Principal Engineer, or equivalent level, independently driving complex technical initiatives and delivering high-impact outcomes with minimal supervision.


Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into enterprise grade code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups.


Our Culture

Who we are:

Led by two pioneering co-founders we are one of the fastest growing companies in the U.S., creating our own category of enterprise autonomous software development. We automate thousands of hours of software development for our customers, which includes strong representation within the Fortune 500.


How we work:

  • We move Blitzy Fast: Time is both our company’s and our clients’ most precious asset. We move quickly and decisively to innovate internally and deliver exceptional software externally.
  • Championship Mindset: We operate like a professional sports team. We win as a team by holding ourselves and each other to high standards, collaborating in-person, and remaining focused on the mission.
  • Passion for Invention: We’re pushing the frontier of what’s possible, requiring constant innovation and iteration.
  • We Work for the Customer: We focus on delivering outsized value to the customers we work with and expanding those relationships into deep, meaningful partnerships.
  • We believe in being ‘everyday athletes’: taking care of ourselves so we can bring our best minds to work. We promote great sleep, movement, and restorative activities for 


Blitzy is an equal opportunity employer committed to building a diverse and inclusive team. We believe different perspectives make us stronger.

Read more
Pune
3 - 6 yrs
₹27L - ₹32L / yr
Artificial Intelligence (AI)

Strong AI Engineer / Machine Learning Engineer profiles.

2

Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

3

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

4

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

5

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

6

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

7

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

8

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

9

Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.

10

Mandatory (Age) - Candidate's Age should be below 28 Years

Read more
Unico Connect Private Limited
Mumbai
5 - 8 yrs
Best in industry
skill iconPython
Large Language Models (LLM)
Artificial Intelligence (AI)
Prompt engineering
LangGraph
+6 more

Senior AI Engineer

Code Generation, Agent Architecture & LLM Systems

📍 Mumbai (On-site) | Full-time | 5+ years


About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.

The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.


The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.

You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.


Responsibilities:


Agent Architecture

Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.

Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.


Code Generation Pipeline

Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.

Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.

Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.


Self-Repair Loop

Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.

This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.


Context Management

Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.

Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.

Own token budgeting and prompt caching strategy.


Prompt Engineering as a Discipline

Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).

Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.

Version prompts like code with changelogs and rollback capability.


Evaluation and Quality Measurement

Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.

Define regression gates that block quality-degrading changes from shipping.

Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.

This responsibility is non-negotiable at this level.


Model Strategy and Cost

Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.

Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.

Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.


Safety and Reliability of Agent Behaviour

Defend against prompt injection from user content and fetched web content.

Ensure secrets never appear in generated client code.

Define what the agent's tools may and may not do in collaboration with the platform team.

Contribute to output moderation and abuse-pattern awareness.


Mentorship and Engineering Standards

Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.

Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.


Requirements:


Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)

Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.

POCs, internal demos, and tutorial-grade work do not qualify.


5+ Years of Professional Software or AI Engineering Experience

With at least 3 years focused on LLM applications, AI engineering, or production AI systems.

Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.


Strong Python Proficiency and Service Development

Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.

Not notebook-only.


Depth Across LLM APIs and Agent Systems

Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).

Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.

Hands-on with tool calling, structured outputs, and multi-step reasoning.


Demonstrated, Systematic Evaluation Practice - Non-Negotiable

Must have built evaluation harnesses that gate production releases, not ad-hoc testing.

Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.

Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.


Cost Discipline for Production AI

Track record of measurable cost optimisation on production AI features.

Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.


AWS Working Knowledge

Hands-on with EC2, S3, IAM, and Docker.

Comfort with CI/CD workflows and deploying AI services.


Awareness of LLM Security Failure Modes

Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.


Nice to Have

  • Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
  • MCP server authoring
  • Open-source AI contributions
  • Published technical writing on LLM systems
  • Multi-modal model experience
  • Fine-tuning exposure (LoRA, QLoRA, PEFT)
Read more
Gurugram
4 - 8 yrs
₹15L - ₹25L / yr
Generative AI
Agentic AI
skill iconAmazon Web Services (AWS)
skill iconPython

Job Summary

We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.

Key Responsibilities

  • Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
  • Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
  • Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
  • Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
  • Integrate AI/ML models with enterprise applications and APIs.
  • Fine-tune and evaluate ML/LLM models based on business requirements.
  • Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
  • Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
  • Conduct model performance evaluation, optimization, and troubleshooting.
  • Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
  • Stay current with emerging AI/ML technologies, frameworks, and industry best practices.

Required Skills

  • Strong programming experience in Python.
  • Strong understanding of Machine Learning algorithms, statistics, and data structures.
  • Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
  • Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
  • Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
  • Experience with NLP, deep learning, or computer vision is an advantage.
  • Experience developing and consuming REST APIs and microservices.
  • Working knowledge of SQL and NoSQL databases.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Understanding of Docker, Kubernetes, CI/CD, and MLOps.
  • Familiarity with Git and modern software development practices.

Preferred Qualifications

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
  • 4 years of relevant experience in AI/ML engineering or a related field.
  • Experience building and deploying production-grade AI/ML solutions.
  • Enterprise application development experience.
  • Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
  • Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
  • Experience with AI/ML model monitoring, evaluation, and optimization.

What You Bring

  • Strong problem-solving and analytical skills.
  • Ability to translate business requirements into practical AI/ML solutions.
  • Strong software engineering and debugging capabilities.
  • Ability to work independently as well as collaboratively in a cross-functional environment.
  • Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.

Keywords

AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI

 

Location: Gurugram

Work mode: Hybrid


Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos