Cutshort logo
For Employers
TalentXO logo
AI Engineer - RAG & LLM Systems
AI Engineer - RAG & LLM Systems

AI Engineer - RAG & LLM Systems at TalentXO · Mumbai · 3 - 7 years · ₹8L - ₹12L / yr · Profitable · Posted 28 Jul 2026

TalentXO's logo

AI Engineer - RAG & LLM Systems

tabbasum shaikh's profile picture
Posted by tabbasum shaikh
3 - 7 yrs
₹8L - ₹12L / yr
Mumbai
Skills
AI Engineer
LLM Engineer
RAG
AI/ML

Role & Responsibilities

We are building an AI-powered Artwork Validation Platform that reads global regulatory rules and validates product packaging using LLMs and Retrieval-Augmented Generation (RAG). We are looking for a hands-on AI Engineer with strong expertise in the LangChain ecosystem to design, orchestrate, and optimize intelligent AI workflows.

Key Responsibilities:

  • Design and build RAG pipelines for rule-based validation
  • Extract structured rules from PDF/XML/web sources using LLMs
  • Develop AI workflows using LangChain and LangGraph
  • Implement semantic search and embeddings for accurate retrieval
  • Use LangSmith for debugging, tracing, and evaluation
  • Prototype workflows using LangFlow
  • Generate explainable AI outputs for artwork validation
  • Optimize prompts and reduce hallucinations

Ideal Candidate

  • Strong AI Engineer / LLM Engineer profile with hands-on experience building RAG or LLM applications
  • Mandatory (Experience): Must have 3+ years of software engineering experience with atleast 6+ months in AI/ML, NLP, or deploying LLM based application
  • Mandatory (LLM & RAG): Must have strong hands-on experience building RAG pipelines, LLM workflows, semantic search, or AI-powered retrieval systems
  • Mandatory (LangChain Ecosystem): Must have hands-on experience with LangChain. Experience with LangGraph, LangSmith, and LangFlow is highly important
  • Mandatory (Vector DB & Embeddings): Must have worked on embeddings and vector databases like Pinecone, FAISS, Weaviate, ChromaDB, etc.
  • Mandatory (Programming): Strong Python skills with experience building AI/NLP pipelines or backend AI workflows
  • Mandatory (Data Processing): Must have experience working with unstructured data such as PDFs, HTML, XML, scanned documents, or web data
  • Mandatory (Prompt Engineering): Must have good understanding of prompt engineering, hallucination reduction, retrieval accuracy, and LLM evaluation
  • Mandatory (Company): Service or product companies acceptable given they have real AI/ML, LLM based experience
  • Mandatory (Note): Must be comfortable with a 6-day (3 days in office) hybrid work model. Mon-Friday 8:30-5:30 pm and Saturdays 8:30-1:00 pm
  • Preferred (Experience): Exposure to food compliance domain


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About TalentXO

Founded :
2018
Type :
Product
Size :
20-100
Stage :
Profitable

About

N/A

Company social profiles

N/A

Similar jobs (10)

Treosoft IT
Anish N
Posted by Anish N
Bengaluru (Bangalore)
3 - 5 yrs
₹10L - ₹20L / yr
skill iconPython
Generative AI
Agentic AI
LangChain
LlamaIndex
+3 more

Job Description:

We are looking for a hands-on AI Engineer with experience in Generative AI and Agentic AI to build and deploy production-ready AI solutions.

Key Responsibilities:

  • Develop and deploy GenAI and Agentic AI applications.
  • Build RAG pipelines, LLM workflows, and AI agents.
  • Develop solutions using Python, LangChain, LangGraph, LlamaIndex, or similar frameworks.
  • Implement tool calling, context retrieval, and LLM orchestration.
  • Integrate AI solutions with APIs and cloud platforms.
  • Work with AWS/Azure/GCP, Docker, and CI/CD.

Required Skills:

  • Strong Python programming skills.
  • 3+ years of GenAI/Agentic AI experience.
  • RAG and LLM orchestration.
  • LangChain / LangGraph / LlamaIndex / AutoGen / CrewAI / Semantic Kernel.
  • MCP and A2A knowledge.
  • Cloud, APIs, Docker, and CI/CD experience.

Preferred Experience:

Hands-on experience building and deploying production-ready AI solutions.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
4 - 12 yrs
₹4L - ₹25L / yr
skill iconData Science
skill iconPython
Large Language Models (LLM) tuning
RAG
Langchain

Support with design and build to prove out agentic AI solution flow by working with other data 

scientists and engineers to build, train Large Language Model (LLM) architectures, RAG 

systems, and autonomous agentic workflows 

Key qualifications: 

  

>> AI solution design & Development: Design Agentic AI solutions using RAG (Retrieval-

Augmented Generation) and orchestration frameworks like LangGraph or LangChain. 

  

>> Model Fine-Tuning: Solid understanding and experience with Pre-train, fine-tune, and 

optimize open-source like BERT, LLama, and other proprietary foundation models for domain-

specific tasks 

  

>> Solid Stats and ML foundations and (vibe) coding skills with Python, PySpark 

  

>>  Implement validation frameworks and tracing practices (using tools like Arize) to monitor 

agent behavior, guard against model drift, and ensure compliance 

  

>> Collaborate with Engineering to deploy models securely on cloud and on-prem ecosystems 

 

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Shakthi M
Posted by Shakthi M
Mumbai
5 - 13 yrs
Best in industry
AIML
skill iconPython
Lang chain

Role Overview

We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.

Key Responsibilities

  • Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
  • Build LLM-based applications and AI agents using LangChain and LangGraph.
  • Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
  • Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
  • Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
  • Work with embeddings, prompt engineering, semantic search, and document processing.
  • Develop scalable APIs and backend services using Python, FastAPI, or Flask.
  • Build and integrate AI solutions with existing applications and enterprise systems.
  • Deploy and maintain AI/ML solutions on cloud platforms.
  • Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.

Required Skills

  • Strong hands-on experience in Python programming.
  • Strong experience in AI/ML and Generative AI.
  • Hands-on experience with LLMs and LLM-based application development.
  • Strong experience with LangChain and/or LangGraph.
  • Experience building AI Agents / Agentic AI workflows.
  • Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
  • Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
  • Experience developing REST APIs using FastAPI/Flask.
  • Good understanding of Machine Learning, NLP, and deep learning concepts.
  • Experience with Azure / AWS / GCP cloud platforms.

Good to Have

  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of MLOps / LLMOps.
  • Experience with Docker, Kubernetes, and CI/CD.
  • Knowledge of LLM evaluation, monitoring, observability, and AI governance.
  • Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
4 - 6 yrs
₹2L - ₹13L / yr
skill iconPython
Generative AI
Large Language Models (LLM) tuning
Agentic AI
LangGraph
+6 more

Role Overview

We are looking for a Python Developer with strong experience in Generative AI and LLM-based applications. The candidate should have hands-on experience building AI solutions using Python, RAG, LangChain/LangGraph, and related GenAI technologies.

Mandatory Skills

Python, GenAI/LLM, RAG, LangChain/LangGraph, Agentic AI, FastAPI, REST API, Vector Database, Prompt Engineering, Microservices

Key Responsibilities

  • Develop and maintain applications using Python and modern frameworks.
  • Build GenAI/LLM-based applications and solutions.
  • Develop RAG pipelines using vector databases.
  • Work with LangChain/LangGraph for LLM and agent-based applications.
  • Develop and integrate REST APIs using FastAPI.
  • Implement Agentic AI workflows and AI-powered features.
  • Integrate LLMs with existing applications and microservices.
  • Apply prompt engineering techniques to improve AI application performance.


Read more
Kuku FM
Waseem Shariff
Posted by Waseem Shariff
Mumbai
1 - 3 yrs
₹15L - ₹24L / yr
Generative AI
Retrieval Augmented Generation (RAG)
LangGraph
LangChain
Large Language Models (LLM) tuning
+3 more

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.


Responsibilities

  • Build and iterate on prompt pipelines and multi-agent workflow components
  • Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
  • Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
  • Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
  • Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
  • Debug and maintain pipeline stages in production


What you bring:  

  • (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
  • Solid Python fundamentals clean, working, readable code
  • Hands-on experience with LLM APIs and prompt engineering (personal projects count)
  • Comfort with Git, REST APIs, and working in a Linux environment
  • A feel for content and narrative you can judge whether generated output is actually good, not just valid
  • Curiosity and clear communication you ask good questions and don't stay stuck silently


 Preferred

  • Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
  • Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
  • Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
  • Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
  • Experience writing evals or LLM-as-judge scoring
  • Node.js and Fastapi familiarity, or experience deploying on AWS


Read more
Transcurators
Asees Kaur
Posted by Asees Kaur
Remote only
2 - 9 yrs
₹7L - ₹35L / yr
Large Language Models (LLM)
Agentic AI
LangChain
skill iconPython
Multi-agent Systems

Applied AI Engineer

About the Role

We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.

We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.

As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.


Key Responsibilities

  • Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
  • Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
  • Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
  • Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
  • Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
  • Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
  • Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
  • Deploy and maintain AI services on AWS or Azure.
  • Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.


Required Qualifications

  • 5+ years of professional software development experience in Python or JavaScript.
  • Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
  • Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
  • Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
  • Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
  • Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
  • Familiarity with MCP and human-in-the-loop workflows.
  • Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.


Good to Have

  • Experience with RLHF or RLAIF.
  • Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
  • Experience with graph databases and graph-based data models.
  • Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.


Why Join Us?

  • Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
  • Build foundational AI architecture and production-grade LLM workflows.
  • Take ownership of technical decisions and system design as an early engineering team member.
  • Solve challenging problems at the intersection of AI, finance, and intelligent automation.


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
6 - 12 yrs
₹10L - ₹15L / yr
skill iconData Science
skill iconPython
Agentic AI

🚨 Hiring – Data Scientist | Python + Agentic AI

💼 Experience: 5+ Years

Must Have:

• Strong Data Science experience

• Python

• Agentic AI / AI Agents

• Generative AI / LLMs

• RAG / Vector Databases

• LangChain / LangGraph or similar Agent Frameworks

• Machine Learning & NLP

Read more
Bengaluru (Bangalore)
5 - 8 yrs
₹2L - ₹15L / yr
skill iconPython
Generative AI (GenAI)
PYTHON DEVELOPER
RAG, LangChain/LangGraph, Agentic AI,

Job Summary

We are looking for a skilled Python Developer with experience in Generative AI and Agentic AI to develop AI-powered applications and scalable backend services.

Mandatory Skills

  • Python
  • Generative AI (GenAI) / Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • LangChain / LangGraph
  • Agentic AI
  • FastAPI
  • REST API development
  • Vector Databases
  • Prompt Engineering
  • Microservices

Key Responsibilities

  • Develop and maintain Python-based applications and backend services.
  • Build GenAI/LLM-powered applications and AI solutions.
  • Implement RAG pipelines for document processing and information retrieval.
  • Develop AI agents using LangChain/LangGraph and Agentic AI frameworks.
  • Build and integrate REST APIs using FastAPI.
  • Work with vector databases for embeddings, semantic search, and retrieval.
  • Design and optimize prompts to improve LLM response quality.
  • Develop scalable microservices and integrate AI models into applications.
  • Collaborate with cross-functional teams to deliver AI-based solutions.
  • Troubleshoot, test, and optimize application performance.

Required Qualifications

  • 4–6 years of experience in Python development.
  • Hands-on experience with GenAI/LLMs, RAG, and Agentic AI.
  • Practical experience with LangChain/LangGraph, FastAPI, and REST APIs.
  • Knowledge of vector databases, prompt engineering, and microservices.
  • Strong problem-solving and debugging skills.
  • Ability to develop and deploy production-ready AI applications.
Read more
Unico Connect Private Limited
Remote, Mumbai
2 - 4 yrs
Best in industry
skill iconPython
Large Language Models (LLM)
Generative AI
LangGraph
FastAPI
+7 more

AI Engineer

LLMs, Agents & AI Services

📍 Mumbai (On-site) | Full-time | 2-4 years


About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

AI is core to how we design, deliver, and scale software for our customers.

We are hiring an AI Engineer for a dedicated client engagement building a complex production AI platform, working on the AI capabilities and agentic features at the core of the product.

The mandatory requirement for this role is at least one AI feature personally shipped to production for real users, with operational ownership.

The role suits someone who thinks quickly on solutioning, can take an ambiguous problem to a working prototype in days, and has the discipline to carry it through to production with predictable economics.

You will work alongside the Senior AI Engineer and the wider pod, with ownership of parts of the AI surface area of the product.


Responsibilities:

Solutioning and POCs

Translate ambiguous customer problems into working POCs at speed.

Pick the right model, framework, and architecture, and demonstrate value early before scaling investment.


LLM Application Development

Build AI features and services using LLM APIs from OpenAI, Anthropic, Google, and self-hosted open-weight models (Llama, Qwen, Mistral).

Choose the right model per use case based on cost, latency, capability, and context-window trade-offs.


Agentic System Design

Design and implement agentic workflows using LangGraph, CrewAI, AutoGen, LlamaIndex Agents, or custom orchestration.

Cover tool use, planning, memory, and multi-step reasoning appropriate to the problem.


API and Service Development

Build production AI services and APIs using Python and FastAPI.

Handle streaming responses, async processing, structured outputs, retries, and graceful degradation when models or tools fail.


Retrieval and Tool Integration

Implement RAG pipelines with vector databases (Pinecone, Weaviate, Qdrant, pgvector, Chroma), embeddings, chunking strategies, hybrid search, and reranking.

Integrate external tools, internal APIs, and document sources through tool-calling and MCP-style patterns.


Cost Analysis and Unit Economics

Model the per-request and per-user cost of every AI feature before it ships.

Track token usage, prompt caching, batching, and model-routing strategies.

Drive measurable improvements in unit economics.


Production Hardening

Add observability and tracing (LangSmith, Langfuse, OpenTelemetry), guardrails, content safety checks, prompt injection defences, and fallback behaviour.


Prompt Engineering and Evaluation

Design, test, and iterate prompts with measured outcomes.

Build evaluation harnesses for accuracy, hallucination, latency, and cost.

Run benchmarks across models and prompt variants before locking in a design.


Requirements:

AI Feature Shipped to Production (Mandatory)

Must have personally built and shipped at least one AI feature that runs in production for real users, with operational ownership.

POCs, internal demos, and one-off scripts do not qualify.


2 to 4 Years of Professional Software or AI Engineering Experience

With at least one production AI feature owned end to end.


Strong Python Proficiency and API Development with FastAPI

Comfort with type hints, async, packaging, testing, streaming responses, and authentication.

Production-grade Python, not notebook-only code.


Hands-on Depth Across the LLM and Agent Stack

Working experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or self-hosted open-weight models (vLLM, Ollama, Together, Replicate).

Working familiarity with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.

Working knowledge of RAG, embeddings, and vector databases (Pinecone, Weaviate, Qdrant, pgvector, Chroma).


Solutioning Speed and POC Velocity

Demonstrated ability to move from a fuzzy problem to a working prototype in days.

Strong instinct for what to build first, what to defer, and what to throw away.


Cost Discipline for Production AI

Ability to calculate, monitor, and optimise the cost of LLM APIs, tokens, embeddings, vector store usage, and infrastructure.

Treats unit economics as a first-class concern.


AWS Familiarity

Working knowledge of EC2, S3, IAM, and at least one of Bedrock, SageMaker, or equivalent.


Comfortable in a Fast-Moving Environment

Self-directed, comfortable with ambiguity, takes ownership without being asked, and ships under shifting priorities.


Strong Written and Spoken English Communication

Able to explain trade-offs to non-AI engineers, designers, product managers, and clients in plain language.


Nice to Have

  • fine-tuning or LoRA, QLoRA, PEFT exposure
  • MCP server authoring
  • eval framework experience (LangSmith, Promptfoo, Ragas, DeepEval)
  • open-source AI contributions
  • multi-modal models (vision, audio)
Read more
Unico Connect Private Limited
Mumbai
5 - 8 yrs
Best in industry
skill iconPython
Large Language Models (LLM)
Artificial Intelligence (AI)
Prompt engineering
LangGraph
+6 more

Senior AI Engineer

Code Generation, Agent Architecture & LLM Systems

📍 Mumbai (On-site) | Full-time | 5+ years


About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.

The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.


The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.

You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.


Responsibilities:


Agent Architecture

Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.

Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.


Code Generation Pipeline

Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.

Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.

Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.


Self-Repair Loop

Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.

This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.


Context Management

Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.

Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.

Own token budgeting and prompt caching strategy.


Prompt Engineering as a Discipline

Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).

Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.

Version prompts like code with changelogs and rollback capability.


Evaluation and Quality Measurement

Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.

Define regression gates that block quality-degrading changes from shipping.

Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.

This responsibility is non-negotiable at this level.


Model Strategy and Cost

Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.

Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.

Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.


Safety and Reliability of Agent Behaviour

Defend against prompt injection from user content and fetched web content.

Ensure secrets never appear in generated client code.

Define what the agent's tools may and may not do in collaboration with the platform team.

Contribute to output moderation and abuse-pattern awareness.


Mentorship and Engineering Standards

Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.

Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.


Requirements:


Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)

Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.

POCs, internal demos, and tutorial-grade work do not qualify.


5+ Years of Professional Software or AI Engineering Experience

With at least 3 years focused on LLM applications, AI engineering, or production AI systems.

Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.


Strong Python Proficiency and Service Development

Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.

Not notebook-only.


Depth Across LLM APIs and Agent Systems

Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).

Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.

Hands-on with tool calling, structured outputs, and multi-step reasoning.


Demonstrated, Systematic Evaluation Practice - Non-Negotiable

Must have built evaluation harnesses that gate production releases, not ad-hoc testing.

Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.

Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.


Cost Discipline for Production AI

Track record of measurable cost optimisation on production AI features.

Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.


AWS Working Knowledge

Hands-on with EC2, S3, IAM, and Docker.

Comfort with CI/CD workflows and deploying AI services.


Awareness of LLM Security Failure Modes

Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.


Nice to Have

  • Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
  • MCP server authoring
  • Open-source AI contributions
  • Published technical writing on LLM systems
  • Multi-modal model experience
  • Fine-tuning exposure (LoRA, QLoRA, PEFT)
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos