GenAI Engineer at KDK Software · Jaipur · 3 - 8 years · ₹10L - ₹12L / yr · Profitable · Posted 8 Aug 2026

Job Description – AI Engineer (End-to-End Development & Deployment)
Role Summary
We are looking for an AI Engineer with hands-on experience in designing, developing, deploying, and maintaining Generative/Agentic AI solutions in production. The ideal candidate should have end-to-end ownership of AI applications, from development to deployment, monitoring, and optimization.
Key Responsibilities
● Design, build, and deploy Generative/Agentic AI solutions.
● Develop applications using LLMs, RAG, AI agents, and vector databases.
● Build scalable APIs and integrate AI solutions with enterprise applications.
● Implement CI/CD pipelines, containerization, and MLOps best practices.
● Monitor, optimize, and maintain production AI systems.
● Collaborate with cross-functional teams to deliver business-driven AI solutions.
Required Skills
● Strong programming skills in Python.
● Experience with vector databases (e.g., Pinecone, FAISS, ChromaDB) and graph memory systems
● Knowledge of atleast one agent development framework: Google ADK (preferred), LangChain/LangGraph/LlamaIndex, CrewAI
● Experience with LLMs, RAG, GenAI, AgenticAI Agents
● Hands-on experience with FastAPI, and REST APIs.
● Knowledge of Docker, Kubernetes, Git, CI/CD.
● Experience with AWS, Azure, or GCP.
● Experience with security compliance, monitoring and observability tools such as AWS CloudWatch, Azure Monitor, Google Cloud Monitoring.

About KDK Software
About
Similar jobs (10)
Location: Pune / Gurgaon
Position: AI Engineer
work mode: WFO
Job Description.
Job responsibilities:
- Responsibility for design, implementation and deployment of Generative AI, Agentic frameworks at scale
- Strong in programming - Python a
- Previous experience of working on Computer Vision projects and VLM /VLAM models.
- In depth awareness of Transformer architectures and End to End Deep neural networks
- Full stack AI / ML development experience
- Design, build & maintain efficient and reliable Agentic / Generative AI code leveraging pipelines
- Hosting and deployment knowledge in GCP or AWS or Azure along with advanced engineering concepts to build user friendly UI interface for easy adoption.
Requirements:
· 4 to 8 years overall years of experience (Agentic AI, Generative AI, VLM, VLAM and LLM) with significant exposure in Development, Architecture design, scaling and hosting in cloud.
Must Have –
· Architecting and solutioning experience with Python and FAST API, Agentic Ai frameworks, VLMs, VLAMs, Open source LLM’s and Code based LLM models at scale with - Langchain / Ollama, embeddings, Memory Management etc.,
· Practical experience in implementing Explainable and ethical AI models Practical experience in implementing frameworks like RAG/ CAG/ Self-reflective RAG etc.,
· Experience in cloud hosting either AWS or Azure or GCP.
· Experience in ML-OPS - Implement a feedback mechanism to continually improve the model over time through feedback loop and monitoring KPI’s in production.
· Experience with Quantization and Kubernetes or docker
Good to have
· gRPC implementation to expose the API’s on a server for easy usage and good user interface
· Streamlit front end creation
· Experience with SAFe framework deliveries.
Senior Generative AI Engineer
Employment Type: Permanent with VDart Digital
Work Location: Marathalli, Bengaluru
Job Description
We are seeking a highly skilled Senior Generative AI Engineer with strong expertise in designing, developing, and deploying enterprise-scale AI solutions using Large Language Models (LLMs) and modern Generative AI frameworks. The ideal candidate should have hands-on production experience building scalable GenAI applications, AI agents, autonomous workflows, and Retrieval-Augmented Generation (RAG) systems in cloud-native environments.
This role requires deep technical expertise in LLM orchestration, AI application architecture, prompt engineering, vector databases, MLOps, and production deployment of AI systems. Candidates should have proven experience delivering real-world AI solutions in enterprise environments with strong exposure to cloud platforms and DevOps practices.
Key Responsibilities
- Design, build, and deploy enterprise-grade Generative AI applications using Large Language Models (LLMs).
- Develop intelligent AI agents and autonomous workflows using frameworks such as LangChain, CrewAI, LangGraph, AutoGen, or similar agentic AI frameworks.
- Implement and optimize Retrieval-Augmented Generation (RAG) pipelines using vector databases and semantic search technologies.
- Work extensively on prompt engineering, tool calling, memory management, agent orchestration, and multi-agent systems.
- Integrate and manage LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, Llama, Mistral, or similar foundation models.
- Develop scalable AI services and APIs using Python and FastAPI.
- Build production-ready AI solutions with high availability, scalability, monitoring, and observability.
- Deploy and manage AI applications in cloud-native environments using Docker and Kubernetes.
- Collaborate with Data Science, ML Engineering, and DevOps teams to operationalize AI solutions.
- Implement CI/CD pipelines and automated deployment processes for AI workloads.
- Monitor model performance, latency, reliability, and operational efficiency in production environments.
- Ensure AI solutions follow enterprise security, governance, and responsible AI standards.
- Evaluate and adopt emerging Generative AI tools, frameworks, and models.
Required Skills
Generative AI & LLM Expertise
- Strong hands-on experience with Generative AI and Large Language Models (LLMs).
- Production-level experience building and deploying GenAI applications.
- Expertise in LangChain, CrewAI, LangGraph, AutoGen, or similar frameworks.
- Experience with AI agents, autonomous workflows, and multi-agent architectures.
- Strong understanding of prompt engineering, embeddings, model evaluation, and LLM orchestration.
- Experience integrating OpenAI, Azure OpenAI, Claude, Gemini, Llama, Mistral, or similar models.
RAG & Vector Databases
- Strong experience implementing RAG pipelines and semantic retrieval systems.
- Experience with vector databases such as Pinecone, Weaviate, ChromaDB, FAISS, or Milvus.
- Understanding of chunking strategies, embeddings, indexing, reranking, and retrieval optimization.
Python & AI Development
- Strong proficiency in Python.
- Experience with FastAPI for AI service and API development.
- Experience with AI/ML libraries and data processing tools such as Pandas and NumPy.
Cloud & Production Deployment
- Mandatory production experience on at least one cloud platform:
- Microsoft Azure
- Experience deploying scalable AI applications in enterprise production environments.
- Hands-on experience with Docker, Kubernetes, Jenkins, Terraform, and CI/CD pipelines.
- Strong understanding of MLOps, AI deployment lifecycle, monitoring, and observability.
Engineering & Operational Excellence
- Strong understanding of software engineering best practices.
- Experience with Git, version control, automated testing, and release management.
- Experience building secure, scalable, and high-performance AI solutions.
- Ability to troubleshoot production AI systems and optimize performance.
Preferred Skills
- Experience with AI observability and evaluation frameworks.
- Exposure to fine-tuning, PEFT, LoRA, or model optimization techniques.
- Experience with enterprise AI governance and responsible AI practices.
- Knowledge of distributed AI systems and scalable inference architectures.
- Familiarity with AI security and compliance standards.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field.
- 3–8 years of overall software engineering experience.
- Minimum 3+ years of hands-on experience in Generative AI and LLM-based application development,
- Proven track record of delivering enterprise-scale AI solutions in production environments.
- Strong communication and stakeholder management skills.
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
Design and develop Agentic AI systems using LLMs, tools, memory,
workflows, and MCP.
Build production-grade RAG pipelines, including ingestion, chunking,
embeddings, retrieval, reranking, and evaluation.
Implement context engineering strategies for improving LLM accuracy,
relevance, and reliability.
Develop and integrate MCP-based tools and services for AI agents.
Work with LLMs, SLMs, quantized models, and model optimization
techniques for efficient inference.
Develop scalable backend services and APIs for AI applications.
Design databases and data models supporting AI/agentic applications.
Implement AI observability covering latency, token usage, cost, failures,
quality, and agent/tool execution.
Apply AI governance and responsible AI practices, including security,
access control, data privacy, and auditability.
Optimize AI systems for latency, scalability, cost, and reliability.
Collaborate with engineering and product teams to take AI solutions from
POC to production.
Strong hands-on experience with GenAI, LLMs, and Agentic AI.
Experience building RAG applications.
Strong understanding of Context Engineering and prompt/context
optimization.
Role Overview
We are looking for a hands-on AI/ML Engineer to design, develop, and deploy
production-ready GenAI and Agentic AI applications. The role involves building
intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI
infrastructure with a strong focus on context engineering, observability,
governance, and model optimisation.
Key Responsibilities
Required Skills
Practical experience with MCP (Model Context Protocol).
Experience with frameworks such as LangChain, LangGraph,
LlamaIndex, or equivalent.
Knowledge of LLM/SLM deployment and quantization techniques.
Strong Python backend development experience.
Experience developing REST APIs using FastAPI/Flask or equivalent.
Strong understanding of SQL/NoSQL databases and database design.
Experience with vector databases such as Qdrant, Pinecone, Weaviate,
ChromaDB, or FAISS.
Understanding of AI observability, evaluation, monitoring, and
governance.
Experience with cloud platforms and production deployment is preferred.
Strong understanding of software engineering principles, Git, testing, and
CI/CD.
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 30 Years
11
Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.
12
Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..
13
Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.
14
Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies
15
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
Role: AI Developer
Experience: 3–4 Years
Employment Type: Full-Time
Location: Goregaon, Mumbai
About the Role
We are looking for an experienced AI Developer with 3–4 years of software development experience and strong hands-on exposure to Generative AI, AI Agents, Copilots, and AI-powered application development.
The candidate will be responsible for building production-ready AI solutions, developing agentic workflows, modernizing legacy applications, and integrating LLM capabilities into enterprise applications.
Key Responsibilities
- Design, develop, and deploy AI Agents and agentic workflows for enterprise use cases.
- Build AI Copilots and LLM-powered applications using modern AI frameworks and APIs.
- Develop RAG-based applications using embeddings, vector databases, and enterprise data.
- Work on legacy application migration and modernization, leveraging AI-assisted development and code transformation techniques.
- Analyze legacy codebases and design strategies for AI-driven migration, refactoring, and modernization.
- Integrate LLMs with enterprise applications, APIs, databases, and third-party systems.
- Implement tool calling, function calling, multi-agent workflows, and workflow automation.
- Perform prompt engineering, context optimization, model evaluation, and AI application testing.
- Take ownership of AI solutions from POC and prototyping through production deployment.
- Collaborate with product managers, architects, and engineering teams to convert business requirements into scalable AI solutions.
- Stay updated with emerging technologies in Generative AI, Agentic AI, LLMs, and AI-assisted software development.
Required Skills
- 3–4 years of professional software development experience.
- Strong proficiency in Python and/or JavaScript/TypeScript.
- Hands-on experience developing Generative AI / LLM-based applications.
- Strong understanding of AI Agents, RAG, Prompt Engineering, LLM APIs, and embeddings.
- Experience with frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, or equivalent.
- Experience working with REST APIs, databases, Git, and cloud environments.
- Hands-on experience with vector databases such as Pinecone, Weaviate, Chroma, FAISS, or equivalent.
- Good understanding of software architecture, debugging, testing, and deployment practices.
Good to Have
- Experience with Microsoft Copilot / Copilot Studio.
- Experience working with Claude, OpenAI, Gemini, Azure OpenAI, or open-source LLMs.
- Experience in legacy application migration, modernization, or code conversion.
- Knowledge of Azure AI / AWS / Google Cloud AI services.
- Experience with MCP, multi-agent systems, tool calling, and AI orchestration.
- Experience building enterprise-grade AI solutions with focus on security, scalability, and performance.
Hiring for AI Engineer
Exp: 6 - 8 yrs
Edu : BE/B.Tech/MCA
Work Location : Pune
Skill Set:
- Total experience ranging from 6–8 years in software engineering/AI roles
- Min 5 years strong programming experience in Python is a MUST
- Min 3.5 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks
- Experience with cloud platforms (AWS/Azure/GCP)
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 28 Years
11
Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.
12
Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..
13
Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.
14
Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies
15
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
Job Summary/ Job Opportunity:
This is an excellent opportunity for an ideal candidate with a high level of technical proficiency and meeting the below mentioned criteria -- • Strong experience in Machine Learning, Deep Learning, Generative AI, and Large Language Models (LLMs). • Hands-on experience building and deploying production-grade solutions using Azure OpenAI, OpenAI, LangChain, LangGraph, Semantic Kernel, LlamaIndex, and Agentic AI frameworks. • Strong expertise in Python, API development, microservices, and cloud-native architectures. • Experience designing and implementing RAG solutions, vector databases, embeddings, knowledge retrieval systems, and AI copilots. • Experience with Azure cloud services, MLOps, CI/CD pipelines, monitoring, and model lifecycle management. • Strong understanding of AI governance, responsible AI, security, compliance, and model evaluation frameworks. • Ability to lead technical discussions, provide architectural recommendations, mentor team members, and interact with business stakeholde
Key Objectives and Major Responsibilities:
• Design, develop, and implement scalable AI/ML and Generative AI solutions for enterprise applications. • Lead development of intelligent applications leveraging LLMs, RAG pipelines, AI agents, and document intelligence solutions. • Collaborate with business stakeholders, architects, and product teams to translate business requirements into technical solutions. • Design and optimize data pipelines, vector search solutions, embeddings, and retrieval mechanisms. • Build and maintain REST APIs, microservices, and cloud-native AI applications. • Ensure best practices in coding standards, performance optimization, security, scalability, and maintainability. • Drive AI solution deployment using MLOps practices, CI/CD pipelines, monitoring, and observability frameworks. • Perform code reviews, mentor junior developers, and contribute to capability building within the team
Key Capabilities and Competencies:
Knowledge, Skills, Qualification and Experience
• Degree in B.Tech/M.Tech (Computer Science/IT/Data Science) or related discipline preferred, with 3–4 years of relevant experience in AI/ML, GenAI and total 5-7 years of experience. • Proficiency in Python and hands-on experience with ML libraries (scikit-learn, TensorFlow, PyTorch) and GenAI frameworks/tools. • Strong understanding of machine learning, deep learning, LLMs, prompt engineering, and techniques like RAG and fine-tuning. • Experience with data processing, embeddings, vector databases, APIs, and building scalable AI driven applications. • Good communication skills, ability to work on multiple projects, and eagerness to learn and adapt to evolving AI technologies.
Senior AI Engineer
Code Generation, Agent Architecture & LLM Systems
📍 Mumbai (On-site) | Full-time | 5+ years
About the Role:
Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.
We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.
The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.
The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.
You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.
Responsibilities:
Agent Architecture
Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.
Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.
Code Generation Pipeline
Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.
Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.
Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.
Self-Repair Loop
Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.
This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.
Context Management
Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.
Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.
Own token budgeting and prompt caching strategy.
Prompt Engineering as a Discipline
Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).
Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.
Version prompts like code with changelogs and rollback capability.
Evaluation and Quality Measurement
Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.
Define regression gates that block quality-degrading changes from shipping.
Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.
This responsibility is non-negotiable at this level.
Model Strategy and Cost
Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.
Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.
Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.
Safety and Reliability of Agent Behaviour
Defend against prompt injection from user content and fetched web content.
Ensure secrets never appear in generated client code.
Define what the agent's tools may and may not do in collaboration with the platform team.
Contribute to output moderation and abuse-pattern awareness.
Mentorship and Engineering Standards
Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.
Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.
Requirements:
Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)
Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.
POCs, internal demos, and tutorial-grade work do not qualify.
5+ Years of Professional Software or AI Engineering Experience
With at least 3 years focused on LLM applications, AI engineering, or production AI systems.
Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.
Strong Python Proficiency and Service Development
Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.
Not notebook-only.
Depth Across LLM APIs and Agent Systems
Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).
Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.
Hands-on with tool calling, structured outputs, and multi-step reasoning.
Demonstrated, Systematic Evaluation Practice - Non-Negotiable
Must have built evaluation harnesses that gate production releases, not ad-hoc testing.
Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.
Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.
Cost Discipline for Production AI
Track record of measurable cost optimisation on production AI features.
Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.
AWS Working Knowledge
Hands-on with EC2, S3, IAM, and Docker.
Comfort with CI/CD workflows and deploying AI services.
Awareness of LLM Security Failure Modes
Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.
Nice to Have
- Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
- MCP server authoring
- Open-source AI contributions
- Published technical writing on LLM systems
- Multi-modal model experience
- Fine-tuning exposure (LoRA, QLoRA, PEFT)






