AI/ML Engineer (LLMs, RAG & Agent Systems) at IAI solution · Bengaluru (Bangalore) · 1 - 2 years · ₹5L - ₹6L / yr · Raised funding · Posted 12 Jan 2026

Job Title: AI/ML Engineer (LLMs, RAG & Agent Systems)
Location: Bangalore, India (On-site)
Type: Full-time
About the Role
As an AI/ML Engineer, you’ll be part of a small, fast-moving team focused on developing LLM-powered agentic systems that drive our next generation of AI products.
You’ll work on designing, implementing, and optimizing pipelines involving retrieval-augmented generation (RAG), multi-agent coordination, and tool-using AI systems.
Responsibilities
- Design and implement components for LLM-based systems (retrievers, planners, memory, evaluators).
- Build and maintain RAG pipelines using vector databases and embedding models.
- Experiment with reasoning frameworks like ReAct, Tree of Thought, and Reflexion.
- Collaborate with backend and infra teams to deploy and optimize agentic applications.
- Research and experiment with open-source LLM frameworks to identify best-fit architectures.
- Contribute to internal tools for evaluation, benchmarking, and scaling AI agents.
Required Skills
- Strong foundation in ML/DL theory and implementation (PyTorch preferred).
- Understanding of transformer architectures, embeddings, and LLM mechanics.
- Practical exposure to prompt engineering, tool calling, and structured output design.
- Experience in Python, Git/GitHub, and data processing pipelines.
- Familiarity with RAG systems, vector databases, and API-based model inference.
- Ability to write clean, modular, and reproducible code.
Preferred Skills
- Experience with LangChain, LangGraph, Autogen, or CrewAI.
- Hands-on with Hugging Face ecosystem (transformers, datasets, etc.).
- Working knowledge of Redis, PostgreSQL, or MongoDB.
- Experience with Docker and deployment workflows.
- Familiarity with OpenAI, Anthropic, vLLM, or Ollama inference APIs.
- Exposure to MLOps concepts like CI/CD, model versioning, or cloud (AWS/GCP/Azure).
What We Value
- Deep understanding of core principles over surface-level familiarity with tools.
- Ability to think like a researcher and execute like an engineer.
- Collaborative mindset, building together, learning together.

About IAI solution
About
Company social profiles
Similar jobs (10)
Support with design and build to prove out agentic AI solution flow by working with other data
scientists and engineers to build, train Large Language Model (LLM) architectures, RAG
systems, and autonomous agentic workflows
Key qualifications:
>> AI solution design & Development: Design Agentic AI solutions using RAG (Retrieval-
Augmented Generation) and orchestration frameworks like LangGraph or LangChain.
>> Model Fine-Tuning: Solid understanding and experience with Pre-train, fine-tune, and
optimize open-source like BERT, LLama, and other proprietary foundation models for domain-
specific tasks
>> Solid Stats and ML foundations and (vibe) coding skills with Python, PySpark
>> Implement validation frameworks and tracing practices (using tools like Arize) to monitor
agent behavior, guard against model drift, and ensure compliance
>> Collaborate with Engineering to deploy models securely on cloud and on-prem ecosystems
About LeadSquared
LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.
Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.
Role Overview
We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.
This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.
Key Responsibilities
•
Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
•
Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.
•
Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.
•
Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.
•
Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.
•
Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.
•
Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.
•
Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.
•
Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.
Required Qualifications
Experience
•
2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.
•
Proven experience shipping LLM-based products or agentic AI systems into production environments.
Technical Skills
•
Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.
•
Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).
•
Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.
•
Solid understanding of RAG architectures, embedding models, and semantic search.
•
Experience with vector databases and similarity search infrastructure.
•
Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).
Problem-Solving & Mindset
•
Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.
•
Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.
•
Ability to balance research exploration with engineering pragmatism to ship reliable systems.
Preferred Qualifications
•
Experience with multi-agent orchestration and agent memory systems (short-term and long-term).
•
Familiarity with fine-tuning or RLHF workflows for domain adaptation.
•
Background in NLP, information retrieval, or conversational AI.
•
Prior experience in B2B SaaS or CRM domain is a plus.
•
Contributions to open-source AI/ML projects or published research/blogs.
•
Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services
Role Overview
We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.
Key Responsibilities
- Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
- Build LLM-based applications and AI agents using LangChain and LangGraph.
- Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
- Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
- Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
- Work with embeddings, prompt engineering, semantic search, and document processing.
- Develop scalable APIs and backend services using Python, FastAPI, or Flask.
- Build and integrate AI solutions with existing applications and enterprise systems.
- Deploy and maintain AI/ML solutions on cloud platforms.
- Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.
Required Skills
- Strong hands-on experience in Python programming.
- Strong experience in AI/ML and Generative AI.
- Hands-on experience with LLMs and LLM-based application development.
- Strong experience with LangChain and/or LangGraph.
- Experience building AI Agents / Agentic AI workflows.
- Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
- Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
- Experience developing REST APIs using FastAPI/Flask.
- Good understanding of Machine Learning, NLP, and deep learning concepts.
- Experience with Azure / AWS / GCP cloud platforms.
Good to Have
- Experience with multi-agent systems and agent orchestration.
- Knowledge of MLOps / LLMOps.
- Experience with Docker, Kubernetes, and CI/CD.
- Knowledge of LLM evaluation, monitoring, observability, and AI governance.
- Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.
Design and develop Agentic AI systems using LLMs, tools, memory,
workflows, and MCP.
Build production-grade RAG pipelines, including ingestion, chunking,
embeddings, retrieval, reranking, and evaluation.
Implement context engineering strategies for improving LLM accuracy,
relevance, and reliability.
Develop and integrate MCP-based tools and services for AI agents.
Work with LLMs, SLMs, quantized models, and model optimization
techniques for efficient inference.
Develop scalable backend services and APIs for AI applications.
Design databases and data models supporting AI/agentic applications.
Implement AI observability covering latency, token usage, cost, failures,
quality, and agent/tool execution.
Apply AI governance and responsible AI practices, including security,
access control, data privacy, and auditability.
Optimize AI systems for latency, scalability, cost, and reliability.
Collaborate with engineering and product teams to take AI solutions from
POC to production.
Strong hands-on experience with GenAI, LLMs, and Agentic AI.
Experience building RAG applications.
Strong understanding of Context Engineering and prompt/context
optimization.
Role Overview
We are looking for a hands-on AI/ML Engineer to design, develop, and deploy
production-ready GenAI and Agentic AI applications. The role involves building
intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI
infrastructure with a strong focus on context engineering, observability,
governance, and model optimisation.
Key Responsibilities
Required Skills
Practical experience with MCP (Model Context Protocol).
Experience with frameworks such as LangChain, LangGraph,
LlamaIndex, or equivalent.
Knowledge of LLM/SLM deployment and quantization techniques.
Strong Python backend development experience.
Experience developing REST APIs using FastAPI/Flask or equivalent.
Strong understanding of SQL/NoSQL databases and database design.
Experience with vector databases such as Qdrant, Pinecone, Weaviate,
ChromaDB, or FAISS.
Understanding of AI observability, evaluation, monitoring, and
governance.
Experience with cloud platforms and production deployment is preferred.
Strong understanding of software engineering principles, Git, testing, and
CI/CD.
Applied AI Engineer
About the Role
We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.
We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.
As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.
Key Responsibilities
- Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
- Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
- Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
- Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
- Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
- Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
- Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
- Deploy and maintain AI services on AWS or Azure.
- Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.
Required Qualifications
- 5+ years of professional software development experience in Python or JavaScript.
- Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
- Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
- Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
- Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
- Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
- Familiarity with MCP and human-in-the-loop workflows.
- Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.
Good to Have
- Experience with RLHF or RLAIF.
- Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
- Experience with graph databases and graph-based data models.
- Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.
Why Join Us?
- Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
- Build foundational AI architecture and production-grade LLM workflows.
- Take ownership of technical decisions and system design as an early engineering team member.
- Solve challenging problems at the intersection of AI, finance, and intelligent automation.
Role Overview
We are looking for an experienced Data Scientist – Agentic AI with strong expertise in Python, Machine Learning, Generative AI, Large Language Models (LLMs), RAG and Agentic AI.
The ideal candidate should have hands-on experience in developing, fine-tuning, evaluating and deploying machine learning and GenAI solutions. The candidate should be comfortable working with open-source LLMs, LangChain/LangGraph, PySpark and AI observability/tracing frameworks.
The role involves building intelligent AI systems that can reason, use tools, retrieve information and execute multi-step tasks using Agentic AI architectures.
Mandatory Technical Skills
1. Data Science & Python
- 5+ years of experience in Data Science / Machine Learning / AI.
- Strong programming experience in Python.
- Strong understanding of data analysis, feature engineering and statistical techniques.
- Experience with Python ML and data science libraries such as:
- NumPy
- Pandas
- Scikit-learn
- Matplotlib / Seaborn
- Good understanding of data preprocessing, exploratory data analysis and experimentation.
2. Machine Learning & Statistics
- Strong understanding of Machine Learning fundamentals.
- Experience with supervised and unsupervised learning techniques.
- Knowledge of:
- Regression
- Classification
- Clustering
- Feature Engineering
- Model Selection
- Hyperparameter Tuning
- Cross-validation
- Strong understanding of Statistics / ML fundamentals.
- Ability to interpret model performance and statistical results.
3. Generative AI / LLM
- Strong hands-on experience with Generative AI and Large Language Models (LLMs).
- Understanding of Transformer architecture and modern LLM-based applications.
- Experience working with commercial or open-source LLMs.
- Strong understanding of:
- Prompt Engineering
- Context Management
- Embeddings
- Tokenization
- LLM inference
- Hallucination mitigation
4. RAG – Retrieval Augmented Generation
- Strong hands-on experience developing RAG applications.
- Experience with:
- Document ingestion
- Chunking
- Embeddings
- Vector search
- Semantic search
- Retrieval pipelines
- Context retrieval
- Reranking
- Ability to optimize RAG pipelines for relevance, accuracy and latency.
- Experience integrating LLMs with enterprise knowledge sources.
5. Agentic AI
- Hands-on experience building Agentic AI / AI Agent solutions.
- Understanding of agent architecture and multi-step reasoning workflows.
- Experience with:
- AI Agents
- Multi-Agent systems
- Tool Calling
- Function Calling
- Agent orchestration
- Planning and reasoning workflows
- Memory
- Workflow automation
- Ability to build agents that can interact with tools, APIs, databases and external systems.
6. LangChain / LangGraph
- Strong hands-on experience with LangChain and/or LangGraph.
- Experience building LLM workflows and agent-based applications.
- Understanding of:
- Chains
- Agents
- Tools
- State management
- Graph-based workflows
- Agent orchestration
- Retrieval workflows
- Experience designing scalable Agentic AI workflows.
7. LLM Fine-Tuning
- Hands-on experience with LLM fine-tuning.
- Understanding of techniques such as:
- Supervised Fine-Tuning (SFT)
- Parameter-Efficient Fine-Tuning
- LoRA
- QLoRA
- Experience preparing datasets for fine-tuning.
- Ability to evaluate fine-tuned models against baseline models.
- Understanding of model optimization and inference considerations.
8. BERT / LLaMA / Open-Source LLMs
Experience working with one or more open-source / transformer-based models such as:
- BERT
- LLaMA / Llama
- Mistral
- Gemma
- Qwen
- Other open-source LLMs
Candidate should understand model loading, inference, fine-tuning and evaluation.
9. PySpark
- Strong experience with PySpark for large-scale data processing.
- Experience working with large datasets and distributed data processing.
- Knowledge of:
- Data transformations
- Data cleaning
- Aggregations
- Joins
- Spark SQL
- Performance optimization
- Ability to build scalable data processing pipelines.
10. Model Validation & Evaluation
- Experience validating and evaluating ML and GenAI models.
- Understanding of traditional ML evaluation metrics.
- Experience evaluating LLM/RAG applications using relevant quality metrics.
- Ability to compare model performance and identify areas for improvement.
- Experience with:
- Accuracy
- Precision
- Recall
- F1 Score
- ROC-AUC
- Retrieval metrics
- LLM response quality
- Groundedness / relevance
- Experience designing evaluation datasets and test cases is preferred.
11. AI Tracing / Observability
- Experience with AI/LLM tracing and observability.
- Ability to monitor AI applications in production.
- Experience tracking:
- LLM requests/responses
- Latency
- Token usage
- Errors
- Retrieval performance
- Agent/tool execution
- Model performance
- Exposure to tools/frameworks such as LangSmith, OpenTelemetry, Arize Phoenix, MLflow or similar is preferred.
12. Model Deployment
- Experience deploying ML/LLM/GenAI solutions into production.
- Exposure to cloud and/or on-premise model deployment.
- Experience with model serving, APIs and production inference.
- Knowledge of deployment environments such as:
- AWS
- Azure
- GCP
- On-premise infrastructure
- Experience with Docker, APIs and CI/CD is an advantage.
Key Responsibilities
- Design, develop and deploy Data Science, Machine Learning and GenAI solutions.
- Build production-ready RAG and Agentic AI applications.
- Develop intelligent agents capable of tool calling, reasoning and multi-step task execution.
- Build LLM-powered applications using LangChain/LangGraph.
- Work with open-source LLMs including BERT, LLaMA and other transformer-based models.
- Fine-tune LLMs for specific business use cases.
- Develop scalable data processing pipelines using PySpark.
- Perform data analysis, feature engineering and statistical modeling.
- Develop and maintain model validation and evaluation frameworks.
- Evaluate ML and LLM models using appropriate performance and quality metrics.
- Implement AI tracing, monitoring and observability for production GenAI systems.
- Deploy models and AI applications in cloud or on-premise environments.
- Optimize model performance, response quality, latency and cost.
- Troubleshoot issues related to model inference, retrieval, agents and LLM workflows.
- Collaborate with Data Scientists, ML Engineers, Software Engineers and business stakeholders.
- Convert business requirements into scalable AI/ML solutions.
Good to Have
- Experience with Vector Databases such as:
- FAISS
- Pinecone
- Weaviate
- Milvus
- Chroma
- Azure AI Search
- Experience with MLflow or similar ML lifecycle tools.
- Experience with Docker/Kubernetes.
- Experience with REST APIs / FastAPI.
- Knowledge of cloud AI/ML services.
- Experience with MLOps / LLMOps.
- Experience with multi-agent frameworks other than LangChain/LangGraph.
- Experience working with enterprise GenAI applications.
Ideal Candidate Profile
The ideal candidate should be a Data Scientist / ML Engineer with strong GenAI and Agentic AI experience, rather than a pure Python developer.
A strong candidate would typically have:
Data Science + Python + ML + Statistics + GenAI/LLM + RAG + Agentic AI + LangChain/LangGraph + LLM Fine-Tuning + Open-Source LLMs + PySpark + Model Evaluation + AI Observability + Model Deployment.
Core Mandatory Skills
Data Science, Python, Machine Learning, Statistics/ML Fundamentals, GenAI/LLM, RAG, Agentic AI, LangChain/LangGraph, LLM Fine-Tuning, BERT/LLaMA/Open-Source LLMs, PySpark, Model Validation/Evaluation, AI Tracing/Observability, Cloud/On-Prem Model Deployment.
Hiring for AI Engineer
Exp: 5 - 8 yrs
Edu : BE/B.Tech/MCA
Work Location : Pune
Skill Set:
Total experience ranging from 5 - 8 years in software engineering/AI roles
Min 5 years strong programming experience in Python or Typescript is a MUST
Min 2.5 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks
Experience with cloud platforms (AWS/Azure/GCP)
Strong Lead AI Engineer Profile with agentic systems architecture expertise
2
Mandatory (Experience 1): Must have 6+ years of software or ML engineering, with at least recent 2+ years building and shipping production LLM or agentic AI systems
3
Mandatory (Tech skill 1): Must have hands-on proficiency with at least two agentic frameworks (LangGraph, LangChain, AutoGen, CrewAI), with experience debugging framework internals
4
Mandatory (Tech skill 2): Must have direct SDK experience with Anthropic Claude API (tool use, streaming), OpenAI Assistants API, or Vertex AI Agent Builder
5
Mandatory (Tech skill 3): Must have Python mastery — production-quality code, type annotations, unit and integration tests, packaging, and performance profiling
6
Mandatory (Tech skill 4): Must have RAG pipeline depth — embedding model selection, vector stores (Pinecone, Weaviate, pgvector), hybrid retrieval, RAGAS or custom evaluation harnesses
7
Mandatory (Tech skill 5): Must have cloud deployment experience with AWS, Azure, or GCP; Docker, Kubernetes, IaC basics (Terraform or CDK), and CI/CD pipelines
8
Mandatory (Tech skill 6): Must have agent observability experience — LangSmith, Helicone, or equivalent — with ability to diagnose latency, cost, and quality issues in production traces
9
Mandatory (Tech skill 8) : Must have owned full sub-system designs — agent topology, data flows, API contracts, failure handling — for a bounded scope, and built multi-agent graphs, tool orchestration, retrieval, and memory systems.
10
Mandatory (Tech skill 7): Must have track record of shipping 2+ agentic or ML systems to production — not just proof-of-concepts — with documented performance benchmarks
11
Mandatory (Communication): Must be able to write crisp component specifications and communicate architectural trade-offs to both engineers and non-technical stakeholders
12
Mandatory (Note 1) : Role is Hybrid, WFH flexibility as well upto 6 days a month
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Senior AI Engineer
Code Generation, Agent Architecture & LLM Systems
📍 Mumbai (On-site) | Full-time | 5+ years
About the Role:
Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.
We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.
The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.
The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.
You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.
Responsibilities:
Agent Architecture
Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.
Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.
Code Generation Pipeline
Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.
Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.
Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.
Self-Repair Loop
Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.
This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.
Context Management
Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.
Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.
Own token budgeting and prompt caching strategy.
Prompt Engineering as a Discipline
Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).
Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.
Version prompts like code with changelogs and rollback capability.
Evaluation and Quality Measurement
Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.
Define regression gates that block quality-degrading changes from shipping.
Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.
This responsibility is non-negotiable at this level.
Model Strategy and Cost
Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.
Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.
Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.
Safety and Reliability of Agent Behaviour
Defend against prompt injection from user content and fetched web content.
Ensure secrets never appear in generated client code.
Define what the agent's tools may and may not do in collaboration with the platform team.
Contribute to output moderation and abuse-pattern awareness.
Mentorship and Engineering Standards
Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.
Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.
Requirements:
Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)
Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.
POCs, internal demos, and tutorial-grade work do not qualify.
5+ Years of Professional Software or AI Engineering Experience
With at least 3 years focused on LLM applications, AI engineering, or production AI systems.
Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.
Strong Python Proficiency and Service Development
Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.
Not notebook-only.
Depth Across LLM APIs and Agent Systems
Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).
Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.
Hands-on with tool calling, structured outputs, and multi-step reasoning.
Demonstrated, Systematic Evaluation Practice - Non-Negotiable
Must have built evaluation harnesses that gate production releases, not ad-hoc testing.
Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.
Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.
Cost Discipline for Production AI
Track record of measurable cost optimisation on production AI features.
Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.
AWS Working Knowledge
Hands-on with EC2, S3, IAM, and Docker.
Comfort with CI/CD workflows and deploying AI services.
Awareness of LLM Security Failure Modes
Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.
Nice to Have
- Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
- MCP server authoring
- Open-source AI contributions
- Published technical writing on LLM systems
- Multi-modal model experience
- Fine-tuning exposure (LoRA, QLoRA, PEFT)
Role Overview
We are looking for a skilled Python Full Stack / Agentic AI Engineer to design, develop, and deploy AI-powered applications and intelligent agentic workflows. The ideal candidate should have strong expertise in Python, FastAPI, LLMs, RAG, LangChain/LangGraph, and modern full-stack development.
You will work on building scalable backend services, integrating Large Language Models, developing AI agents, implementing Retrieval-Augmented Generation (RAG) pipelines, and creating production-ready AI applications.
Key Responsibilities
- Design and develop scalable backend applications using Python and FastAPI.
- Build and deploy Agentic AI solutions using LLMs and agent frameworks.
- Develop multi-step and multi-agent workflows using LangChain and LangGraph.
- Design and implement RAG (Retrieval-Augmented Generation) pipelines.
- Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or open-source models.
- Develop prompt engineering strategies and structured LLM workflows.
- Work with vector databases and embedding models for semantic search and knowledge retrieval.
- Build APIs and microservices for AI-powered applications.
- Integrate AI services with databases, third-party APIs, and enterprise systems.
- Develop conversation memory, tool calling, function calling, and agent orchestration capabilities.
- Implement evaluation, monitoring, logging, guardrails, and error handling for AI applications.
- Optimize applications for performance, scalability, reliability, and cost.
- Collaborate with product managers, frontend developers, data engineers, and other stakeholders.
- Write clean, maintainable, well-tested, and production-ready code.
- Participate in architecture discussions, code reviews, testing, and deployment activities.
Required Skills
Programming & Backend
- Strong proficiency in Python.
- Hands-on experience with FastAPI, REST APIs, and backend development.
- Strong understanding of asynchronous programming, API design, authentication, and middleware.
- Experience with SQL/NoSQL databases.
Generative AI / Agentic AI
- Strong understanding of LLMs and Generative AI.
- Hands-on experience building AI Agents / Agentic AI applications.
- Experience with LangChain and/or LangGraph.
- Knowledge of agent orchestration, tool calling, function calling, memory, and workflow management.
- Strong understanding of prompt engineering.
RAG
- Experience designing and implementing RAG architectures.
- Knowledge of document ingestion, chunking, embeddings, vector search, retrieval, reranking, and response generation.
- Experience with vector databases such as FAISS, Chroma, Pinecone, Weaviate, Qdrant, or similar.
LLM & AI Integration
- Experience integrating commercial or open-source LLMs.
- Understanding of embeddings, context windows, temperature, token usage, and model selection.
- Experience with structured outputs and LLM-based workflows.
- Familiarity with LLM evaluation and observability is a plus.
Full Stack
- Working knowledge of HTML, CSS, JavaScript/TypeScript.
- Experience with React.js or similar frontend frameworks is preferred.
- Ability to integrate frontend applications with Python/FastAPI services.












