Senior AI/ML Engineer (GenAI

Job Description – AI Engineer (End-to-End Development & Deployment)

Role Summary

We are looking for an AI Engineer with hands-on experience in designing, developing, deploying, and maintaining Generative/Agentic AI solutions in production. The ideal candidate should have end-to-end ownership of AI applications, from development to deployment, monitoring, and optimization.

Key Responsibilities

●        Design, build, and deploy Generative/Agentic AI solutions.

●        Develop applications using LLMs, RAG, AI agents, and vector databases.

●        Build scalable APIs and integrate AI solutions with enterprise applications.

●        Implement CI/CD pipelines, containerization, and MLOps best practices.

●        Monitor, optimize, and maintain production AI systems.

●        Collaborate with cross-functional teams to deliver business-driven AI solutions.

Required Skills

●       Strong programming skills in Python.

●       Experience with vector databases (e.g., Pinecone, FAISS, ChromaDB) and graph memory systems

●       Knowledge of atleast one agent development framework: Google ADK (preferred), LangChain/LangGraph/LlamaIndex, CrewAI

●       Experience with LLMs, RAG, GenAI, AgenticAI Agents

●       Hands-on experience with FastAPI, and REST APIs.

●       Knowledge of Docker, Kubernetes, Git, CI/CD.

●       Experience with AWS, Azure, or GCP. 

●       Experience with security compliance, monitoring and observability tools such as AWS CloudWatch, Azure Monitor, Google Cloud Monitoring.

About the Role

We’re building the next generation of AI-powered business software, and we’re looking for people who want to shape that future with us. With Lumen, we’re reimagining how users interact with CRM — moving beyond screens, menus and dashboards to an intelligent interface where users can simply ask AI to take actions, retrieve knowledge, generate insights and get work done. With Agent Studio, we’re enabling businesses to build, test and deploy their own AI agents for real-world workflows. And with Invorto, we’re bringing AI to voice, allowing businesses to create intelligent voice agents tailored to their customer and operational use cases.

What makes this especially exciting is the stage and scale of the opportunity. You’ll get to work on genuinely hard problems across LLMs, agents, reasoning, orchestration, voice AI, evaluation, reliability and enterprise security — not as isolated experiments, but as products used in real business workflows. You’ll have the opportunity to build zero-to-one, own meaningful parts of the product end-to-end, work closely with customers, experiment rapidly, and see your work reach production at scale.

Why join now? Because the playbook for enterprise AI is still being written. You won’t just be implementing someone else’s roadmap — you’ll help define the product, architecture and experiences that become that playbook. Expect high ownership, fast iteration, hard technical and product problems, direct customer impact, and the chance to build AI systems that have to work reliably in the real world — not just in a demo.

About the Role

We are looking for a Senior AI/ML Backend Engineer to help build the core intelligence layer powering Lumen and Agent Studio. You will design and ship production-grade backend systems that integrate LLMs into real agentic workflows — taking actions, retrieving knowledge and generating insights inside a live CRM product used by real businesses. This is a hands-on, build-focused role with direct ownership of systems that ship to production.

What You’ll Do

• Design, build and scale backend services in Python that power LLM-driven and agentic features within Lumen and Agent Studio.
• Build and productionize agentic AI systems — including planning, tool use, orchestration, memory and multi-step task execution.
• Integrate LLMs into core product workflows, focusing on reliability, latency, cost and correctness at production scale.
• Build robust APIs and services that connect AI agents with CRM data, business logic and third-party systems.
• Own evaluation, testing and monitoring for AI features to ensure they behave reliably in real-world, not just demo, conditions.
• Collaborate closely with product, design and other engineers to take features from zero to one and iterate rapidly based on real usage and customer feedback.
• Work directly with customers and customer-facing teams to understand real workflows, debug issues and translate feedback into product and engineering decisions.

What We’re Looking For

• 2–4 years of professional backend engineering experience, with strong hands-on Python skills.
• Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
• Should be hands-on with traditional Machine learning frameworks like Pytorch, Scikit-learn
• Solid understanding of API design, backend architecture, databases and distributed systems fundamentals.
• Familiarity with LLM orchestration concepts — prompting, tool/function calling, RAG, agent frameworks, evaluation and guardrails.
• Comfort working in a fast-paced, ambiguous, zero-to-one environment where you’ll be defining as much as building.
• Strong communication skills — this is a customer-facing role, and you will be expected to clearly articulate technical concepts, decisions and trade-offs to both technical and non-technical stakeholders, including customers.

Good to Have

• Experience with enterprise security, reliability or observability practices for AI systems.
• Prior experience working on CRM, SaaS or other enterprise business software.
• Exposure to voice AI or real-time systems.

Hiring for AI Engineer

Exp: 6 - 12 yrs

Edu : BE/B.Tech/MCA

Work Location : Pune / Mumbai

Skill Set:

Total experience ranging from 5–10 years in software engineering/AI roles

Min 5 years strong programming experience in Python or Typescript is a MUST

Min 2.5 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks

2+ years shipping LLM systems in production

Experience with cloud platforms (AWS/Azure/GCP)

Design and develop Agentic AI systems using LLMs, tools, memory,

workflows, and MCP.

Build production-grade RAG pipelines, including ingestion, chunking,

embeddings, retrieval, reranking, and evaluation.

Implement context engineering strategies for improving LLM accuracy,

relevance, and reliability.

Develop and integrate MCP-based tools and services for AI agents.

Work with LLMs, SLMs, quantized models, and model optimization

techniques for efficient inference.

Develop scalable backend services and APIs for AI applications.

Design databases and data models supporting AI/agentic applications.

Implement AI observability covering latency, token usage, cost, failures,

quality, and agent/tool execution.

Apply AI governance and responsible AI practices, including security,

access control, data privacy, and auditability.

Optimize AI systems for latency, scalability, cost, and reliability.

Collaborate with engineering and product teams to take AI solutions from

POC to production.

Strong hands-on experience with GenAI, LLMs, and Agentic AI.

Experience building RAG applications.

Strong understanding of Context Engineering and prompt/context

optimization.

Role Overview

We are looking for a hands-on AI/ML Engineer to design, develop, and deploy

production-ready GenAI and Agentic AI applications. The role involves building

intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI

infrastructure with a strong focus on context engineering, observability,

governance, and model optimisation.

Key Responsibilities

Required Skills

Practical experience with MCP (Model Context Protocol).

Experience with frameworks such as LangChain, LangGraph,

LlamaIndex, or equivalent.

Knowledge of LLM/SLM deployment and quantization techniques.

Strong Python backend development experience.

Experience developing REST APIs using FastAPI/Flask or equivalent.

Strong understanding of SQL/NoSQL databases and database design.

Experience with vector databases such as Qdrant, Pinecone, Weaviate,

ChromaDB, or FAISS.

Understanding of AI observability, evaluation, monitoring, and

governance.

Experience with cloud platforms and production deployment is preferred.

Strong understanding of software engineering principles, Git, testing, and

CI/CD.

Job Title: Senior AI/ML Engineer

Company: Timble Technologies Pvt. Ltd

Location: Gurugram (Hybrid)

Experience: 2 TO 5 Years

About Us

Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.

Role Overview

We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.

Key Responsibilities

·       Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).

·       GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.

·       Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.

·       MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.

·       Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.

·       Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.

Required Qualifications & Skills

·       Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.

·       Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.

·       GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.

·       Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.

·       Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.

·       Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).

Preferred Qualifications

·       Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.

·       Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).

·       Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.

About LeadSquared

LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.

Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.

Role Overview

We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.

This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.

Key Responsibilities

•

Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.

•

Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.

•

Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.

•

Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.

•

Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.

•

Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.

•

Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.

•

Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.

•

Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.

Required Qualifications

Experience

•

2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.

•

Proven experience shipping LLM-based products or agentic AI systems into production environments.

Technical Skills

•

Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.

•

Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).

•

Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.

•

Solid understanding of RAG architectures, embedding models, and semantic search.

•

Experience with vector databases and similarity search infrastructure.

•

Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).

Problem-Solving & Mindset

•

Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.

•

Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.

•

Ability to balance research exploration with engineering pragmatism to ship reliable systems.

Preferred Qualifications

•

Experience with multi-agent orchestration and agent memory systems (short-term and long-term).

•

Familiarity with fine-tuning or RLHF workflows for domain adaptation.

•

Background in NLP, information retrieval, or conversational AI.

•

Prior experience in B2B SaaS or CRM domain is a plus.

•

Contributions to open-source AI/ML projects or published research/blogs.

•

Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services

Role Overview 

We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale. 

Key Responsibilities 

Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production. 

Write clean, tested, production-grade code and participate actively in code and design reviews. 

Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production. 

Required Qualifications 

8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs. 

Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel). 

Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers. 

Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability. 

Role Overview

We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.

Key Responsibilities

• Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
• Build LLM-based applications and AI agents using LangChain and LangGraph.
• Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
• Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
• Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
• Work with embeddings, prompt engineering, semantic search, and document processing.
• Develop scalable APIs and backend services using Python, FastAPI, or Flask.
• Build and integrate AI solutions with existing applications and enterprise systems.
• Deploy and maintain AI/ML solutions on cloud platforms.
• Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.

Required Skills

• Strong hands-on experience in Python programming.
• Strong experience in AI/ML and Generative AI.
• Hands-on experience with LLMs and LLM-based application development.
• Strong experience with LangChain and/or LangGraph.
• Experience building AI Agents / Agentic AI workflows.
• Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
• Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
• Experience developing REST APIs using FastAPI/Flask.
• Good understanding of Machine Learning, NLP, and deep learning concepts.
• Experience with Azure / AWS / GCP cloud platforms.

Good to Have

• Experience with multi-agent systems and agent orchestration.
• Knowledge of MLOps / LLMOps.
• Experience with Docker, Kubernetes, and CI/CD.
• Knowledge of LLM evaluation, monitoring, observability, and AI governance.
• Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.

Job Summary

We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.

Key Responsibilities

• Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
• Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
• Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
• Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
• Integrate AI/ML models with enterprise applications and APIs.
• Fine-tune and evaluate ML/LLM models based on business requirements.
• Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
• Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
• Conduct model performance evaluation, optimization, and troubleshooting.
• Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
• Stay current with emerging AI/ML technologies, frameworks, and industry best practices.

Required Skills

• Strong programming experience in Python.
• Strong understanding of Machine Learning algorithms, statistics, and data structures.
• Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
• Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
• Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
• Experience with NLP, deep learning, or computer vision is an advantage.
• Experience developing and consuming REST APIs and microservices.
• Working knowledge of SQL and NoSQL databases.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Understanding of Docker, Kubernetes, CI/CD, and MLOps.
• Familiarity with Git and modern software development practices.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
• 4 years of relevant experience in AI/ML engineering or a related field.
• Experience building and deploying production-grade AI/ML solutions.
• Enterprise application development experience.
• Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
• Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
• Experience with AI/ML model monitoring, evaluation, and optimization.

What You Bring

• Strong problem-solving and analytical skills.
• Ability to translate business requirements into practical AI/ML solutions.
• Strong software engineering and debugging capabilities.
• Ability to work independently as well as collaboratively in a cross-functional environment.
• Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.

Keywords

AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI

Location: Gurugram

Work mode: Hybrid

Senior AI Engineer

Code Generation, Agent Architecture & LLM Systems

📍 Mumbai (On-site) | Full-time | 5+ years

About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.

The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.

The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.

You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.

Responsibilities:

Agent Architecture

Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.

Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.

Code Generation Pipeline

Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.

Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.

Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.

Self-Repair Loop

Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.

This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.

Context Management

Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.

Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.

Own token budgeting and prompt caching strategy.

Prompt Engineering as a Discipline

Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).

Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.

Version prompts like code with changelogs and rollback capability.

Evaluation and Quality Measurement

Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.

Define regression gates that block quality-degrading changes from shipping.

Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.

This responsibility is non-negotiable at this level.

Model Strategy and Cost

Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.

Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.

Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.

Safety and Reliability of Agent Behaviour

Defend against prompt injection from user content and fetched web content.

Ensure secrets never appear in generated client code.

Define what the agent's tools may and may not do in collaboration with the platform team.

Contribute to output moderation and abuse-pattern awareness.

Mentorship and Engineering Standards

Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.

Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.

Requirements:

Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)

Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.

POCs, internal demos, and tutorial-grade work do not qualify.

5+ Years of Professional Software or AI Engineering Experience

With at least 3 years focused on LLM applications, AI engineering, or production AI systems.

Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.

Strong Python Proficiency and Service Development

Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.

Not notebook-only.

Depth Across LLM APIs and Agent Systems

Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).

Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.

Hands-on with tool calling, structured outputs, and multi-step reasoning.

Demonstrated, Systematic Evaluation Practice - Non-Negotiable

Must have built evaluation harnesses that gate production releases, not ad-hoc testing.

Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.

Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.

Cost Discipline for Production AI

Track record of measurable cost optimisation on production AI features.

Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.

AWS Working Knowledge

Hands-on with EC2, S3, IAM, and Docker.

Comfort with CI/CD workflows and deploying AI services.

Awareness of LLM Security Failure Modes

Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.

Nice to Have

• Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
• MCP server authoring
• Open-source AI contributions
• Published technical writing on LLM systems
• Multi-modal model experience
• Fine-tuning exposure (LoRA, QLoRA, PEFT)