Ai Engineering Managers at Techjays · Coimbatore · 10 - 15 years · Profitable · Posted 21 May 2026

About Techjays
At Techjays, we build production-grade AI platforms for global clients. We operate at the intersection of backend engineering, distributed systems, and applied AI — delivering secure, scalable, and enterprise-ready intelligent systems. Our team has built and scaled products at Google, Akamai, NetApp, ADP, Cognizant, and Capgemini.
About the Role
This is not a feature-delivery role. We are looking for an AI Lead who can architect, own, and scale intelligent backend systems end-to-end. You will drive both technical direction and execution — working across LLM integrations, RAG pipelines, agentic AI workflows, and cloud-native backend systems for global clients.
What You'll Do
- Architect and scale backend systems powering AI-driven applications
- Design and implement RAG pipelines, AI agents, and LLM integrations
- Own systems end-to-end — from architecture to deployment and scaling
- Integrate and optimize LLMs (Claude, GPT, Gemini) for real-world production use cases
- Build high-performance distributed systems with observability and cost efficiency
- Lead backend and AI initiatives with strong technical ownership
- Mentor engineers and raise the technical bar across teams
- Collaborate with product and AI teams to deliver AI-native solutions
What We're Looking For
- 6–10 years of strong backend engineering experience
- Hands-on expertise in Python (FastAPI / Django / Flask)
- Deep understanding of Generative AI and LLM-based systems
- Strong experience with RAG pipelines and Vector Databases (Pinecone, FAISS, ChromaDB, Weaviate)
- Solid knowledge of Agentic AI — building autonomous agents and multi-agent workflows
- Proficiency in AWS or GCP in production environments
- Experience with distributed systems, microservices, and system design
- Strong grasp of Data Structures, Algorithms, and Design Patterns
- Familiarity with WebSockets, Git, Linux/Unix, and CI/CD
Nice to Have
- Experience with Anthropic Claude API and Claude Code
- Familiarity with real-time data systems or streaming (Kafka, etc.)
- MLOps and AI system lifecycle experience
- Optimizing AI systems for latency, cost, and scalability
Who You Are
- You think in systems, not just features
- You take full ownership of what you build
- You are comfortable navigating fast-moving, ambiguous environments
- You stay updated with the latest in Generative AI and backend technologies
- Strong communicator who can collaborate across teams and global clients
What We Offer
- Competitive compensation (Best in Industry)
- Work on production-grade AI systems used by global clients
- Exposure to cutting-edge AI tools and frameworks
- A culture that values clarity, integrity, and continuous growth

About Techjays
About
Techjays is The AI Reimagination Company — an enterprise AI partner founded by leaders with experience at Google. We don’t just experiment with AI; we build, deploy, and scale production-grade systems that solve real business problems.
Our focus is on industries where impact matters most — manufacturing, logistics, and complex enterprise operations. From intelligent automation to LLM-powered workflows, we design solutions that deliver measurable business outcomes in under 90 days.
With 20+ live AI systems already in production and over $100M in cost savings delivered, our work goes beyond proof of concept — it drives tangible value.
Headquartered in Menlo Park, Techjays operates across seven countries including the USA, India, UAE, UK, Canada, Australia, and Bangladesh — helping global enterprises rethink how they build, operate, and scale with AI at the core.
Tech stack
Candid answers by the company
Coimbatore (remote) and Remote options available.
Product showcase
Photos
Connect with the team
Similar jobs (10)

AI Architect – Enterprise AI & Generative AI ( Remote) - Contractual
Experience: 8+ years
Location: Remote, India
Employment Type: Contractual
Working Hours: 3:00 PM – 12:00 AM IST
Client Engagement: US-based client
About the Role
We are looking for a hands-on, client-facing AI Architect to lead the architecture, technical direction, and production implementation of enterprise AI and Generative AI solutions for a US-based client.
You should combine strong software engineering and cloud architecture fundamentals with practical experience building secure, scalable, and reliable AI applications. This role involves end-to-end technical ownership, from solution design and prototyping to production deployment and optimization. It is not a research-only, advisory-only, or prompt-writing position.
Key Responsibilities
- Lead end-to-end architecture and delivery of AI/ML and Generative AI solutions, from discovery and proof of concept to production rollout.
- Design LLM-powered applications using Retrieval-Augmented Generation (RAG), embeddings, vector databases, AI agents, and orchestration frameworks.
- Define data ingestion, chunking, retrieval, grounding, evaluation, and knowledge-refresh strategies.
- Select appropriate AI models and platforms based on quality, latency, cost, security, and operational requirements.
- Design cloud-native architectures, APIs, integrations, identity controls, monitoring, and resilient deployment patterns.
- Create architecture diagrams, technical designs, implementation roadmaps, and technical standards.
- Implement AI quality and safety measures, including hallucination mitigation, guardrails, access controls, and prompt-injection defenses.
- Guide engineering, data, ML, and DevOps teams through implementation, code reviews, troubleshooting, and go-live readiness.
- Lead technical discussions and design reviews with US client stakeholders.
- Establish production monitoring, CI/CD, versioning, incident handling, and performance and cost optimization practices.
Required Skills & Qualifications
- 8+ years of relevant experience in software engineering, AI/ML engineering, data engineering, or technology architecture.
- Proven experience personally architecting and deploying at least one enterprise-grade AI or Generative AI solution into production.
- Strong practical knowledge of LLMs, RAG, embeddings, vector databases, orchestration frameworks, and model evaluation.
- Hands-on experience with Python and APIs, including prototyping, code review, and troubleshooting.
- Experience with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud Platform (GCP).
- Understanding of data pipelines, SQL/NoSQL databases, containers, CI/CD, MLOps, and LLMOps.
- Knowledge of enterprise security, privacy, identity and access management, and responsible AI practices.
- Experience independently leading architecture workshops, design reviews, and technical discussions with US clients.
- Excellent written and spoken English, documentation, and stakeholder management skills.
- Availability to work from 3:00 PM to 12:00 AM IST and willingness to accept a contractual engagement.
Preferred Experience
- Azure AI Foundry, Azure OpenAI, Amazon Bedrock, or Google Vertex AI.
- Azure AI Search or equivalent retrieval tools.
- LangChain, LangGraph, Semantic Kernel, and agent/tool orchestration.
- Model fine-tuning, predictive ML, document intelligence, multimodal AI, or real-time AI applications.
- Experience in cloud modernization, enterprise integrations, data analytics, or technology consulting.
- Relevant AI/cloud architecture certifications and experience mentoring technical teams.
What Success Looks Like
- Designing secure, scalable, production-ready AI solutions rather than demos or conceptual presentations.
- Making sound technical decisions around feasibility, performance, reliability, cost, and AI risks.
- Taking ownership of architecture decisions and resolving technical blockers with limited supervision.
- Building trust with senior US stakeholders and collaborating effectively with India-based delivery teams.
Contract Details
- Initial engagement: Minimum 3 months, with extension subject to project requirements and performance.
- Working schedule: 3:00 PM – 12:00 AM IST.
- Potential permanent employment: After 18 months, the client may consider direct permanent employment at its sole discretion. Conversion is not guaranteed.
Mandatory Screening Criteria
Candidates should be able to:
- Explain an enterprise AI/GenAI solution they personally architected and deployed, including architecture, scale, evaluation, and business impact.
- Whiteboard an enterprise RAG or agentic solution covering data flow, security, authentication, authorization, monitoring, and cost controls.
- Discuss real-world model-quality issues, hallucinations, privacy risks, incidents, and architectural trade-offs.
- Lead a technical design review with US client stakeholders.
- Confirm acceptance of the working hours and contractual engagement.
Apply only if you have hands-on experience architecting and deploying enterprise AI/GenAI solutions in production.
Hiring for AI Engineer
Exp: 5 - 12 yrs
Edu : BE/B.Tech/MCA
Work Location : Pune / Mumbai
Skill Set:
Total experience ranging from 5–10 years in software engineering/AI roles
Min 5 years strong programming experience in Python or Typescript is a MUST
Min 2.5 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks
2+ years shipping LLM systems in production
Experience with cloud platforms (AWS/Azure/GCP)
Job Description – AI Engineer (End-to-End Development & Deployment)
Role Summary
We are looking for an AI Engineer with hands-on experience in designing, developing, deploying, and maintaining Generative/Agentic AI solutions in production. The ideal candidate should have end-to-end ownership of AI applications, from development to deployment, monitoring, and optimization.
Key Responsibilities
● Design, build, and deploy Generative/Agentic AI solutions.
● Develop applications using LLMs, RAG, AI agents, and vector databases.
● Build scalable APIs and integrate AI solutions with enterprise applications.
● Implement CI/CD pipelines, containerization, and MLOps best practices.
● Monitor, optimize, and maintain production AI systems.
● Collaborate with cross-functional teams to deliver business-driven AI solutions.
Required Skills
● Strong programming skills in Python.
● Experience with vector databases (e.g., Pinecone, FAISS, ChromaDB) and graph memory systems
● Knowledge of atleast one agent development framework: Google ADK (preferred), LangChain/LangGraph/LlamaIndex, CrewAI
● Experience with LLMs, RAG, GenAI, AgenticAI Agents
● Hands-on experience with FastAPI, and REST APIs.
● Knowledge of Docker, Kubernetes, Git, CI/CD.
● Experience with AWS, Azure, or GCP.
● Experience with security compliance, monitoring and observability tools such as AWS CloudWatch, Azure Monitor, Google Cloud Monitoring.
Job Title: Senior AI/ML Engineer
Company: Timble Technologies Pvt. Ltd
Location: Gurugram (Hybrid)
Experience: 2 TO 5 Years
About Us
Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.
Role Overview
We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.
Key Responsibilities
· Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).
· GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.
· Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.
· MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.
· Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.
· Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.
Required Qualifications & Skills
· Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.
· Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.
· GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.
· Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.
· Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.
· Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).
Preferred Qualifications
· Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.
· Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).
· Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.
Kody Technolab Limited
AI/ML Lead (7+ Years Experience)
Location: Ahmedabad / Gandhinagar
Experience: 7+ Years
Employment Type: Full-Time
Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy
cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have
strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and
cloud-based AI deployments.
Key Responsibilities
• Design, develop, and deploy Machine Learning and Deep Learning models for classification,
regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.
• Build and maintain end-to-end ML pipelines including data preprocessing, feature
engineering, model training, validation, evaluation, and deployment.
• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related
frameworks.
• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama,
Claude, and Stable Diffusion.
• Collaborate with product, engineering, and business teams to translate requirements into
scalable AI solutions.
• Optimize model performance, scalability, and reliability for production environments.
• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.
• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence,
Mathematics, or a related field.
• 7+ years of hands-on experience in AI/ML product development.
• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and
Hugging Face.
• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.
• Strong understanding of the ML lifecycle including model training, tuning, deployment,
monitoring, and optimization.
• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.
• Experience with AWS, Azure, or GCP cloud platforms.
• Strong problem-solving and analytical skills.Preferred Skills
• Fine-tuning and deployment of Large Language Models.
• Experience with RAG (Retrieval Augmented Generation) architectures.
• Contributions to open-source AI projects or research publications.
• Knowledge of model interpretability, data annotation, and feature engineering.
• C++ experience for high-performance AI applications.
Why Join Kody Technolab Limited?
Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,
and enterprise-scale applications while collaborating with a highly skilled technology team.
Visit the Website to know more about us.
Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution
Kody Robots | Robotics Company in India for Autonomous Robots
Most sales tools help you send emails. We’re building something different.
At Salesforge, we’re creating autonomous AI agents that can:
Find the right prospects
Generate highly personalized outreach
Run conversations
And book meetings
All without human involvement.
Why this is interesting
A lot of AI products stop at “generate text.” We’re focused on outcomes.
That means solving problems like:
How do you generate messages that actually get replies?
How do you evaluate and improve agent performance over time?
How do you orchestrate millions of AI-driven interactions reliably?
How do you combine structured data + LLMs in a way that scales?
If you enjoy working at the intersection of systems + AI + real-world feedback loops, this will feel like a playground.
What you’ll be working on
You won’t be maintaining legacy systems.
You’ll be:
Designing and building core backend systems that power our AI agents
Creating APIs and services that handle high-scale, real-time workflows
Working with queues (Kafka / SQS / RabbitMQ) to orchestrate async systems
Thinking deeply about performance, cost, and reliability in AI pipelines
Shipping features end-to-end with a small, senior team
The team
We’re a small group of experienced builders. We move quickly, care about quality, and avoid unnecessary process.
No layers of management.
No long planning cycles.
Lots of ownership and autonomy.
What we’re looking for
5+ years of backend engineering experience
Strong system design fundamentals
Experience with distributed systems and async processing
Familiarity with relational and/or document databases
Clear communicator, low ego, high ownership
Why join
You’ll work on a product where the output is measurable (meetings booked, revenue generated)
You’ll have real ownership from day one
You’ll be early in building a new category (AI sales agents)
You’ll grow as fast as we do
Solid product experience and an educational background from Tier‑1 universities are preferred.
As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities.
In this role, you will:
- Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance.
- Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features.
- Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability.
- Work with SQL and NoSQL databases to implement efficient data models and service access patterns.
- Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs).
- Use AI powered engineering tools to improve development quality, speed, and productivity.
- Mentor engineers, supporting them in technical planning, implementation, and best practices.
- Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure.
- Write unit and integration tests and participate in code reviews to uphold engineering excellence.
- Investigate production issues, ensuring timely and effective solutions.
- Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies.
Who You’ll Work With
You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction.
What Makes You a Qualified Candidate
(Nonnegotiable qualifications)
- Bachelor’s degree in Computer Science or equivalent from a recognized institution.
- 5+ years of experience in backend services, distributed systems, or data platform development.
- Strong proficiency in Java, Go, or Python for service development.
- Good understanding of design principles, distributed system patterns, and service framework.
- Hands-on experience designing and developing RESTful APIs.
- Experience with SQL and NoSQL databases and data modelling.
- Strong debugging, problem solving, and troubleshooting skills.
- Experience with modern containerization and orchestration tools such as Kubernetes.
- Knowledge of public cloud platforms.
- Experience with AI productivity tools (e.g., GitHub Copilot).
- Ability to work independently, drive workstreams, and deliver high quality outcomes.
- Strong communication and collaboration skills.
What You’ll Bring
(Preferred qualifications)
- Familiarity with messaging systems such as Kafka.
- Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs.
- A track record of influencing design decisions and driving engineering best practices.
- The ability to mentor engineers and guide them through design, planning, and execution.
- A proactive mindset and comfort working in fast paced, dynamic environments.
- Curiosity, adaptability, and a passion for building impactful AI-driven products.
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
About the Role
We’re building the next generation of AI-powered business software, and we’re looking for people who want to shape that future with us. With Lumen, we’re reimagining how users interact with CRM — moving beyond screens, menus and dashboards to an intelligent interface where users can simply ask AI to take actions, retrieve knowledge, generate insights and get work done. With Agent Studio, we’re enabling businesses to build, test and deploy their own AI agents for real-world workflows. And with Invorto, we’re bringing AI to voice, allowing businesses to create intelligent voice agents tailored to their customer and operational use cases.
What makes this especially exciting is the stage and scale of the opportunity. You’ll get to work on genuinely hard problems across LLMs, agents, reasoning, orchestration, voice AI, evaluation, reliability and enterprise security — not as isolated experiments, but as products used in real business workflows. You’ll have the opportunity to build zero-to-one, own meaningful parts of the product end-to-end, work closely with customers, experiment rapidly, and see your work reach production at scale.
Why join now? Because the playbook for enterprise AI is still being written. You won’t just be implementing someone else’s roadmap — you’ll help define the product, architecture and experiences that become that playbook. Expect high ownership, fast iteration, hard technical and product problems, direct customer impact, and the chance to build AI systems that have to work reliably in the real world — not just in a demo.
About the Role
We are looking for a Senior AI/ML Backend Engineer to help build the core intelligence layer powering Lumen and Agent Studio. You will design and ship production-grade backend systems that integrate LLMs into real agentic workflows — taking actions, retrieving knowledge and generating insights inside a live CRM product used by real businesses. This is a hands-on, build-focused role with direct ownership of systems that ship to production.
What You’ll Do
- Design, build and scale backend services in Python that power LLM-driven and agentic features within Lumen and Agent Studio.
- Build and productionize agentic AI systems — including planning, tool use, orchestration, memory and multi-step task execution.
- Integrate LLMs into core product workflows, focusing on reliability, latency, cost and correctness at production scale.
- Build robust APIs and services that connect AI agents with CRM data, business logic and third-party systems.
- Own evaluation, testing and monitoring for AI features to ensure they behave reliably in real-world, not just demo, conditions.
- Collaborate closely with product, design and other engineers to take features from zero to one and iterate rapidly based on real usage and customer feedback.
- Work directly with customers and customer-facing teams to understand real workflows, debug issues and translate feedback into product and engineering decisions.
What We’re Looking For
- 2–4 years of professional backend engineering experience, with strong hands-on Python skills.
- Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
- Should be hands-on with traditional Machine learning frameworks like Pytorch, Scikit-learn
- Solid understanding of API design, backend architecture, databases and distributed systems fundamentals.
- Familiarity with LLM orchestration concepts — prompting, tool/function calling, RAG, agent frameworks, evaluation and guardrails.
- Comfort working in a fast-paced, ambiguous, zero-to-one environment where you’ll be defining as much as building.
- Strong communication skills — this is a customer-facing role, and you will be expected to clearly articulate technical concepts, decisions and trade-offs to both technical and non-technical stakeholders, including customers.
Good to Have
- Experience with enterprise security, reliability or observability practices for AI systems.
- Prior experience working on CRM, SaaS or other enterprise business software.
- Exposure to voice AI or real-time systems.
Senior AI Engineer
Code Generation, Agent Architecture & LLM Systems
📍 Mumbai (On-site) | Full-time | 5+ years
About the Role:
Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.
We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.
The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.
The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.
You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.
Responsibilities:
Agent Architecture
Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.
Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.
Code Generation Pipeline
Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.
Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.
Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.
Self-Repair Loop
Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.
This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.
Context Management
Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.
Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.
Own token budgeting and prompt caching strategy.
Prompt Engineering as a Discipline
Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).
Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.
Version prompts like code with changelogs and rollback capability.
Evaluation and Quality Measurement
Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.
Define regression gates that block quality-degrading changes from shipping.
Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.
This responsibility is non-negotiable at this level.
Model Strategy and Cost
Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.
Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.
Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.
Safety and Reliability of Agent Behaviour
Defend against prompt injection from user content and fetched web content.
Ensure secrets never appear in generated client code.
Define what the agent's tools may and may not do in collaboration with the platform team.
Contribute to output moderation and abuse-pattern awareness.
Mentorship and Engineering Standards
Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.
Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.
Requirements:
Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)
Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.
POCs, internal demos, and tutorial-grade work do not qualify.
5+ Years of Professional Software or AI Engineering Experience
With at least 3 years focused on LLM applications, AI engineering, or production AI systems.
Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.
Strong Python Proficiency and Service Development
Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.
Not notebook-only.
Depth Across LLM APIs and Agent Systems
Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).
Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.
Hands-on with tool calling, structured outputs, and multi-step reasoning.
Demonstrated, Systematic Evaluation Practice - Non-Negotiable
Must have built evaluation harnesses that gate production releases, not ad-hoc testing.
Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.
Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.
Cost Discipline for Production AI
Track record of measurable cost optimisation on production AI features.
Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.
AWS Working Knowledge
Hands-on with EC2, S3, IAM, and Docker.
Comfort with CI/CD workflows and deploying AI services.
Awareness of LLM Security Failure Modes
Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.
Nice to Have
- Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
- MCP server authoring
- Open-source AI contributions
- Published technical writing on LLM systems
- Multi-modal model experience
- Fine-tuning exposure (LoRA, QLoRA, PEFT)





















