Agentic AI Architect at A leading AI and digital transformation consulting firm. · Hyderabad · 12 - 18 years · ₹30L - ₹40L / yr · Posted 10 Jul 2026

Agentic AI Architect
at A leading AI and digital transformation consulting firm.
Job Summary
We are seeking an experienced Agentic AI Architect to design and build enterprise-scale Agentic AI platforms that enable autonomous, intelligent, and collaborative AI agents. The ideal candidate will drive architecture, technology strategy, and AI engineering best practices while delivering scalable, secure, and production-ready AI solutions.
Key Responsibilities
- Design enterprise architecture and technical roadmap for Agentic AI platforms.
- Build scalable multi-agent AI systems with reasoning, planning, memory, and autonomous decision-making capabilities.
- Architect solutions using LLMs, RAG, vector databases, embeddings, prompt engineering, orchestration frameworks, and agent execution engines.
- Design reusable frameworks for agent orchestration, lifecycle management, governance, observability, and monitoring.
- Integrate AI platforms with enterprise applications, APIs, databases, messaging systems, and cloud services.
- Implement AI security, governance, privacy, compliance, guardrails, and Responsible AI practices.
- Evaluate and implement frameworks such as Google ADK, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, and MCP.
- Lead architecture reviews, technical governance, design workshops, and solution validation.
- Develop Proof of Concepts (PoCs) to evaluate emerging AI technologies.
- Mentor engineering teams and establish architecture standards and best practices.
- Collaborate with Product, AI/ML, Data Engineering, Cloud, DevOps, and Security teams.
- Drive AI platform scalability, modernization, performance optimization, and cost efficiency.
Required Skills
- Strong expertise in Agentic AI architecture and enterprise AI solution design.
- Hands-on experience with Large Language Models (GPT, Gemini, Claude, Llama, Mistral).
- Strong knowledge of RAG, Vector Databases, Embeddings, Prompt Engineering, AI Memory, Knowledge Graphs, and AI Orchestration.
- Experience with Google ADK, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, MCP, or similar frameworks.
- Strong Python programming skills.
- Experience with FastAPI, REST APIs, Microservices, Distributed Systems, Event-Driven Architecture, Docker, Kubernetes, CI/CD, Git, and Azure/AWS/GCP.
- Knowledge of MLOps, LLMOps, AI Observability, monitoring, and production deployments.
- Strong understanding of AI Security, Governance, Responsible AI, and Enterprise Architecture.
Qualifications
- Master's or Ph.D. in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
- 10+ years of software engineering experience.
- 5–7+ years of experience designing enterprise AI/ML platforms and distributed systems.
- Proven experience architecting production-grade Agentic AI solutions.
Preferred Experience
- Domain experience in Supply Chain, Manufacturing, Retail, Healthcare, Financial Services, or Enterprise Automation.
- Experience building multi-agent collaboration systems.
- Knowledge of AI Governance and Responsible AI.
- Enterprise Architecture and Cloud Certifications are preferred.

Similar jobs (10)
Strong Lead AI Engineer Profile with agentic systems architecture expertise
2
Mandatory (Experience 1): Must have 6+ years of software or ML engineering, with at least recent 2+ years building and shipping production LLM or agentic AI systems
3
Mandatory (Tech skill 1): Must have hands-on proficiency with at least two agentic frameworks (LangGraph, LangChain, AutoGen, CrewAI), with experience debugging framework internals
4
Mandatory (Tech skill 2): Must have direct SDK experience with Anthropic Claude API (tool use, streaming), OpenAI Assistants API, or Vertex AI Agent Builder
5
Mandatory (Tech skill 3): Must have Python mastery — production-quality code, type annotations, unit and integration tests, packaging, and performance profiling
6
Mandatory (Tech skill 4): Must have RAG pipeline depth — embedding model selection, vector stores (Pinecone, Weaviate, pgvector), hybrid retrieval, RAGAS or custom evaluation harnesses
7
Mandatory (Tech skill 5): Must have cloud deployment experience with AWS, Azure, or GCP; Docker, Kubernetes, IaC basics (Terraform or CDK), and CI/CD pipelines
8
Mandatory (Tech skill 6): Must have agent observability experience — LangSmith, Helicone, or equivalent — with ability to diagnose latency, cost, and quality issues in production traces
9
Mandatory (Tech skill 8) : Must have owned full sub-system designs — agent topology, data flows, API contracts, failure handling — for a bounded scope, and built multi-agent graphs, tool orchestration, retrieval, and memory systems.
10
Mandatory (Tech skill 7): Must have track record of shipping 2+ agentic or ML systems to production — not just proof-of-concepts — with documented performance benchmarks
11
Mandatory (Communication): Must be able to write crisp component specifications and communicate architectural trade-offs to both engineers and non-technical stakeholders
Strong Lead AI Engineer Profile with agentic systems architecture expertise
2
Mandatory (Experience 1): Must have 6+ years of software or ML engineering, with at least recent 2+ years building and shipping production LLM or agentic AI systems
3
Mandatory (Tech skill 1): Must have hands-on proficiency with at least two agentic frameworks (LangGraph, LangChain, AutoGen, CrewAI), with experience debugging framework internals
4
Mandatory (Tech skill 2): Must have direct SDK experience with Anthropic Claude API (tool use, streaming), OpenAI Assistants API, or Vertex AI Agent Builder
5
Mandatory (Tech skill 3): Must have Python mastery — production-quality code, type annotations, unit and integration tests, packaging, and performance profiling
6
Mandatory (Tech skill 4): Must have RAG pipeline depth — embedding model selection, vector stores (Pinecone, Weaviate, pgvector), hybrid retrieval, RAGAS or custom evaluation harnesses
7
Mandatory (Tech skill 5): Must have cloud deployment experience with AWS, Azure, or GCP; Docker, Kubernetes, IaC basics (Terraform or CDK), and CI/CD pipelines
8
Mandatory (Tech skill 6): Must have agent observability experience — LangSmith, Helicone, or equivalent — with ability to diagnose latency, cost, and quality issues in production traces
9
Mandatory (Tech skill 8) : Must have owned full sub-system designs — agent topology, data flows, API contracts, failure handling — for a bounded scope, and built multi-agent graphs, tool orchestration, retrieval, and memory systems.
10
Mandatory (Tech skill 7): Must have track record of shipping 2+ agentic or ML systems to production — not just proof-of-concepts — with documented performance benchmarks
11
Mandatory (Communication): Must be able to write crisp component specifications and communicate architectural trade-offs to both engineers and non-technical stakeholders
12
Mandatory (Note 1) : Role is Hybrid, WFH flexibility as well upto 6 days a month
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
Support with design and build to prove out agentic AI solution flow by working with other data
scientists and engineers to build, train Large Language Model (LLM) architectures, RAG
systems, and autonomous agentic workflows
Key qualifications:
>> AI solution design & Development: Design Agentic AI solutions using RAG (Retrieval-
Augmented Generation) and orchestration frameworks like LangGraph or LangChain.
>> Model Fine-Tuning: Solid understanding and experience with Pre-train, fine-tune, and
optimize open-source like BERT, LLama, and other proprietary foundation models for domain-
specific tasks
>> Solid Stats and ML foundations and (vibe) coding skills with Python, PySpark
>> Implement validation frameworks and tracing practices (using tools like Arize) to monitor
agent behavior, guard against model drift, and ensure compliance
>> Collaborate with Engineering to deploy models securely on cloud and on-prem ecosystems
Job Details
Position Title: AI Evangelist
Role Purpose
We are seeking a highly experienced AI Evangelist & Core AI Engineer who combines deep technical expertise in Artificial Intelligence with the ability to influence, educate, demonstrate, and accelerate AI adoption across the enterprise.
The role requires deep understanding of AI, Machine Learning, Deep Learning, Generative AI, Large Language Models, Agentic AI, AI engineering, and modern software development practices, combined with significant hands-on experience implementing scalable AI applications in complex enterprise environments.
Key Responsibilities
1. Core AI Engineering & Architecture
- Design, develop, and implement enterprise-grade AI and Generative AI applications.
- Build scalable applications using LLMs, multimodal models, AI agents, RAG, vector databases, knowledge graphs, APIs, and enterprise data platforms.
- Architect AI solutions capable of supporting enterprise-scale workloads with appropriate considerations for:
- Scalability
- Reliability
- Security
- Performance
- Observability
- Cost optimization
- Governance
- Develop and implement advanced Retrieval-Augmented Generation (RAG) architectures including hybrid search, reranking, metadata filtering, semantic retrieval, and knowledge grounding.
- Build multi-agent and agentic AI applications capable of reasoning, tool usage, workflow execution, orchestration, and enterprise system integration.
- Design AI applications integrating structured and unstructured enterprise information.
- Evaluate architecture choices between commercial models, open-source models, small language models, domain-specific models, and hosted AI platforms.
- Implement model routing, prompt orchestration, caching, guardrails, evaluation pipelines, and fallback strategies.
- Work closely with cloud, platform, security, enterprise architecture, DevOps, and application engineering teams.
2. Deep AI / ML / DL Expertise
The candidate should have strong conceptual and practical understanding across the modern AI technology landscape, including:
- Artificial Intelligence /Machine Learning/ Deep Learning/ Neural Networks /LLM/SLM/RAG/Graph RAG / MLOps / LLMOps / GenAIOps
3. Generative AI & LLM Engineering
- Build production-grade applications utilizing leading commercial and open-source LLM ecosystems.
- Design scalable LLM platforms supporting multiple enterprise applications and use cases.
- Develop reusable LLM services, APIs, components, agent frameworks, and reference architectures.
4. AI Agents & Automation
- Design and implement AI agents and agentic workflows that automate complex business and engineering processes.
- Build agents capable of interacting with enterprise applications, APIs, databases, documents, development environments, and workflow platforms.
- Evaluate emerging agent architectures and orchestration frameworks pragmatically.
- Develop reusable patterns for:
- Single-agent systems
- Multi-agent systems
- Human-in-the-loop workflows
- Autonomous workflows
- Tool-calling agents
- Coding agents
- Enterprise knowledge agents
- Establish appropriate controls for AI agent identity, permissions, auditability, security, and human oversight.
5. AI-Enabled Software Engineering
Drive adoption of AI throughout the Software Development Life Cycle.
- Primary Skillsets: Python, Generative AI, Agentic AI, LLM, experience with designing and developing production grade AI solutions, AWS/Azure/GCP, LLMOps, Data Engineering (Databricks/Snowflake), Regulated GenAI, Data and Decisions, and Agentic Systems.
- Preferred: Pharma or life sciences experience, especially in regulated (GxP) environments, experience setting up a team or practice from scratch.
- Only immediate joiners are considered.

AI Architect – Enterprise AI & Generative AI ( Remote) - Contractual
Experience: 8+ years
Location: Remote, India
Employment Type: Contractual
Working Hours: 3:00 PM – 12:00 AM IST
Client Engagement: US-based client
About the Role
We are looking for a hands-on, client-facing AI Architect to lead the architecture, technical direction, and production implementation of enterprise AI and Generative AI solutions for a US-based client.
You should combine strong software engineering and cloud architecture fundamentals with practical experience building secure, scalable, and reliable AI applications. This role involves end-to-end technical ownership, from solution design and prototyping to production deployment and optimization. It is not a research-only, advisory-only, or prompt-writing position.
Key Responsibilities
- Lead end-to-end architecture and delivery of AI/ML and Generative AI solutions, from discovery and proof of concept to production rollout.
- Design LLM-powered applications using Retrieval-Augmented Generation (RAG), embeddings, vector databases, AI agents, and orchestration frameworks.
- Define data ingestion, chunking, retrieval, grounding, evaluation, and knowledge-refresh strategies.
- Select appropriate AI models and platforms based on quality, latency, cost, security, and operational requirements.
- Design cloud-native architectures, APIs, integrations, identity controls, monitoring, and resilient deployment patterns.
- Create architecture diagrams, technical designs, implementation roadmaps, and technical standards.
- Implement AI quality and safety measures, including hallucination mitigation, guardrails, access controls, and prompt-injection defenses.
- Guide engineering, data, ML, and DevOps teams through implementation, code reviews, troubleshooting, and go-live readiness.
- Lead technical discussions and design reviews with US client stakeholders.
- Establish production monitoring, CI/CD, versioning, incident handling, and performance and cost optimization practices.
Required Skills & Qualifications
- 8+ years of relevant experience in software engineering, AI/ML engineering, data engineering, or technology architecture.
- Proven experience personally architecting and deploying at least one enterprise-grade AI or Generative AI solution into production.
- Strong practical knowledge of LLMs, RAG, embeddings, vector databases, orchestration frameworks, and model evaluation.
- Hands-on experience with Python and APIs, including prototyping, code review, and troubleshooting.
- Experience with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud Platform (GCP).
- Understanding of data pipelines, SQL/NoSQL databases, containers, CI/CD, MLOps, and LLMOps.
- Knowledge of enterprise security, privacy, identity and access management, and responsible AI practices.
- Experience independently leading architecture workshops, design reviews, and technical discussions with US clients.
- Excellent written and spoken English, documentation, and stakeholder management skills.
- Availability to work from 3:00 PM to 12:00 AM IST and willingness to accept a contractual engagement.
Preferred Experience
- Azure AI Foundry, Azure OpenAI, Amazon Bedrock, or Google Vertex AI.
- Azure AI Search or equivalent retrieval tools.
- LangChain, LangGraph, Semantic Kernel, and agent/tool orchestration.
- Model fine-tuning, predictive ML, document intelligence, multimodal AI, or real-time AI applications.
- Experience in cloud modernization, enterprise integrations, data analytics, or technology consulting.
- Relevant AI/cloud architecture certifications and experience mentoring technical teams.
What Success Looks Like
- Designing secure, scalable, production-ready AI solutions rather than demos or conceptual presentations.
- Making sound technical decisions around feasibility, performance, reliability, cost, and AI risks.
- Taking ownership of architecture decisions and resolving technical blockers with limited supervision.
- Building trust with senior US stakeholders and collaborating effectively with India-based delivery teams.
Contract Details
- Initial engagement: Minimum 3 months, with extension subject to project requirements and performance.
- Working schedule: 3:00 PM – 12:00 AM IST.
- Potential permanent employment: After 18 months, the client may consider direct permanent employment at its sole discretion. Conversion is not guaranteed.
Mandatory Screening Criteria
Candidates should be able to:
- Explain an enterprise AI/GenAI solution they personally architected and deployed, including architecture, scale, evaluation, and business impact.
- Whiteboard an enterprise RAG or agentic solution covering data flow, security, authentication, authorization, monitoring, and cost controls.
- Discuss real-world model-quality issues, hallucinations, privacy risks, incidents, and architectural trade-offs.
- Lead a technical design review with US client stakeholders.
- Confirm acceptance of the working hours and contractual engagement.
Apply only if you have hands-on experience architecting and deploying enterprise AI/GenAI solutions in production.
Applied AI Engineer
About the Role
We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.
We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.
As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.
Key Responsibilities
- Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
- Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
- Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
- Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
- Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
- Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
- Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
- Deploy and maintain AI services on AWS or Azure.
- Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.
Required Qualifications
- 5+ years of professional software development experience in Python or JavaScript.
- Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
- Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
- Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
- Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
- Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
- Familiarity with MCP and human-in-the-loop workflows.
- Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.
Good to Have
- Experience with RLHF or RLAIF.
- Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
- Experience with graph databases and graph-based data models.
- Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.
Why Join Us?
- Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
- Build foundational AI architecture and production-grade LLM workflows.
- Take ownership of technical decisions and system design as an early engineering team member.
- Solve challenging problems at the intersection of AI, finance, and intelligent automation.
AI Solution Architect
Experience: 12+ Years
Location: Coimbatore / Hybrid
Joining: Immediate / Within 30 Days
Primary Skills: Enterprise Architecture, Python, REST APIs, Microservices, Distributed Systems, Cloud (AWS/Azure/GCP), CI/CD, Docker, Kubernetes, Enterprise Data Architecture, Integration Patterns.
Preferred Skills: LLM Integrations, RAG Pipelines, AI Agents, Agentic Workflows, MCP (Model Context Protocol), Vector Databases, Prompt Engineering, LangChain/LlamaIndex, LLMOps, Multi-Agent Orchestration.
About the Role
At Techjays, we're helping companies reimagine how they build, operate, and scale with AI at the core. We focus on building secure, scalable, production-grade AI systems that solve real business problems and deliver measurable outcomes.
We're looking for an AI Solution Architect who can own enterprise-level solution architecture end-to-end. The ideal candidate combines deep technical expertise with the ability to understand complex business challenges, engage with prospective clients, and design compelling, scalable, AI-native solutions.
This is a senior technical role at the intersection of enterprise architecture, pre-sales, solutioning, and delivery governance. You'll collaborate with leadership, engineering teams, and clients to architect solutions spanning AI integrations, RAG pipelines, agentic workflows, cloud infrastructure, and enterprise platforms.
This role requires a strong technical background and current hands-on expertise. Candidates with purely pre-sales experience or non-technical solutioning backgrounds will not be a fit.
Key Responsibilities
- Own end-to-end enterprise architecture for AI-native platforms, defining high-level and low-level designs across backend systems, data platforms, and AI components.
- Lead solutioning for complex enterprise engagements, translating client requirements into technically sound, secure, scalable, and commercially viable architectures.
- Define reference architectures and design standards for LLM integrations, RAG pipelines, agentic workflows, MCP-based integrations, and enterprise data platforms.
- Partner with pre-sales and business development teams to prepare RFP responses, technical proposals, solution presentations, and architecture documents.
- Lead client discovery sessions and technical presentations, communicating architectural decisions and trade-offs to technical and executive stakeholders.
- Conduct architecture reviews and technical assessments to ensure scalability
Role Overview
We are looking for an experienced Data Scientist – Agentic AI with strong expertise in Python, Machine Learning, Generative AI, Large Language Models (LLMs), RAG and Agentic AI.
The ideal candidate should have hands-on experience in developing, fine-tuning, evaluating and deploying machine learning and GenAI solutions. The candidate should be comfortable working with open-source LLMs, LangChain/LangGraph, PySpark and AI observability/tracing frameworks.
The role involves building intelligent AI systems that can reason, use tools, retrieve information and execute multi-step tasks using Agentic AI architectures.
Mandatory Technical Skills
1. Data Science & Python
- 5+ years of experience in Data Science / Machine Learning / AI.
- Strong programming experience in Python.
- Strong understanding of data analysis, feature engineering and statistical techniques.
- Experience with Python ML and data science libraries such as:
- NumPy
- Pandas
- Scikit-learn
- Matplotlib / Seaborn
- Good understanding of data preprocessing, exploratory data analysis and experimentation.
2. Machine Learning & Statistics
- Strong understanding of Machine Learning fundamentals.
- Experience with supervised and unsupervised learning techniques.
- Knowledge of:
- Regression
- Classification
- Clustering
- Feature Engineering
- Model Selection
- Hyperparameter Tuning
- Cross-validation
- Strong understanding of Statistics / ML fundamentals.
- Ability to interpret model performance and statistical results.
3. Generative AI / LLM
- Strong hands-on experience with Generative AI and Large Language Models (LLMs).
- Understanding of Transformer architecture and modern LLM-based applications.
- Experience working with commercial or open-source LLMs.
- Strong understanding of:
- Prompt Engineering
- Context Management
- Embeddings
- Tokenization
- LLM inference
- Hallucination mitigation
4. RAG – Retrieval Augmented Generation
- Strong hands-on experience developing RAG applications.
- Experience with:
- Document ingestion
- Chunking
- Embeddings
- Vector search
- Semantic search
- Retrieval pipelines
- Context retrieval
- Reranking
- Ability to optimize RAG pipelines for relevance, accuracy and latency.
- Experience integrating LLMs with enterprise knowledge sources.
5. Agentic AI
- Hands-on experience building Agentic AI / AI Agent solutions.
- Understanding of agent architecture and multi-step reasoning workflows.
- Experience with:
- AI Agents
- Multi-Agent systems
- Tool Calling
- Function Calling
- Agent orchestration
- Planning and reasoning workflows
- Memory
- Workflow automation
- Ability to build agents that can interact with tools, APIs, databases and external systems.
6. LangChain / LangGraph
- Strong hands-on experience with LangChain and/or LangGraph.
- Experience building LLM workflows and agent-based applications.
- Understanding of:
- Chains
- Agents
- Tools
- State management
- Graph-based workflows
- Agent orchestration
- Retrieval workflows
- Experience designing scalable Agentic AI workflows.
7. LLM Fine-Tuning
- Hands-on experience with LLM fine-tuning.
- Understanding of techniques such as:
- Supervised Fine-Tuning (SFT)
- Parameter-Efficient Fine-Tuning
- LoRA
- QLoRA
- Experience preparing datasets for fine-tuning.
- Ability to evaluate fine-tuned models against baseline models.
- Understanding of model optimization and inference considerations.
8. BERT / LLaMA / Open-Source LLMs
Experience working with one or more open-source / transformer-based models such as:
- BERT
- LLaMA / Llama
- Mistral
- Gemma
- Qwen
- Other open-source LLMs
Candidate should understand model loading, inference, fine-tuning and evaluation.
9. PySpark
- Strong experience with PySpark for large-scale data processing.
- Experience working with large datasets and distributed data processing.
- Knowledge of:
- Data transformations
- Data cleaning
- Aggregations
- Joins
- Spark SQL
- Performance optimization
- Ability to build scalable data processing pipelines.
10. Model Validation & Evaluation
- Experience validating and evaluating ML and GenAI models.
- Understanding of traditional ML evaluation metrics.
- Experience evaluating LLM/RAG applications using relevant quality metrics.
- Ability to compare model performance and identify areas for improvement.
- Experience with:
- Accuracy
- Precision
- Recall
- F1 Score
- ROC-AUC
- Retrieval metrics
- LLM response quality
- Groundedness / relevance
- Experience designing evaluation datasets and test cases is preferred.
11. AI Tracing / Observability
- Experience with AI/LLM tracing and observability.
- Ability to monitor AI applications in production.
- Experience tracking:
- LLM requests/responses
- Latency
- Token usage
- Errors
- Retrieval performance
- Agent/tool execution
- Model performance
- Exposure to tools/frameworks such as LangSmith, OpenTelemetry, Arize Phoenix, MLflow or similar is preferred.
12. Model Deployment
- Experience deploying ML/LLM/GenAI solutions into production.
- Exposure to cloud and/or on-premise model deployment.
- Experience with model serving, APIs and production inference.
- Knowledge of deployment environments such as:
- AWS
- Azure
- GCP
- On-premise infrastructure
- Experience with Docker, APIs and CI/CD is an advantage.
Key Responsibilities
- Design, develop and deploy Data Science, Machine Learning and GenAI solutions.
- Build production-ready RAG and Agentic AI applications.
- Develop intelligent agents capable of tool calling, reasoning and multi-step task execution.
- Build LLM-powered applications using LangChain/LangGraph.
- Work with open-source LLMs including BERT, LLaMA and other transformer-based models.
- Fine-tune LLMs for specific business use cases.
- Develop scalable data processing pipelines using PySpark.
- Perform data analysis, feature engineering and statistical modeling.
- Develop and maintain model validation and evaluation frameworks.
- Evaluate ML and LLM models using appropriate performance and quality metrics.
- Implement AI tracing, monitoring and observability for production GenAI systems.
- Deploy models and AI applications in cloud or on-premise environments.
- Optimize model performance, response quality, latency and cost.
- Troubleshoot issues related to model inference, retrieval, agents and LLM workflows.
- Collaborate with Data Scientists, ML Engineers, Software Engineers and business stakeholders.
- Convert business requirements into scalable AI/ML solutions.
Good to Have
- Experience with Vector Databases such as:
- FAISS
- Pinecone
- Weaviate
- Milvus
- Chroma
- Azure AI Search
- Experience with MLflow or similar ML lifecycle tools.
- Experience with Docker/Kubernetes.
- Experience with REST APIs / FastAPI.
- Knowledge of cloud AI/ML services.
- Experience with MLOps / LLMOps.
- Experience with multi-agent frameworks other than LangChain/LangGraph.
- Experience working with enterprise GenAI applications.
Ideal Candidate Profile
The ideal candidate should be a Data Scientist / ML Engineer with strong GenAI and Agentic AI experience, rather than a pure Python developer.
A strong candidate would typically have:
Data Science + Python + ML + Statistics + GenAI/LLM + RAG + Agentic AI + LangChain/LangGraph + LLM Fine-Tuning + Open-Source LLMs + PySpark + Model Evaluation + AI Observability + Model Deployment.
Core Mandatory Skills
Data Science, Python, Machine Learning, Statistics/ML Fundamentals, GenAI/LLM, RAG, Agentic AI, LangChain/LangGraph, LLM Fine-Tuning, BERT/LLaMA/Open-Source LLMs, PySpark, Model Validation/Evaluation, AI Tracing/Observability, Cloud/On-Prem Model Deployment.











