AI/ML Engineer (LLMs, RAG & Agent Systems) at IAI solution · Bengaluru (Bangalore) · 1 - 2 years · ₹5L - ₹6L / yr · Raised funding · Posted 12 Jan 2026

Job Title: AI/ML Engineer (LLMs, RAG & Agent Systems)
Location: Bangalore, India (On-site)
Type: Full-time
About the Role
As an AI/ML Engineer, you’ll be part of a small, fast-moving team focused on developing LLM-powered agentic systems that drive our next generation of AI products.
You’ll work on designing, implementing, and optimizing pipelines involving retrieval-augmented generation (RAG), multi-agent coordination, and tool-using AI systems.
Responsibilities
- Design and implement components for LLM-based systems (retrievers, planners, memory, evaluators).
- Build and maintain RAG pipelines using vector databases and embedding models.
- Experiment with reasoning frameworks like ReAct, Tree of Thought, and Reflexion.
- Collaborate with backend and infra teams to deploy and optimize agentic applications.
- Research and experiment with open-source LLM frameworks to identify best-fit architectures.
- Contribute to internal tools for evaluation, benchmarking, and scaling AI agents.
Required Skills
- Strong foundation in ML/DL theory and implementation (PyTorch preferred).
- Understanding of transformer architectures, embeddings, and LLM mechanics.
- Practical exposure to prompt engineering, tool calling, and structured output design.
- Experience in Python, Git/GitHub, and data processing pipelines.
- Familiarity with RAG systems, vector databases, and API-based model inference.
- Ability to write clean, modular, and reproducible code.
Preferred Skills
- Experience with LangChain, LangGraph, Autogen, or CrewAI.
- Hands-on with Hugging Face ecosystem (transformers, datasets, etc.).
- Working knowledge of Redis, PostgreSQL, or MongoDB.
- Experience with Docker and deployment workflows.
- Familiarity with OpenAI, Anthropic, vLLM, or Ollama inference APIs.
- Exposure to MLOps concepts like CI/CD, model versioning, or cloud (AWS/GCP/Azure).
What We Value
- Deep understanding of core principles over surface-level familiarity with tools.
- Ability to think like a researcher and execute like an engineer.
- Collaborative mindset, building together, learning together.

About IAI solution
About
Company social profiles
Similar jobs (10)
AI Engineer
Experience: 2–4 Years
Employment Type: Full-Time
Work Mode: Coimbatore / Hybrid
About Techjays
Techjays is an AI Reimagination Company focused on building intelligent, scalable, and impactful software solutions. We help businesses solve complex challenges through AI, automation, and modern software engineering.
We are looking for an AI Engineer who is passionate about building AI-powered applications and integrating modern AI technologies into real-world products.
Key Responsibilities
- Design, develop, and deploy AI-powered applications using Python and modern AI frameworks.
- Build and implement LLM-based applications, including Retrieval-Augmented Generation (RAG) systems.
- Work with LLM APIs such as OpenAI, Gemini, and Anthropic.
- Develop AI agents and workflows using frameworks such as LangChain and LangGraph.
- Integrate vector databases and implement efficient embedding and semantic search solutions.
- Develop scalable backend services and REST APIs.
- Work with databases, data processing pipelines, and cloud-based services.
- Collaborate with frontend and backend teams to integrate AI capabilities into applications.
- Evaluate AI model performance, improve response accuracy, and optimize application performance.
- Debug, test, and maintain production-grade AI applications.
Required Skills
- 2–4 years of experience in software development, AI engineering, or a related field.
- Strong programming knowledge in Python.
- Hands-on experience with LLMs and Generative AI applications.
- Understanding of RAG architecture, embeddings, and semantic search.
- Experience with frameworks such as LangChain, LangGraph, or LlamaIndex.
- Knowledge of vector databases such as Pinecone, FAISS, ChromaDB, or Qdrant.
- Experience in building REST APIs using FastAPI or Flask.
- Good understanding of SQL and NoSQL databases.
- Familiarity with Git, Docker, and basic cloud services.
- Strong problem-solving and analytical skills.
Good to Have
- Experience building AI agents and multi-agent systems.
- Knowledge of React or other frontend frameworks.
- Exposure to AWS, Azure, or GCP.
- Understanding of model evaluation, prompt engineering, and fine-tuning.
- Experience deploying AI applications in production environments.
What We’re Looking For
- Someone who enjoys solving real-world problems using AI.
- Ability to take ownership of tasks and deliver solutions independently.
- Strong learning mindset and willingness to explore emerging AI technologies.
- Good communication and collaboration skills.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Support with design and build to prove out agentic AI solution flow by working with other data
scientists and engineers to build, train Large Language Model (LLM) architectures, RAG
systems, and autonomous agentic workflows
Key qualifications:
>> AI solution design & Development: Design Agentic AI solutions using RAG (Retrieval-
Augmented Generation) and orchestration frameworks like LangGraph or LangChain.
>> Model Fine-Tuning: Solid understanding and experience with Pre-train, fine-tune, and
optimize open-source like BERT, LLama, and other proprietary foundation models for domain-
specific tasks
>> Solid Stats and ML foundations and (vibe) coding skills with Python, PySpark
>> Implement validation frameworks and tracing practices (using tools like Arize) to monitor
agent behavior, guard against model drift, and ensure compliance
>> Collaborate with Engineering to deploy models securely on cloud and on-prem ecosystems
About LeadSquared
LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.
Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.
Role Overview
We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.
This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.
Key Responsibilities
•
Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
•
Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.
•
Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.
•
Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.
•
Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.
•
Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.
•
Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.
•
Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.
•
Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.
Required Qualifications
Experience
•
2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.
•
Proven experience shipping LLM-based products or agentic AI systems into production environments.
Technical Skills
•
Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.
•
Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).
•
Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.
•
Solid understanding of RAG architectures, embedding models, and semantic search.
•
Experience with vector databases and similarity search infrastructure.
•
Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).
Problem-Solving & Mindset
•
Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.
•
Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.
•
Ability to balance research exploration with engineering pragmatism to ship reliable systems.
Preferred Qualifications
•
Experience with multi-agent orchestration and agent memory systems (short-term and long-term).
•
Familiarity with fine-tuning or RLHF workflows for domain adaptation.
•
Background in NLP, information retrieval, or conversational AI.
•
Prior experience in B2B SaaS or CRM domain is a plus.
•
Contributions to open-source AI/ML projects or published research/blogs.
•
Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Role Overview
We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.
Key Responsibilities
- Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
- Build LLM-based applications and AI agents using LangChain and LangGraph.
- Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
- Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
- Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
- Work with embeddings, prompt engineering, semantic search, and document processing.
- Develop scalable APIs and backend services using Python, FastAPI, or Flask.
- Build and integrate AI solutions with existing applications and enterprise systems.
- Deploy and maintain AI/ML solutions on cloud platforms.
- Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.
Required Skills
- Strong hands-on experience in Python programming.
- Strong experience in AI/ML and Generative AI.
- Hands-on experience with LLMs and LLM-based application development.
- Strong experience with LangChain and/or LangGraph.
- Experience building AI Agents / Agentic AI workflows.
- Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
- Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
- Experience developing REST APIs using FastAPI/Flask.
- Good understanding of Machine Learning, NLP, and deep learning concepts.
- Experience with Azure / AWS / GCP cloud platforms.
Good to Have
- Experience with multi-agent systems and agent orchestration.
- Knowledge of MLOps / LLMOps.
- Experience with Docker, Kubernetes, and CI/CD.
- Knowledge of LLM evaluation, monitoring, observability, and AI governance.
- Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Design and develop Agentic AI systems using LLMs, tools, memory,
workflows, and MCP.
Build production-grade RAG pipelines, including ingestion, chunking,
embeddings, retrieval, reranking, and evaluation.
Implement context engineering strategies for improving LLM accuracy,
relevance, and reliability.
Develop and integrate MCP-based tools and services for AI agents.
Work with LLMs, SLMs, quantized models, and model optimization
techniques for efficient inference.
Develop scalable backend services and APIs for AI applications.
Design databases and data models supporting AI/agentic applications.
Implement AI observability covering latency, token usage, cost, failures,
quality, and agent/tool execution.
Apply AI governance and responsible AI practices, including security,
access control, data privacy, and auditability.
Optimize AI systems for latency, scalability, cost, and reliability.
Collaborate with engineering and product teams to take AI solutions from
POC to production.
Strong hands-on experience with GenAI, LLMs, and Agentic AI.
Experience building RAG applications.
Strong understanding of Context Engineering and prompt/context
optimization.
Role Overview
We are looking for a hands-on AI/ML Engineer to design, develop, and deploy
production-ready GenAI and Agentic AI applications. The role involves building
intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI
infrastructure with a strong focus on context engineering, observability,
governance, and model optimisation.
Key Responsibilities
Required Skills
Practical experience with MCP (Model Context Protocol).
Experience with frameworks such as LangChain, LangGraph,
LlamaIndex, or equivalent.
Knowledge of LLM/SLM deployment and quantization techniques.
Strong Python backend development experience.
Experience developing REST APIs using FastAPI/Flask or equivalent.
Strong understanding of SQL/NoSQL databases and database design.
Experience with vector databases such as Qdrant, Pinecone, Weaviate,
ChromaDB, or FAISS.
Understanding of AI observability, evaluation, monitoring, and
governance.
Experience with cloud platforms and production deployment is preferred.
Strong understanding of software engineering principles, Git, testing, and
CI/CD.
Applied AI Engineer
About the Role
We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.
We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.
As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.
Key Responsibilities
- Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
- Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
- Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
- Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
- Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
- Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
- Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
- Deploy and maintain AI services on AWS or Azure.
- Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.
Required Qualifications
- 5+ years of professional software development experience in Python or JavaScript.
- Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
- Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
- Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
- Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
- Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
- Familiarity with MCP and human-in-the-loop workflows.
- Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.
Good to Have
- Experience with RLHF or RLAIF.
- Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
- Experience with graph databases and graph-based data models.
- Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.
Why Join Us?
- Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
- Build foundational AI architecture and production-grade LLM workflows.
- Take ownership of technical decisions and system design as an early engineering team member.
- Solve challenging problems at the intersection of AI, finance, and intelligent automation.

Job Title : Data Scientist / AI Engineer (Python, ML & RAG)
Experience : 3 to 8 Years
Open Positions : 15
Location : Pune, Maharashtra
Work Mode : Work From Office (5 Days a Week)
Compensation : 75% Fixed + 25% Variable as per hiring policy
Notice Period : Immediate to 30 Days
Job Overview :
We are looking for an experienced Data Scientist / AI Engineer with strong hands-on expertise in Python, Machine Learning, Deep Learning, NLP, and Generative AI. The candidate will be responsible for designing and developing AI-powered applications, building RAG pipelines, integrating Large Language Models (LLMs), and deploying scalable AI solutions to address real-world business challenges in the financial services domain.
Mandatory skills :
Python, Data Science, Machine Learning, Deep Learning, NLP, Generative AI, LLM, RAG, Prompt Engineering, LangChain, LangGraph, FastAPI, Flask, PyTorch, TensorFlow, Vector Databases, Semantic Search, REST API Development.
Key Responsibilities :
- Design and develop AI / ML and Generative AI applications using Python, NLP, and LLM technologies.
- Build and optimize Retrieval-Augmented Generation (RAG) pipelines using structured and unstructured data.
- Integrate and orchestrate LLMs / SLMs such as GPT, LLaMA, Mistral, Claude, Gemini, and similar models.
- Implement advanced prompt engineering, semantic search, hybrid search, and vector-based retrieval.
- Develop and deploy REST APIs using FastAPI, Flask, or similar Python frameworks.
- Build NLP solutions involving text classification, Named Entity Recognition (NER), sentiment analysis, embeddings, and document understanding.
- Develop, train, and evaluate Machine Learning and Deep Learning models using PyTorch, TensorFlow, Keras, or Scikit-learn.
- Work with vector databases and search technologies such as FAISS, Pinecone, Weaviate, and Elasticsearch.
- Monitor, evaluate, and optimize AI models for accuracy, performance, relevance, and latency.
- Support production-grade AI applications and collaborate with cross-functional teams to troubleshoot and resolve issues.
- Identify business problems and contribute to the design and implementation of AI-driven solutions.
- Work independently as an Individual Contributor across new and existing projects.
Mandatory Skills :
- 3+ years of hands-on experience in Data Science, AI/ML, NLP, Deep Learning, or Generative AI.
- Strong Python programming and backend / API development experience.
- Hands-on experience with Machine Learning and Deep Learning frameworks.
- Practical experience with NLP applications and use cases.
- Experience working with LLMs and building RAG-based applications.
- Strong understanding of Prompt Engineering and frameworks such as LangChain, LangGraph, or similar.
- Experience developing and integrating APIs using FastAPI, Flask, or equivalent frameworks.
- Experience deploying or supporting production-grade AI/ML applications.
Good to Have :
- Exposure to LLMOps / MLOps tools for model monitoring, evaluation, experimentation, and versioning.
- Experience with Azure OpenAI, Azure Kubernetes Service (AKS), Kubernetes, or cloud-native AI deployments.
- Knowledge of PostgreSQL, MongoDB, Redis, Kafka, and large-scale data platforms.
- Familiarity with Docker, distributed systems, and scalable deployment architectures.
- Experience in fintech, financial services, SaaS, product-based organizations, or AI-first companies.
Interview Process :
- Technical Round 1
- Technical Round 2
- Technical Round 3
- Underwriting Call
- Criminal Background Verification
- HR Discussion
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Role Overview
We are looking for an experienced Data Scientist – Agentic AI with strong expertise in Python, Machine Learning, Generative AI, Large Language Models (LLMs), RAG and Agentic AI.
The ideal candidate should have hands-on experience in developing, fine-tuning, evaluating and deploying machine learning and GenAI solutions. The candidate should be comfortable working with open-source LLMs, LangChain/LangGraph, PySpark and AI observability/tracing frameworks.
The role involves building intelligent AI systems that can reason, use tools, retrieve information and execute multi-step tasks using Agentic AI architectures.
Mandatory Technical Skills
1. Data Science & Python
- 5+ years of experience in Data Science / Machine Learning / AI.
- Strong programming experience in Python.
- Strong understanding of data analysis, feature engineering and statistical techniques.
- Experience with Python ML and data science libraries such as:
- NumPy
- Pandas
- Scikit-learn
- Matplotlib / Seaborn
- Good understanding of data preprocessing, exploratory data analysis and experimentation.
2. Machine Learning & Statistics
- Strong understanding of Machine Learning fundamentals.
- Experience with supervised and unsupervised learning techniques.
- Knowledge of:
- Regression
- Classification
- Clustering
- Feature Engineering
- Model Selection
- Hyperparameter Tuning
- Cross-validation
- Strong understanding of Statistics / ML fundamentals.
- Ability to interpret model performance and statistical results.
3. Generative AI / LLM
- Strong hands-on experience with Generative AI and Large Language Models (LLMs).
- Understanding of Transformer architecture and modern LLM-based applications.
- Experience working with commercial or open-source LLMs.
- Strong understanding of:
- Prompt Engineering
- Context Management
- Embeddings
- Tokenization
- LLM inference
- Hallucination mitigation
4. RAG – Retrieval Augmented Generation
- Strong hands-on experience developing RAG applications.
- Experience with:
- Document ingestion
- Chunking
- Embeddings
- Vector search
- Semantic search
- Retrieval pipelines
- Context retrieval
- Reranking
- Ability to optimize RAG pipelines for relevance, accuracy and latency.
- Experience integrating LLMs with enterprise knowledge sources.
5. Agentic AI
- Hands-on experience building Agentic AI / AI Agent solutions.
- Understanding of agent architecture and multi-step reasoning workflows.
- Experience with:
- AI Agents
- Multi-Agent systems
- Tool Calling
- Function Calling
- Agent orchestration
- Planning and reasoning workflows
- Memory
- Workflow automation
- Ability to build agents that can interact with tools, APIs, databases and external systems.
6. LangChain / LangGraph
- Strong hands-on experience with LangChain and/or LangGraph.
- Experience building LLM workflows and agent-based applications.
- Understanding of:
- Chains
- Agents
- Tools
- State management
- Graph-based workflows
- Agent orchestration
- Retrieval workflows
- Experience designing scalable Agentic AI workflows.
7. LLM Fine-Tuning
- Hands-on experience with LLM fine-tuning.
- Understanding of techniques such as:
- Supervised Fine-Tuning (SFT)
- Parameter-Efficient Fine-Tuning
- LoRA
- QLoRA
- Experience preparing datasets for fine-tuning.
- Ability to evaluate fine-tuned models against baseline models.
- Understanding of model optimization and inference considerations.
8. BERT / LLaMA / Open-Source LLMs
Experience working with one or more open-source / transformer-based models such as:
- BERT
- LLaMA / Llama
- Mistral
- Gemma
- Qwen
- Other open-source LLMs
Candidate should understand model loading, inference, fine-tuning and evaluation.
9. PySpark
- Strong experience with PySpark for large-scale data processing.
- Experience working with large datasets and distributed data processing.
- Knowledge of:
- Data transformations
- Data cleaning
- Aggregations
- Joins
- Spark SQL
- Performance optimization
- Ability to build scalable data processing pipelines.
10. Model Validation & Evaluation
- Experience validating and evaluating ML and GenAI models.
- Understanding of traditional ML evaluation metrics.
- Experience evaluating LLM/RAG applications using relevant quality metrics.
- Ability to compare model performance and identify areas for improvement.
- Experience with:
- Accuracy
- Precision
- Recall
- F1 Score
- ROC-AUC
- Retrieval metrics
- LLM response quality
- Groundedness / relevance
- Experience designing evaluation datasets and test cases is preferred.
11. AI Tracing / Observability
- Experience with AI/LLM tracing and observability.
- Ability to monitor AI applications in production.
- Experience tracking:
- LLM requests/responses
- Latency
- Token usage
- Errors
- Retrieval performance
- Agent/tool execution
- Model performance
- Exposure to tools/frameworks such as LangSmith, OpenTelemetry, Arize Phoenix, MLflow or similar is preferred.
12. Model Deployment
- Experience deploying ML/LLM/GenAI solutions into production.
- Exposure to cloud and/or on-premise model deployment.
- Experience with model serving, APIs and production inference.
- Knowledge of deployment environments such as:
- AWS
- Azure
- GCP
- On-premise infrastructure
- Experience with Docker, APIs and CI/CD is an advantage.
Key Responsibilities
- Design, develop and deploy Data Science, Machine Learning and GenAI solutions.
- Build production-ready RAG and Agentic AI applications.
- Develop intelligent agents capable of tool calling, reasoning and multi-step task execution.
- Build LLM-powered applications using LangChain/LangGraph.
- Work with open-source LLMs including BERT, LLaMA and other transformer-based models.
- Fine-tune LLMs for specific business use cases.
- Develop scalable data processing pipelines using PySpark.
- Perform data analysis, feature engineering and statistical modeling.
- Develop and maintain model validation and evaluation frameworks.
- Evaluate ML and LLM models using appropriate performance and quality metrics.
- Implement AI tracing, monitoring and observability for production GenAI systems.
- Deploy models and AI applications in cloud or on-premise environments.
- Optimize model performance, response quality, latency and cost.
- Troubleshoot issues related to model inference, retrieval, agents and LLM workflows.
- Collaborate with Data Scientists, ML Engineers, Software Engineers and business stakeholders.
- Convert business requirements into scalable AI/ML solutions.
Good to Have
- Experience with Vector Databases such as:
- FAISS
- Pinecone
- Weaviate
- Milvus
- Chroma
- Azure AI Search
- Experience with MLflow or similar ML lifecycle tools.
- Experience with Docker/Kubernetes.
- Experience with REST APIs / FastAPI.
- Knowledge of cloud AI/ML services.
- Experience with MLOps / LLMOps.
- Experience with multi-agent frameworks other than LangChain/LangGraph.
- Experience working with enterprise GenAI applications.
Ideal Candidate Profile
The ideal candidate should be a Data Scientist / ML Engineer with strong GenAI and Agentic AI experience, rather than a pure Python developer.
A strong candidate would typically have:
Data Science + Python + ML + Statistics + GenAI/LLM + RAG + Agentic AI + LangChain/LangGraph + LLM Fine-Tuning + Open-Source LLMs + PySpark + Model Evaluation + AI Observability + Model Deployment.
Core Mandatory Skills
Data Science, Python, Machine Learning, Statistics/ML Fundamentals, GenAI/LLM, RAG, Agentic AI, LangChain/LangGraph, LLM Fine-Tuning, BERT/LLaMA/Open-Source LLMs, PySpark, Model Validation/Evaluation, AI Tracing/Observability, Cloud/On-Prem Model Deployment.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Description – Python & Generative AI Engineer
Python & Generative AI Engineer
Location: Bangalore, India
Experience: 4+ Years
Employment Type: Full-time
Job Summary
We are looking for an experienced Python & Generative AI Engineer with 4+ years of software development experience and strong hands-on expertise in Python, LLMs, Generative AI, and AI application development.
The ideal candidate should be comfortable building production-grade AI solutions, integrating LLMs with enterprise applications, and developing scalable APIs and services using Python.
Key Responsibilities
- Design, develop, and deploy Generative AI applications using Python and modern AI/ML frameworks.
- Work with Large Language Models (LLMs) such as GPT, Claude, Gemini, Llama, or similar models.
- Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases and embedding models.
- Build AI-powered applications using frameworks such as LangChain, LangGraph, LlamaIndex, or equivalent.
- Develop scalable REST APIs and backend services using FastAPI, Flask, or Django.
- Integrate LLM APIs, prompt engineering, function/tool calling, and structured outputs into enterprise applications.
- Work with vector databases such as FAISS, Pinecone, Weaviate, Milvus, or Azure AI Search.
- Implement document processing, chunking, embeddings, semantic search, and knowledge retrieval solutions.
- Evaluate LLM responses for accuracy, relevance, hallucination, latency, and cost.
- Build and maintain production-ready AI pipelines with appropriate monitoring, logging, security, and error handling.
- Collaborate with data scientists, ML engineers, software engineers, and business stakeholders to deliver AI solutions.
- Write clean, reusable, testable, and well-documented Python code.
- Participate in architecture discussions, code reviews, testing, deployment, and production support.
Required Skills
- 4+ years of experience in software/Python development.
- Strong proficiency in Python and object-oriented programming.
- Hands-on experience with Generative AI and LLM-based applications.
- Experience with OpenAI/Azure OpenAI, Anthropic, Google Gemini, or open-source LLMs.
- Strong understanding of Prompt Engineering and LLM application patterns.
- Experience implementing RAG pipelines.
- Knowledge of embeddings, vector databases, semantic search, and document retrieval.
- Experience with LangChain, LangGraph, LlamaIndex, or similar frameworks.
- Strong experience developing REST APIs using FastAPI/Flask/Django.
- Familiarity with Git, CI/CD, Docker, and cloud platforms such as AWS, Azure, or GCP.
- Good understanding of SQL and databases.
- Strong problem-solving and communication skills.
Good to Have
- Experience with AI agents / Agentic AI and tool/function calling.
- Experience with multi-agent frameworks.
- Knowledge of MLOps/LLMOps and model evaluation.
- Experience with Kubernetes and containerized deployments.
- Knowledge of NLP, machine learning, or deep learning.
- Experience with Azure AI, AWS Bedrock, Amazon SageMaker, or Google Vertex AI.
- Understanding of responsible AI, data privacy, and LLM security.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Strong Lead AI Engineer Profile with agentic systems architecture expertise
2
Mandatory (Experience 1): Must have 6+ years of software or ML engineering, with at least recent 2+ years building and shipping production LLM or agentic AI systems
3
Mandatory (Tech skill 1): Must have hands-on proficiency with at least two agentic frameworks (LangGraph, LangChain, AutoGen, CrewAI), with experience debugging framework internals
4
Mandatory (Tech skill 2): Must have direct SDK experience with Anthropic Claude API (tool use, streaming), OpenAI Assistants API, or Vertex AI Agent Builder
5
Mandatory (Tech skill 3): Must have Python mastery — production-quality code, type annotations, unit and integration tests, packaging, and performance profiling
6
Mandatory (Tech skill 4): Must have RAG pipeline depth — embedding model selection, vector stores (Pinecone, Weaviate, pgvector), hybrid retrieval, RAGAS or custom evaluation harnesses
7
Mandatory (Tech skill 5): Must have cloud deployment experience with AWS, Azure, or GCP; Docker, Kubernetes, IaC basics (Terraform or CDK), and CI/CD pipelines
8
Mandatory (Tech skill 6): Must have agent observability experience — LangSmith, Helicone, or equivalent — with ability to diagnose latency, cost, and quality issues in production traces
9
Mandatory (Tech skill 8) : Must have owned full sub-system designs — agent topology, data flows, API contracts, failure handling — for a bounded scope, and built multi-agent graphs, tool orchestration, retrieval, and memory systems.
10
Mandatory (Tech skill 7): Must have track record of shipping 2+ agentic or ML systems to production — not just proof-of-concepts — with documented performance benchmarks
11
Mandatory (Communication): Must be able to write crisp component specifications and communicate architectural trade-offs to both engineers and non-technical stakeholders












