AI Platform Engineer at Its for a IT Service MNC · Remote, Bengaluru (Bangalore), Chennai, Mumbai · 6 - 10 years · Remote friendly · Posted 20 Jul 2026

Primary Skills
- Observability: ELK (Elasticsearch/Kibana), Prometheus, Grafana, PromQL
- Automation: Java/Vert.x or Python (FastAPI), Shell/Bash, REST/SOAP APIs
- Cloud & Platform: Docker, Kubernetes, Kafka, Redis
- Reliability Engineering: Distributed Systems, Microservices, Event-Driven Architecture, DR & Incident Management
- Stakeholder Management & Cross-functional Collaboration
Secondary Skills
- Agentic AI: LangChain, LangGraph, RAG, MCP
- LLM Integration & AI Frameworks
- Python (FastAPI)
Key Responsibilities
- Build and deploy LLM-powered Agentic AI solutions with tool calling and autonomous workflows.
- Integrate AI capabilities into existing applications using modern AI frameworks.
- Own platform reliability through SLAs, SLOs, error budgets, MTTD/MTTR, and operational governance.
- Enhance observability using ELK, Prometheus, Grafana, and advanced alerting.
- Lead incident response, RCA, disaster recovery, and resiliency initiatives.
- Drive production readiness, automation, platform stability, and infrastructure optimization.

Similar jobs (10)
Applied AI Engineer
About the Role
We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.
We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.
As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.
Key Responsibilities
- Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
- Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
- Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
- Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
- Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
- Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
- Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
- Deploy and maintain AI services on AWS or Azure.
- Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.
Required Qualifications
- 5+ years of professional software development experience in Python or JavaScript.
- Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
- Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
- Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
- Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
- Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
- Familiarity with MCP and human-in-the-loop workflows.
- Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.
Good to Have
- Experience with RLHF or RLAIF.
- Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
- Experience with graph databases and graph-based data models.
- Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.
Why Join Us?
- Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
- Build foundational AI architecture and production-grade LLM workflows.
- Take ownership of technical decisions and system design as an early engineering team member.
- Solve challenging problems at the intersection of AI, finance, and intelligent automation.
Design and develop Agentic AI systems using LLMs, tools, memory,
workflows, and MCP.
Build production-grade RAG pipelines, including ingestion, chunking,
embeddings, retrieval, reranking, and evaluation.
Implement context engineering strategies for improving LLM accuracy,
relevance, and reliability.
Develop and integrate MCP-based tools and services for AI agents.
Work with LLMs, SLMs, quantized models, and model optimization
techniques for efficient inference.
Develop scalable backend services and APIs for AI applications.
Design databases and data models supporting AI/agentic applications.
Implement AI observability covering latency, token usage, cost, failures,
quality, and agent/tool execution.
Apply AI governance and responsible AI practices, including security,
access control, data privacy, and auditability.
Optimize AI systems for latency, scalability, cost, and reliability.
Collaborate with engineering and product teams to take AI solutions from
POC to production.
Strong hands-on experience with GenAI, LLMs, and Agentic AI.
Experience building RAG applications.
Strong understanding of Context Engineering and prompt/context
optimization.
Role Overview
We are looking for a hands-on AI/ML Engineer to design, develop, and deploy
production-ready GenAI and Agentic AI applications. The role involves building
intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI
infrastructure with a strong focus on context engineering, observability,
governance, and model optimisation.
Key Responsibilities
Required Skills
Practical experience with MCP (Model Context Protocol).
Experience with frameworks such as LangChain, LangGraph,
LlamaIndex, or equivalent.
Knowledge of LLM/SLM deployment and quantization techniques.
Strong Python backend development experience.
Experience developing REST APIs using FastAPI/Flask or equivalent.
Strong understanding of SQL/NoSQL databases and database design.
Experience with vector databases such as Qdrant, Pinecone, Weaviate,
ChromaDB, or FAISS.
Understanding of AI observability, evaluation, monitoring, and
governance.
Experience with cloud platforms and production deployment is preferred.
Strong understanding of software engineering principles, Git, testing, and
CI/CD.

Position: Senior/Lead Full Stack Engineer – Gen AI / Agentic AI
Experience: 7+ Years
Employment: Permanent Position
Location: Banglore / Hyderabad
Job Summary
We are looking for a Senior/Lead Full Stack Engineer – Gen AI / Agentic AI with strong hands-on experience in Python, React.js, MongoDB, Java/Spring Boot and Generative AI/Agentic AI.
The candidate should have experience designing and developing scalable enterprise applications and implementing production-grade LLM, RAG, AI Agent and multi-agent solutions.
Key Responsibilities
- Design, develop and maintain scalable full-stack applications using Python, React.js, MongoDB and Java/Spring Boot.
- Build production-grade Generative AI and Agentic AI applications using LLMs and modern AI frameworks.
- Develop RAG pipelines, AI agents, tool calling, memory management, planning and agent orchestration.
- Work with LangChain, LangGraph, MCP, vector databases and semantic search.
- Develop Python-based APIs, microservices and asynchronous applications using FastAPI/Flask/Django.
- Build REST APIs and event-driven microservices with focus on scalability, performance and resilience.
- Integrate LLMs, embeddings, vector stores and external enterprise tools/services.
- Implement prompt engineering, LLM evaluation, guardrails and AI observability.
- Develop responsive front-end applications using React.js.
- Work with MongoDB, SQL and hybrid data models.
- Implement CI/CD pipelines and support cloud/OCP deployments.
- Follow secure coding, testing, code quality and performance best practices.
- Participate in architecture, technical design, code reviews and mentoring of team members.
- Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
Mandatory Skills
- Python
- React.js
- Gen AI / Agentic AI
- RAG + LLM
- LangChain / LangGraph
- MongoDB
- Java + Spring Boot
- REST APIs / Microservices
- Vector Databases / Embeddings
- MCP / AI Agent orchestration
Good to Have
- FastAPI / Flask / Django
- Kafka / Solace
- Docker / Kubernetes
- AWS / Azure / GCP / OCP
- CI/CD – Jenkins / GitHub Actions
- LLMOps / AI evaluation / observability
- ELK / Grafana / Splunk / AppDynamics
- SQL / NoSQL
- Agile/Scrum
Job Description
Role: Site Reliability Engineer (SRE)
Experience: 8+ Years
Location: Bangalore
Notice Period: Immediate Joiners Only
Key Responsibilities
- Implement reliability practices across applications and cloud platforms.
- Monitor and troubleshoot production systems using observability tools.
- Manage incidents, perform root cause analysis (RCA), and prepare post-incident reports.
- Develop and maintain CI/CD pipelines and automate operational tasks.
- Improve system availability, performance, scalability, and operational stability.
- Develop proof-of-concepts and convert them into production-ready solutions.
- Collaborate with engineering teams to improve reliability and reduce operational toil.
- Use AI tools responsibly to enhance operational efficiency and productivity.
Required Skills
- Strong SRE fundamentals and production support experience.
- Hands-on experience with AWS cloud services and best practices.
- Observability tools: Splunk, Grafana, and Datadog.
- Understanding of metrics, logs/events, and distributed tracing.
- Familiarity with Amazon Connect and contact center technologies, including voice, call recording, and telephony.
- CI/CD tools: Jenkins/Jules; source control: Git/Bitbucket.
- Scripting and automation skills are preferred.
- Experience in incident management, troubleshooting, and RCA documentation.
- Cloud certification or experience supporting cloud-based applications.
- Familiarity with AI concepts and responsible AI tool usage.
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
Job Spec:-
- Strong SRE fundamentals with hands-on experience applying reliability practices across applications and platforms
- Familiarity with Amazon Connect and contact center technologies, including voice, call recording, and telephony
- Demonstrated expertise in service instrumentation and operating observability platforms (Splunk, Grafana, Datadog), with solid understanding of metrics, logs/events, and traces
- Strong proficiency with AWS cloud services and operational best practices
- Hands-on experience with CI/CD pipelines and source control (Jenkins/Jules; Git/Bitbucket)
- Scripting/automation skills (preferred) to reduce toil and improve operational efficiency
- Ability to rapidly develop proof-of-concepts and mature them into stable, production-ready solutions
- Cloud certification and/or strong experience supporting cloud-based applications (public and/or private cloud)
- Proven incident management experience, including clear communications and writing thorough RCAs (post-incident reports)
- Familiarity with AI concepts and responsible use of AI tools to improve operations and productivity
Job Summary
A Senior Full Stack Observability Engineer – AI Ops & Autonomous Observability to handle / manage , Design and implement enterprise-wide observability across applications, infrastructure, cloud, network, database and digital services. Lead adoption of Datadog, AI Ops, SRE and Autonomous Observability. Build agentic AI and multi-agent orchestration solutions that automate operational workflows and enable autonomous operations.
Technical Skills
- Datadog (Expert)
- OpenTelemetry
- Distributed Tracing
- Application Performance Monitoring
- AI Ops
- LangGraph/CrewAI/AutoGen/Semantic Kernel
- Python
- Azure, AWS
- Kubernetes
- ServiceNow Integration
Enterprise Observability Strategy
- Define observability standards, governance and operating model.
- Create monitoring roadmaps, service health frameworks, business service dashboards and dependency mapping.
Full Stack Observability Scope
- Applications, APIs, microservices and user journeys.
- Windows, Linux, VMware, storage and infrastructure platforms.
- Azure and AWS.
- Network monitoring, SQL and NoSQL databases.
Datadog Platform
- Deploy and optimize Datadog solutions.
- Build dashboards, monitors, alerts and observability-as-code frameworks.
- Integrate Datadog with ServiceNow, Teams and enterprise tooling.
- New Relic exposure is optional.
AI Ops Responsibilities
- Event correlation and noise reduction.
- Predictive analytics and anomaly detection.
- Incident intelligence and root cause analytics.
- Proactive issue identification and MTTR reduction
Site reliability engineer - Experience: 8+ Years
Location: Hyderabad / Bangalore
Mandatory Skills: Production Support, SRE, Linux/Unix, AI/ML Infrastructure Knowledge
About LeadSquared
LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.
Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.
Role Overview
We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.
This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.
Key Responsibilities
•
Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
•
Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.
•
Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.
•
Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.
•
Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.
•
Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.
•
Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.
•
Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.
•
Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.
Required Qualifications
Experience
•
2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.
•
Proven experience shipping LLM-based products or agentic AI systems into production environments.
Technical Skills
•
Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.
•
Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).
•
Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.
•
Solid understanding of RAG architectures, embedding models, and semantic search.
•
Experience with vector databases and similarity search infrastructure.
•
Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).
Problem-Solving & Mindset
•
Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.
•
Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.
•
Ability to balance research exploration with engineering pragmatism to ship reliable systems.
Preferred Qualifications
•
Experience with multi-agent orchestration and agent memory systems (short-term and long-term).
•
Familiarity with fine-tuning or RLHF workflows for domain adaptation.
•
Background in NLP, information retrieval, or conversational AI.
•
Prior experience in B2B SaaS or CRM domain is a plus.
•
Contributions to open-source AI/ML projects or published research/blogs.
•
Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services
Position Overview
The AI Observability Engineer will be instrumental in implementation of scalable, cloud-native solutions to meet the growing needs of our Data & Development team. The successful candidate will demonstrate the ability to abstract complexity and create reusable, scalable patterns that accelerate development. The AI Observability Engineer will build and maintain a robust framework to ensure the reliability and maintainability of DPR Construction's complex AI systems.
Responsibilities
- Standardize observability practices across AI/ML and other development teams including logging, metrics, tracing, and model performance monitoring, ingesting data from multiple platforms
- Lead hands-on implementation of automation-first DevOps and MLOps practices, enabling infrastructure-as-code and consistent, repeatable environment provisioning
- Design and manage intelligent DataOps pipelines with automated data quality monitoring and anomaly detection
- Deploy, maintain and monitor containerized ML workloads
- Extend existing CI/CD pipelines to support automated infrastructure changes and ML workflows
- Implement AI-driven data validation, schema and concept drift detection and metadata management.
- Establish governance frameworks for AI systems, including bias detection, explainability, and auditability
- Extend existing Azure RBAC strategy by automating role and permission management to reduce manual intervention
- Develop automated test suites for model performance, regression, edge cases and bias validation
- Monitor model KPIs (accuracy, precision, recall, latency, calibration)
- Ensure reproducability of experiments and production models
- Act as a technical point of contact for DevOps and MLOps practices, developing reusable patterns, documentation, and proof-of-concepts to drive adoption
Qualifications
- Bachelor’s degree in computer science, Data Science, Information Systems, or a related field
- 5+ years of experience in DevOps, MLOps, Data Engineering, Software Engineering or Site Reliability Engineering
- Strong understanding of cloud infrastructure and experience working with at least one major cloud provider, preferably Azure
- Proficiency in at least one objected-oriented programming language, preferably python with hands-on experience in ml frameworks like TensorFlow, PyTorch or Scikit-learn









