AI/ML Engineer - AI Observability(ML Ops Engineer)

Job Summary 

A Senior Full Stack Observability Engineer – AI Ops & Autonomous Observability to handle / manage , Design and implement enterprise-wide observability across applications, infrastructure, cloud, network, database and digital services. Lead adoption of Datadog, AI Ops, SRE and Autonomous Observability. Build agentic AI and multi-agent orchestration solutions that automate operational workflows and enable autonomous operations.

Technical Skills

• Datadog (Expert)
• OpenTelemetry
• Distributed Tracing
• Application Performance Monitoring
• AI Ops
• LangGraph/CrewAI/AutoGen/Semantic Kernel
• Python
• Azure, AWS
• Kubernetes
• ServiceNow Integration
• 
  

Enterprise Observability Strategy

• Define observability standards, governance and operating model.
• Create monitoring roadmaps, service health frameworks, business service dashboards and dependency mapping.
• 
  

Full Stack Observability Scope

• Applications, APIs, microservices and user journeys.
• Windows, Linux, VMware, storage and infrastructure platforms.
• Azure and AWS.
• Network monitoring, SQL and NoSQL databases.
• 
  

Datadog Platform

• Deploy and optimize Datadog solutions.
• Build dashboards, monitors, alerts and observability-as-code frameworks.
• Integrate Datadog with ServiceNow, Teams and enterprise tooling.
• New Relic exposure is optional.
• 
  

AI Ops Responsibilities

• Event correlation and noise reduction.
• Predictive analytics and anomaly detection.
• Incident intelligence and root cause analytics.
• Proactive issue identification and MTTR reduction

• Bachelor’s degree in computer science, Data Science, Information Systems, or a related field  
• 8-10 years of experience in DevOps, MLOps, Data Engineering, Software Engineering or Site Reliability Engineering  
• Strong understanding of cloud infrastructure and experience working with at least one major cloud provider, preferably Azure  
• Proficiency in at least one objected-oriented programming language, preferably python with hands-on experience in ml frameworks like TensorFlow, PyTorch or Scikit-learn  

Greetings!

Hiring For Large Product Based Company!

Role- Mlops Engineer

Experience- 8-12 years

Location- Pune, Nagpur

JD-

• 8-10 years of experience in DevOps, MLOps, Data Engineering, Software Engineering or Site Reliability Engineering  
• Strong understanding of cloud infrastructure and experience working with at least one major cloud provider, preferably Azure  

Proficiency in at least one objected-oriented programming language, preferably python with hands-on experience in ml frameworks like TensorFlow, PyTorch or Scikit-learn  

Title                                 : Senior AI Platform / MLOps Engineer

Experience                    : 6+ years

Work type                      : Chennai - Work from Office/other locations - Remote

Employment Type      : Full Time

Notice Period              : Immediate

Work Day                     :Mon to Fri

Key Responsibilities:

• Install, configure and operate OpenShift, NVIDIA GPU operator, OpenShift AI, and NIM microservices on 12× RTX PRO 6000 across two servers; single-node and HA control-plane topologies
• Serving configuration and tuning: quantized model deployment (FP8/FP4), replica balancing, batching, KV-cache and context management
• Azure GPU build environments: provisioning, cost control, parity with the on-prem stack via pinned container/model versions; cloud-to-factory migration with parity regression
• GitOps CI/CD, container registry, artifact/model versioning, environment promotion; observability and audit wiring (Splunk, Prometheus/Grafana)
• Benchmark automation: load harness, p50/p95/p99 latency, tokens/sec, GPU utilization; the capacity report data pipeline
• Platform upgrade procedure with evaluation-regression gates; deployment runbook as a first-class deliverable

Technical Skills:

• 6+ years infrastructure/platform engineering with 3+ years production Kubernetes; OpenShift experience strongly preferred
• Hands-on GPU inference serving in production: NIM, Triton, vLLM, or TensorRT-LLM — you have sized, deployed, and tuned LLM serving on real GPUs and can talk memory-bandwidth trade-offs
• GitOps fluency (ArgoCD/Flux), infrastructure-as-code, container internals; comfortable in air-gapped/proxy-restricted enterprise networks
• Observability depth: metrics, traces, log pipelines; has built performance test harnesses, not just run them

• Azure or AWS GPU compute operations experience

Strongly preferred

• NVIDIA GPU operator and AI Enterprise stack specifics; KServe; Milvus or pgvector operations; VAST/NFS/S3 storage integration; banking or other regulated-environment delivery

About Ampera: 

Ampera Technologies, a purpose driven Digital IT Services with primary focus on supporting our client with their Data, AI / ML, Accessibility and other Digital IT needs. We also ensure that equal opportunities are provided to Persons with Disabilities Talent. Ampera Technologies has its Global Headquarters in Chicago, USA and its Global Delivery Center is based out of Chennai, India. We are actively expanding our Tech Delivery team in Chennai and across India. We offer exciting benefits for our teams, such as 1) Hybrid and Remote work options available, 2) Opportunity to work directly with our Global Enterprise Clients, 3) Opportunity to learn and implement evolving Technologies, 4) Comprehensive healthcare, and 5) Conducive environment for Persons with Disability Talent meeting Physical and Digital Accessibility standards 

• Strong hands-on experience in Microsoft Azure Cloud.
• Good understanding of Azure services such as Compute, Storage, Event Hub, Event Subscription, Storage Queue, and PaaS services.
• Basic understanding of Azure AI Foundry and AI-related Azure service setup.
• Good Azure networking basics: VNet, subnet, routing, and basic troubleshooting.
• Strong knowledge of Terraform, especially:
• Terraform state
• plan / apply
• troubleshooting failures
• migration risks
• Terraform Enterprise concepts
• Strong Python coding capability, not just basic scripting.
• Experience using Python for API integration, automation, JSON/YAML handling, and internal tooling.
• Good understanding of CI/CD pipelines.
• Ability to troubleshoot pipeline failures.
• Comfortable with YAML and JSON.
• Ability to troubleshoot Azure infrastructure/platform issues.
• Ability to collect logs/evidence and coordinate with network/app/Microsoft support teams.
• Basic awareness of agentic AI / LLM concepts.
• Awareness of security and cost best practices.

Good to Have Skills

• Hands-on experience with Harness.
• Hands-on experience with Terraform Enterprise.
• Exposure to LangGraph / LangChain.
• Exposure to agentic AI workflows or skill creation.
• Exposure to Claude or enterprise LLM integrations.
• Knowledge of Azure ML Workspace, model registry, and managed endpoints.
• MLOps / LLMOps knowledge.
• FinOps / Azure cost optimization experience.
• Azure certifications: AZ-104, AZ-305, AZ-400, AZ-500.

Screening Priority:

Azure Cloud + Terraform + Python Coding + CI/CD Troubleshooting + YAML/JSON + Basic Agentic AI Awareness

EMBEDDED AI ENGINEERING POD

AI Implementation Engineer Role

Level: AI Implementation Engineer Senior / Advanced - 6+ years

Practice: Wissen GenAI

Locations: Mumbai / Bengaluru / New York - hybrid, embedded with delivery teams

Reports to: EMBEDDED AI PRACTICE Senior AI Engineering Specialist (Architect); Wissen GenAI Program Lead

Embedded inside enterprise delivery teams, you work closely with global, cross-regional teams to turn prioritized GenAI use cases into production software - building, integrating, and hardening Azure-based AI solutions and accelerating adoption within the teams you join.

You deliver production software and help the teams you join work faster.

As an embedded AI Implementation Engineer, you help convert prioritized use cases into shipped, governed, measurable software.

Key responsibilities

1. Build and ship.

Implement GenAI features end to end on Azure - RAG pipelines, agents, APIs, and UI integrations - against enterprise systems and data.

2. Embed and enable.

Work inside the delivery pods: pair with their engineers, remove blockers, and transfer GenAI skills so adoption sticks after you move on.

3. Productionize.

Add evaluation, observability, guardrails, caching, and CI/CD so prototypes become reliable, cost-efficient services.

4. Integrate securely.

Connect to enterprise data with correct access control, secrets management, and compliance with enterprise security standards and handling of sensitive data.

5. Iterate on quality.

Use evaluation results and user feedback to improve grounding, accuracy, latency, and cost.

6. Measure.

Track delivery and quality metrics that roll up to the program's targets.

Must-have qualifications

• 6+ years in software engineering, with 2+ years building GenAI/LLM applications in production.
• Strong Python (incl. async) and Java (the primary enterprise application stack; Spring a plus); solid API and systems design.
• Azure GenAI hands-on: Azure OpenAI, Azure AI Foundry, Azure AI Search for RAG, Azure AI Document Intelligence (IDP), and Prompt Flow.
• Agent frameworks: Microsoft Agent Framework / Semantic Kernel / AutoGen (or LangChain / LangGraph) and tool / function calling.

Preferred

• RAG fundamentals: embeddings, chunking, vector search, reranking, and grounding.
• Data platforms: Snowflake including Cortex AI (Cortex Search, LLM functions) and SQL, for accessing and grounding on enterprise data.
• Prompt engineering as versioned code; building and running evaluations.
• DevOps: Azure DevOps / GitHub Actions, Docker, AKS / Azure Functions, and observability.
• Financial services or other regulated environments.
• Front-end (React) for AI-assisted UX; streaming and token level operations.
• Azure AI Content Safety and responsible-AI practices.
• Certification: Azure AI Engineer Associate.

What success looks like - first 6 to 12 months

• Multiple GenAI features shipped to production within the embedded delivery pods.
• Measurable adoption and productivity uplift in the teams you support.
• Reusable components adopted from the architects' reference framework.
• Clear contribution to faster time-to-market and lower defect rates.

Design and develop Agentic AI systems using LLMs, tools, memory,

workflows, and MCP.

Build production-grade RAG pipelines, including ingestion, chunking,

embeddings, retrieval, reranking, and evaluation.

Implement context engineering strategies for improving LLM accuracy,

relevance, and reliability.

Develop and integrate MCP-based tools and services for AI agents.

Work with LLMs, SLMs, quantized models, and model optimization

techniques for efficient inference.

Develop scalable backend services and APIs for AI applications.

Design databases and data models supporting AI/agentic applications.

Implement AI observability covering latency, token usage, cost, failures,

quality, and agent/tool execution.

Apply AI governance and responsible AI practices, including security,

access control, data privacy, and auditability.

Optimize AI systems for latency, scalability, cost, and reliability.

Collaborate with engineering and product teams to take AI solutions from

POC to production.

Strong hands-on experience with GenAI, LLMs, and Agentic AI.

Experience building RAG applications.

Strong understanding of Context Engineering and prompt/context

optimization.

Role Overview

We are looking for a hands-on AI/ML Engineer to design, develop, and deploy

production-ready GenAI and Agentic AI applications. The role involves building

intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI

infrastructure with a strong focus on context engineering, observability,

governance, and model optimisation.

Key Responsibilities

Required Skills

Practical experience with MCP (Model Context Protocol).

Experience with frameworks such as LangChain, LangGraph,

LlamaIndex, or equivalent.

Knowledge of LLM/SLM deployment and quantization techniques.

Strong Python backend development experience.

Experience developing REST APIs using FastAPI/Flask or equivalent.

Strong understanding of SQL/NoSQL databases and database design.

Experience with vector databases such as Qdrant, Pinecone, Weaviate,

ChromaDB, or FAISS.

Understanding of AI observability, evaluation, monitoring, and

governance.

Experience with cloud platforms and production deployment is preferred.

Strong understanding of software engineering principles, Git, testing, and

CI/CD.

• Senior Machine Learning Engineer – Vertex AI
• Senior Generative AI Engineer – GCP
• Google Cloud AI/ML Engineer
• MLOps Engineer – Vertex AI
• LLM Engineer – RAG, Gemini, and Vertex AI

GEMBA CONCEPTS

Experience: ~3–5 years Type: Full-time

AI/ML Engineer

Location: Bengaluru, India (Hybrid)

About Gemba Concepts

Gemba Concepts is a lean manufacturing and technology consulting firm helping clients across pharma, manufacturing, and logistics

modernize how they operate. We build production systems that sit close to the shop floor — warehouse management, manufacturing

traceability, and an applied AI/ML platform whose flagship use cases are visual quality inspection and predictive maintenance. We’re a

tight engineering team that ships real systems for demanding, often regulated, environments.

The Role

We’re looking for an AI/ML Engineer to take ML capabilities from prototype to production. You’ll own models end-to-end — framing the

problem with stakeholders, building and validating the model, and deploying it as a reliable service that holds up against real-world, messy

industrial data. This is a hands-on building role, not a pure research seat: your work goes into client-facing systems.

What You’ll Do

Build and ship computer vision models for visual quality inspection (defect detection, classification, segmentation) that perform under

real factory lighting, throughput, and edge-case conditions.

Develop predictive maintenance models using sensor/time-series data — anomaly detection, remaining-useful-life estimation, failure

prediction.

Own the full ML lifecycle: data pipelines, feature engineering, training, evaluation, and deployment, with proper versioning and monitoring.

Deploy and serve models in production on Azure (AKS), and keep them healthy — track drift, retraining triggers, and latency.

Integrate LLM-based capabilities (we use the Claude API and self-hosted open models) into delivery and product workflows where they

add leverage.

Collaborate with product, engineering, and domain experts to translate fuzzy operational problems into well-scoped ML solutions — and to

know when ML is not the right answer.

Communicate results and limitations clearly to non-ML stakeholders, including clients.

What We’re Looking For

3–5 years of hands-on experience building and deploying ML models in production (not just notebooks or coursework).

Strong Python and the modern ML stack — PyTorch or TensorFlow, scikit-learn, NumPy/Pandas.

Solid grounding in at least one of: computer vision (CNNs, object detection/segmentation, image preprocessing) or time-series /

anomaly detection.

Practical MLOps experience: containerization (Docker), model serving, experiment tracking, and deploying on a cloud platform — Azure /

Kubernetes (AKS) is a strong plus.

Comfort working with imperfect, real-world data — labeling strategy, class imbalance, data drift, and validation that reflects production

reality.

Good engineering hygiene (Git, testing, code review) and the ability to write code others can build on.

Nice to Have

Experience with industrial / manufacturing data or regulated environments (pharma, 21 CFR Part 11 awareness).

Hands-on LLM integration experience — RAG, prompt engineering, working with APIs or self-hosted models (vLLM, Qwen, etc.).

Edge deployment experience (running CV models on-device / near the line).

Exposure to data pipeline tooling and orchestration.

What You’ll Get

Real ownership of ML systems that go into production for serious clients.

A lean, senior-heavy team where you ship fast and learn across the stack.

Direct exposure to applied AI in manufacturing — a domain where the work has tangible, physical impact

Kody Technolab Limited

AI/ML Lead (7+ Years Experience)

Location: Ahmedabad / Gandhinagar

Experience: 7+ Years

Employment Type: Full-Time

Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy

cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have

strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and

cloud-based AI deployments.

Key Responsibilities

• Design, develop, and deploy Machine Learning and Deep Learning models for classification,

regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.

• Build and maintain end-to-end ML pipelines including data preprocessing, feature

engineering, model training, validation, evaluation, and deployment.

• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related

frameworks.

• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama,

Claude, and Stable Diffusion.

• Collaborate with product, engineering, and business teams to translate requirements into

scalable AI solutions.

• Optimize model performance, scalability, and reliability for production environments.

• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.

• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence,

Mathematics, or a related field.

• 7+ years of hands-on experience in AI/ML product development.

• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and

Hugging Face.

• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.

• Strong understanding of the ML lifecycle including model training, tuning, deployment,

monitoring, and optimization.

• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.

• Experience with AWS, Azure, or GCP cloud platforms.

• Strong problem-solving and analytical skills.Preferred Skills

• Fine-tuning and deployment of Large Language Models.

• Experience with RAG (Retrieval Augmented Generation) architectures.

• Contributions to open-source AI projects or research publications.

• Knowledge of model interpretability, data annotation, and feature engineering.

• C++ experience for high-performance AI applications.

Why Join Kody Technolab Limited?

Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,

and enterprise-scale applications while collaborating with a highly skilled technology team.

Visit the Website to know more about us.

Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution

Kody Robots | Robotics Company in India for Autonomous Robots