Senior AI Platform / MLOps Engineer at Ampera Technologies · Chennai, Bengaluru (Bangalore), Mumbai, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Pune, Hyderabad, Kolkata · 6 - 15 years · Profitable · Posted 6 Oct 2026

Title : Senior AI Platform / MLOps Engineer
Experience : 6+ years
Work type : Chennai - Work from Office/other locations - Remote
Employment Type : Full Time
Notice Period : Immediate
Work Day :Mon to Fri
Key Responsibilities:
- Install, configure and operate OpenShift, NVIDIA GPU operator, OpenShift AI, and NIM microservices on 12× RTX PRO 6000 across two servers; single-node and HA control-plane topologies
- Serving configuration and tuning: quantized model deployment (FP8/FP4), replica balancing, batching, KV-cache and context management
- Azure GPU build environments: provisioning, cost control, parity with the on-prem stack via pinned container/model versions; cloud-to-factory migration with parity regression
- GitOps CI/CD, container registry, artifact/model versioning, environment promotion; observability and audit wiring (Splunk, Prometheus/Grafana)
- Benchmark automation: load harness, p50/p95/p99 latency, tokens/sec, GPU utilization; the capacity report data pipeline
- Platform upgrade procedure with evaluation-regression gates; deployment runbook as a first-class deliverable
Technical Skills:
- 6+ years infrastructure/platform engineering with 3+ years production Kubernetes; OpenShift experience strongly preferred
- Hands-on GPU inference serving in production: NIM, Triton, vLLM, or TensorRT-LLM — you have sized, deployed, and tuned LLM serving on real GPUs and can talk memory-bandwidth trade-offs
- GitOps fluency (ArgoCD/Flux), infrastructure-as-code, container internals; comfortable in air-gapped/proxy-restricted enterprise networks
- Observability depth: metrics, traces, log pipelines; has built performance test harnesses, not just run them
- Azure or AWS GPU compute operations experience
Strongly preferred
- NVIDIA GPU operator and AI Enterprise stack specifics; KServe; Milvus or pgvector operations; VAST/NFS/S3 storage integration; banking or other regulated-environment delivery
About Ampera:
Ampera Technologies, a purpose driven Digital IT Services with primary focus on supporting our client with their Data, AI / ML, Accessibility and other Digital IT needs. We also ensure that equal opportunities are provided to Persons with Disabilities Talent. Ampera Technologies has its Global Headquarters in Chicago, USA and its Global Delivery Center is based out of Chennai, India. We are actively expanding our Tech Delivery team in Chennai and across India. We offer exciting benefits for our teams, such as 1) Hybrid and Remote work options available, 2) Opportunity to work directly with our Global Enterprise Clients, 3) Opportunity to learn and implement evolving Technologies, 4) Comprehensive healthcare, and 5) Conducive environment for Persons with Disability Talent meeting Physical and Digital Accessibility standards

About Ampera Technologies
About
At Ampera Technologies, we empower businesses with cutting-edge data analytics, quality assurance, and data engineering solutions
Company social profiles
Similar jobs (10)

Educational Qualification:• B.Tech / M. Tech / M.S. in Computer Science, Data Engineering, AI or related discipline.• Certification in cloud DevOps or MLOps platforms (AWS DevOps Engineer, AzureDevOps Expert, GCP Professional ML Engineer) is highly desirable.• Contributions to MI-Ops or DevOps open source projects is preferred
Experience:• 7—10 years in machine learning operations or DevOps engineering.• Minimum 4 years building CVCD pipelines for AI/ML model deployment in enterprise orgovernment ecosystems.• Proven experience with containerized and microservice architectures.
Key Responsibilities:1.Design and manage continuous integration and delivery (CVCD) pipelines for AIIMLmodels across multiple environments.2. Establish model versioning, deployment, monitoring, and rollback mechanisms to ensurestability and traceability.3.Automate training, testing, and serving workflows using containerized solutions.4.Define infrastructure-as-code templates for scalable AI deployment on on-prem or cloud environments.5. Collaborate with Data Science and Engineering teams to standardize model input/outputformats and performance metrics.6.Implement logging, monitoring, and alerting for deployed models to ensure highavailability and accuracy over time.7.Ensure compliance with Responsible Al guidelines for deployment, including bias auditingand explainability tracking.
- Technical Competencies:• MLOps Platforms: MLflow, Kubeflow, Azure ML, AWS SageMaker Pipelines, GCP VertexAl Pipelines for end-to—end ML workflow orchestration• Containerization: Docker, Kubernetes, Helm charts, container registries, and microservicesarchitecture for ML workloads• CI/CD: Jenkins, GitLab CI, GitHub Actions, Azure DevOps with specialized ML pipelineintegration and automated testing• Infrastructure-as-Code: Terraform, CloudFormation, Ansible for reproducible MLinfrastructure provisioning and management• Cloud Platforms: AWS (EKS, Lambda, ECR, S3), Azure (AKS, Container Registry, BlobStorage), GCP (GKE, Cloud Build, Cloud Storage)• Model Serving: TorchServe, TensorFlow Serving, Seldon, KServe, REST APIs, and real-time inference infrastructure.• Programming Languages: Python for automation, Bash scripting, YAML for configurationmanagement, basic understanding Of Go/Java• Database & Storage: Feature stores (Feast, Tecton), model registries, data versioning(DVC), and distributed storage systems• Workflow Orchestration: Apache Airflow, Prefect, Argo Workflows for complex MLpipeline scheduling and dependency management.

- Bachelor’s degree in computer science, Data Science, Information Systems, or a related field
- 8-10 years of experience in DevOps, MLOps, Data Engineering, Software Engineering or Site Reliability Engineering
- Strong understanding of cloud infrastructure and experience working with at least one major cloud provider, preferably Azure
- Proficiency in at least one objected-oriented programming language, preferably python with hands-on experience in ml frameworks like TensorFlow, PyTorch or Scikit-learn
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI
About Us:
CLOUDSUFI, a Google Cloud Premier Partner, is a global leading provider of data-driven digital transformation across cloud-based enterprises. With a global presence and focus on Software & Platforms, Life sciences and Healthcare, Retail, CPG, financial services and supply chain, CLOUDSUFI is positioned to meet customers where they are in their data monetization journey.
Our Values
We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.
Equal Opportunity Statement
CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace. Please explore more at https://www.cloudsufi.com/
About the role
CloudSufi is hiring an AgentOps Engineer to own the runtime, infrastructure, and operational monitoring for an AI agent testing platform deployed for an enterprise client. You will deploy and instrument agents for testing, set up observability and continuous evaluation on live traffic, and manage the cloud infrastructure the platform runs on.
Responsibilities:
- Deploy and instrument AI agents for testing and monitoring.
- Set up observability — traces, logs, and metrics — and continuous evaluation on production traffic.
- Build drift detection and alerting so quality regressions are caught early.
- Own the cloud infrastructure and CI/CD automation supporting the platform.
- Manage environments, access, and operational reliability.
Required qualifications:
- 5+ years in DevOps, MLOps, or platform engineering.
- Strong Google Cloud experience (Cloud Run, Cloud Build, Pub/Sub, Cloud Logging and Monitoring, IAM) or equivalent cloud platform.
- Experience with CI/CD automation and infrastructure as code.
- Familiarity with deploying LLM or AI agent workloads.
Preferred qualifications:
- Experience with OpenTelemetry and AI/agent observability.
- Exposure to Vertex AI, Gemini Enterprise Agent Platform, or ADK.
Experience: 4+ Years
Job Title: DevOps Engineer / Cloud Engineer
Job Summary
We are looking for an experienced DevOps & Cloud Engineer with 4+ years of experience in cloud infrastructure management, Kubernetes administration, CI/CD pipeline automation, and containerization. The ideal candidate should have hands-on experience with Azure cloud services, Azure Kubernetes Service (AKS), Azure DevOps, Jenkins, Docker, Terraform, and infrastructure automation.
The candidate will be responsible for managing cloud environments, automating application deployments, maintaining Kubernetes clusters, monitoring system performance, and ensuring the reliability, scalability, security, and availability of applications across development, testing, and production environments.
Key Responsibilities
- Design, deploy, and manage cloud infrastructure using Microsoft Azure services, including Virtual Machines, Virtual Networks, Storage Accounts, Load Balancers, Key Vaults, and Resource Groups.
- Manage and administer Azure Kubernetes Service (AKS), Azure Arc-enabled Kubernetes, and Kubernetes clusters.
- Develop, configure, and maintain CI/CD pipelines using Azure DevOps and Jenkins for automated application builds, testing, and deployments.
- Containerize applications using Docker and deploy microservices-based applications on Kubernetes.
- Manage Kubernetes resources, including Pods, Deployments, StatefulSets, Services, Ingress, ConfigMaps, Secrets, and Namespaces.
- Automate infrastructure provisioning and configuration management using Terraform, Ansible, and Infrastructure as Code (IaC) practices.
- Implement Kubernetes networking, load balancing, Role-Based Access Control (RBAC), autoscaling, and resource optimization.
- Monitor infrastructure and application performance using Prometheus and Grafana.
- Troubleshoot application, deployment, networking, container, and infrastructure-related issues and perform root cause analysis.
- Implement disaster recovery procedures, backup validation, failover testing, patch management, and environment upgrades.
- Manage source code repositories, branching strategies, pull requests, code merges, and version control using Git, GitHub, and Azure Repos.
- Maintain cloud infrastructure security, compliance, governance, high availability, and operational reliability.
- Collaborate with development, infrastructure, and security teams to implement DevOps best practices and improve deployment efficiency.
Mandatory Technical Skills
- Cloud Platforms: Microsoft Azure, Azure Virtual Machines, Virtual Networks, Storage Accounts, Load Balancers, Key Vaults.
- Containerization & Orchestration: Docker, Kubernetes, Azure Kubernetes Service (AKS).
- CI/CD & Automation: Azure DevOps, Jenkins, CI/CD pipeline development and maintenance.
- Infrastructure as Code: Terraform; exposure to Ansible and automated configuration management.
- Monitoring & Version Control: Prometheus, Grafana, Git, GitHub, Azure Repos.
Preferred Skills
- Azure Arc-enabled Kubernetes.
- VMware Tanzu Kubernetes Grid (TKG).
- Kubernetes Service Mesh, Ingress Controllers, and Horizontal Pod Autoscaling (HPA).
- RHEL Linux administration and Shell Scripting.
- Groovy scripting and SQL fundamentals.
- Disaster recovery, incident management, and production support.
- Experience supporting microservices architectures and application migration activities.
Qualifications
- Bachelor’s degree in Engineering (B.E.) or an equivalent qualification.
- 4+ years of experience in DevOps engineering, cloud infrastructure, Kubernetes administration, and deployment automation.
- Strong troubleshooting, analytical, and problem-solving skills.
- Ability to work collaboratively with cross-functional teams and manage infrastructure-related incidents.
Key Deliverables
- Reliable, scalable, and secure cloud infrastructure.
- Automated and efficient CI/CD pipelines.
- Stable Kubernetes clusters and containerized application deployments.
- Reduced infrastructure provisioning and deployment time through automation.
- Effective monitoring, incident resolution, and disaster recovery readiness.

Role Overview: Take full ownership of infrastructure architecture, scaling, and uptime. Establish the technical roadmap, shape and formalize the SRE function, and coach engineers. Design, deploy, and run AI-scale infrastructure that enables real-time healthcare workflows.
Serve as a Founding Member, owning end-to-end infrastructure capabilities and introducing AI-first DevOps, SRE, and MLOps best practices, with direct collaboration alongside the Founder, Co-Founder, and Head of Engineering.
Key Responsibilities:
Architecture & Platform
- Design scalable, secure, cost-efficient AWS/GCP architectures for AI and healthcare workloads
- Lead IaC standards and reusable modules org-wide; own GitOps practices
- Architect optimized Kubernetes (EKS/GKE) for HA, scale, and GPU workload orchestration
Reliability Engineering
- Define and drive reliability targets (SLOs/SLIs); establish SRE practice
- Lead incident management, RCA, and blameless post-mortems for critical systems
- Partner on infrastructure hardening and compliance (SOC 2, HIPAA)
AI-First Engineering
- Lead AI/ML inference and GPU infrastructure scaling in production
- Evaluate and introduce AI tooling, platforms, and automation best practices
- Contribute to LLM deployment pipelines and AI systems reliability
Leadership & SDLC
- Mentor L1/L2 engineers; influence cross-team infrastructure decisions
- Drive DevSecOps maturity across the SDLC (policy-as-code, SBOM, supply-chain security)
- Evaluate and introduce new tooling and platforms
Key Requirements:
- 4–8 years infrastructure/platform/DevOps/SRE
- Deep expertise in AWS & GCP large-scale production systems
- Advanced Kubernetes (cluster design, multi-tenant ops, resource quotas)
- AI/ML inference or GPU infrastructure scaling (production track record)
- Strong Terraform / equiv. and GitOps practices
- Python, Go, or Bash scripting and automation
- Track record in scale, reliability, and cost efficiency
- Lead incident response and on-call practices
Nice-to-Have
- LLM Gateway architecture and optimization
- Zero-trust networking and advanced security/compliance (SOC 2, HIPAA)
- DevSecOps maturity: SBOM, supply-chain security, policy-as-code
- Open-source contributions or platform-team leadership
Why This Role?
- Build infrastructure and products powering real-world healthcare AI
- Work with AI-native engineering teams using cutting-edge tools (Claude Code, Cursor, Copilot)
- Mission-driven impact — improve patient outcomes and save thousands of staff hours
- High ownership, rapid learning, and significant career upside
- Global collaboration across India and the US
- Seed-stage growth — scale from Seed to Series A alongside the team
- Founding Member role and own the entire infrastructure capabilities, including bringing best AI-first practices in DevOps, SRE and MLOps; direct access to work with the Founder, Co-Founder and Head of Engineering
Summary -
- We are looking for a Cloud Infrastructure Engineer to build and operate the Azure foundation for our AI workloads and serve as the working bridge between the Cloud Infrastructure and Data teams. You will own Terraform-driven Azure infrastructure, DevOps pipelines, and hands-on platform components, including Azure AI Foundry, Model Context Protocol (MCP) servers, and Databricks.
Responsibilities -
- Build and maintain Azure infrastructure as code with Terraform, including reusable modules and multi-environment patterns.
- Provision and operate Azure AI Foundry hubs and projects, including model deployments, data connections, and identity and network configuration.
- Design and secure MCP servers that expose internal tools and data to AI agents.
- Partner with the Data team to deploy and configure Databricks workspaces, including VNet injection, private endpoints, Entra ID integration, and Unity Catalog.
- Own CI/CD pipelines in Azure DevOps or GitHub Actions for infrastructure and AI platform deployments.
- Enforce guardrails for AI workloads, including Key Vault secrets management, managed identities, and network isolation.
- Monitor platform health, reliability, and cost with Azure Monitor and Log Analytics.
- Triage cross-team platform requests, document reference patterns, and remove blockers between Cloud and Data teams.
Requirements -
- 5 to 8 years of experience in cloud infrastructure or platform engineering.
- Strong hands-on Azure experience, including networking, Entra ID, RBAC, and managed identities.
- Advanced Terraform skills, including module design and state management.
- Working knowledge of DevOps practices, CI/CD, and Git-based workflows.
- Working knowledge of Azure AI Foundry or Azure OpenAI, including access control and network integration.
- Practical understanding of MCP and the security considerations for connecting AI agents to enterprise systems.
- Hands-on Databricks platform experience, including workspace deployment, Unity Catalog, and cluster configuration.
- Scripting skills in Python, PowerShell, or Bash.
- Experience working within SOC 2 Type II or similar control frameworks.
Preferred Qualifications -
- Experience with RAG architectures or Azure AI Search.
- Experience with GPU capacity and quota planning in Azure.
Build production-grade cloud infrastructure that powers enterprise applications with cutting-edge DevOps practices.
What you'll do:
- Design CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI)
- Containerize apps with Docker, deploy on Kubernetes clusters
- Manage infrastructure as code (Terraform, CloudFormation)
- Set up monitoring (Prometheus, Grafana, ELK Stack)
- Cloud migrations (AWS EC2, EKS, RDS → GCP equivalent)
- Optimize costs and performance for live production systems
What we need:
- Basic Python/Bash scripting
- Docker basics, Git workflows
- Cloud exposure (AWS/GCP/Azure free tier projects)
- Problem-solving mindset, eagerness to learn
Real impact:
- Deploy apps used by 1000+ daily users
- Work with senior DevOps engineers on client deliverables
- Build portfolio for FAANG-level interviews
Role Overview
We are looking for a DevOps / Platform Engineer with 3–4 years of experience to help manage AWS cloud infrastructure, automation, and AI-ready platform operations. You will work closely with engineering and AI teams to ensure scalable, secure, and reliable deployments.
Key Responsibilities
- AWS & Infrastructure: Manage core AWS services (EC2, EKS, Lambda, RDS, S3, VPC) using Infrastructure-as-Code (Terraform, CloudFormation, or CDK).
- AI/ML Workflows: Support infra for AI applications, model serving, vector databases, and GPU-based workloads.
- CI/CD & Automation: Build and maintain deployment pipelines using GitHub Actions, GitLab CI, or Jenkins.
- Containers & Kubernetes: Deploy and maintain containerized applications using Docker and Kubernetes (EKS) or ECS.
- Observability & Incident Support: Maintain dashboards and alerts with CloudWatch, Prometheus, or Grafana, and participate in on-call response.
- Security & FinOps: Apply AWS security best practices (IAM, encryption, secrets) and assist with cloud cost optimization.
Must-Have Skills & Qualifications
- 3–4 years of experience in DevOps, SRE, or Cloud Infrastructure Engineering.
- AWS & Containers: Good working knowledge of core AWS services, Docker, and Kubernetes (EKS).
- Infrastructure-as-Code: Practical experience with Terraform, CloudFormation, or AWS CDK.
- Linux & Networking: Solid fundamentals in Linux systems, DNS, routing, and load balancing.
- Scripting: Hands-on scripting proficiency in Python, Bash, or Go.
- CI/CD & Observability: Experience building CI/CD pipelines (GitHub Actions, GitLab CI, or Jenkins) and using monitoring tools (CloudWatch, Prometheus, Grafana, or Datadog).
Nice-to-Have Skills
- Basic exposure to AI/ML infrastructure, model serving, or GPU-based compute.
- Experience with event-driven messaging systems (Kafka, Redis, or SQS).
- Familiarity with GitOps tools and Helm (ArgoCD, Flux, or OpenTelemetry).
- AWS Certifications (Solutions Architect Associate, SysOps Administrator, or DevOps Engineer).
DevOps & AI Infrastructure Engineer (SDE-2)
Location: Bengaluru (Hybrid)
Experience: 3–5 years
Role: Own the infrastructure behind RockED’s platform, end-to-end
About us
RockED is the premier people development platform for the automotive industry, supporting the entire employee lifecycle from pre-hire and onboarding to upskilling and career transitions. With microlearning content, gamified delivery, and real-time feedback, RockED is educating the automotive workforce and solving the industry's greatest business challenges.
The RockED Company Inc. is headquartered in Florida. Backed by top industry experts and investors, we’re a well-funded startup on an exciting growth journey. Our R&D team (Indian entity) is at the core of all product and technology innovation
We partner with 10000+ dealerships, empower 60,000+ learners, complete 15000+ certifications, and have crossed 11 million lesson completions
Check out our website: https://www.rocked.us/.
What You'll Actually Own
AI-led DevOps
- Use AI across your work: AI-assisted Terraform and scripting, automated pipeline debugging, and smarter alerting and log analysis (AIOps).
- Build and run infrastructure for AI features, including LLM integrations, AI APIs (e.g., AWS Bedrock) and the pipelines that serve them.
- Experiment with new AI tools that make the team faster, and share what works.
Cloud infrastructure, end-to-end
- Build and run the cloud infrastructure behind RockED’s mobile learning platform, primarily on AWS.
- Set up infrastructure for new projects from scratch, including new AWS accounts, environments, VPCs, networking and VPNs.
- Define everything as code with Terraform, so environments are repeatable, version-controlled and easy to scale.
- Optimise cloud costs continuously (FinOps), right-sizing resources and cutting waste as we grow.
Security and access management
- Own infrastructure security: IAM and access controls, VPC design, security groups, secrets management and configuration hardening.
- Run regular security checks and audits, fix vulnerabilities quickly, and keep us compliance-ready, including SOC 2.
- Apply least-privilege access across teams and tools, and make security a default rather than an afterthought.
CI/CD and developer velocity
- Own and improve CI/CD pipelines (GitHub Actions, Jenkins or similar) for fast, reliable and safe releases of our backend, web and mobile apps.
- Containerise and orchestrate services with Docker and Kubernetes.
- Give developers self-serve tools and paved paths, so shipping is quick and painless.
Reliability and observability
- Set up monitoring, logging and alerting with Prometheus, Grafana, ELK or Datadog, so we catch issues before users do.
- Lead incident response and root cause analysis, and build preventive fixes so problems don’t repeat.
- Own backups, disaster recovery and uptime targets as our user base scales.
Collaboration
- Work closely with engineering to build DevOps practices into the full software development lifecycle.
- Document infrastructure, runbooks and workflows so knowledge isn’t stuck in one person’s head.
How We Expect You to Work
Must-have
- 3–5 years of hands-on DevOps or infrastructure experience, ideally at a high-growth, product-based startup.
- Strong hands-on AWS experience (EC2, VPC, IAM, RDS, S3, Lambda, EKS/ECS), including setting up infrastructure and accounts from scratch.
- Infrastructure as code with Terraform.
- Docker and Kubernetes in production.
- CI/CD pipelines with GitHub Actions, Jenkins or similar.
- Monitoring and logging with Prometheus, Grafana, ELK or Datadog.
- Scripting in Bash and Python.
- Solid understanding of networking (VPC, VPN, DNS, load balancers) and security hardening.
- Hands-on use of AI tools in your daily DevOps workflow.
Good to have
- Experience with Azure.
- Exposure to deploying or running AI/LLM workloads.
- Experience with SOC 2 or similar compliance frameworks.
- Experience supporting mobile app releases (iOS/Android build pipelines).
- Familiarity with SQL/NoSQL databases and serverless architectures.
Why choose a career at RockED?
- Real ownership: you’ll build and own RockED’s infrastructure, not just maintain it.
- An AI-first culture: we run AI hackathons and encourage you to experiment.
- Startup speed: high ownership, autonomy and direct access to leadership.
- Learn from the best: work with experienced investors who’ve had multi-million-dollar exits.
- Global exposure: collaborate with teams across the US and India.
- Meaningful impact: your work powers learning for tens of thousands of professionals.
- Care for you and your family: group health insurance for you and your family.
Ready to raise the bar?











