AI Runtime Lead (LLM DevOps, PyTorch) at IT Industry · Bengaluru (Bangalore) · 5 - 8 years · ₹12L - ₹16L / yr · Posted 6 Jan 2026

Review Criteria:
Mandatory:
- Strong AI Runtime Engineering (Lead / Staff) Profiles
- Must have 4+ years of software engineering experience
- Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
- Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
- Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
- Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
- Must have strong programming skills in Python, Java, C++ , etc
Preferred:
Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks
Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration
Role & Responsibilities:
As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.
What you’ll do:
Lead Runtime Design & Development:
- Own the core runtime architecture supporting AI training and inference at scale.
- Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
- Optimize distributed training reliability, orchestration, and job-level fault tolerance.
Drive Performance at Scale:
- Profile and enhance low-level system performance across training and inference pipelines.
- Improve packaging, deployment, and integration of customer models in production environments.
- Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.
Build Internal Tooling & Frameworks:
- Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
- Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
- Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.
Collaborate & Mentor:
- Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
- Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.
Ideal Candidate:
- 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
- Experience in delivering PaaS services.
- Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
- Strong programming skills in Python and C++ (Go or Rust is a plus).
- Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
- Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
- Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.

Similar jobs (10)
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have
strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and cloud-based AI deployments.
Key Responsibilities
• Design, develop, and deploy Machine Learning and Deep Learning models for classification, regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.
• Build and maintain end-to-end ML pipelines including data preprocessing, feature engineering, model training, validation, evaluation, and deployment.
• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related frameworks.
• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama, Claude, and Stable Diffusion.
• Collaborate with product, engineering, and business teams to translate requirements into scalable AI solutions.
• Optimize model performance, scalability, and reliability for production environments.
• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.
• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a related field.
• 7+ years of hands-on experience in AI/ML product development.
• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and Hugging Face.
• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.
• Strong understanding of the ML lifecycle including model training, tuning, deployment, monitoring, and optimization.
• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.
• Experience with AWS, Azure, or GCP cloud platforms.
• Strong problem-solving and analytical skills.
Preferred Skills
• Fine-tuning and deployment of Large Language Models.
• Experience with RAG (Retrieval Augmented Generation) architectures.
• Contributions to open-source AI projects or research publications.
• Knowledge of model interpretability, data annotation, and feature engineering.
• C++ experience for high-performance AI applications.
Why Join Kody Technolab Limited?
Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,
and enterprise-scale applications while collaborating with a highly skilled technology team.
Visit the Website to know more about us.
Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution
Kody Robots | Robotics Company in India for Autonomous Robots
Role Summary
We are seeking an Advanced Machine Learning Engineer to design, build, train, deploy, and operate scalable machine learning systems. This hands-on ML engineering role focuses on implementing models and production systems—not solely conducting data analysis or research. It requires strong Python and deep-learning expertise, experience with frameworks such as PyTorch or TensorFlow, and the ability to own the end-to-end model lifecycle, from behavioral/event data preparation and feature engineering through model development, large-scale training, deployment, inference optimization, and monitoring. The engineer will work with Snowflake, Databricks, Spark, and GPU-based training infrastructure to deliver reliable, efficient, and maintainable ML capabilities.
Must have - Buulding and operated production ML systems using Python + PyTorch /TensorFlow + Snowflake/Databricks + MLOps.
Key Responsibilities
Machine Learning Engineering
- Implement and optimize machine learning algorithms and models for business use cases, including classification, regression, clustering, and recommendation systems as applicable.
- Translate model requirements into robust, reusable, and testable Python components.
- Build model training, validation, scoring, and inference workflows that can be integrated into production applications.
- Evaluate model performance against agreed technical and business metrics and implement improvements to accuracy, latency, robustness, and resource efficiency.
- Apply appropriate validation, error analysis, and model testing practices to ensure reliable behavior.
Train models efficiently on GPU infrastructure using techniques such as mixed-precision training, gradient accumulation, checkpointing, memory optimization, and distributed training strategies where appropriate.
Use PyTorch, TensorFlow,Pyspark or equivalent frameworks to implement experiments and production-ready training code; apply rigorous evaluation, error analysis, and reproducibility practices.
Build model-training workflows covering event/token sequence preparation, tokenization, temporal and positional representations, self-supervised pretraining, and downstream fine-tuning when appropriate to the use case.
Design, implement, train, and optimize deep-learning models; develop custom architectures where required, including transformer- and attention-based models for sequential or behavioral data.
Deep Learning & Model Architecture
Data Platforms & ML Pipelines
- Use Snowflake and SQL to access, query, and prepare enterprise data required by machine learning applications.
- Use Databricks for scalable data processing, feature preparation, model development, and ML pipeline execution.
- Develop and maintain reliable pipelines for data preparation, feature generation, training, batch scoring, and inference.
- Use PySpark and distributed processing techniques where appropriate for large-scale workloads.
- Work with data engineering teams to integrate upstream data sources and ensure dependable data contracts, quality checks, and pipeline operation.
Productionization & MLOps
- Productionize ML solutions and integrate them with services, APIs, data products, or downstream business workflows.
- Implement model and code versioning, experiment tracking, reproducible builds, automated testing, and release practices.
- Monitor model outputs and pipeline health; troubleshoot failures, data changes, drift, and performance degradation.
- Improve operational reliability, scalability, observability, and maintainability of ML systems.
- Collaborate with platform, cloud, and DevOps teams on deployment automation and production support.
Build observable production ML systems with appropriate logging, alerting, performance tracking, and operational safeguards.
Optimize inference latency, throughput, memory use, and serving cost through model architecture choices, batching, and serving-side optimizations.
Software Engineering & Technical Ownership
- Develop clean, modular, documented, and maintainable code following engineering standards and design principles.
- Contribute to technical design, code reviews, testing strategies, and architectural decisions for ML systems.
- Own assigned ML engineering deliverables from technical design through implementation, release, and ongoing support.
- Identify performance bottlenecks and improve runtime, resource utilization, and processing efficiency.
- Collaborate with cross-functional engineering and product teams to deliver dependable ML capabilities.
Required Skills & Qualifications
- Strong proficiency in Python and software engineering practices, including object-oriented design, modular development, testing, debugging, and code quality.
- Strong ML foundation and mathematical understanding
- Strong understanding of the end-to-end ML lifecycle, including model architecture, training, evaluation, optimization, inference, production integration, and monitoring.
- Strong SQL skills and experience working with structured data and data pipelines.
- Hands-on experience with Snowflake for querying and preparing data for ML workflows.
- Hands-on experience with Databricks for data processing and/or ML pipeline development.
- Strong hands-on experience with PyTorch, TensorFlow, or a similar deep-learning framework; experience with scikit-learn is also useful where appropriate.
- Understanding of production ML concepts, including reproducibility, model versioning, deployment, monitoring, and troubleshooting.
- Ability to design reliable, scalable, and maintainable software components and pipelines.
Familiarity with GPU training concepts and distributed strategies such as Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), or equivalents is an advantage for large-model workloads.
Understanding of model optimization, inference efficiency, and integration with production services or applications.
Experience developing and deploying ML solutions at scale, including end-to-end model lifecycle ownership.
Preferred Skills
- PySpark, Apache Spark, and distributed processing for large-scale behavioral or event data.
- MLflow or similar tooling for experiment tracking, model registry, reproducible training, and model lifecycle management.
- Experience integrating Snowflake and Databricks within enterprise ML workflows.
- Cloud experience with AWS, Microsoft Azure, or Google Cloud.
- REST APIs, containers, CI/CD, automated testing, logging, and observability.
- Experience with fraud detection, anomaly detection, behavioral modeling, identity or account-abuse signals, recommendation systems, or other large-scale ML applications.
- Exposure to Generative AI, LLM integration, embeddings, or RAG as an additional advantage.
Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, Computer Engineering, or a related field, or equivalent practical experience.
- At least 5 years of professional experience building, deploying, and supporting machine learning solutions at scale, or equivalent experience demonstrating the required engineering depth.
- Demonstrated ability to take ownership of engineering deliverables and work through implementation, deployment, and operational issues.
Job Title: Senior AI/ML Engineer
Company: Timble Technologies Pvt. Ltd
Location: Gurugram (Hybrid)
Experience: 2 TO 5 Years
About Us
Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.
Role Overview
We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.
Key Responsibilities
· Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).
· GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.
· Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.
· MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.
· Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.
· Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.
Required Qualifications & Skills
· Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.
· Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.
· GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.
· Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.
· Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.
· Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).
Preferred Qualifications
· Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.
· Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).
· Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.
Job Title: Senior AI Engineer
Experience: 5–10 years in software engineering, with 3+ years in AI/ML engineering preferred
Employment Type: Full-time
Department: Artificial Intelligence / Engineering
Location: Bangalore
We are looking for a highly skilled Senior AI Engineer to design, develop, deploy, and scale intelligent AI-powered applications and solutions. The ideal candidate will have strong expertise in machine learning, Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and production-grade software engineering.
The candidate will work closely with product managers, data scientists, software engineers, and business stakeholders to translate complex business requirements into scalable, reliable, secure, and cost-effective AI solutions.
Key Responsibilities
1. AI Solution Design and Development
- Design, develop, and deploy end-to-end AI and machine learning solutions.
- Build intelligent applications using LLMs, Generative AI, NLP, and deep learning techniques.
- Develop scalable AI architectures and reusable components for enterprise applications.
- Evaluate AI models and select appropriate approaches based on accuracy, latency, cost, and business requirements.
2. Generative AI and LLM Engineering
- Develop LLM-powered applications using models from providers such as OpenAI, Anthropic, Google, or open-source ecosystems.
- Design and implement RAG pipelines, document processing workflows, semantic search, and knowledge retrieval systems.
- Build AI agents and multi-step workflows using appropriate orchestration frameworks.
- Implement prompt engineering, structured outputs, tool calling, and context management.
- Optimize model performance through evaluation, fine-tuning where appropriate, and inference optimization.
3. Machine Learning and Data Engineering
- Develop and operationalize machine learning models for classification, prediction, recommendation, and other business use cases.
- Work with structured, unstructured, and multimodal data.
- Build data preprocessing, feature engineering, model training, and validation pipelines.
- Apply appropriate model evaluation techniques and statistical methods.
4. Production Deployment and MLOps / LLMOps
- Deploy AI solutions using cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Build automated CI/CD pipelines for AI applications and model deployment.
- Implement model versioning, experiment tracking, monitoring, and performance evaluation.
- Optimize inference latency, throughput, infrastructure utilization, and operating costs.
- Establish observability for AI applications, including token usage, retrieval quality, latency, failures, and model behavior.
5. Software Engineering and System Architecture
- Develop production-quality applications and APIs using Python and modern backend frameworks.
- Design RESTful APIs, asynchronous processing systems, and microservices where appropriate.
- Integrate AI services with enterprise applications, databases, and third-party systems.
- Use relational databases, vector databases, caching, and distributed systems effectively.
- Apply software engineering best practices, including testing, code reviews, documentation, and design patterns.
6. Security, Quality, and Responsible AI
- Implement safeguards against prompt injection, data leakage, insecure tool execution, and unauthorized access.
- Apply appropriate privacy, security, and compliance controls to AI systems.
- Evaluate hallucinations, bias, reliability, and failure modes.
- Design human-in-the-loop workflows and fallback mechanisms for critical use cases.
7. Technical Leadership and Collaboration
- Lead technical design discussions and mentor junior AI engineers.
- Define engineering standards, coding practices, and AI development guidelines.
- Collaborate with cross-functional teams to deliver measurable business outcomes.
- Conduct code reviews, evaluate emerging technologies, and recommend practical innovations.
- Communicate technical trade-offs and solution architecture to both technical and non-technical stakeholders.
Required Technical Skills
Programming and Backend Development
- Strong proficiency in Python.
- Experience with FastAPI, Flask, or Django.
- Knowledge of REST APIs, asynchronous programming, data structures, algorithms, and software design principles.
- Experience with Git, automated testing, and CI/CD.
AI and Machine Learning
- Strong understanding of supervised and unsupervised learning, model evaluation, and statistical concepts.
- Hands-on experience with PyTorch, TensorFlow, or scikit-learn.
- Knowledge of NLP, embeddings, transformers, and deep learning fundamentals.
Generative AI and LLMs
- Hands-on experience building production applications using LLM APIs or open-source models.
- Strong understanding of RAG architecture, embeddings, chunking, reranking, and retrieval evaluation.
- Experience with vector databases such as Pinecone, Weaviate, Qdrant, Milvus, or pgvector.
- Familiarity with orchestration frameworks such as LangChain, LangChain, or comparable tools.
- Experience with tool calling, structured generation, agent workflows, and LLM evaluation.
Cloud and Infrastructure
- Experience with AWS, Azure, or Google Cloud.
- Working knowledge of Docker and Kubernetes.
- Familiarity with model serving, scalable APIs, monitoring, and production deployments.
- Experience with MLOps or LLMOps practices.
Databases and Data Processing
- Strong SQL skills and experience with relational databases.
- Familiarity with NoSQL databases, data pipelines, and distributed processing.
- Experience working with unstructured data, document ingestion, and retrieval systems.
Preferred Qualifications
- Experience with fine-tuning, quantization, or serving open-source LLMs.
- Experience with multimodal AI, including text, image, audio, or video.
- Knowledge of agent evaluation, workflow orchestration, and multi-agent systems.
- Experience with AI security, guardrails, governance, and responsible AI.
- Experience optimizing AI workloads for latency, scalability, and cost.
- Contributions to open-source AI projects, research, or technical publications.
Education
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Equivalent practical experience and demonstrated engineering expertise may be considered.
Key Success Metrics
- Quality, accuracy, and reliability of deployed AI solutions.
- Production adoption and measurable business impact.
- Reduction in inference costs and response latency.
- RAG retrieval quality and reduction in unsupported or incorrect responses.
- System availability, scalability, and operational stability.
- Delivery timelines, code quality, and technical mentoring effectiveness.
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI
Solid product experience and an educational background from Tier‑1 universities are preferred.
As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities.
In this role, you will:
- Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance.
- Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features.
- Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability.
- Work with SQL and NoSQL databases to implement efficient data models and service access patterns.
- Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs).
- Use AI powered engineering tools to improve development quality, speed, and productivity.
- Mentor engineers, supporting them in technical planning, implementation, and best practices.
- Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure.
- Write unit and integration tests and participate in code reviews to uphold engineering excellence.
- Investigate production issues, ensuring timely and effective solutions.
- Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies.
Who You’ll Work With
You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction.
What Makes You a Qualified Candidate
(Nonnegotiable qualifications)
- Bachelor’s degree in Computer Science or equivalent from a recognized institution.
- 5+ years of experience in backend services, distributed systems, or data platform development.
- Strong proficiency in Java, Go, or Python for service development.
- Good understanding of design principles, distributed system patterns, and service framework.
- Hands-on experience designing and developing RESTful APIs.
- Experience with SQL and NoSQL databases and data modelling.
- Strong debugging, problem solving, and troubleshooting skills.
- Experience with modern containerization and orchestration tools such as Kubernetes.
- Knowledge of public cloud platforms.
- Experience with AI productivity tools (e.g., GitHub Copilot).
- Ability to work independently, drive workstreams, and deliver high quality outcomes.
- Strong communication and collaboration skills.
What You’ll Bring
(Preferred qualifications)
- Familiarity with messaging systems such as Kafka.
- Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs.
- A track record of influencing design decisions and driving engineering best practices.
- The ability to mentor engineers and guide them through design, planning, and execution.
- A proactive mindset and comfort working in fast paced, dynamic environments.
- Curiosity, adaptability, and a passion for building impactful AI-driven products.
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Position Overview
The AI Observability Engineer will be instrumental in implementation of scalable, cloud-native solutions to meet the growing needs of our Data & Development team. The successful candidate will demonstrate the ability to abstract complexity and create reusable, scalable patterns that accelerate development. The AI Observability Engineer will build and maintain a robust framework to ensure the reliability and maintainability of DPR Construction's complex AI systems.
Responsibilities
- Standardize observability practices across AI/ML and other development teams including logging, metrics, tracing, and model performance monitoring, ingesting data from multiple platforms
- Lead hands-on implementation of automation-first DevOps and MLOps practices, enabling infrastructure-as-code and consistent, repeatable environment provisioning
- Design and manage intelligent DataOps pipelines with automated data quality monitoring and anomaly detection
- Deploy, maintain and monitor containerized ML workloads
- Extend existing CI/CD pipelines to support automated infrastructure changes and ML workflows
- Implement AI-driven data validation, schema and concept drift detection and metadata management.
- Establish governance frameworks for AI systems, including bias detection, explainability, and auditability
- Extend existing Azure RBAC strategy by automating role and permission management to reduce manual intervention
- Develop automated test suites for model performance, regression, edge cases and bias validation
- Monitor model KPIs (accuracy, precision, recall, latency, calibration)
- Ensure reproducability of experiments and production models
- Act as a technical point of contact for DevOps and MLOps practices, developing reusable patterns, documentation, and proof-of-concepts to drive adoption
Qualifications
- Bachelor’s degree in computer science, Data Science, Information Systems, or a related field
- 5+ years of experience in DevOps, MLOps, Data Engineering, Software Engineering or Site Reliability Engineering
- Strong understanding of cloud infrastructure and experience working with at least one major cloud provider, preferably Azure
- Proficiency in at least one objected-oriented programming language, preferably python with hands-on experience in ml frameworks like TensorFlow, PyTorch or Scikit-learn











