AI Runtime Lead (LLM DevOps, PyTorch) at IT Industry · Bengaluru (Bangalore) · 5 - 8 years · ₹12L - ₹16L / yr · Posted 6 Jan 2026

Review Criteria:
Mandatory:
- Strong AI Runtime Engineering (Lead / Staff) Profiles
- Must have 4+ years of software engineering experience
- Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
- Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
- Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
- Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
- Must have strong programming skills in Python, Java, C++ , etc
Preferred:
Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks
Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration
Role & Responsibilities:
As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.
What you’ll do:
Lead Runtime Design & Development:
- Own the core runtime architecture supporting AI training and inference at scale.
- Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
- Optimize distributed training reliability, orchestration, and job-level fault tolerance.
Drive Performance at Scale:
- Profile and enhance low-level system performance across training and inference pipelines.
- Improve packaging, deployment, and integration of customer models in production environments.
- Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.
Build Internal Tooling & Frameworks:
- Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
- Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
- Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.
Collaborate & Mentor:
- Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
- Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.
Ideal Candidate:
- 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
- Experience in delivering PaaS services.
- Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
- Strong programming skills in Python and C++ (Go or Rust is a plus).
- Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
- Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
- Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.

Similar jobs (10)
Description:
We are looking for an AI Development Engineer who is passionate about solving complex engineering problems and using AI to improve the speed, quality, and cost efficiency of software development.
The role involves rethinking the traditional approach to software engineering — moving from coding and implementation-heavy workflows to solution orchestration, structured thinking, detailed specifications, system design, and validation.
You will work on building intelligent, agentic applications that combine AI capabilities with traditional engineering systems. The focus is on using AI effectively while ensuring that the solutions we build remain reliable, secure, scalable, maintainable, and production-ready.
Key Responsibilities:
Requirement Clarity and Engineering Design
- Develop a deep understanding of technical requirements and system-level design to minimise rework and reduce the risk of AI-generated errors.
- Translate ambiguous product and business ideas into clear, structured technical specifications.
- Create specifications that serve as a reliable source of truth for both engineering teams and AI systems.
Engineering Excellence
- Establish practices to minimise functional defects and operational issues caused by AI-generated code.
- Identify and eliminate code bloat, redundant logic, dead code, and unnecessary complexity.
- Ensure AI-generated code remains understandable, maintainable, and easy for engineers to navigate.
- Build the right documentation and engineering artefacts so that AI-generated code does not become a black box.
- Incorporate security best practices into prompts, context, and code-generation workflows.
Agentic Applications
- Build, maintain, and scale production systems that leverage Generative AI to transform user experiences.
- Design and monitor agentic workflows where AI components interact with traditional microservices to solve complex business problems.
- Explore and implement ways to move from manual workflows to intelligent, agent-driven applications.
Operational Excellence
- Focus on rigorous validation as AI accelerates development and output.
- Ensure automated outputs meet high standards of security, performance, reliability, and intended functionality.
- Build deep observability into services and systems to identify and address production issues.
- Explore self-healing production workflows where AI can interpret logs, identify issues, and suggest real-time fixes.
Cost Efficiency
- Optimise inference costs through effective prompt engineering, model selection, tool usage, and workflow design.
- Balance model performance, token consumption, and overall business ROI.
- Identify and reduce technical debt caused by AI-generated code and redundant implementations before they affect system performance or cloud costs.
Organisational Leadership and Collaboration
- Work closely with Product, Production Engineering, Security, and other stakeholders to align AI capabilities with business goals and responsible AI practices.
- Encourage a culture where engineers can experiment with new AI workflows, learn from failures, and continuously improve.
- Mentor junior engineers and help drive the shift from traditional coding practices towards AI-assisted engineering and system orchestration.
Requirements:
- Strong foundations in Machine Learning and AI, including linear algebra, probability and statistics, supervised and unsupervised learning algorithms, and standard MLP/DNN architectures.
- Understanding of bias-variance trade-offs, model fitting and selection, hyperparameter tuning, and model performance evaluation.
- 5+ years of hands-on experience and working knowledge of Generative AI foundation models and LLM building blocks, including:
- Transformers for vision and text
- Tokenisation and attention mechanisms
- Prompting techniques
- Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) concepts
- Retrieval-Augmented Generation (RAG)
- Hands-on experience with prominent ML frameworks and libraries such as PyTorch, TensorFlow, and Hugging Face.
- Experience building or working on AI applications across one or more domains, including text, vision, speech, audio, and video.
- Ability to understand complex engineering requirements and translate them into structured specifications, implementation plans, and validation workflows.
- Strong problem-solving skills and an interest in exploring how AI can improve engineering workflows and application development.
Benefits:
- Best-in-class salary: We hire strong talent and compensate accordingly.
- Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
- Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
- High-impact work: Build AI-first systems and products used at scale by global clients.
About us
Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world! We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore. Since 2019, Proximity has created and grown high-impact, scalable products used by 370 million daily users, with a total net worth of $45.7 billion among our client companies.
We are Proximity — a global team of coders, designers, product managers, geeks, and experts. We solve complex problems and build cutting-edge tech at scale. Our team of Proxonauts is growing quickly, which means your impact on the company’s success will be huge.

Role Summary
We are seeking an Advanced Machine Learning Engineer to design, build, train, deploy, and operate scalable machine learning systems. This hands-on ML engineering role focuses on implementing models and production systems—not solely conducting data analysis or research. It requires strong Python and deep-learning expertise, experience with frameworks such as PyTorch or TensorFlow, and the ability to own the end-to-end model lifecycle, from behavioral/event data preparation and feature engineering through model development, large-scale training, deployment, inference optimization, and monitoring. The engineer will work with Snowflake, Databricks, Spark, and GPU-based training infrastructure to deliver reliable, efficient, and maintainable ML capabilities.
Must have - Buulding and operated production ML systems using Python + PyTorch /TensorFlow + Snowflake/Databricks + MLOps.
Key Responsibilities
Machine Learning Engineering
- Implement and optimize machine learning algorithms and models for business use cases, including classification, regression, clustering, and recommendation systems as applicable.
- Translate model requirements into robust, reusable, and testable Python components.
- Build model training, validation, scoring, and inference workflows that can be integrated into production applications.
- Evaluate model performance against agreed technical and business metrics and implement improvements to accuracy, latency, robustness, and resource efficiency.
- Apply appropriate validation, error analysis, and model testing practices to ensure reliable behavior.
Train models efficiently on GPU infrastructure using techniques such as mixed-precision training, gradient accumulation, checkpointing, memory optimization, and distributed training strategies where appropriate.
Use PyTorch, TensorFlow,Pyspark or equivalent frameworks to implement experiments and production-ready training code; apply rigorous evaluation, error analysis, and reproducibility practices.
Build model-training workflows covering event/token sequence preparation, tokenization, temporal and positional representations, self-supervised pretraining, and downstream fine-tuning when appropriate to the use case.
Design, implement, train, and optimize deep-learning models; develop custom architectures where required, including transformer- and attention-based models for sequential or behavioral data.
Deep Learning & Model Architecture
Data Platforms & ML Pipelines
- Use Snowflake and SQL to access, query, and prepare enterprise data required by machine learning applications.
- Use Databricks for scalable data processing, feature preparation, model development, and ML pipeline execution.
- Develop and maintain reliable pipelines for data preparation, feature generation, training, batch scoring, and inference.
- Use PySpark and distributed processing techniques where appropriate for large-scale workloads.
- Work with data engineering teams to integrate upstream data sources and ensure dependable data contracts, quality checks, and pipeline operation.
Productionization & MLOps
- Productionize ML solutions and integrate them with services, APIs, data products, or downstream business workflows.
- Implement model and code versioning, experiment tracking, reproducible builds, automated testing, and release practices.
- Monitor model outputs and pipeline health; troubleshoot failures, data changes, drift, and performance degradation.
- Improve operational reliability, scalability, observability, and maintainability of ML systems.
- Collaborate with platform, cloud, and DevOps teams on deployment automation and production support.
Build observable production ML systems with appropriate logging, alerting, performance tracking, and operational safeguards.
Optimize inference latency, throughput, memory use, and serving cost through model architecture choices, batching, and serving-side optimizations.
Software Engineering & Technical Ownership
- Develop clean, modular, documented, and maintainable code following engineering standards and design principles.
- Contribute to technical design, code reviews, testing strategies, and architectural decisions for ML systems.
- Own assigned ML engineering deliverables from technical design through implementation, release, and ongoing support.
- Identify performance bottlenecks and improve runtime, resource utilization, and processing efficiency.
- Collaborate with cross-functional engineering and product teams to deliver dependable ML capabilities.
Required Skills & Qualifications
- Strong proficiency in Python and software engineering practices, including object-oriented design, modular development, testing, debugging, and code quality.
- Strong ML foundation and mathematical understanding
- Strong understanding of the end-to-end ML lifecycle, including model architecture, training, evaluation, optimization, inference, production integration, and monitoring.
- Strong SQL skills and experience working with structured data and data pipelines.
- Hands-on experience with Snowflake for querying and preparing data for ML workflows.
- Hands-on experience with Databricks for data processing and/or ML pipeline development.
- Strong hands-on experience with PyTorch, TensorFlow, or a similar deep-learning framework; experience with scikit-learn is also useful where appropriate.
- Understanding of production ML concepts, including reproducibility, model versioning, deployment, monitoring, and troubleshooting.
- Ability to design reliable, scalable, and maintainable software components and pipelines.
Familiarity with GPU training concepts and distributed strategies such as Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), or equivalents is an advantage for large-model workloads.
Understanding of model optimization, inference efficiency, and integration with production services or applications.
Experience developing and deploying ML solutions at scale, including end-to-end model lifecycle ownership.
Preferred Skills
- PySpark, Apache Spark, and distributed processing for large-scale behavioral or event data.
- MLflow or similar tooling for experiment tracking, model registry, reproducible training, and model lifecycle management.
- Experience integrating Snowflake and Databricks within enterprise ML workflows.
- Cloud experience with AWS, Microsoft Azure, or Google Cloud.
- REST APIs, containers, CI/CD, automated testing, logging, and observability.
- Experience with fraud detection, anomaly detection, behavioral modeling, identity or account-abuse signals, recommendation systems, or other large-scale ML applications.
- Exposure to Generative AI, LLM integration, embeddings, or RAG as an additional advantage.
Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, Computer Engineering, or a related field, or equivalent practical experience.
- At least 5 years of professional experience building, deploying, and supporting machine learning solutions at scale, or equivalent experience demonstrating the required engineering depth.
- Demonstrated ability to take ownership of engineering deliverables and work through implementation, deployment, and operational issues.
F2F interview only.
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
Job Title: Senior AI/ML Engineer
Company: Timble Technologies Pvt. Ltd
Location: Gurugram (Hybrid)
Experience: 2 TO 5 Years
About Us
Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.
Role Overview
We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.
Key Responsibilities
· Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).
· GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.
· Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.
· MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.
· Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.
· Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.
Required Qualifications & Skills
· Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.
· Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.
· GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.
· Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.
· Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.
· Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).
Preferred Qualifications
· Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.
· Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).
· Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.
Job Title: Senior AI Engineer
Experience: 5–10 years in software engineering, with 3+ years in AI/ML engineering preferred
Employment Type: Full-time
Department: Artificial Intelligence / Engineering
Location: Bangalore
We are looking for a highly skilled Senior AI Engineer to design, develop, deploy, and scale intelligent AI-powered applications and solutions. The ideal candidate will have strong expertise in machine learning, Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and production-grade software engineering.
The candidate will work closely with product managers, data scientists, software engineers, and business stakeholders to translate complex business requirements into scalable, reliable, secure, and cost-effective AI solutions.
Key Responsibilities
1. AI Solution Design and Development
- Design, develop, and deploy end-to-end AI and machine learning solutions.
- Build intelligent applications using LLMs, Generative AI, NLP, and deep learning techniques.
- Develop scalable AI architectures and reusable components for enterprise applications.
- Evaluate AI models and select appropriate approaches based on accuracy, latency, cost, and business requirements.
2. Generative AI and LLM Engineering
- Develop LLM-powered applications using models from providers such as OpenAI, Anthropic, Google, or open-source ecosystems.
- Design and implement RAG pipelines, document processing workflows, semantic search, and knowledge retrieval systems.
- Build AI agents and multi-step workflows using appropriate orchestration frameworks.
- Implement prompt engineering, structured outputs, tool calling, and context management.
- Optimize model performance through evaluation, fine-tuning where appropriate, and inference optimization.
3. Machine Learning and Data Engineering
- Develop and operationalize machine learning models for classification, prediction, recommendation, and other business use cases.
- Work with structured, unstructured, and multimodal data.
- Build data preprocessing, feature engineering, model training, and validation pipelines.
- Apply appropriate model evaluation techniques and statistical methods.
4. Production Deployment and MLOps / LLMOps
- Deploy AI solutions using cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Build automated CI/CD pipelines for AI applications and model deployment.
- Implement model versioning, experiment tracking, monitoring, and performance evaluation.
- Optimize inference latency, throughput, infrastructure utilization, and operating costs.
- Establish observability for AI applications, including token usage, retrieval quality, latency, failures, and model behavior.
5. Software Engineering and System Architecture
- Develop production-quality applications and APIs using Python and modern backend frameworks.
- Design RESTful APIs, asynchronous processing systems, and microservices where appropriate.
- Integrate AI services with enterprise applications, databases, and third-party systems.
- Use relational databases, vector databases, caching, and distributed systems effectively.
- Apply software engineering best practices, including testing, code reviews, documentation, and design patterns.
6. Security, Quality, and Responsible AI
- Implement safeguards against prompt injection, data leakage, insecure tool execution, and unauthorized access.
- Apply appropriate privacy, security, and compliance controls to AI systems.
- Evaluate hallucinations, bias, reliability, and failure modes.
- Design human-in-the-loop workflows and fallback mechanisms for critical use cases.
7. Technical Leadership and Collaboration
- Lead technical design discussions and mentor junior AI engineers.
- Define engineering standards, coding practices, and AI development guidelines.
- Collaborate with cross-functional teams to deliver measurable business outcomes.
- Conduct code reviews, evaluate emerging technologies, and recommend practical innovations.
- Communicate technical trade-offs and solution architecture to both technical and non-technical stakeholders.
Required Technical Skills
Programming and Backend Development
- Strong proficiency in Python.
- Experience with FastAPI, Flask, or Django.
- Knowledge of REST APIs, asynchronous programming, data structures, algorithms, and software design principles.
- Experience with Git, automated testing, and CI/CD.
AI and Machine Learning
- Strong understanding of supervised and unsupervised learning, model evaluation, and statistical concepts.
- Hands-on experience with PyTorch, TensorFlow, or scikit-learn.
- Knowledge of NLP, embeddings, transformers, and deep learning fundamentals.
Generative AI and LLMs
- Hands-on experience building production applications using LLM APIs or open-source models.
- Strong understanding of RAG architecture, embeddings, chunking, reranking, and retrieval evaluation.
- Experience with vector databases such as Pinecone, Weaviate, Qdrant, Milvus, or pgvector.
- Familiarity with orchestration frameworks such as LangChain, LangChain, or comparable tools.
- Experience with tool calling, structured generation, agent workflows, and LLM evaluation.
Cloud and Infrastructure
- Experience with AWS, Azure, or Google Cloud.
- Working knowledge of Docker and Kubernetes.
- Familiarity with model serving, scalable APIs, monitoring, and production deployments.
- Experience with MLOps or LLMOps practices.
Databases and Data Processing
- Strong SQL skills and experience with relational databases.
- Familiarity with NoSQL databases, data pipelines, and distributed processing.
- Experience working with unstructured data, document ingestion, and retrieval systems.
Preferred Qualifications
- Experience with fine-tuning, quantization, or serving open-source LLMs.
- Experience with multimodal AI, including text, image, audio, or video.
- Knowledge of agent evaluation, workflow orchestration, and multi-agent systems.
- Experience with AI security, guardrails, governance, and responsible AI.
- Experience optimizing AI workloads for latency, scalability, and cost.
- Contributions to open-source AI projects, research, or technical publications.
Education
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Equivalent practical experience and demonstrated engineering expertise may be considered.
Key Success Metrics
- Quality, accuracy, and reliability of deployed AI solutions.
- Production adoption and measurable business impact.
- Reduction in inference costs and response latency.
- RAG retrieval quality and reduction in unsupported or incorrect responses.
- System availability, scalability, and operational stability.
- Delivery timelines, code quality, and technical mentoring effectiveness.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Role Overview
We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale.
Key Responsibilities
Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production.
Write clean, tested, production-grade code and participate actively in code and design reviews.
Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production.
Required Qualifications
8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs.
Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel).
Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers.
Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability.
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Solid product experience and an educational background from Tier‑1 universities are preferred.
As a Senior AI Engineer, you will play a key role in designing and delivering highly scalable, next generation AI products within our AI stack. You will work in a technically rich environment with talented peers, contributing to product planning, design, and execution while influencing the evolution of Teradata’s AI capabilities.
In this role, you will:
- Design, develop, and maintain high quality systems, services, and applications with an emphasis on scalability, reliability, and performance.
- Collaborate with cross-functional engineers and product partners to shape design and consistently deliver end to end features.
- Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability.
- Work with SQL and NoSQL databases to implement efficient data models and service access patterns.
- Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs).
- Use AI powered engineering tools to improve development quality, speed, and productivity.
- Mentor engineers, supporting them in technical planning, implementation, and best practices.
- Identify and resolve system performance bottlenecks, optimizing code, design, and infrastructure.
- Write unit and integration tests and participate in code reviews to uphold engineering excellence.
- Investigate production issues, ensuring timely and effective solutions.
- Stay current with emerging trends in engineering, AI/ML, and cloud-native technologies.
Who You’ll Work With
You will be part of a high-performing engineering team building core components of Teradata’s AI platform. You will collaborate closely with other engineers, AI/ML specialists, product managers, cloud architects, and partner teams across the company. The role offers opportunities to contribute directly to Teradata’s AI product roadmap and technological direction.
What Makes You a Qualified Candidate
(Nonnegotiable qualifications)
- Bachelor’s degree in Computer Science or equivalent from a recognized institution.
- 5+ years of experience in backend services, distributed systems, or data platform development.
- Strong proficiency in Java, Go, or Python for service development.
- Good understanding of design principles, distributed system patterns, and service framework.
- Hands-on experience designing and developing RESTful APIs.
- Experience with SQL and NoSQL databases and data modelling.
- Strong debugging, problem solving, and troubleshooting skills.
- Experience with modern containerization and orchestration tools such as Kubernetes.
- Knowledge of public cloud platforms.
- Experience with AI productivity tools (e.g., GitHub Copilot).
- Ability to work independently, drive workstreams, and deliver high quality outcomes.
- Strong communication and collaboration skills.
What You’ll Bring
(Preferred qualifications)
- Familiarity with messaging systems such as Kafka.
- Experience experimenting with or implementing AI/ML technologies, Agentic AI, or LLMs.
- A track record of influencing design decisions and driving engineering best practices.
- The ability to mentor engineers and guide them through design, planning, and execution.
- A proactive mindset and comfort working in fast paced, dynamic environments.
- Curiosity, adaptability, and a passion for building impactful AI-driven products.
About Us:
CLOUDSUFI, a Google Cloud Premier Partner, is a global leading provider of data-driven digital transformation across cloud-based enterprises. With a global presence and focus on Software & Platforms, Life sciences and Healthcare, Retail, CPG, financial services and supply chain, CLOUDSUFI is positioned to meet customers where they are in their data monetization journey.
Our Values
We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.
Equal Opportunity Statement
CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace. Please explore more at https://www.cloudsufi.com/
About the role
CloudSufi is hiring an AgentOps Engineer to own the runtime, infrastructure, and operational monitoring for an AI agent testing platform deployed for an enterprise client. You will deploy and instrument agents for testing, set up observability and continuous evaluation on live traffic, and manage the cloud infrastructure the platform runs on.
Responsibilities:
- Deploy and instrument AI agents for testing and monitoring.
- Set up observability — traces, logs, and metrics — and continuous evaluation on production traffic.
- Build drift detection and alerting so quality regressions are caught early.
- Own the cloud infrastructure and CI/CD automation supporting the platform.
- Manage environments, access, and operational reliability.
Required qualifications:
- 5+ years in DevOps, MLOps, or platform engineering.
- Strong Google Cloud experience (Cloud Run, Cloud Build, Pub/Sub, Cloud Logging and Monitoring, IAM) or equivalent cloud platform.
- Experience with CI/CD automation and infrastructure as code.
- Familiarity with deploying LLM or AI agent workloads.
Preferred qualifications:
- Experience with OpenTelemetry and AI/agent observability.
- Exposure to Vertex AI, Gemini Enterprise Agent Platform, or ADK.











