Cutshort logo
For Employers
IT Industry  logo
AI Runtime Lead (LLM DevOps, PyTorch)
IT Industry
AI Runtime Lead (LLM DevOps, PyTorch)

AI Runtime Lead (LLM DevOps, PyTorch) at IT Industry · Bengaluru (Bangalore) · 5 - 8 years · ₹12L - ₹16L / yr · Posted 6 Jan 2026

Peak Hire Solutions's logo

AI Runtime Lead (LLM DevOps, PyTorch)

at IT Industry

Agency job
5 - 8 yrs
₹12L - ₹16L / yr
Bengaluru (Bangalore)
Skills
skill iconPython

Review Criteria:

Mandatory:

  • Strong AI Runtime Engineering (Lead / Staff) Profiles
  • Must have 4+ years of software engineering experience
  • Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
  • Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
  • Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
  • Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
  • Must have strong programming skills in Python, Java, C++ , etc


Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration


Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.


What you’ll do:

Lead Runtime Design & Development:

  • Own the core runtime architecture supporting AI training and inference at scale.
  • Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
  • Optimize distributed training reliability, orchestration, and job-level fault tolerance.


Drive Performance at Scale:

  • Profile and enhance low-level system performance across training and inference pipelines.
  • Improve packaging, deployment, and integration of customer models in production environments.
  • Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.


Build Internal Tooling & Frameworks:

  • Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
  • Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
  • Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.


Collaborate & Mentor:

  • Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
  • Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.


Ideal Candidate:

  • 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
  • Experience in delivering PaaS services.
  • Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
  • Strong programming skills in Python and C++ (Go or Rust is a plus).
  • Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
  • Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
  • Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

company logo
Agency job
via by Bhavesh Kiroula
Remote only
3 - 15 yrs
₹15L - ₹42L / yr
MLOps
Aws sagemaker
skill iconAmazon Web Services (AWS)
MLFlow
Systems Development Life Cycle (SDLC)
+3 more

Example Responsibilities:

  • Build and optimize model serving infrastructure with a focus on inference latency and cost optimization
  • Architect efficient inference pipelines that balance latency, throughput, and cost across various acceleration options
  • Develop monitoring and observability solutions for ML systems
  • Collaborate with ML Engineers to establish best practices for optimized model deployment
  • Implement cost-efficient, enterprise-scale solutions
  • Collaborate in a cross-functional, distributed team for continuous system improvement
  • Work with MLEs, QA Engineers, and DevOps Engineers
  • Evaluate and implement new technologies and tools
  • Contribute to architectural decisions for distributed ML systems


Experience and Qualifications:

  • 5+ years of experience in software engineering with Python
  • Experience with ML frameworks, particularly PyTorch
  • Experience optimizing ML models with hardware acceleration (AWS Neuron , ONNX, TensorRT)
  • Experience with AWS ML services and hardware-accelerated instances (Sagemaker, Inferentia,Trainium)
  • Proven experience building and operating AWS serverless architectures
  • Deep understanding of event-driven processing patterns, SQS/SNS and serverless caching solutions
  • Experience with containerization using Docker and orchestration tools
  • Strong knowledge of RESTful API design and implementation
  • Proficiency in writing good quality & secure code and be familiar with static code analysis tools
  • Excellent analytical, conceptual and communication skills in spoken and written English
  • Experience applying Computer Science fundamentals in algorithm design, problem solving, and complexity analysis


Great to have Experience and Qualifications:

  • Experience with any of the following: model compilation and quantization, performance profiling and benchmarking ML inference systems
  • Experience working in regulated industries with strict compliance requirements for cloud-native solutions
Read more
company logo
Neeta Trivedi
Posted by Neeta Trivedi
Bengaluru (Bangalore)
2 - 3 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDeep Learning
skill iconMachine Learning (ML)
skill iconC++
CUDA
+11 more

AI based systems design and development, entire pipeline from image/ video ingest, metadata ingest, processing, encoding, transmitting.


Implementation and testing of advanced computer vision algorithms.

Dataset search, preparation, annotation, training, testing, fine tuning of vision CNN models. Multimodal AI, LLMs, hardware deployment, explainability.


Detailed analysis of results. Documentation, version control, client support, upgrades.

Read more
company logo
Taher Ujjainwala
Posted by Taher Ujjainwala
Pune
12 - 25 yrs
₹70L - ₹120L / yr (ESOP available)
skill iconPython
skill iconKubernetes
Google Cloud Platform (GCP)
skill iconAmazon Web Services (AWS)
Windows Azure
+15 more

About the Role

We are hiring Staff / Principal Engineers to take full, hands-on ownership of Blitzy's most critical production-grade systems and to deliver high-leverage features that materially improve customer outcomes and engineering velocity. This is the most senior individual contributor role at the company today.

This is not a Senior-plus role, an architecture-only role, or a promotion-track role. We are looking for someone who has already operated at Principal / Staff+ scope in a highly technical environment and expects to spend their time writing, reviewing, and shipping production code.

This role is 100% hands-on. Leverage comes from system ownership, execution quality, and durable technical decisions — not people management or process.


Responsibilities

  • Own mission-critical production systems end-to-end, ensuring correctness, scalability, performance, reliability, and operational excellence.
  • Design, build, and ship high-impact backend systems and features that improve product reliability, performance, and customer value.
  • Architect scalable services and cloud infrastructure using technologies such as Python, REST, gRPC, Kubernetes, and Terraform.
  • Identify and resolve complex technical bottlenecks that limit engineering quality, system performance, or organizational velocity.
  • Build and operate LLM-powered systems and validation loops that evaluate correctness, consistency, durability, and production performance.
  • Design and evolve data architectures incorporating relational, NoSQL, graph, and vector databases to support complex enterprise applications and semantic retrieval.
  • Modernize and improve complex enterprise systems while balancing reliability, maintainability, scalability, and delivery speed.
  • Set and uphold engineering quality standards through hands-on technical leadership, sound technical judgment, and ownership of long-term technical decisions.


Qualifications

  • Direct experience with Python as a primary programming language, backend frameworks, and microservices architectures.
  • Expertise in REST and gRPC, with proficiency in Node.js and JavaScript.
  • Proficiency in GCP, along with experience using at least one additional cloud platform such as AWS or Azure.
  • Advanced knowledge of Kubernetes and Terraform in production environments.
  • Experience operating highly available production systems, including monitoring, scalability, reliability, performance optimization, and operational tooling.
  • Strong knowledge of SQL and NoSQL databases, including PostgreSQL, MySQL, MongoDB, Cassandra, or DynamoDB.
  • Familiarity with graph databases such as Neo4j and vector databases or embedding infrastructure for semantic search and retrieval.
  • Hands-on experience building and operating LLM-powered systems in production, including evaluation, validation, regression testing, tracing, and failure analysis.
  • Working knowledge of LangSmith or comparable LLM observability and evaluation tools; familiarity with OpenAI, Anthropic, or similar model providers is a plus.
  • Ability to contribute across the full stack, with a strong understanding of frontend architecture and the ability to debug, design, and ship across frontend, backend, infrastructure, and AI systems.
  • Understanding of large-scale enterprise software systems, including architecture, integration, deployment, modernization, and long-term maintainability.
  • Proven track record of operating at Staff+, Principal Engineer, or equivalent level, independently driving complex technical initiatives and delivering high-impact outcomes with minimal supervision.


Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into enterprise grade code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups.


Our Culture

Who we are:

Led by two pioneering co-founders we are one of the fastest growing companies in the U.S., creating our own category of enterprise autonomous software development. We automate thousands of hours of software development for our customers, which includes strong representation within the Fortune 500.


How we work:

  • We move Blitzy Fast: Time is both our company’s and our clients’ most precious asset. We move quickly and decisively to innovate internally and deliver exceptional software externally.
  • Championship Mindset: We operate like a professional sports team. We win as a team by holding ourselves and each other to high standards, collaborating in-person, and remaining focused on the mission.
  • Passion for Invention: We’re pushing the frontier of what’s possible, requiring constant innovation and iteration.
  • We Work for the Customer: We focus on delivering outsized value to the customers we work with and expanding those relationships into deep, meaningful partnerships.
  • We believe in being ‘everyday athletes’: taking care of ourselves so we can bring our best minds to work. We promote great sleep, movement, and restorative activities for 


Blitzy is an equal opportunity employer committed to building a diverse and inclusive team. We believe different perspectives make us stronger.

Read more
company logo
Hinal Shah
Posted by Hinal Shah
Ahmedabad
7 - 9 yrs
₹13L - ₹30L / yr
Large Language Models (LLM)
Generative AI
GPT
BERT
LAMA
+4 more

Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have

strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and cloud-based AI deployments.


Key Responsibilities


• Design, develop, and deploy Machine Learning and Deep Learning models for classification, regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.

• Build and maintain end-to-end ML pipelines including data preprocessing, feature engineering, model training, validation, evaluation, and deployment.

• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related frameworks.

• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama, Claude, and Stable Diffusion.

• Collaborate with product, engineering, and business teams to translate requirements into scalable AI solutions.

• Optimize model performance, scalability, and reliability for production environments.

• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.

• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.


Required Qualifications


• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a related field.


• 7+ years of hands-on experience in AI/ML product development.

• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and Hugging Face.


• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.


• Strong understanding of the ML lifecycle including model training, tuning, deployment, monitoring, and optimization.

• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.


• Experience with AWS, Azure, or GCP cloud platforms.


• Strong problem-solving and analytical skills.


Preferred Skills

• Fine-tuning and deployment of Large Language Models.

• Experience with RAG (Retrieval Augmented Generation) architectures.

• Contributions to open-source AI projects or research publications.

• Knowledge of model interpretability, data annotation, and feature engineering.

• C++ experience for high-performance AI applications.



Why Join Kody Technolab Limited?

Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,

and enterprise-scale applications while collaborating with a highly skilled technology team.


Visit the Website to know more about us.

Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution

Kody Robots | Robotics Company in India for Autonomous Robots

Read more
company logo
Orenda Finserv
Posted by Orenda Finserv
Ahmedabad
3 - 5 yrs
₹7L - ₹11L / yr
skill iconMachine Learning (ML)
Model Serving
Vision Models
skill iconPython
RESTful APIs
+2 more

About the role

We are building AI systems that read, understand and act on real business documents, bank statements, financial reports, policy documents and forms and putting them into production where accuracy and cost both matters.

This is not a research role and it is not a prompt-writing role. You will own features end to end: pick and deploy open-source models, build the pipelines around them, measure whether they actually work on our documents, drive the cost per document down, and keep the whole thing running in production.

You will work closely with the engineering and product teams, and your work will be directly used by business users from day one.


What you will do

Deploy and evaluate open-source models

  • Select, deploy and benchmark open-source LLMs and vision-language models for specific, narrow use cases not general chat.
  • Build evaluation sets from real documents and define what "good" means numerically (field-level accuracy, extraction recall, hallucination rate) before shipping.
  • Run structured comparisons between models and approaches, and write up the trade-offs so the team can make a decision.
  • Apply quantization, batching and other optimizations to fit models into a sensible GPU budget.

Build and optimize AI orchestration

  • Design multi-step pipelines that combine deterministic code, ML models and LLM calls and know when not to use an LLM.
  • Optimize for latency, cost and reliability: caching, batching, request routing, fallback tiers, retries and graceful degradation.
  • Instrument pipelines so failures are visible and traceable rather than silent.

Ship to production

  • Package models and services with Docker, expose them behind clean APIs, and deploy them to our GPU and CPU infrastructure.
  • Handle the unglamorous production concerns: cold starts, timeouts, concurrency limits, versioning, rollback and monitoring.
  • Own on-call-style responsibility for the AI features you build, including cost tracking.


Must-have skills


Programming & engineering

  • Strong Python: type hints, async/await, dataclasses/Pydantic, clean module design, testing.
  • REST API development with FastAPI (or Flask/Django with a willingness to move to FastAPI).
  • Git, code review discipline, and the ability to write code someone else can maintain.
  • Comfortable in Linux and on the command line.

Machine learning fundamentals

  • Working knowledge of PyTorch and the Hugging Face ecosystem (transformers, tokenizers, accelerate).
  • Understanding of inference-time concepts: tokenization, context windows, batching, precision (FP16/BF16/INT8), memory footprint.
  • Ability to read a model card and a paper well enough to judge whether a model fits a use case.

Document processing

  • Hands-on experience with at least two of: pypdfium2, PyMuPDF, pdfplumber, pdfminer.six, Docling, Unstructured, Surya, DocTR, LayoutLM family.
  • Practical OCR experience (Tesseract, PaddleOCR, or a cloud OCR) and an understanding of when OCR is the wrong tool.
  • Experience extracting tables from PDFs and dealing with merged cells, multi-line rows, and inconsistent column layouts.


Strongly preferred

You will be a much stronger candidate with any of these. We do not expect all of them.

Model serving & optimization

  • vLLM, TGI, Ollama, llama.cpp, or Triton Inference Server.
  • Quantization formats and tooling: GGUF, AWQ, GPTQ, bitsandbytes, ONNX Runtime, INT8 export.
  • Serverless GPU platforms: Modal, RunPod, Replicate, Baseten including cold-start and container-lifecycle management.
  • LoRA / QLoRA fine-tuning with PEFT for narrow, task-specific improvements.

Vision-language models

  • Practical use of open VLMs: Qwen2.5-VL, InternVL, Granite Vision, Molmo, Phi-Vision, or similar.
  • Awareness of where VLMs hallucinate especially on numeric and financial content and patterns for constraining them (using the model for layout only, sourcing values from the text layer, constrained decoding).

Orchestration & pipelines

  • Workflow orchestration: Dagster, Airflow, Prefect, or Temporal.
  • Async job patterns: Celery, RQ, or platform-native spawn/poll patterns.
  • LLM orchestration frameworks (LangGraph, LlamaIndex, Haystack) with the judgement to know when plain Python is a better answer.
  • Structured output enforcement: Instructor, Outlines, XGrammar, JSON schema / tool-use modes.

Evaluation & observability

  • Building golden datasets and regression suites for extraction tasks.
  • Eval tooling: promptfoo, DeepEval, Ragas, or in-house harnesses.
  • LLM tracing and monitoring: Langfuse, Arize Phoenix, LangSmith, OpenTelemetry.

Nice extras

  • Rule engines and policy evaluation (Open Policy Agent / Rego, Drools, rule-engine).
  • Experience in fintech, lending, insurance or accounting documents.
  • Handling of PII and data-security practices in document pipelines.
  • Contributions to open-source ML or document-processing projects.


Why join us

  • Real production ownership from month one your work goes to actual users, not a demo.
  • Genuinely hard technical problems in document AI, not wrappers over an API.
  • Small team, short decision cycles, direct access to leadership.
  • Budget and freedom to evaluate and adopt new open-source models as they land.


To apply: send your CV along with a short note on one AI system you have taken to production what it did, what the accuracy was, and what broke.


Read more
company logo
Sandeep C
Posted by Sandeep C
Bengaluru (Bangalore)
8 - 16 yrs
₹1L - ₹2L / yr (ESOP available)
Large Language Models (LLM)
Agentic AI
Applied mathematics

Key Responsibilities:

·      Architectural Leadership: Design and lead the development of robust, scalable AI architectures, ensuring high performance, reliability, and security.

·      Applied Mathematics & Statistics: Apply statistical analysis, numerical computation, and mathematical modeling to derive insights from large-scale data and optimize model performance.

·      Deep Learning Development: Design, train, and deploy advanced Deep Learning (DL) models.

·      Technical Mentorship: Mentor engineering teams on best practices for AI/ML, coding standards, and architectural design.

·      Model Optimization: Optimize models for speed, efficiency, and accuracy using techniques like pruning, quantization, or GPU acceleration.

·      Strategy & Innovation: Evaluate and select appropriate AI frameworks, tools, and platforms, staying abreast of cutting-edge research and industry trends.

Qualifications:

Required:

·      Education: Master's or PhD in Computer Science, Applied Mathematics, Statistics, Physics, or a related quantitative field.

·      Experience: 10+ years of experience in software development, with at least 3-5 years in a Applied Mathematics and Deep learning.

·      AI/ML Expertise: Proven experience designing and deploying deep learning models in production using frameworks.

·      Mathematics/Statistics: Strong proficiency in linear algebra, calculus, probability, and statistical methods.

·      Programming Skills: Expert-level coding skills in Python (NumPy, Pandas, Scikit-learn) and experience with languages like Java or C++.

Key Competencies:

  • Strategic mindset with deep operational awareness.
  • Excellent communication and stakeholder management skills.
  • Ability to simplify complex technical concepts for executive reporting.
  • Strong leadership, people development, and cross-functional influencing skills.

Bias for action and a relentless focus on continuous improvement.

Read more
Remote only
10 - 15 yrs
₹28L - ₹34L / yr
GenAI,
DevOps
skill iconPython
Infrastructure architecture
Infrastructure-as-Code
+4 more


Job Description: AI Engineer – GenAI Platform Automation

Experience: 10+ Years

Location: Remote – Pan India

Employment Type: Haparz Payroll

Work Mode: Remote

Notice Period: Immediate / Short Notice Preferred


About the Role


We are looking for a senior AI Engineer – GenAI Platform Automation to lead automation initiatives across enterprise Generative AI, Data Science, Data Engineering, and Analytics platforms.

The role focuses on building scalable, secure, and self-service automation capabilities across infrastructure provisioning, CI/CD, cloud environments, AI workload deployment, governance, observability, and operational excellence. The ideal candidate will have strong hands-on experience in platform engineering, cloud automation, DevOps, Infrastructure-as-Code, Python, and enterprise GenAI ecosystems.


Key Responsibilities

  • Lead end-to-end automation initiatives for enterprise GenAI, Data Science, Data Engineering, Metadata, Data Quality, Event Streaming, and Analytics platforms.
  • Design self-service automation for infrastructure provisioning, environment onboarding, deployment, governance, monitoring, and operational workflows.
  • Build automation capabilities supporting the AI lifecycle, including experimentation, model training, deployment, inference, observability, and lifecycle management.
  • Develop scalable Infrastructure-as-Code solutions using Terraform and cloud-native automation frameworks.
  • Design and maintain enterprise CI/CD pipelines, automated testing, deployment, and release processes using modern DevOps toolchains.
  • Automate Kubernetes, containers, serverless, and distributed computing environments in collaboration with cloud and platform engineering teams.
  • Develop automation solutions for GenAI and Agentic AI applications, including MCP-enabled services, API integrations, workflow automation, and event-driven architectures.
  • Implement observability, monitoring, logging, tracing, alerting, automated remediation, and reliability engineering practices.
  • Work with architecture, security, governance, engineering, and business teams to ensure enterprise standards and compliance requirements are met.
  • Conduct technical design reviews, automation assessments, code reviews, and establish engineering best practices.
  • Provide technical leadership and mentorship to engineering teams adopting automation-first and platform engineering practices.

What We’re Looking For

  • 10+ years of hands-on experience in platform engineering, automation engineering, cloud engineering, DevOps, or distributed systems.
  • Strong experience building enterprise self-service platforms supporting AI/ML, Data Science, Data Engineering, or Advanced Analytics workloads.
  • Strong expertise in automation frameworks, CI/CD, DevOps, Infrastructure-as-Code, and software delivery lifecycle automation.
  • Hands-on experience with Terraform and cloud-native infrastructure automation.
  • Strong experience with Python for automation, orchestration, scripting, tooling, and platform engineering.
  • Experience with Bitbucket, Bamboo, Jira, Confluence, or similar enterprise DevOps toolchains.
  • Experience working with Kubernetes, containers, serverless platforms, YARN, and distributed processing environments.
  • Knowledge of Generative AI and Agentic AI architectures, MCP frameworks, APIs, workflow automation, and enterprise AI platforms.
  • Experience with event-driven architectures and technologies such as Kafka and streaming platforms.
  • Strong understanding of cloud engineering, networking, security, scalability, resilience, and cost optimization.
  • Experience implementing observability solutions covering monitoring, logging, tracing, alerting, and operational dashboards.
  • Understanding of metadata management, data lineage, data governance, and semantic-layer concepts is highly valuable.

Good to Have

  • Experience supporting enterprise GenAI platforms, AI governance, model management, and AI operationalization.
  • Experience with GitOps, DevSecOps, Platform Engineering, and Reliability Engineering practices.
  • Exposure to data governance, data quality, metadata management, and model lifecycle automation.
  • Experience creating reusable internal developer platforms and self-service engineering tools at enterprise scale.
  • Banking, AML, fraud detection, financial crime, or risk analytics domain experience is an advantage.


Read more
company logo
Shefali Gupta
Posted by Shefali Gupta
Remote, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Bengaluru (Bangalore)
2 - 10 yrs
₹5L - ₹15L / yr
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
skill iconDocker
API
skill iconFlask
+4 more

Job Title: Senior AI/ML Engineer

Company: Timble Technologies Pvt. Ltd

Location: Gurugram (Hybrid)

Experience: 2 TO 5 Years


About Us

Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.

Role Overview

We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.


Key Responsibilities


·       Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).

·       GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.

·       Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.

·       MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.

·       Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.

·       Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.


Required Qualifications & Skills


·       Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.

·       Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.

·       GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.

·       Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.

·       Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.

·       Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).


Preferred Qualifications

·       Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.

·       Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).

·       Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.

Read more
company logo
Bengaluru (Bangalore), Mumbai, Hyderabad, Delhi, Gurugram
5 - 12 yrs
₹20L - ₹40L / yr
Computer Vision
OpenCV

AuxoAI is hiring a Senior Applied AI Engineer to design and deploy production-grade computer vision systems that operate reliably in real-world environments.

This role focuses on building end-to-end visual intelligence systems, combining deep learning, classical computer vision techniques, and multimodal models. It is not limited to model training and requires strong ownership of system design, deployment, and real-world performance.

You will work on systems that perform perception, understanding, and reasoning over visual data, and integrate these capabilities into larger AI platforms and agent-based workflows.

You will also work on problems where existing approaches may not be sufficient, and will be expected to combine deep learning, geometric methods, and multimodal reasoning to build robust, production-grade systems.

Location – Mumbai / Bangalore / Hyderabad / Gurgaon (Hybrid – 3 days per week in office)


Responsibilities:

  • Design and deploy computer vision systems for tasks such as:
  • Object detection, segmentation, and tracking
  • Scene understanding and structured perception
  • Video understanding and temporal reasoning
  • Build and optimize models using architectures such as:
  • CNNs (ResNet, EfficientNet)
  • Vision Transformers (ViT, Swin, DeiT)
  • Detection/segmentation models (YOLO, DETR, Mask R-CNN)
  • Develop multimodal systems combining vision and language:
  • CLIP-style models
  • Vision-language models (VLMs)
  • Visual grounding and captioning systems
  • Implement algorithms for:
  • Multi-object tracking (SORT, DeepSORT, ByteTrack)
  • Feature matching and representation learning
  • Temporal modeling (RNNs, Transformers for video)
  • Apply geometric and classical computer vision methods where relevant:
  • Camera calibration
  • Epipolar geometry
  • Pose estimation
  • 3D reconstruction or depth estimation
  • Optimize systems for:
  • Low-latency, real-time inference
  • Throughput and scalability
  • Edge and distributed deployment
  • Design and build data pipelines for:
  • Annotation workflows
  • Dataset curation
  • Synthetic data generation
  • Integrate vision systems into:
  • Multimodal AI pipelines
  • Agent-based systems
  • Decision-making workflows



Requirements:

  • 5+ years of experience building computer vision systems in production environments
  • Strong experience with deep learning frameworks (PyTorch / TensorFlow)
  • Hands-on experience with:
  • Detection, segmentation, or tracking systems
  • Model training, fine-tuning, and evaluation
  • Strong understanding of:
  • Representation learning
  • Loss functions (contrastive loss, focal loss, etc.)
  • Evaluation metrics (mAP, IoU, precision/recall)
  • Experience building and deploying end-to-end vision systems, not just training models


Candidates whose primary experience is limited to academic projects or model experimentation without real-world deployment may not be a fit for this role.


Nice to Have:

  • Experience with multimodal systems (vision + language)
  • Familiarity with models such as:
  • CLIP, BLIP, Flamingo, or similar
  • Experience with 3D vision:
  • NeRFs
  • SLAM
  • Point clouds
  • Experience with video understanding:
  • Action recognition
  • Event detection
  • Experience building data engines:
  • Active learning
  • Hard negative mining
  • Experience working with large-scale datasets and distributed training pipelines



Read more
company logo
Rishu Dutta
Posted by Rishu Dutta
Gurugram
7 - 12 yrs
₹20L - ₹50L / yr
Retrieval Augmented Generation (RAG)
Agentic AI
Multi-agent Systems

Role Overview 

We are looking for an AI Engineer to design, build, and ship production AI systems, including agentic AI applications, for enterprise clients. This is a hands-on engineering role: you will write production code, build and evaluate models and agents, and work closely with architects and product teams to take solutions from prototype to scale. 


Key Responsibilities 

Design and build agentic AI systems: agent workflows, tool/function-calling, memory, and human-in-the-loop patterns. Build and productionise RAG pipelines, prompt-based applications, and LLM integrations across providers. Develop and maintain data and ML pipelines: feature engineering, model training, evaluation, and monitoring. Integrate AI systems with enterprise applications (CRMs, ERPs, ITSM tools) via APIs, events, and MCP-based tool servers. Implement guardrails, prompt-injection defences, and evaluation frameworks to keep AI systems safe and reliable in production. 

Write clean, tested, production-grade code and participate actively in code and design reviews. 

Collaborate with architects, product managers, and delivery teams to translate requirements into working AI solutions. Troubleshoot and optimise AI systems for accuracy, latency, and cost in production. 


Required Qualifications 

8–12 years of hands-on software engineering experience, with a strong, unbroken technical track record. Hands-on experience building and shipping AI/ML systems in production, not just POCs. 

Practical experience with agentic AI systems and at least one major agent framework (LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Bedrock Agents/Strands, or Semantic Kernel). 

Experience with LLM/GenAI systems: RAG pipelines, prompt engineering, structured outputs, and tool calling across providers. 

Strong Python skills (TypeScript/Node.js a plus), with production-grade testing, CI/CD, and API design practices. Working knowledge of ML fundamentals: model evaluation, feature engineering, and experimentation. Cloud-native experience on AWS and/or Azure: containers, serverless, event backbones, and vector databases. Understanding of LLM safety and reliability practices: guardrails, prompt-injection defences, and observability. 



Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos