LLM/AI Model Engineer – Training, Evaluation & Benchmarking at QubeLabs Systems Private Limited · Delhi · 3 - 5 years · ₹10L - ₹20L / yr · Posted 9 Oct 2026

LLM/AI Model Engineer – Training, Evaluation & Benchmarking
LLM/AI Model Engineer – Training, Evaluation & Benchmarking
Location: New Delhi, India (On-site)
Employment Type: Full-time
Experience: 3–5 years
Industry: Enterprise AI / Generative AI / Machine Learning / NLP
About QubeLabs
QubeLabs is building the next generation of Enterprise AI Systems that transform workforce operations and intelligence for the financial services industry.
Our platform combines Conversational AI, Agentic AI, workflow automation, proprietary language models and enterprise intelligence. Our flagship product, QubeLabs Workmate, serves banks, NBFCs, MFIs, wealth management firms, insurance companies and fintechs across India and Europe.
At the core of our AI platform is the Vectro Series, our proprietary family of language models designed for enterprise and financial-services use cases.
We are looking for an LLM/AI Model Engineer to build the training pipelines, datasets and evaluation infrastructure required to continuously improve the Vectro Series.
Role Overview
You will work closely with the Head of AI, Research Partners and engineering teams to implement and operationalize LLM training approaches and build a reliable model improvement lifecycle:
Data Preparation → Training → Evaluation → Benchmarking → Error Analysis → Model Improvement
The role combines hands-on LLM fine-tuning, dataset engineering, tokenization, evaluation framework development and model quality management.
Key Responsibilities
1. LLM Training & Fine-tuning
Build and maintain pipelines for training and fine-tuning open-source foundation models for the Vectro Series.
Implement supervised fine-tuning (SFT), parameter-efficient fine-tuning (PEFT), LoRA/QLoRA and domain adaptation techniques; support continued pre-training where required.
Manage training configurations, checkpoints, model versions and experiment tracking.
Optimize training workflows for computational efficiency, reproducibility and reliability.
Translate model development approaches defined with the Head of AI and Research Partners into practical, scalable training pipelines.
2. Training Data & Tokenization
Build data pipelines to collect, clean, filter, normalize, deduplicate and validate training data.
Develop instruction-tuning, SFT and domain-specific datasets for financial-services and enterprise use cases.
Implement tokenization workflows, tokenizer configuration, vocabulary management, sequence packing, truncation and padding.
Address data representation challenges involving financial terminology, numerical values and multilingual content.
Maintain dataset versioning, lineage and quality controls, incorporating identified data gaps and relevant model failures into future training data.
3. Golden Dataset & Model Evaluation
Build and maintain QubeLabs' Golden Dataset to evaluate key model capabilities and target use cases.
Develop automated evaluation pipelines and reusable evaluation harnesses, combining automated metrics with human assessment where appropriate.
Evaluate accuracy, reasoning, factuality, instruction following, safety, multilingual performance and financial-domain capabilities.
Establish consistent evaluation methodology and regression tests to measure changes across model versions.
4. Benchmarking & Error Analysis
Evaluate Vectro against relevant public benchmarks and proprietary QubeLabs BFSI/enterprise benchmarks.
Compare results with relevant open-source and commercial models using consistent evaluation conditions.
Analyze failures, identify root causes across data, training and model behavior, and translate findings into actionable improvements.
Maintain reproducible benchmark results and reports to track model strengths, limitations and progress.
5. Model Quality & Release
Define model release quality gates and ensure each major release meets agreed evaluation and benchmark criteria.
Support red-teaming, robustness and safety testing.
Coordinate with the Head of AI, Research Partners and engineering teams to ensure validated model improvements are suitable for integration into production systems.
Experience
3–5 years in Machine Learning, Deep Learning, NLP, Generative AI or related fields.
Hands-on experience training or fine-tuning LLMs using open-source foundation models.
Practical experience building training pipelines, preparing datasets and evaluating model performance.
Experience with GPU-based training; distributed training is an advantage.
Financial-services, multilingual AI or enterprise AI experience is preferred.
Required Skills
LLM & Machine Learning: Large Language Models, Transformer architectures, Generative AI, NLP, Deep Learning, SFT, PEFT, LoRA/QLoRA, fine-tuning and continued pre-training.
Frameworks & Infrastructure: Python, PyTorch, Hugging Face Transformers, Hugging Face Tokenizers, GPU computing, experiment tracking and ML pipelines.
Data & Tokenization: Tokenization, tokenizer configuration, text preprocessing, sequence packing, dataset construction, data quality, versioning and lineage.
Evaluation & Benchmarking: Golden datasets, LLM evaluation, evaluation harnesses, automated and human evaluation, LLM-as-a-Judge, public and domain-specific benchmarks, regression testing and error analysis.
The role requires the ability to build both the model training pipeline and the measurement system that determines whether the model has actually improved.
What Success Looks Like
Reliable and reproducible training and fine-tuning pipelines for the Vectro Series.
High-quality training datasets, tokenization workflows and a comprehensive Golden Dataset.
Automated evaluation and benchmarking infrastructure with measurable model quality gates.
Clear, reproducible evidence of model performance against public, proprietary BFSI and relevant competing-model benchmarks.
A continuous improvement loop that converts evaluation findings into measurable gains across successive Vectro releases.
Key Performance Indicators
Training pipeline reliability and experiment throughput.
Training data quality and coverage.
Golden Dataset and evaluation coverage.
Benchmark reproducibility and model performance improvement.
Accuracy of error diagnosis and effectiveness of regression detection.
Time required to complete training, evaluation and benchmarking cycles.
Compliance with model release quality criteria.
Why Join QubeLabs?
Build the proprietary Vectro Series of enterprise and financial-services language models.
Develop model training, evaluation and benchmarking infrastructure from the ground up.
Work closely with the Head of AI and Research Partners.
Solve real-world AI challenges across financial services.
Develop proprietary datasets, benchmarks and model improvement systems.
Contribute directly to production AI systems serving customers across India and Europe.
Preferred Candidate Profile
B.Tech, M.Tech, MS or PhD in Computer Science, AI, ML, Mathematics or a related field.
3–5 years of relevant experience with strong practical skills in Python, PyTorch, LLM fine-tuning and training data pipelines.
Working knowledge of tokenization, evaluation datasets, benchmarking and regression testing.
Experience with open-source models such as Llama, Qwen, Mistral or similar is preferred.
Ability to independently build reliable model training and evaluation systems from scratch.
QubeLabs is an equal opportunity employer and values diversity and inclusion. We encourage applications from qualified candidates regardless of background or identity.

Similar jobs (10)
This is a senior individual contributor role. You'll work as a peer to the other AI engineers on the team and own your problems completely: you choose the approach, build it, measure it, ship it and keep it working. If you've led a project or a small team before, that experience will help, because your work will often pull in backend, app and hardware engineers.
We're hiring from a core ML background on purpose. Much of the work ahead is model work: training and fine-tuning on data we're allowed to use, building evaluation sets, and deciding when our own model should replace a paid API. It is hands-on work, and you'll write and ship the code yourself.
What you'll own
- Speech and speaker identity. Improve speech-to-text on real-world audio, separate speakers reliably, and recognize who is speaking across conversations, including when several known people are in the same conversation.
- Memory and retrieval. Turn transcripts into memories that are accurate and grounded in what was said, with no invented people or facts. A line from the TV or a stranger at the next table should not become a fact about the user. When the user asks weeks later, the right memory should come back.
- Agents and actions. Build tool-using agents on top of memory, for example reminders and follow-ups that act on what a user committed to in a conversation.
- Our own models for cost and latency. Fine-tune or distill smaller models that match large API models on our tasks, and prove it on our evaluations before they ship.
Across all of these, you'll build the evaluation sets that tell us whether a change helped, and you'll keep tracking quality, latency and cost after launch. You'll start with one or two of these areas, chosen around your strengths and the product's needs, and take on more through the first year.
What end to end means here
- Define the problem with a metric and a baseline.
- Build or collect the data, within our privacy rules on what data a model may use.
- Train, fine-tune or choose the model, and run the experiments.
- Prove the change on an evaluation set we trust, including its cost and latency.
- Ship it into the product with the backend and app engineers.
- Watch it in production and fix what real users find.
Your first 90 days
- Own one live problem, such as speaker identity or memory accuracy, with a written baseline and an evaluation set the team trusts.
- Ship at least one measured improvement to production, with before and after numbers for quality, latency and cost.
- Write a plan, with its data needs, for one place where our own model should replace an API call.
What we're looking for
- Experience. 4 to 6 years of industry experience building ML systems, with a core ML foundation. You have trained, fine-tuned and evaluated models yourself, and you can explain why a model fails.
- GenAI depth. About 2 years of hands-on work with transformers and generative AI. That could be fine-tuning language or speech models, building agents, voice AI, retrieval systems or similar work.
- Shipped work. At least one model you took into a live product and owned after launch: the data, training, evaluation, serving and the fixes once users found the edge cases.
- Ownership. You have taken a loosely defined problem, broken it down yourself and carried it into production.
- Fundamentals. Solid probability, linear algebra and optimization. You can read a paper, implement it and tell us whether it helped on our data.
- Engineering. Strong Python and PyTorch, and enough backend skill to put a model behind a service and debug it in production.
- Education. A B.Tech, M.Tech, MS or dual degree from an IIT, NIT, BITS or IIIT Hyderabad. If you studied elsewhere and have exceptional public work, such as widely used open-source projects, apply and show us.
- Clear writing. You can explain a trade-off to an engineer, a product manager and a founder.
Nice to have
- Speech work: speech recognition, diarization, speaker verification or voice activity detection.
- Experience leading a project or a small team.
- Distillation, quantization, or serving models under tight latency and cost budgets.
- Work with multilingual or code-mixed language data.
- Papers or open-source work in speech, retrieval, long-term memory or agents.
How we work
- On-site in Bengaluru. Device, app and AI engineers sit together, and many bugs need a real Neo and a real phone to reproduce.
- We decide with evaluations and numbers. A change ships when it beats the baseline on quality without breaking our cost and latency budgets.
- We use AI coding tools every day, and we expect you to as well.
What we offer
- Competitive salary and ESOPs.
- Ownership of problems that decide whether the product works for its users.
- Unsolved problems in ambient speech and long-term memory, with room to train our own models.
- Direct work with the CTO.
Requirements
Must haves:
- 4 to 6 years of experience with a core ML background. They should have trained, fine-tuned and evaluated models themselves
- About 1-2 years of hands-on GenAI work: fine-tuning LLMs or speech models, agents, voice AI or retrieval
- At least one model they took to production and owned after launch
- B.Tech, M.Tech or MS from an IIT, NIT, BITS or IIIT Hyderabad. Share someone from elsewhere only if their open-source work is exceptional and tell us why
- Bengaluru, on-site
It's a hands on IC role. Past lead experience is a plus.
Please avoid:
- PhDs, they'll be too senior for this role
- Backend engineers who have only called LLM APIs or built prompt wrappers
- Research profiles with nothing in production
Job Title: Senior AI/ML Engineer
Company: Timble Technologies Pvt. Ltd
Location: Gurugram (Hybrid)
Experience: 2 TO 5 Years
About Us
Timble Glance is a high-growth AI RegTech and B2B SaaS company catering to top-tier BFSI and enterprise clients. We build cutting-edge systems powering 30+ high-scale APIs for digital identity verification, fraud detection, document intelligence, and compliance automation.
Role Overview
We are looking for a hands-on Senior AI/ML Engineer to design, develop, and productionize high-throughput AI/ML and Generative AI systems. You will own the full lifecycle—from problem formulation and data pipelines to deep learning architectures, RAG systems, LLMOps, and model governance—delivering sub-second latency and high reliability across our enterprise products.
Key Responsibilities
· Model Architecture & Deployment: Design, train, and deploy production-scale ML/Deep Learning and GenAI systems (computer vision, document intelligence, OCR, NLP, fraud risk classification, and LLM applications).
· GenAI & LLM Solutions: Develop robust LLM workflows including prompt engineering, fine-tuning, RAG pipelines, semantic search, vector indexing (Pinecone/Milvus/Chroma), and safety guardrails.
· Pipelines & Engineering: Build performant feature extraction and data pipelines; write modular, vectorized, production-grade Python (NumPy, Pandas) and advanced SQL.
· MLOps & Monitoring: Establish end-to-end MLOps/LLMOps standards—model registries, CI/CD, experiment tracking, drift detection, A/B testing, latency optimization, and cost governance.
· Responsible AI & Security: Ensure model decisions comply with enterprise data security, privacy standards, and auditability required by the BFSI sector.
· Collaboration & Ownership: Translate complex business requirements into technical roadmaps, conduct rigorous code reviews, and mentor junior engineers.
Required Qualifications & Skills
· Education: B.Tech / M.Tech in Computer Science, AI/ML, Mathematics, or a related field—Tier-1 institutes (IIT, IIIT, NIT) strongly preferred.
· Experience: 2+ years of hands-on experience developing, deploying, and maintaining ML/Deep Learning or GenAI models in production environments.
· GenAI & NLP Stack: Hands-on experience with LLMs, embeddings, RAG architectures, and frameworks such as LangChain, LlamaIndex, or Hugging Face.
· Deep Learning Frameworks: Strong proficiency in PyTorch or TensorFlow, with deep knowledge of transformer architectures and modern NLP/CV models.
· Software & Data Engineering: Expert-level Python skills (pytest, Git, OOP, asynchronous programming), solid SQL proficiency, and familiarity with data workflows.
· Deployment & Cloud: Practical exposure to cloud platforms (AWS/GCP), containerization (Docker), API frameworks (FastAPI/Flask), and basic orchestration (Kubernetes).
Preferred Qualifications
· Prior domain experience in Fintech, RegTech, Identity Verification (KYC/AML), Fraud Intelligence, or B2B SaaS.
· Experience optimizing models for low latency and inference cost (e.g., ONNX, TensorRT, model quantization).
· Familiarity with workflow orchestrators such as Airflow, Prefect, or Kubeflow.
F2F interview only.
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Title: AI Developer
Location: Bangalore / Hyderabad
Experience: 5–7 Years
Notice Period: Immediate to 15 days Preferred
About the Role
We are looking for a skilled AI Developer to design, develop, and deploy Artificial Intelligence and Machine Learning solutions that solve real-world business problems. You will work closely with data scientists, engineers, and business stakeholders to build scalable AI-powered applications and pipelines.
Key Responsibilities
- Design and develop Machine Learning models, Deep Learning architectures, and NLP solutions for production use.
- Build and maintain end-to-end ML pipelines, from data ingestion and preprocessing to model training, evaluation, and deployment.
- Integrate AI/ML models into existing applications and APIs.
- Fine-tune and evaluate Large Language Models (LLMs) for business-specific use cases.
- Collaborate with data engineers to ensure high-quality training data.
- Monitor model performance in production and implement retraining strategies.
- Research and evaluate emerging AI frameworks, tools, and technologies.
- Document models, experiments, and technical decisions.
Required Skills & Experience
- 3+ years of experience in AI/ML development.
- Strong proficiency in Python.
- Hands-on experience with TensorFlow, PyTorch, or Scikit-learn.
- Experience with NLP frameworks such as Hugging Face, spaCy, and LangChain.
- Familiarity with LLMs and Prompt Engineering (OpenAI, Anthropic, Gemini, etc.).
- Experience deploying models using FastAPI or Flask (REST APIs).
- Strong understanding of Data Structures, Algorithms, and Statistics.
- Experience with AWS, Azure, or GCP and MLOps tools.
- Experience with Vector Databases such as Pinecone, Weaviate, or FAISS is an added advantage.
Description:
We are looking for an AI Development Engineer who is passionate about solving complex engineering problems and using AI to improve the speed, quality, and cost efficiency of software development.
The role involves rethinking the traditional approach to software engineering — moving from coding and implementation-heavy workflows to solution orchestration, structured thinking, detailed specifications, system design, and validation.
You will work on building intelligent, agentic applications that combine AI capabilities with traditional engineering systems. The focus is on using AI effectively while ensuring that the solutions we build remain reliable, secure, scalable, maintainable, and production-ready.
Key Responsibilities:
Requirement Clarity and Engineering Design
- Develop a deep understanding of technical requirements and system-level design to minimise rework and reduce the risk of AI-generated errors.
- Translate ambiguous product and business ideas into clear, structured technical specifications.
- Create specifications that serve as a reliable source of truth for both engineering teams and AI systems.
Engineering Excellence
- Establish practices to minimise functional defects and operational issues caused by AI-generated code.
- Identify and eliminate code bloat, redundant logic, dead code, and unnecessary complexity.
- Ensure AI-generated code remains understandable, maintainable, and easy for engineers to navigate.
- Build the right documentation and engineering artefacts so that AI-generated code does not become a black box.
- Incorporate security best practices into prompts, context, and code-generation workflows.
Agentic Applications
- Build, maintain, and scale production systems that leverage Generative AI to transform user experiences.
- Design and monitor agentic workflows where AI components interact with traditional microservices to solve complex business problems.
- Explore and implement ways to move from manual workflows to intelligent, agent-driven applications.
Operational Excellence
- Focus on rigorous validation as AI accelerates development and output.
- Ensure automated outputs meet high standards of security, performance, reliability, and intended functionality.
- Build deep observability into services and systems to identify and address production issues.
- Explore self-healing production workflows where AI can interpret logs, identify issues, and suggest real-time fixes.
Cost Efficiency
- Optimise inference costs through effective prompt engineering, model selection, tool usage, and workflow design.
- Balance model performance, token consumption, and overall business ROI.
- Identify and reduce technical debt caused by AI-generated code and redundant implementations before they affect system performance or cloud costs.
Organisational Leadership and Collaboration
- Work closely with Product, Production Engineering, Security, and other stakeholders to align AI capabilities with business goals and responsible AI practices.
- Encourage a culture where engineers can experiment with new AI workflows, learn from failures, and continuously improve.
- Mentor junior engineers and help drive the shift from traditional coding practices towards AI-assisted engineering and system orchestration.
Requirements:
- Strong foundations in Machine Learning and AI, including linear algebra, probability and statistics, supervised and unsupervised learning algorithms, and standard MLP/DNN architectures.
- Understanding of bias-variance trade-offs, model fitting and selection, hyperparameter tuning, and model performance evaluation.
- 5+ years of hands-on experience and working knowledge of Generative AI foundation models and LLM building blocks, including:
- Transformers for vision and text
- Tokenisation and attention mechanisms
- Prompting techniques
- Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) concepts
- Retrieval-Augmented Generation (RAG)
- Hands-on experience with prominent ML frameworks and libraries such as PyTorch, TensorFlow, and Hugging Face.
- Experience building or working on AI applications across one or more domains, including text, vision, speech, audio, and video.
- Ability to understand complex engineering requirements and translate them into structured specifications, implementation plans, and validation workflows.
- Strong problem-solving skills and an interest in exploring how AI can improve engineering workflows and application development.
Benefits:
- Best-in-class salary: We hire strong talent and compensate accordingly.
- Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
- Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
- High-impact work: Build AI-first systems and products used at scale by global clients.
About us
Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world! We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore. Since 2019, Proximity has created and grown high-impact, scalable products used by 370 million daily users, with a total net worth of $45.7 billion among our client companies.
We are Proximity — a global team of coders, designers, product managers, geeks, and experts. We solve complex problems and build cutting-edge tech at scale. Our team of Proxonauts is growing quickly, which means your impact on the company’s success will be huge.
About the role
We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.
Responsibilities
- Build and iterate on prompt pipelines and multi-agent workflow components
- Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
- Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
- Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
- Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
- Debug and maintain pipeline stages in production
What you bring:
- (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
- Solid Python fundamentals clean, working, readable code
- Hands-on experience with LLM APIs and prompt engineering (personal projects count)
- Comfort with Git, REST APIs, and working in a Linux environment
- A feel for content and narrative you can judge whether generated output is actually good, not just valid
- Curiosity and clear communication you ask good questions and don't stay stuck silently
Preferred
- Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
- Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
- Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
- Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
- Experience writing evals or LLM-as-judge scoring
- Node.js and Fastapi familiarity, or experience deploying on AWS
About the role
We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.
Responsibilities
- Build and iterate on prompt pipelines and multi-agent workflow components
- Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
- Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
- Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
- Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
- Debug and maintain pipeline stages in production
What you bring:
- (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
- Solid Python fundamentals clean, working, readable code
- Hands-on experience with LLM APIs and prompt engineering (personal projects count)
- Comfort with Git, REST APIs, and working in a Linux environment
- A feel for content and narrative you can judge whether generated output is actually good, not just valid
- Curiosity and clear communication you ask good questions and don't stay stuck silently
Preferred
- Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
- Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
- Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
- Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
- Experience writing evals or LLM-as-judge scoring
- Node.js and Fastapi familiarity, or experience deploying on AWS











