AI Engineer

LLM/AI Model Engineer – Training, Evaluation & Benchmarking

Location: New Delhi, India (On-site)

Employment Type: Full-time

Experience: 3–5 years

Industry: Enterprise AI / Generative AI / Machine Learning / NLP

About QubeLabs

QubeLabs is building the next generation of Enterprise AI Systems that transform workforce operations and intelligence for the financial services industry.

Our platform combines Conversational AI, Agentic AI, workflow automation, proprietary language models and enterprise intelligence. Our flagship product, QubeLabs Workmate, serves banks, NBFCs, MFIs, wealth management firms, insurance companies and fintechs across India and Europe.

At the core of our AI platform is the Vectro Series, our proprietary family of language models designed for enterprise and financial-services use cases.

We are looking for an LLM/AI Model Engineer to build the training pipelines, datasets and evaluation infrastructure required to continuously improve the Vectro Series.

Role Overview

You will work closely with the Head of AI, Research Partners and engineering teams to implement and operationalize LLM training approaches and build a reliable model improvement lifecycle:

Data Preparation → Training → Evaluation → Benchmarking → Error Analysis → Model Improvement

The role combines hands-on LLM fine-tuning, dataset engineering, tokenization, evaluation framework development and model quality management.

Key Responsibilities

1. LLM Training & Fine-tuning

Build and maintain pipelines for training and fine-tuning open-source foundation models for the Vectro Series.

Implement supervised fine-tuning (SFT), parameter-efficient fine-tuning (PEFT), LoRA/QLoRA and domain adaptation techniques; support continued pre-training where required.

Manage training configurations, checkpoints, model versions and experiment tracking.

Optimize training workflows for computational efficiency, reproducibility and reliability.

Translate model development approaches defined with the Head of AI and Research Partners into practical, scalable training pipelines.

2. Training Data & Tokenization

Build data pipelines to collect, clean, filter, normalize, deduplicate and validate training data.

Develop instruction-tuning, SFT and domain-specific datasets for financial-services and enterprise use cases.

Implement tokenization workflows, tokenizer configuration, vocabulary management, sequence packing, truncation and padding.

Address data representation challenges involving financial terminology, numerical values and multilingual content.

Maintain dataset versioning, lineage and quality controls, incorporating identified data gaps and relevant model failures into future training data.

3. Golden Dataset & Model Evaluation

Build and maintain QubeLabs' Golden Dataset to evaluate key model capabilities and target use cases.

Develop automated evaluation pipelines and reusable evaluation harnesses, combining automated metrics with human assessment where appropriate.

Evaluate accuracy, reasoning, factuality, instruction following, safety, multilingual performance and financial-domain capabilities.

Establish consistent evaluation methodology and regression tests to measure changes across model versions.

4. Benchmarking & Error Analysis

Evaluate Vectro against relevant public benchmarks and proprietary QubeLabs BFSI/enterprise benchmarks.

Compare results with relevant open-source and commercial models using consistent evaluation conditions.

Analyze failures, identify root causes across data, training and model behavior, and translate findings into actionable improvements.

Maintain reproducible benchmark results and reports to track model strengths, limitations and progress.

5. Model Quality & Release

Define model release quality gates and ensure each major release meets agreed evaluation and benchmark criteria.

Support red-teaming, robustness and safety testing.

Coordinate with the Head of AI, Research Partners and engineering teams to ensure validated model improvements are suitable for integration into production systems.

Experience

3–5 years in Machine Learning, Deep Learning, NLP, Generative AI or related fields.

Hands-on experience training or fine-tuning LLMs using open-source foundation models.

Practical experience building training pipelines, preparing datasets and evaluating model performance.

Experience with GPU-based training; distributed training is an advantage.

Financial-services, multilingual AI or enterprise AI experience is preferred.

Required Skills

LLM & Machine Learning: Large Language Models, Transformer architectures, Generative AI, NLP, Deep Learning, SFT, PEFT, LoRA/QLoRA, fine-tuning and continued pre-training.

Frameworks & Infrastructure: Python, PyTorch, Hugging Face Transformers, Hugging Face Tokenizers, GPU computing, experiment tracking and ML pipelines.

Data & Tokenization: Tokenization, tokenizer configuration, text preprocessing, sequence packing, dataset construction, data quality, versioning and lineage.

Evaluation & Benchmarking: Golden datasets, LLM evaluation, evaluation harnesses, automated and human evaluation, LLM-as-a-Judge, public and domain-specific benchmarks, regression testing and error analysis.

The role requires the ability to build both the model training pipeline and the measurement system that determines whether the model has actually improved.

What Success Looks Like

Reliable and reproducible training and fine-tuning pipelines for the Vectro Series.

High-quality training datasets, tokenization workflows and a comprehensive Golden Dataset.

Automated evaluation and benchmarking infrastructure with measurable model quality gates.

Clear, reproducible evidence of model performance against public, proprietary BFSI and relevant competing-model benchmarks.

A continuous improvement loop that converts evaluation findings into measurable gains across successive Vectro releases.

Key Performance Indicators

Training pipeline reliability and experiment throughput.

Training data quality and coverage.

Golden Dataset and evaluation coverage.

Benchmark reproducibility and model performance improvement.

Accuracy of error diagnosis and effectiveness of regression detection.

Time required to complete training, evaluation and benchmarking cycles.

Compliance with model release quality criteria.

Why Join QubeLabs?

Build the proprietary Vectro Series of enterprise and financial-services language models.

Develop model training, evaluation and benchmarking infrastructure from the ground up.

Work closely with the Head of AI and Research Partners.

Solve real-world AI challenges across financial services.

Develop proprietary datasets, benchmarks and model improvement systems.

Contribute directly to production AI systems serving customers across India and Europe.

Preferred Candidate Profile

B.Tech, M.Tech, MS or PhD in Computer Science, AI, ML, Mathematics or a related field.

3–5 years of relevant experience with strong practical skills in Python, PyTorch, LLM fine-tuning and training data pipelines.

Working knowledge of tokenization, evaluation datasets, benchmarking and regression testing.

Experience with open-source models such as Llama, Qwen, Mistral or similar is preferred.

Ability to independently build reliable model training and evaluation systems from scratch.

QubeLabs is an equal opportunity employer and values diversity and inclusion. We encourage applications from qualified candidates regardless of background or identity.

Job Summary

We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.

Key Responsibilities

• Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
• Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
• Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
• Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
• Integrate AI/ML models with enterprise applications and APIs.
• Fine-tune and evaluate ML/LLM models based on business requirements.
• Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
• Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
• Conduct model performance evaluation, optimization, and troubleshooting.
• Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
• Stay current with emerging AI/ML technologies, frameworks, and industry best practices.

Required Skills

• Strong programming experience in Python.
• Strong understanding of Machine Learning algorithms, statistics, and data structures.
• Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
• Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
• Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
• Experience with NLP, deep learning, or computer vision is an advantage.
• Experience developing and consuming REST APIs and microservices.
• Working knowledge of SQL and NoSQL databases.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Understanding of Docker, Kubernetes, CI/CD, and MLOps.
• Familiarity with Git and modern software development practices.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
• 4 years of relevant experience in AI/ML engineering or a related field.
• Experience building and deploying production-grade AI/ML solutions.
• Enterprise application development experience.
• Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
• Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
• Experience with AI/ML model monitoring, evaluation, and optimization.

What You Bring

• Strong problem-solving and analytical skills.
• Ability to translate business requirements into practical AI/ML solutions.
• Strong software engineering and debugging capabilities.
• Ability to work independently as well as collaboratively in a cross-functional environment.
• Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.

Keywords

AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI

Location: Gurugram

Work mode: Hybrid

About LeadSquared

LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.

Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.

Role Overview

We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.

This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.

Key Responsibilities

•

Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.

•

Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.

•

Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.

•

Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.

•

Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.

•

Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.

•

Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.

•

Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.

•

Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.

Required Qualifications

Experience

•

2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.

•

Proven experience shipping LLM-based products or agentic AI systems into production environments.

Technical Skills

•

Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.

•

Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).

•

Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.

•

Solid understanding of RAG architectures, embedding models, and semantic search.

•

Experience with vector databases and similarity search infrastructure.

•

Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).

Problem-Solving & Mindset

•

Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.

•

Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.

•

Ability to balance research exploration with engineering pragmatism to ship reliable systems.

Preferred Qualifications

•

Experience with multi-agent orchestration and agent memory systems (short-term and long-term).

•

Familiarity with fine-tuning or RLHF workflows for domain adaptation.

•

Background in NLP, information retrieval, or conversational AI.

•

Prior experience in B2B SaaS or CRM domain is a plus.

•

Contributions to open-source AI/ML projects or published research/blogs.

•

Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS

The Role

We’re looking for a Senior Applied AI & Data Engineer to become our first dedicated AI and data engineer.

You’ll build conversational AI experiences across web, mobile, and in-store channels while developing the data foundation behind them. You’ll make key technical decisions and own your work through to production.

What You’ll Do

• Build AI assistants using tool calling to work with real product, search, and order systems

• Design guardrails and evaluation sets to ensure AI responses are accurate and safe

• Build real-time and voice-enabled AI experiences

• Improve product data quality through AI-assisted enrichment and review workflows

• Build data pipelines, analytics, and personalisation systems

• Work closely with web and mobile developers and help guide technical implementation

What You’ll Need

• 6+ years of experience building and running production backend systems

• Strong Python skills, plus experience with JavaScript/TypeScript backends

• Experience shipping at least one LLM-powered feature to real users

• Experience with search and relevance

• Experience building data pipelines and analytics stores

• Comfortable deploying and monitoring services on a major cloud platform

• Strong communication skills and the ability to work independently

Nice to Have

• Experience with speech or voice AI

• E-commerce or retail technology experience

• Experience building multilingual products

Job Overview

We are looking for an experienced AI/ML Engineer with strong full-stack development skills to design, develop, and deploy AI-powered applications. The ideal candidate should be proficient in Python backend development, frontend technologies, and LLM integration, with the ability to build end-to-end AI-native products, custom dashboards, and lightweight applications.

This role focuses on applying AI to real-world business problems through rapid prototyping, prompt engineering, Retrieval-Augmented Generation (RAG), and scalable application development.

Key Responsibilities

• Design, develop, and deploy end-to-end AI-powered applications.
• Build backend services and REST APIs using Python.
• Develop responsive frontends using React, Next.js, or similar frameworks.
• Integrate LLM APIs such as OpenAI, Claude, and Hugging Face into production applications.
• Build custom dashboards, internal tools, micro-apps, and AI-driven business solutions.
• Implement prompt engineering, embeddings, RAG pipelines, and context-aware AI systems.
• Rapidly prototype and validate ideas using modern AI-assisted development workflows.
• Optimize application performance, scalability, reliability, and AI usage costs.
• Work with data processing libraries such as Pandas and NumPy.
• Collaborate with product and business teams to translate requirements into functional AI solutions.
• Take ownership of features from ideation and development through testing, deployment, and production support.

Required Skills & Qualifications

• 2+ years of experience in software engineering, AI engineering, or application development.
• Strong proficiency in Python and backend development.
• Hands-on experience with React, Next.js, or similar frontend technologies.
• Practical experience integrating LLM APIs such as OpenAI, Claude, or Hugging Face.
• Understanding of REST APIs, microservices, and system design principles.
• Knowledge of prompt engineering, embeddings, and RAG architectures.
• Experience with data processing using Pandas and NumPy.
• Ability to independently build, test, and deploy full-stack applications.
• Strong problem-solving, debugging, and analytical skills.
• Ability to work in a fast-paced environment with a strong ownership mindset.

Good to Have

• Experience with LangChain, LlamaIndex, or similar AI frameworks.
• Familiarity with vector databases such as Pinecone, Weaviate, or Supabase.
• Experience building AI chat interfaces, copilots, assistants, and custom dashboards.
• Familiarity with cloud platforms, application deployment, and production monitoring.
• Experience with AI-assisted coding tools and rapid prototyping workflows.

What We Are Looking For

• A full-stack AI engineer who is comfortable working across both backend and frontend development.
• Someone focused on building practical AI-powered products rather than only training machine learning models.
• A developer who can prototype quickly, validate ideas, and iterate efficiently using a “vibe coding” approach.
• A self-driven professional who can take ownership of a feature from concept to production.

Please note that this job is only for Ahmedabad location.

Full Stack Developer – AI/ML & GenAI

Location: Mumbai

Experience: 7–9 Years

Employment Type: Full-time

Virtual Drive: Saturday

We are looking for a Python Full Stack Developer with 3+ years of hands-on experience in AI/ML and Generative AI.

Key Skills: Python Full Stack, FastAPI/Flask/Django, React/Angular, AI/ML, GenAI, LLMs, RAG, Embeddings, Vector Databases, Cloud (AWS/Azure/GCP), CI/CD, Docker & Kubernetes.

Product Engineer — Role Summary

We are looking for a Product Engineer to build user-facing products that combine AI capabilities with practical applications. You will work at the intersection of software engineering and AI, developing autonomous, agent-driven systems that solve complex educational and research problems.

Key Responsibilities:

• Product Development: Design, build, and deploy production-ready applications powered by LLMs and AI agents.
• Data Engineering: Build scalable ETL/ELT pipelines to process structured and unstructured data, including text and audio, for RAG and model fine-tuning.
• Agentic Workflows: Develop multi-step AI agents with tool calling, APIs, databases, search, reasoning, and memory.
• Rapid Prototyping: Turn ideas and research concepts into interactive, production-ready applications.
• AI Integration: Use frameworks such as LangChain, LlamaIndex, AutoGen, or custom orchestrators to integrate AI into scalable systems.
• User Experience: Transform raw AI outputs into reliable, intuitive, and responsive user experiences.
• Collaboration: Work closely with ML researchers and data engineers to integrate custom and fine-tuned models.
• Observability: Monitor agent behavior, manage edge cases, reduce hallucinations, and improve reliability in production.

The ideal candidate combines strong software engineering, AI/LLM expertise, data engineering, and product thinking, with the ability to take an AI concept from prototype to production.

Job Summary

We are looking for a skilled Python Developer with experience in Generative AI and Agentic AI to develop AI-powered applications and scalable backend services.

Mandatory Skills

• Python
• Generative AI (GenAI) / Large Language Models (LLMs)
• Retrieval-Augmented Generation (RAG)
• LangChain / LangGraph
• Agentic AI
• FastAPI
• REST API development
• Vector Databases
• Prompt Engineering
• Microservices

Key Responsibilities

• Develop and maintain Python-based applications and backend services.
• Build GenAI/LLM-powered applications and AI solutions.
• Implement RAG pipelines for document processing and information retrieval.
• Develop AI agents using LangChain/LangGraph and Agentic AI frameworks.
• Build and integrate REST APIs using FastAPI.
• Work with vector databases for embeddings, semantic search, and retrieval.
• Design and optimize prompts to improve LLM response quality.
• Develop scalable microservices and integrate AI models into applications.
• Collaborate with cross-functional teams to deliver AI-based solutions.
• Troubleshoot, test, and optimize application performance.

Required Qualifications

• 4–6 years of experience in Python development.
• Hands-on experience with GenAI/LLMs, RAG, and Agentic AI.
• Practical experience with LangChain/LangGraph, FastAPI, and REST APIs.
• Knowledge of vector databases, prompt engineering, and microservices.
• Strong problem-solving and debugging skills.
• Ability to develop and deploy production-ready AI applications.