AI Researcher, Speech & Audio, Intern | Josh Talks

LLM/AI Model Engineer – Training, Evaluation & Benchmarking

Location: New Delhi, India (On-site)

Employment Type: Full-time

Experience: 3–5 years

Industry: Enterprise AI / Generative AI / Machine Learning / NLP

About QubeLabs

QubeLabs is building the next generation of Enterprise AI Systems that transform workforce operations and intelligence for the financial services industry.

Our platform combines Conversational AI, Agentic AI, workflow automation, proprietary language models and enterprise intelligence. Our flagship product, QubeLabs Workmate, serves banks, NBFCs, MFIs, wealth management firms, insurance companies and fintechs across India and Europe.

At the core of our AI platform is the Vectro Series, our proprietary family of language models designed for enterprise and financial-services use cases.

We are looking for an LLM/AI Model Engineer to build the training pipelines, datasets and evaluation infrastructure required to continuously improve the Vectro Series.

Role Overview

You will work closely with the Head of AI, Research Partners and engineering teams to implement and operationalize LLM training approaches and build a reliable model improvement lifecycle:

Data Preparation → Training → Evaluation → Benchmarking → Error Analysis → Model Improvement

The role combines hands-on LLM fine-tuning, dataset engineering, tokenization, evaluation framework development and model quality management.

Key Responsibilities

1. LLM Training & Fine-tuning

Build and maintain pipelines for training and fine-tuning open-source foundation models for the Vectro Series.

Implement supervised fine-tuning (SFT), parameter-efficient fine-tuning (PEFT), LoRA/QLoRA and domain adaptation techniques; support continued pre-training where required.

Manage training configurations, checkpoints, model versions and experiment tracking.

Optimize training workflows for computational efficiency, reproducibility and reliability.

Translate model development approaches defined with the Head of AI and Research Partners into practical, scalable training pipelines.

2. Training Data & Tokenization

Build data pipelines to collect, clean, filter, normalize, deduplicate and validate training data.

Develop instruction-tuning, SFT and domain-specific datasets for financial-services and enterprise use cases.

Implement tokenization workflows, tokenizer configuration, vocabulary management, sequence packing, truncation and padding.

Address data representation challenges involving financial terminology, numerical values and multilingual content.

Maintain dataset versioning, lineage and quality controls, incorporating identified data gaps and relevant model failures into future training data.

3. Golden Dataset & Model Evaluation

Build and maintain QubeLabs' Golden Dataset to evaluate key model capabilities and target use cases.

Develop automated evaluation pipelines and reusable evaluation harnesses, combining automated metrics with human assessment where appropriate.

Evaluate accuracy, reasoning, factuality, instruction following, safety, multilingual performance and financial-domain capabilities.

Establish consistent evaluation methodology and regression tests to measure changes across model versions.

4. Benchmarking & Error Analysis

Evaluate Vectro against relevant public benchmarks and proprietary QubeLabs BFSI/enterprise benchmarks.

Compare results with relevant open-source and commercial models using consistent evaluation conditions.

Analyze failures, identify root causes across data, training and model behavior, and translate findings into actionable improvements.

Maintain reproducible benchmark results and reports to track model strengths, limitations and progress.

5. Model Quality & Release

Define model release quality gates and ensure each major release meets agreed evaluation and benchmark criteria.

Support red-teaming, robustness and safety testing.

Coordinate with the Head of AI, Research Partners and engineering teams to ensure validated model improvements are suitable for integration into production systems.

Experience

3–5 years in Machine Learning, Deep Learning, NLP, Generative AI or related fields.

Hands-on experience training or fine-tuning LLMs using open-source foundation models.

Practical experience building training pipelines, preparing datasets and evaluating model performance.

Experience with GPU-based training; distributed training is an advantage.

Financial-services, multilingual AI or enterprise AI experience is preferred.

Required Skills

LLM & Machine Learning: Large Language Models, Transformer architectures, Generative AI, NLP, Deep Learning, SFT, PEFT, LoRA/QLoRA, fine-tuning and continued pre-training.

Frameworks & Infrastructure: Python, PyTorch, Hugging Face Transformers, Hugging Face Tokenizers, GPU computing, experiment tracking and ML pipelines.

Data & Tokenization: Tokenization, tokenizer configuration, text preprocessing, sequence packing, dataset construction, data quality, versioning and lineage.

Evaluation & Benchmarking: Golden datasets, LLM evaluation, evaluation harnesses, automated and human evaluation, LLM-as-a-Judge, public and domain-specific benchmarks, regression testing and error analysis.

The role requires the ability to build both the model training pipeline and the measurement system that determines whether the model has actually improved.

What Success Looks Like

Reliable and reproducible training and fine-tuning pipelines for the Vectro Series.

High-quality training datasets, tokenization workflows and a comprehensive Golden Dataset.

Automated evaluation and benchmarking infrastructure with measurable model quality gates.

Clear, reproducible evidence of model performance against public, proprietary BFSI and relevant competing-model benchmarks.

A continuous improvement loop that converts evaluation findings into measurable gains across successive Vectro releases.

Key Performance Indicators

Training pipeline reliability and experiment throughput.

Training data quality and coverage.

Golden Dataset and evaluation coverage.

Benchmark reproducibility and model performance improvement.

Accuracy of error diagnosis and effectiveness of regression detection.

Time required to complete training, evaluation and benchmarking cycles.

Compliance with model release quality criteria.

Why Join QubeLabs?

Build the proprietary Vectro Series of enterprise and financial-services language models.

Develop model training, evaluation and benchmarking infrastructure from the ground up.

Work closely with the Head of AI and Research Partners.

Solve real-world AI challenges across financial services.

Develop proprietary datasets, benchmarks and model improvement systems.

Contribute directly to production AI systems serving customers across India and Europe.

Preferred Candidate Profile

B.Tech, M.Tech, MS or PhD in Computer Science, AI, ML, Mathematics or a related field.

3–5 years of relevant experience with strong practical skills in Python, PyTorch, LLM fine-tuning and training data pipelines.

Working knowledge of tokenization, evaluation datasets, benchmarking and regression testing.

Experience with open-source models such as Llama, Qwen, Mistral or similar is preferred.

Ability to independently build reliable model training and evaluation systems from scratch.

QubeLabs is an equal opportunity employer and values diversity and inclusion. We encourage applications from qualified candidates regardless of background or identity.

Strong AI Engineer / Machine Learning Engineer profiles.

2

Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

3

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

4

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

5

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

6

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

7

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

8

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.

About Us

Invorto is our Voice AI product, bringing intelligent voice agents to real-world customer and operational use cases. Our voice pipeline is built in Python, running an STT → LLM → TTS architecture on top of the Pipecat framework.

This is a chance to work on hard problems in voice AI — latency, accuracy, naturalness, and reliability — building zero-to-one, owning your area end-to-end, and shipping to production at scale.

Note: This is a customer-facing role, and strong communication skills are essential.

About the Role

We're looking for a Voice AI Research Engineer to join the Invorto team and help build and continuously improve the voice AI systems that power our intelligent voice agents. This role is focused on the specialized craft of voice AI — designing evaluation and automation frameworks that ensure our STT, LLM, and TTS pipeline performs reliably in real-world, production conditions.

What You'll Do

• Design and build automated testing and quality frameworks for our STT → LLM → TTS voice pipeline, built on Pipecat
• Evaluate and benchmark STT, LLM, and TTS/ASR components on accuracy, latency, naturalness, and robustness across accents, languages, and real-world audio conditions
• Work hands-on with STT, TTS, and ASR models — fine-tuning, evaluating, and improving them for production use cases
• Identify failure modes and edge cases across the pipeline (background noise, accents, interruptions, turn-taking, latency, pipeline-stage handoffs) and build systems to catch them before production
• Collaborate closely with engineering to integrate quality checks and automation into the voice agent development lifecycle within the Pipecat-based architecture
• Research and stay current with advances in voice AI, and bring in new techniques, models, and tools to improve pipeline performance
• Work directly with customers to understand real-world voice use cases and translate them into evaluation criteria and quality benchmarks
• Partner with product and engineering to define what "production-grade quality" means for voice agents and drive the team toward it

What We're Looking For

• 4–6 years of experience, with a specialization in voice AI systems and automated quality evaluation
• Hands-on experience with STT (Speech-to-Text), TTS (Text-to-Speech), and ASR (Automatic Speech Recognition) models
• Experience designing and building automated testing/evaluation frameworks for voice or speech systems
• Strong understanding of what drives voice AI quality — accuracy, latency, naturalness, and robustness to real-world variability
• Strong programming skills in Python; familiarity with Pipecat or similar voice pipeline/orchestration frameworks is a plus
• Understanding of STT → LLM → TTS pipeline architectures and the trade-offs involved at each stage
• Research mindset — comfortable exploring new models, techniques, and tools and translating them into practical improvements
• Excellent communication skills — this is a customer-facing role, and you'll regularly engage directly with customers to understand needs and validate quality expectations

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

Strong Data Scientist / AI Engineer / Generative AI Engineer profile.

2

Mandatory (Experience 1) - Must have 3+ years of hands-on experience in Data Science, Artificial Intelligence, Machine Learning, Deep Learning, NLP, or Generative AI application development.

3

Mandatory (Experience 2) - Must have strong hands-on experience in Python programming, backend development, API development, and production-grade application support.

4

Mandatory (Experience 3) - Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, or Scikit-learn.

5

Mandatory (Experience 4) - Must have hands-on experience in NLP use cases such as text classification, sentiment analysis, entity recognition (NER), semantic search, embeddings, or document understanding.

6

Mandatory (Experience 5) - Must have experience working with Large Language Models (LLMs) such as GPT, LLaMA, Mistral, Phi, Claude, Gemini, or similar models.

7

Mandatory (Experience 6) - Must have hands-on experience building or implementing Retrieval Augmented Generation (RAG) solutions, vector search, semantic search, or knowledge-based AI applications.

8

Mandatory (Experience 7) - Must have experience with Prompt Engineering and Generative AI frameworks such as LangChain, LangGraph, AI Agents, Azure OpenAI, or similar technologies.

9

Mandatory (Experience 8) - Must have experience developing, consuming, or integrating APIs using Python frameworks such as FastAPI, Flask, or similar technologies.

Mandatory (Education) - B.TECH / M.TECH from Tier 1 Colleges (IIT, NIT, BITS, IIIT, DTU, NSUT) are considered.

Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have

strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and cloud-based AI deployments.

Key Responsibilities

• Design, develop, and deploy Machine Learning and Deep Learning models for classification, regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.

• Build and maintain end-to-end ML pipelines including data preprocessing, feature engineering, model training, validation, evaluation, and deployment.

• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related frameworks.

• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama, Claude, and Stable Diffusion.

• Collaborate with product, engineering, and business teams to translate requirements into scalable AI solutions.

• Optimize model performance, scalability, and reliability for production environments.

• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.

• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a related field.

• 7+ years of hands-on experience in AI/ML product development.

• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and Hugging Face.

• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.

• Strong understanding of the ML lifecycle including model training, tuning, deployment, monitoring, and optimization.

• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.

• Experience with AWS, Azure, or GCP cloud platforms.

• Strong problem-solving and analytical skills.

Preferred Skills

• Fine-tuning and deployment of Large Language Models.

• Experience with RAG (Retrieval Augmented Generation) architectures.

• Contributions to open-source AI projects or research publications.

• Knowledge of model interpretability, data annotation, and feature engineering.

• C++ experience for high-performance AI applications.

Why Join Kody Technolab Limited?

Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,

and enterprise-scale applications while collaborating with a highly skilled technology team.

Visit the Website to know more about us.

Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution

Kody Robots | Robotics Company in India for Autonomous Robots

Job Title: AI Developer

Location: Bangalore / Hyderabad

Experience: 5–7 Years

Notice Period: Immediate to 15 days Preferred

About the Role

We are looking for a skilled AI Developer to design, develop, and deploy Artificial Intelligence and Machine Learning solutions that solve real-world business problems. You will work closely with data scientists, engineers, and business stakeholders to build scalable AI-powered applications and pipelines.

Key Responsibilities

• Design and develop Machine Learning models, Deep Learning architectures, and NLP solutions for production use.
• Build and maintain end-to-end ML pipelines, from data ingestion and preprocessing to model training, evaluation, and deployment.
• Integrate AI/ML models into existing applications and APIs.
• Fine-tune and evaluate Large Language Models (LLMs) for business-specific use cases.
• Collaborate with data engineers to ensure high-quality training data.
• Monitor model performance in production and implement retraining strategies.
• Research and evaluate emerging AI frameworks, tools, and technologies.
• Document models, experiments, and technical decisions.
• 
  

Required Skills & Experience

• 3+ years of experience in AI/ML development.
• Strong proficiency in Python.
• Hands-on experience with TensorFlow, PyTorch, or Scikit-learn.
• Experience with NLP frameworks such as Hugging Face, spaCy, and LangChain.
• Familiarity with LLMs and Prompt Engineering (OpenAI, Anthropic, Gemini, etc.).
• Experience deploying models using FastAPI or Flask (REST APIs).
• Strong understanding of Data Structures, Algorithms, and Statistics.
• Experience with AWS, Azure, or GCP and MLOps tools.
• Experience with Vector Databases such as Pinecone, Weaviate, or FAISS is an added advantage.

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

The Role

We’re looking for a Senior Applied AI & Data Engineer to become our first dedicated AI and data engineer.

You’ll build conversational AI experiences across web, mobile, and in-store channels while developing the data foundation behind them. You’ll make key technical decisions and own your work through to production.

What You’ll Do

• Build AI assistants using tool calling to work with real product, search, and order systems

• Design guardrails and evaluation sets to ensure AI responses are accurate and safe

• Build real-time and voice-enabled AI experiences

• Improve product data quality through AI-assisted enrichment and review workflows

• Build data pipelines, analytics, and personalisation systems

• Work closely with web and mobile developers and help guide technical implementation

What You’ll Need

• 6+ years of experience building and running production backend systems

• Strong Python skills, plus experience with JavaScript/TypeScript backends

• Experience shipping at least one LLM-powered feature to real users

• Experience with search and relevance

• Experience building data pipelines and analytics stores

• Comfortable deploying and monitoring services on a major cloud platform

• Strong communication skills and the ability to work independently

Nice to Have

• Experience with speech or voice AI

• E-commerce or retail technology experience

• Experience building multilingual products

Product Engineer — Role Summary

We are looking for a Product Engineer to build user-facing products that combine AI capabilities with practical applications. You will work at the intersection of software engineering and AI, developing autonomous, agent-driven systems that solve complex educational and research problems.

Key Responsibilities:

• Product Development: Design, build, and deploy production-ready applications powered by LLMs and AI agents.
• Data Engineering: Build scalable ETL/ELT pipelines to process structured and unstructured data, including text and audio, for RAG and model fine-tuning.
• Agentic Workflows: Develop multi-step AI agents with tool calling, APIs, databases, search, reasoning, and memory.
• Rapid Prototyping: Turn ideas and research concepts into interactive, production-ready applications.
• AI Integration: Use frameworks such as LangChain, LlamaIndex, AutoGen, or custom orchestrators to integrate AI into scalable systems.
• User Experience: Transform raw AI outputs into reliable, intuitive, and responsive user experiences.
• Collaboration: Work closely with ML researchers and data engineers to integrate custom and fine-tuned models.
• Observability: Monitor agent behavior, manage edge cases, reduce hallucinations, and improve reliability in production.

The ideal candidate combines strong software engineering, AI/LLM expertise, data engineering, and product thinking, with the ability to take an AI concept from prototype to production.