Test Engineer - AI/ML at Leading digital testing boutique firm · Delhi · 5 - 8 years · ₹11L - ₹15L / yr · Posted 27 Jan 2026

Review Criteria
- Strong AI/ML Test Engineer
- 5+ years of overall experience in Testing/QA
- 2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
- Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
- Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
- Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
- Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
- Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
- Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
- Candidate must be based within Delhi NCR (100 km radius)
Preferred
- Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.
Job Specific Criteria
- CV Attachment is mandatory
- Have you worked with large datasets for AI/ML testing?
- Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
- Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
- Are you willing to relocate to Delhi and why (if not from Delhi)?
- Are you available for a face-to-face round?
Role & Responsibilities
- 5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
- Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
- Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
- Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
- Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
- Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
- Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
- Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials
Ideal Candidate
- 5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
- Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
- Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
- Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
- Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
- Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
- Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
- Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Similar jobs (10)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Principal Software Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.
Key Responsibilities
- Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
- Develop comprehensive test suites, including:
- Unit, integration, and end-to-end (E2E)
- Functional, regression, performance, and safety testing
- Validate AI system behavior, including:
- Non-deterministic LLM outputs
- Hallucinations and edge cases
- Multi-step agent decision-making
- Design and manage evaluation systems:
- Golden datasets
- Benchmarking pipelines (accuracy, latency, reliability)
- Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
- Implement observability and telemetry to enable traceability, monitoring, and audit readiness
- Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
- Track and report quality KPIs, including test coverage, defect leakage, and system reliability
- Drive root-cause analysis and continuous improvement across the AI testing lifecycle
Required Skills
Core Engineering
- Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
- Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
- Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
- Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)
AI / ML & Agentic Systems
- Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
- Familiarity with:
- RAG architectures and vector databases (Pinecone, Weaviate)
- Agent frameworks (LangChain, LlamaIndex, AutoGen)
AI Testing Techniques
- Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
- Knowledge of evaluation methods:
- LLM-as-a-judge
- BLEU, ROUGE, semantic similarity scoring
- Experience with prompt and agent regression testing
- Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection
Tooling (Preferred)
- AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
- Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
- Monitoring: Prometheus, Grafana, OpenTelemetry
Soft Skills
- Strong analytical and problem-solving skills
- Excellent communication and cross-functional collaboration
- Data-driven mindset with focus on quality KPIs
- Detail-oriented with a strong bias toward automation and scalability
Experience Requirements
- 7+ years in QA, SDET, or test automation engineering
- Proven experience building and scaling automation frameworks
- Hands-on experience with AI/ML systems or LLM-based applications
- Experience testing RAG pipelines or agentic workflows
- Owned end-to-end AI test strategy and architecture
- Defined quality metrics and release gates
- Delivered scalable validation pipelines for production AI systems
- Supported audit and compliance readiness
Preferred
- Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
- Exposure to:
- Shift-left testing practices
- Production observability and monitoring
- Chaos or resilience testing
Senior-Level Differentiators
Education
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field
Nice-to-have:
- ISTQB certification
- Cloud/ML certifications (AWS, Azure, GCP)
- AI testing certifications
What Success Looks Like
- AI systems that are accurate, reliable, and safe
- Fully automated test pipelines integrated into CI/CD
- Measurable improvements in defect leakage and model quality
- Strong observability and auditability across AI systems
- Scalable validation frameworks supporting rapid AI innovation
Job Summary
We are looking for an experienced AI Automation Tester with hands-on experience in testing AI-powered products and applications. The ideal candidate should have strong expertise in Playwright automation, along with practical experience in LLM evaluations (Evals), Golden Datasets (Goldens), and AI Observability.
Key Responsibilities
- Design, develop and execute automated test scripts using Playwright.
- Test AI-powered applications, LLM-based products and Generative AI solutions.
- Work on Evals to assess AI response accuracy, relevance, quality and consistency.
- Create, maintain and validate Golden Datasets (Goldens) for benchmarking AI outputs.
- Implement and work with AI Observability to monitor model performance, response quality, latency and failures.
- Perform functional, regression, API and end-to-end testing.
- Identify, report and track defects to ensure product quality and reliability.

About NonStop io Technologies
NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.
Brief Description:
We're seeking an AI/ML Engineer to join our team. As AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real-world business problems. You will work closely with engineering teams, including software engineers, domain experts, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms and data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.
Responsibilities
● Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI
● AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.
● Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data
● Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics
● Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behaviour, and performance metrics
● Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems
● Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes
● Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions
● Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference.
Qualifications & Skills
● Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus
● Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects
● Proficiency in programming languages commonly used for AI/ML. Preferably Python
● Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.
● Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.
● Strong understanding of machine learning algorithms, statistics, and data structures
● Experience with data preprocessing, data wrangling, and feature engineering
● Knowledge of deep learning architectures, neural networks, and transfer learning
● Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment
● Solid understanding of software engineering principles and best practices for writing maintainable and scalable code
● Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions
● Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Summary
We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.
Key Responsibilities
- Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
- Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
- Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
- Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
- Integrate AI/ML models with enterprise applications and APIs.
- Fine-tune and evaluate ML/LLM models based on business requirements.
- Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
- Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
- Conduct model performance evaluation, optimization, and troubleshooting.
- Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
- Stay current with emerging AI/ML technologies, frameworks, and industry best practices.
Required Skills
- Strong programming experience in Python.
- Strong understanding of Machine Learning algorithms, statistics, and data structures.
- Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
- Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
- Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
- Experience with NLP, deep learning, or computer vision is an advantage.
- Experience developing and consuming REST APIs and microservices.
- Working knowledge of SQL and NoSQL databases.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Understanding of Docker, Kubernetes, CI/CD, and MLOps.
- Familiarity with Git and modern software development practices.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
- 4 years of relevant experience in AI/ML engineering or a related field.
- Experience building and deploying production-grade AI/ML solutions.
- Enterprise application development experience.
- Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
- Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
- Experience with AI/ML model monitoring, evaluation, and optimization.
What You Bring
- Strong problem-solving and analytical skills.
- Ability to translate business requirements into practical AI/ML solutions.
- Strong software engineering and debugging capabilities.
- Ability to work independently as well as collaboratively in a cross-functional environment.
- Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.
Keywords
AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI
Location: Gurugram
Work mode: Hybrid
TECHJAYS
THE AI REIMAGINATION COMPANY
AI Quality Engineer
Position : AI Quality Engineer
Experience : 3–10 Years
Location : Coimbatore / Hybrid
Joining : Immediate / Within 30 Days
Primary SkillsManual & Functional Testing, AI/ML Application Testing, LLM Testing, Prompt Testing, Test Case Design, API Testing, Regression Testing, Defect Management
Preferred SkillsRAG Testing, Chatbot Testing, AI Response Evaluation, Selenium, Playwright, Cypress, Python, JavaScript, SQL, Postman, JIRA, BDD
About Techjays
At Techjays, we're helping businesses reimagine how they build, operate, and scale with AI at the core. We focus on developing intelligent, scalable, and production-grade AI solutions that solve real-world business challenges.
Our global team brings together experienced technology professionals from organizations such as Google, NetApp, ADP, Cognizant Consulting, and Capgemini. We work with global clients to build AI-powered applications, intelligent automation platforms, and enterprise software solutions.
We're looking for an AI Quality Engineer with strong functional testing expertise and prior hands-on experience testing AI/ML-powered applications.
This role goes beyond traditional software testing. You will be responsible for validating the quality, accuracy, reliability, and behaviour of AI-powered features, ensuring that intelligent applications perform consistently across different scenarios and real-world use cases.
The ideal candidate should understand both traditional QA methodologies and the unique testing challenges associated with AI systems, including non-deterministic outputs, prompt behaviour, hallucinations, response relevance, and edge-case validation.
Prior hands-on experience testing AI/ML-based products or applications is mandatory. Candidates with only traditional manual testing experience and no AI project exposure will not be a fit.
Key Responsibilities
1. AI Application & LLM Testing
- Perform functional and quality testing of AI-powered applications, LLM-based products, chatbots, and intelligent automation systems.
- Design test scenarios to validate AI-generated responses for accuracy, relevance, consistency, completeness, and contextual understanding.
- Test prompts, prompt variations, and conversational flows to identify unexpected outputs and behavioural inconsistencies.
- Evaluate AI responses for hallucinations, incorrect information, irrelevant answers, and context retention issues.
- Validate AI application behaviour across different user inputs, edge cases, and complex scenarios.
- Test RAG-based applications by validating document retrieval, response relevance, contextual accuracy, and source grounding.
- Evaluate AI-powered search, recommendation engines, and other intelligent product features.
- Collaborate with AI engineers and data science teams to define acceptance criteria and quality benchmarks.
2. Functional & Manual Testing
- Analyse business and technical requirements and convert them into comprehensive test scenarios and test cases.
- Execute functional, regression, integration, system, and user acceptance testing across web and mobile applications.
- Validate end-to-end application workflows, business logic, user interactions, and data processing.
- Identify functional gaps, unexpected behaviour, and usability issues.
- Perform exploratory testing to uncover defects that may not be covered by predefined test cases.
- Ensure application functionality remains stable across different releases and environments.
- Review requirements early in the development lifecycle to identify potential quality risks.
3. AI Quality Evaluation & Validation
- Develop structured testing approaches for non-deterministic AI outputs using behaviour-based, range-based, and scenario-based validation.
- Evaluate AI response quality against expected outcomes and predefined acceptance criteria.
- Validate prompt sensitivity, context handling, conversation memory, and multi-turn interactions.
- Identify failure patterns involving hallucinations, prompt injection, incorrect retrieval, and inconsistent responses.
- Test AI system performance across different input formats, languages, and user scenarios where applicable.
- Maintain test datasets and evaluation scenarios for repeatable AI quality assessment.
- Work with engineering teams to identify root causes of AI-related defects and verify fixes.
4. API & Integration Testing
- Perform manual API testing using Postman or similar tools.
- Validate API request and response structures, status codes, authentication, authorization, and error handling.
- Test integrations between AI services, backend systems, databases, and external APIs.
- Validate data flow between application components and identify integration issues.
- Test API behaviour under different input conditions, including invalid inputs and boundary cases.
- Verify API responses and ensure consistency between frontend and backend functionality.
5. Defect Management & Quality Reporting
- Identify, document, track, and manage defects throughout the testing lifecycle.
- Maintain detailed test cases, test execution reports, defect logs, and test documentation.
- Collaborate with developers to reproduce issues, analyse root causes, and validate fixes.
- Track test coverage, defect trends, and application quality metrics.
- Communicate release risks, unresolved defects, and testing status to relevant stakeholders.
- Participate in release readiness reviews and provide quality sign-off for assigned modules.
6. Automation & Continuous Improvement
- Identify repetitive test scenarios that can be automated to improve testing efficiency.
- Support automation initiatives using Selenium, Playwright, or Cypress.
- Work with developers to improve testability and integrate testing practices into CI/CD workflows.
- Explore AI-assisted testing tools and approaches to improve test coverage and efficiency.
- Continuously improve testing methodologies for both conventional software applications and AI-powered systems.
Required Skills & Experience
1. Functional & Manual QA
- 3–5 years of hands-on experience in manual and functional software testing.
- Strong understanding of software testing methodologies, SDLC, STLC, and defect management.
- Experience designing and executing test cases for functional, regression, integration, and end-to-end testing.
- Strong knowledge of Agile/Scrum methodologies and sprint-based QA processes.
- Experience testing web applications, APIs, and mobile applications.
- Ability to analyse requirements and identify functional gaps, edge cases, and potential risks.
2. Mandatory AI/ML Testing Experience
- Prior hands-on experience testing AI/ML-powered applications or products.
- Practical experience testing LLM-based applications, AI chatbots, conversational systems, or intelligent automation features.
- Understanding of prompt testing and evaluating AI-generated responses.
- Ability to validate AI outputs for accuracy, relevance, consistency, and contextual correctness.
- Experience identifying hallucinations, unexpected AI behaviour, and response-quality issues.
- Understanding of AI application workflows, model outputs, and the challenges associated with non-deterministic systems.
- Experience collaborating with AI/ML engineers or data science teams during testing and validation.
3. API & Integration Testing
- Hands-on experience with manual API testing using Postman.
- Understanding of REST APIs, JSON, request/response validation, authentication, and error handling.
- Experience validating integrations between frontend, backend, and external services.
- Basic understanding of database validation and SQL queries.
4. Testing Tools & Technologies
- Experience with JIRA and Confluence for defect tracking and test documentation.
- Familiarity with Postman, SQL, and browser developer tools.
- Understanding of test management and reporting practices.
- Basic knowledge of BDD frameworks such as Cucumber/Gherkin is an advantage.
Preferred Skills
- Experience testing RAG-based applications, including document retrieval and contextual response validation.
- Exposure to vector databases and semantic search testing.
- Familiarity with LangChain, LangGraph, LlamaIndex, or similar AI frameworks.
- Understanding of LLM evaluation frameworks and AI quality assessment methodologies.
- Experience with AI evaluation tools such as Ragas, DeepEval, or similar frameworks.
- Exposure to prompt injection, adversarial testing, and responsible AI validation.
- Working knowledge of Selenium, Playwright, or Cypress.
- Basic scripting knowledge in Python or JavaScript.
- Familiarity with CI/CD pipelines and automated testing practices.
- Exposure to cross-browser testing tools such as BrowserStack or Sauce Labs.
What We're Looking For Beyond Skills
- AI Testing Mindset: Understands that testing AI applications requires more than checking whether a feature works. Can evaluate response quality, accuracy, relevance, and behaviour.
- Analytical Thinking: Ability to identify unusual scenarios, inconsistent outputs, and hidden quality issues.
- Strong QA Fundamentals: Applies structured testing methodologies while adapting them to AI-powered applications.
- Attention to Detail: Documents defects clearly and identifies patterns in application and AI behaviour.
- Ownership: Takes responsibility for testing quality from requirement analysis through release validation.
- Collaboration: Works effectively with developers, AI engineers, product managers, and data science teams.
- Continuous Learning: Interested in exploring emerging AI technologies and evolving testing methodologies.
- Communication: Clearly communicates test results, defect impact, quality risks, and release readiness.
What We Offer
- Competitive compensation aligned with experience and expertise.
- Flexible work environment (Coimbatore office / Hybrid).
- Paid holidays and flexible time off.
- Medical insurance covering self and family, up to ₹4 lakh per person.
- Opportunity to work on real-world AI-powered products and enterprise applications.
- Hands-on exposure to LLMs, RAG systems, agentic AI, and modern AI engineering practices.
- Opportunities to develop expertise in AI quality engineering and automation testing.
- A collaborative, multicultural environment with opportunities for professional growth.
- A culture that values clarity, integrity, ownership, and continuous learning.
Join Techjays
If you're passionate about software quality and have hands-on experience validating AI-powered applications, we'd love to hear from you.
Join us in building reliable, intelligent, and production-ready AI systems.
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Kody Technolab Limited
AI/ML Lead (7+ Years Experience)
Location: Ahmedabad / Gandhinagar
Experience: 7+ Years
Employment Type: Full-Time
Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy
cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have
strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and
cloud-based AI deployments.
Key Responsibilities
• Design, develop, and deploy Machine Learning and Deep Learning models for classification,
regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.
• Build and maintain end-to-end ML pipelines including data preprocessing, feature
engineering, model training, validation, evaluation, and deployment.
• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related
frameworks.
• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama,
Claude, and Stable Diffusion.
• Collaborate with product, engineering, and business teams to translate requirements into
scalable AI solutions.
• Optimize model performance, scalability, and reliability for production environments.
• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.
• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence,
Mathematics, or a related field.
• 7+ years of hands-on experience in AI/ML product development.
• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and
Hugging Face.
• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.
• Strong understanding of the ML lifecycle including model training, tuning, deployment,
monitoring, and optimization.
• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.
• Experience with AWS, Azure, or GCP cloud platforms.
• Strong problem-solving and analytical skills.Preferred Skills
• Fine-tuning and deployment of Large Language Models.
• Experience with RAG (Retrieval Augmented Generation) architectures.
• Contributions to open-source AI projects or research publications.
• Knowledge of model interpretability, data annotation, and feature engineering.
• C++ experience for high-performance AI applications.
Why Join Kody Technolab Limited?
Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,
and enterprise-scale applications while collaborating with a highly skilled technology team.
Visit the Website to know more about us.
Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution
Kody Robots | Robotics Company in India for Autonomous Robots
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software

About the team
SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.
About the Role
We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.
You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.
What You’ll Do
● Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.
● Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.
● Performing functional, regression, performance, scalability and security testing to identify bugs or defects.
● Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.
● Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.
● Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.
● Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.
● Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.
● Ensuring the software meets customer and business requirements by validating the functionality and performance.
● Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.
● Supporting user acceptance testing (UAT) and assisting clients with product validation.
● Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.
Required Experience
● A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.
● 8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.
● Expertise in manual and automated testing.
● Deep domain expertise in complex system validation and advanced automation practices at scale.
● Proficiency in programming languages like Python to build and run automated test scripts.
● "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."
● Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.
● Strong communication skills for documenting test results and interacting with cross-functional teams.
● Excellent analytical skills, attention to detail, and problem-solving ability.
● Ability to work independently as well as collaboratively in a team environment.
● A curious mindset with a willingness to quickly learn new technologies and testing tools.
Required Skills & Qualifications
● Familiarity with cloud-based testing environments (GCP, AWS, Azure).
● Experience with cybersecurity products or cloud services or IDP or Web UI
The Mindset
● Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.
● Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.
● Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.
● Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.








