Test Engineer - AI/ML

Leading digital testing boutique firm

Test Engineer - AI/ML

Peak Hire Solutions

Company

Home

Test Engineer - AI/ML

at Leading digital testing boutique firm

Agency job

via Peak Hire Solutions

5 - 8 yrs

₹11L - ₹15L / yr

Delhi

Skills

Artificial Intelligence (AI)

Machine Learning (ML)

Software Testing (QA)

Natural Language Processing (NLP)

Analytics

pytest

TensorFlow

Model-based testing

MLFlow

Python

Data validation

CI/CD

Algorithms

Data Science

ISTQB

Jupyter Notebook

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

Group Head

at Moshi Moshi

3 candid answers

Posted by Human Resource

Bengaluru (Bangalore)

5 - 7 yrs

₹8L - ₹12L / yr

Social Media Marketing (SMM)

Social media management

Job Role: Group Head - Social Media

Experience Level: 5 - 6 Years (3 years in Agency set-up)

Location: Bangalore, Onsite

Job Overview: We are seeking an experienced and strategic-minded Group Head of Social Media to lead our client-based social media team. This role requires a dynamic individual who can ideate and execute

effective social media campaigns giving great results that meet with client’s objectives, foster a cohesive team environment, and cultivate strong client relationships. The ideal candidate should possess a deep

understanding of social media dynamics, a proven track record in team leadership, and exceptional communication skills.

Job Description

1. Ideation and Strategy of Campaigns:

● Develop innovative and tailored integrated marketing strategies that align with client's objectives, target audiences, and industry trends.

● Lead brainstorming sessions to generate creative campaign ideas, considering various platforms, formats, and engagement techniques.

● Collaborate with the creative team to conceptualize engaging content that resonates with the intended audiences.

2. Team Management:

● Lead, mentor, and inspire a team of social media account managers and executives.

● Set clear performance expectations, provide regular feedback, and conduct performance evaluations.

● Foster a collaborative and innovative team culture that encourages the sharing of ideas and professional growth.

3. Client Management:

● Develop and maintain strong relationships with the clients through regular communication, meetings & strategic interaction.

● Clearly understand clients' goals, needs, and expectations and ensure that marketing strategy media strategies align with their business objectives.

● Present campaign proposals, strategies, and other integrated marketing reports to clients in a compelling and informative manner.

● Proactively address client concerns, feedback, and requests to ensure their satisfaction and long-term partnership.

Requirements:

1. Bachelor's degree in Marketing, Communications, or a related field (Master's degree preferred).

2. 5-6 years of proven experience in social media management within a client-based agency or related environment. (With minimum 3 years of agency experience)

3. Demonstrated success in devising and executing impactful social media strategies for a variety of clients.

4. Profound understanding of social media platforms, algorithms, content formats, and best practices.

5. Proven track record of generating exceptional results via integrated marketing strategies (online + offline). {must have}

6. Strong analytical skills to interpret data and insights for continuous campaign optimization.

7. Excellent written and verbal communication skills, capable of conveying ideas clearly to both internal teams and clients.

8. Proven leadership skills with experience in managing and developing high-performing teams.

9. Adept at managing multiple client relationships simultaneously and adept at handling client feedback and expectations.

10. Experience in presenting campaign strategies and performance reports to clients.

11. Detail-oriented, organized, and able to meet tight deadlines in a fast-paced environment.

12. Creative thinker with the ability to ideate innovative and tailored campaigns that drive engagement.

13. In-depth knowledge of the broader marketing landscape