Test Engineer - AI/ML

Leading digital testing boutique firm

Test Engineer - AI/ML

Peak Hire Solutions

Company

Home

Test Engineer - AI/ML

at Leading digital testing boutique firm

Agency job

via Peak Hire Solutions

5 - 8 yrs

₹11L - ₹15L / yr

Delhi

Skills

Artificial Intelligence (AI)

Machine Learning (ML)

Software Testing (QA)

Natural Language Processing (NLP)

Analytics

pytest

TensorFlow

Model-based testing

MLFlow

Python

Data validation

CI/CD

Algorithms

Data Science

ISTQB

Jupyter Notebook

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

RF Engineer

at LS Spectrum Solutions Private Limited

1 recruiter

Posted by Chetnya Thanvi

Mumbai

1 - 5 yrs

₹3L - ₹10L / yr

Spectrum management

Spectrum analyzer

RF engineering

Project planning

Job Overview

The primary role of a candidate will be a RF Engineer. The RF engineer will be a consultant who work collaboratively with the RF product team as well as partners to provide support for all presales solution aspects of the sales cycle.

Job requirements include but are not limited to the following activities: assistance & response to RFI/RFP preparation, opportunity & account planning, relation building with Partners and Product Management teams, demonstrations, joint partner solutions etc.

Responsibilities

Strong Focus on Customer engagements in ongoing opportunities
Assistance to product teams throughout the sales cycles
Lead initial solution demonstrations to customers/partners.
Assist in pre-sales to post-sale transition to ensure smooth implementation and maximum customer satisfaction.

Job description:

Should be ready for a full-time job working from office.
Interest and ability to identify, document and articulate the business and technical requirements of a customer.
Excellent in customer facing, communication and presentation skills.
Should have clear understanding of RF, Electromagnetics, RADAR, and communication technologies.
Good knowledge in KPI parameter analysis , having knowledge in 2G/3G/4G/5G Technology & concepts.
Should quickly learn Technology/Product/Solution offerings Spectrum monitoring equipment.
Should be able to provide support to customers on issues raised by them.
Should be good in writing and quantitative skills, other Microsoft tools like Excel, Word, PowerPoint, etc.
High level of energy, enthusiasm, persistence, discipline, and a strong desire to succeed.
Willingness to do whatever is necessary to win .
Ability to travel abroad as well as domestically. Should be ready to travel to clients in India regularly for demonstrations, POCs, customer presentations, installations, and commissioning.

Technical Skills

Preferred technical experience in data collection, RF optimization, Spectrum Monitoring and Management system.
Electronics and telecommunications engineer with CCNA or equivalent networking knowledge.
Good understanding of computer hardware technologies and its trends in market.
Preferred experience up to 2-5 years in presales role.
Should have better understanding of software languages and to operate the application software.
Experience with Database, Application integration etc. desirable.
Should be capable in conducting demos, training, etc.

Job Overview

Responsibilities

Strong Focus on Customer engagements in ongoing opportunities
Assistance to product teams throughout the sales cycles
Lead initial solution demonstrations to customers/partners.
Assist in pre-sales to post-sale transition to ensure smooth implementation and maximum customer satisfaction.

Job description:

Should be ready for a full-time job working from office.
Interest and ability to identify, document and articulate the business and technical requirements of a customer.
Excellent in customer facing, communication and presentation skills.
Should have clear understanding of RF, Electromagnetics, RADAR, and communication technologies.
Good knowledge in KPI parameter analysis , having knowledge in 2G/3G/4G/5G Technology & concepts.
Should quickly learn Technology/Product/Solution offerings Spectrum monitoring equipment.
Should be able to provide support to customers on issues raised by them.
Should be good in writing and quantitative skills, other Microsoft tools like Excel, Word, PowerPoint, etc.
High level of energy, enthusiasm, persistence, discipline, and a strong desire to succeed.
Willingness to do whatever is necessary to win .
Ability to travel abroad as well as domestically. Should be ready to travel to clients in India regularly for demonstrations, POCs, customer presentations, installations, and commissioning.

Technical Skills

Preferred technical experience in data collection, RF optimization, Spectrum Monitoring and Management system.
Electronics and telecommunications engineer with CCNA or equivalent networking knowledge.
Good understanding of computer hardware technologies and its trends in market.
Preferred experience up to 2-5 years in presales role.
Should have better understanding of software languages and to operate the application software.
Experience with Database, Application integration etc. desirable.
Should be capable in conducting demos, training, etc.

Sales Manager

at Memorres Digital Pvt Ltd

1 video

3 recruiters

Posted by UM Priyanga

Jaipur

2 - 7 yrs

₹3L - ₹12L / yr

Sales

Business Development

Lead Generation

Customer Relationship Management (CRM)

Revenue growth

+5 more

Achieve growth and hit sales targets set by the company. Mentor sales team towards ICPs, revenue generation, and managing the sales team
Design and implement a strategic business plan that expands the company’s customer base and ensure its strong presence
Own recruiting, objectives setting, coaching, and performance monitoring of sales representatives
Build and promote strong, long-lasting customer relationships by partnering with them and understanding their needs
Present sales, revenue, and expenses reports and realistic forecasts to the management team
Identify emerging markets and market shifts while being fully aware of new products and competition status

Java Developer

at OnlineCounselling4U

Posted by Preeti Arora

Remote, Gurugram, Delhi, Noida, Ghaziabad, Faridabad

4 - 8 yrs

₹7L - ₹25L / yr

Java

J2EE

Spring Boot

Hibernate (Java)

We are seeking an experienced Java Developer to join our team. The successful candidate will be responsible for designing, developing, and maintaining Java-based applications. As a Java Developer, you will work closely with project managers, business analysts, and other members of the development team to create high-quality software that meets our clients' needs.

Responsibilities:

Design, develop and maintain Java-based applications
Collaborate with cross-functional teams to identify, prioritize and execute tasks
Participate in code and design reviews to maintain code quality and ensure that the software is consistent with established standards
Ensure timely delivery of high-quality software by following agile development methodologies
Provide technical guidance and mentorship to junior developers

Requirements:

Strong knowledge of Java and object-oriented programming principles
Experience with Java frameworks such as Spring, Hibernate, Struts
Experience with web development technologies such as HTML, CSS, JavaScript, and AJAX
Familiarity with relational databases such as MySQL, Oracle, or PostgreSQL
Understanding of software development methodologies, such as Agile, Scrum, and Waterfall
Excellent problem-solving and analytical skills
Strong written and verbal communication skills
Bachelor's or Master's degree in Computer Science or a related field

If you are passionate about Java development and are looking for a challenging and rewarding opportunity to grow your skills and career, we encourage you to apply for this position.

Responsibilities:

Design, develop and maintain Java-based applications
Collaborate with cross-functional teams to identify, prioritize and execute tasks
Participate in code and design reviews to maintain code quality and ensure that the software is consistent with established standards
Ensure timely delivery of high-quality software by following agile development methodologies
Provide technical guidance and mentorship to junior developers

Requirements:

Strong knowledge of Java and object-oriented programming principles
Experience with Java frameworks such as Spring, Hibernate, Struts
Experience with web development technologies such as HTML, CSS, JavaScript, and AJAX
Familiarity with relational databases such as MySQL, Oracle, or PostgreSQL
Understanding of software development methodologies, such as Agile, Scrum, and Waterfall
Excellent problem-solving and analytical skills
Strong written and verbal communication skills
Bachelor's or Master's degree in Computer Science or a related field

If you are passionate about Java development and are looking for a challenging and rewarding opportunity to grow your skills and career, we encourage you to apply for this position.

Backend Developer

at EnKash

1 recruiter

Posted by Manju M

Pune

4 - 8 yrs

₹12L - ₹35L / yr

Java

J2EE

Spring Boot

Hibernate (Java)

Microservices

Coding experience during internship or has knowledge
• Understanding of OOPS Concepts and data structure
• Have practical knowledge/experience in JAVA , Microservices , Springboot , hibernate and
MySQL database
• Have idea in scrum and agile methodologies
• Good communicator and problem-solving attitude is a sure winner
• Teamwork skills, great attention to detail and organizational skills

BI Developer

at Agiletech Info Solutions pvt ltd

Posted by Kalaithendral Nagarajan

Chennai

4 - 9 yrs

₹4L - ₹12L / yr

Data Analytics

Data Visualization

PowerBI

Tableau

Qlikview

+5 more

4 - 8 overall experience.

1-2 years’ experience in Azure Data Factory - schedule Jobs in Flows and ADF Pipelines, Performance Tuning, Error logging etc..
1+ years of experience with Power BI - designing and developing reports, dashboards, metrics and visualizations in Powe BI.
(Required) Participate in video conferencing calls - daily stand-up meetings and all day working with team members on cloud migration planning, development, and support.
Proficiency in relational database concepts & design using star, Azure Datawarehouse, and data vault.
Requires 2-3 years of experience with SQL scripting (merge, joins, and stored procedures) and best practices.
Knowledge on deploying and run SSIS packages in Azure.
Knowledge of Azure Data Bricks.
Ability to write and execute complex SQL queries and stored procedures.

4 - 8 overall experience.

1-2 years’ experience in Azure Data Factory - schedule Jobs in Flows and ADF Pipelines, Performance Tuning, Error logging etc..
1+ years of experience with Power BI - designing and developing reports, dashboards, metrics and visualizations in Powe BI.
(Required) Participate in video conferencing calls - daily stand-up meetings and all day working with team members on cloud migration planning, development, and support.
Proficiency in relational database concepts & design using star, Azure Datawarehouse, and data vault.
Requires 2-3 years of experience with SQL scripting (merge, joins, and stored procedures) and best practices.
Knowledge on deploying and run SSIS packages in Azure.
Knowledge of Azure Data Bricks.
Ability to write and execute complex SQL queries and stored procedures.

Business Development Executive

at Web Mavens

1 recruiter

Posted by prapti patel

Ahmedabad

1 - 2 yrs

₹1L - ₹3L / yr

Lead Generation

upwork

cold calling

Must have experience in handling bidding portals.
Should have knowledge of email marketing and follow-up with the clients response.
Excellent Communication skills.
Should be able to work independently.
Must have strong drive to results and passion for growing businesses.
Knowledge of web and mobile applications development practices.
Deep understanding of marketing principles.
Excellent oral and written communication skills including presentation skills.
Must be self-motivated and a good team player.
Must have strong decision-making, and problem solving skills.
Ability to provide quality leadership to Sales team.
Shaping marketing strategy of new products.
Marketing the Company's software products via emails, blogs, newsletters and social media.
Develop new opportunities to increase company visibility.
Analyse work statistics to determine project requirements, and generate business opportunities by getting new development projects for the company in the areas of web and mobile applications.
Screen potential business deals by analyzing requirements and financials.
Generating leads for new development projects and convert them.
Cold calling experience will be added advantage.

Must have experience in handling bidding portals.
Should have knowledge of email marketing and follow-up with the clients response.
Excellent Communication skills.
Should be able to work independently.
Must have strong drive to results and passion for growing businesses.
Knowledge of web and mobile applications development practices.
Deep understanding of marketing principles.
Excellent oral and written communication skills including presentation skills.
Must be self-motivated and a good team player.
Must have strong decision-making, and problem solving skills.
Ability to provide quality leadership to Sales team.
Shaping marketing strategy of new products.
Marketing the Company's software products via emails, blogs, newsletters and social media.
Develop new opportunities to increase company visibility.
Analyse work statistics to determine project requirements, and generate business opportunities by getting new development projects for the company in the areas of web and mobile applications.
Screen potential business deals by analyzing requirements and financials.
Generating leads for new development projects and convert them.
Cold calling experience will be added advantage.

Implementation Manager/Project Manager

at Yatra

4 recruiters

Posted by Anusha Vasishta

Bengaluru (Bangalore)

4 - 6 yrs

₹6L - ₹10L / yr

Risk Management

Project Management

Project Manager

Agile/Scrum

At Yatra Online, we are looking to hire a positive, proactive Project Manager.

What will you be doing?

 Develop, document, and execute overall implementation project management and change management processes around evolving business and project needs by utilizing proven methodologies and techniques.
 Drive process improvement, standards development, and new working methods for project management.
 Create solutions to enable effective monitoring of projects using an existing project management system.
 Ensure projects are kept up to date and in accordance with best practices.
 Implement and roll out resource management capabilities.
 Monitor and control quality deliveries and adherence to set processes.
 Provide impactful data analysis, and insights to business users.
 Ensure effective internal communication across company interfaces.
 Demonstrate solid understanding of Yatra corporate solutions and other tools.

angular developer

at Minebrat Private Limited

1 recruiter

Posted by melantha Fernandes

Bengaluru (Bangalore)

1 - 3 yrs

₹2L - ₹4L / yr

Angular (2+)

Javascript

HTML/CSS

Angular Developer

1-3 years experience in Javascript Development
Extensive technical experience and development expertise in Javascript
Experience in working with REST API
Experience in any Javascript framework like Angular or React
Possess advanced knowledge of object-oriented design and development(OOA/OOD) and data architectures.
Experience working with and applying Design patterns to solve problems.
Demonstrate strong written and oral communication skills.
Hands on Coder Knowledge of any back end technology is a plus
Knowledge of Mobile Application is a plus (Android, IOS)
Candidate should be able to join in 1 month or less

Benefits
Flexible work timings,
Good team to work with

UX Designer

at DIYGURU.ORG

1 video

2 recruiters

Posted by Avinash Singh

NCR (Delhi | Gurgaon | Noida)

0 - 4 yrs

₹2L - ₹5L / yr

User Experience (UX) Design

HTML/CSS

Wordpress

Job Description DIYguru Digital (a sister concern of DIYguru Education & Research Pvt. Ltd.) is looking for a WordPress Developer responsible for both back-end and front-end development, including editing/creating Wordpress themes and plugins. This position requires a combination of basic programming skills (namely PHP, HTML5, CSS3, and JavaScript) and aesthetics (understanding element arrangements on the screen, the color and font choices, and so on). The candidate should have a strong understanding of content management systems (CMS). Also, an understanding of the entire web development process, including design, development, and SEO. Responsibilities Designing and implementing new features and functionality Establishing and guiding the website’s architecture Ensuring high-performance and availability, and managing all technical aspects of the CMS Helping formulate an effective, responsive design and turning it into a working theme and plugin. Creating site maps, robot.txt, writing meta description & tags, proper use of SEO plugins. Optimising images and pages of the present websites. Designing new Wordpress websites as per the need. Skills and Qualifications Understanding of front-end technologies, including HTML5, CSS3, JavaScript, jQuery Experience building user interfaces for websites. Experience designing and developing responsive design websites mainly Wordpress Comfortable working with debugging tools like Firebug, Chrome inspector, etc. Ability to understand CSS changes and their ramifications to ensure consistent style across platforms and browsers Knowledge of how to interact with RESTful APIs and formats (JSON, XML) Strong understanding of setting up/deploying Wordpress websites on New hosting servers. Should know how to use child themes in Wordpress. Interested candidates can apply at jaskaran@diyguru.org or hr@diyguru.org