Test Engineer - AI/ML

Leading digital testing boutique firm

Test Engineer - AI/ML

Peak Hire Solutions

Company

Home

Test Engineer - AI/ML

at Leading digital testing boutique firm

Agency job

via Peak Hire Solutions

5 - 8 yrs

₹11L - ₹15L / yr

Delhi

Skills

Artificial Intelligence (AI)

Machine Learning (ML)

Software Testing (QA)

Natural Language Processing (NLP)

Analytics

pytest

TensorFlow

Model-based testing

MLFlow

Python

Data validation

CI/CD

Algorithms

Data Science

ISTQB

Jupyter Notebook

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Review Criteria

Strong AI/ML Test Engineer
5+ years of overall experience in Testing/QA
2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
Candidate must be based within Delhi NCR (100 km radius)

Preferred

Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.

Job Specific Criteria

CV Attachment is mandatory
Have you worked with large datasets for AI/ML testing?
Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
Are you willing to relocate to Delhi and why (if not from Delhi)?
Are you available for a face-to-face round?

Role & Responsibilities

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials

Ideal Candidate

5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

Data Analyst

at Euphoric Thought Technologies

Posted by Sakshi Mittal

Noida

2 - 4 yrs

₹8L - ₹15L / yr

SQL

ETL

Data modeling

Business Intelligence (BI)

Position Overview:

As a BI (Business Intelligence) Developer, they will be responsible for designing,

developing, and maintaining the business intelligence solutions that support data

analysis and reporting. They will collaborate with business stakeholders, analysts, and

data engineers to understand requirements and translate them into efficient and

effective BI solutions. Their role will involve working with various data sources,

designing data models, assisting ETL (Extract, Transform, Load) processes, and

developing interactive dashboards and reports.

Key Responsibilities:

1. Requirement Gathering: Collaborate with business stakeholders to understand

their data analysis and reporting needs. Translate these requirements into

technical specifications and develop appropriate BI solutions.

2. Data Modelling: Design and develop data models that effectively represent

the underlying business processes and facilitate data analysis and reporting.

Ensure data integrity, accuracy, and consistency within the data models.

3. Dashboard and Report Development: Design, develop, and deploy interactive

dashboards and reports using Sigma computing.

4. Data Integration: Integrate data from various systems and sources to provide a

comprehensive view of business performance. Ensure data consistency and

accuracy across different data sets.

5. Performance Optimization: Identify performance bottlenecks in BI solutions and

optimize query performance, data processing, and report rendering. Continuously

monitor and fine-tune the performance of BI applications.

6. Data Governance: Ensure compliance with data governance policies and

standards. Implement appropriate security measures to protect sensitive data.

7. Documentation and Training: Document the technical specifications, data

models, ETL processes, and BI solution configurations.

8. Ensuring that the proposed solutions meet business needs and requirements.

9. Should be able to create and own Business/ Functional Requirement

Documents.

10. Monitor or track project milestones and deliverables.

11. Submit project deliverables, ensuring adherence to quality standards.

Qualifications and Skills:

1. Master/ Bachelor’s degree in IT or relevant and having a minimum of 2-4 years of

experience in Business Analysis or a related field

2. Proven experience as a BI Developer or similar role.

3. Fundamental analytical and conceptual thinking skills with demonstrated skills in

managing projects on implementation of Platform Solutions

4. Excellent planning, organizational and time management skills.

5. Strong understanding of data warehousing concepts, dimensional modelling, and

ETL processes.

6. Proficiency in SQL, Snowflake for data extraction, manipulation, and analysis.

7. Experience with one or more BI tools such as Sigma computing.

8. Knowledge of data visualization best practices and ability to create compelling

data visualizations.

9. Solid problem-solving and analytical skills with a detail-oriented mindset.

10. Strong communication and interpersonal skills to collaborate effectively with

different stakeholders.

11. Ability to work independently and manage multiple priorities in a fast-paced

environment.

12. Knowledge of data governance principles and security best practices.

13. Candidate having experience in managing implementation project of platform

solutions to the U.S. clients would be preferable.

14. Exposure to U.S debt collection industry is a plus.

Position Overview:

As a BI (Business Intelligence) Developer, they will be responsible for designing,

developing, and maintaining the business intelligence solutions that support data

analysis and reporting. They will collaborate with business stakeholders, analysts, and

data engineers to understand requirements and translate them into efficient and

effective BI solutions. Their role will involve working with various data sources,

designing data models, assisting ETL (Extract, Transform, Load) processes, and

developing interactive dashboards and reports.

Key Responsibilities:

1. Requirement Gathering: Collaborate with business stakeholders to understand

their data analysis and reporting needs. Translate these requirements into

technical specifications and develop appropriate BI solutions.

2. Data Modelling: Design and develop data models that effectively represent

the underlying business processes and facilitate data analysis and reporting.

Ensure data integrity, accuracy, and consistency within the data models.

3. Dashboard and Report Development: Design, develop, and deploy interactive

dashboards and reports using Sigma computing.

4. Data Integration: Integrate data from various systems and sources to provide a

comprehensive view of business performance. Ensure data consistency and

accuracy across different data sets.

5. Performance Optimization: Identify performance bottlenecks in BI solutions and

optimize query performance, data processing, and report rendering. Continuously

monitor and fine-tune the performance of BI applications.

6. Data Governance: Ensure compliance with data governance policies and

standards. Implement appropriate security measures to protect sensitive data.

7. Documentation and Training: Document the technical specifications, data

models, ETL processes, and BI solution configurations.

8. Ensuring that the proposed solutions meet business needs and requirements.

9. Should be able to create and own Business/ Functional Requirement

Documents.

10. Monitor or track project milestones and deliverables.

11. Submit project deliverables, ensuring adherence to quality standards.

Qualifications and Skills:

1. Master/ Bachelor’s degree in IT or relevant and having a minimum of 2-4 years of

experience in Business Analysis or a related field

2. Proven experience as a BI Developer or similar role.

3. Fundamental analytical and conceptual thinking skills with demonstrated skills in

managing projects on implementation of Platform Solutions

4. Excellent planning, organizational and time management skills.

5. Strong understanding of data warehousing concepts, dimensional modelling, and

ETL processes.

6. Proficiency in SQL, Snowflake for data extraction, manipulation, and analysis.

7. Experience with one or more BI tools such as Sigma computing.

8. Knowledge of data visualization best practices and ability to create compelling

data visualizations.

9. Solid problem-solving and analytical skills with a detail-oriented mindset.

10. Strong communication and interpersonal skills to collaborate effectively with

different stakeholders.

11. Ability to work independently and manage multiple priorities in a fast-paced

environment.

12. Knowledge of data governance principles and security best practices.

13. Candidate having experience in managing implementation project of platform

solutions to the U.S. clients would be preferable.

14. Exposure to U.S debt collection industry is a plus.

Digital Marketing Executive

at HelixSense Technologies Pvt Ltd

Posted by Jyoti Gogna

Bengaluru (Bangalore)

1 - 2 yrs

₹2L - ₹3.5L / yr

Search Engine Optimization (SEO)

Content Writing

Content Marketing

Social Media Marketing (SMM)

Social Media Optimization (SMO)

+2 more

Job Description for Digital Marketing Executive

Contribute to the development of an overall strategy for digital marketing.
Develop and implement digital marketing campaigns across a broad range of media (SEO, SEM, social media, email, mobile, display).
Provide management and maintenance to the company’s owned media, such as websites, mobile apps, and CRM/email software.
Creating engaging and relevant digital content for distribution across a variety of digital platforms.
Campaign management for social media.
Management of digital advertising campaigns.
Campaign management for search engine optimization.
Ensure that conversions, pixels, and events are tracked on the website and across various digital platforms.
Identify market trends, the brand’s audience, and competitors, along with the entire consumer journey to increase engagement and conversion.
To develop optimization plans, analyze data from digital marketing analytics reports, and share insights with team members.
Share insights with the rest of the team on new technologies, emerging digital tools, and digital marketing trends.

Requirements for Digital marketing executive

The following qualifications are required if you are applying for a digital marketing executive job position:

An undergraduate or graduate degree in marketing or a related field is required.
Experience, ideally within the industry, in digital marketing.
Independently handling the content.
Efforts to lead and manage SEO/SEM, marketing databases, email campaigns, social media campaigns, and display advertising campaigns.
Optimization of landing pages and conversion funnels.
Multivariate and A/B testing experience.
The digital marketing executive job role needs an understanding of ad serving tools.
Knowledge of how to set up and optimize PPC campaigns across all major search engines.
Having a working understanding of HTML, CSS, as well as JavaScript.

Job Description for Digital Marketing Executive

Contribute to the development of an overall strategy for digital marketing.
Develop and implement digital marketing campaigns across a broad range of media (SEO, SEM, social media, email, mobile, display).
Provide management and maintenance to the company’s owned media, such as websites, mobile apps, and CRM/email software.
Creating engaging and relevant digital content for distribution across a variety of digital platforms.
Campaign management for social media.
Management of digital advertising campaigns.
Campaign management for search engine optimization.
Ensure that conversions, pixels, and events are tracked on the website and across various digital platforms.
Identify market trends, the brand’s audience, and competitors, along with the entire consumer journey to increase engagement and conversion.
To develop optimization plans, analyze data from digital marketing analytics reports, and share insights with team members.
Share insights with the rest of the team on new technologies, emerging digital tools, and digital marketing trends.

Requirements for Digital marketing executive

The following qualifications are required if you are applying for a digital marketing executive job position:

An undergraduate or graduate degree in marketing or a related field is required.
Experience, ideally within the industry, in digital marketing.
Independently handling the content.
Efforts to lead and manage SEO/SEM, marketing databases, email campaigns, social media campaigns, and display advertising campaigns.
Optimization of landing pages and conversion funnels.
Multivariate and A/B testing experience.
The digital marketing executive job role needs an understanding of ad serving tools.
Knowledge of how to set up and optimize PPC campaigns across all major search engines.
Having a working understanding of HTML, CSS, as well as JavaScript.

Customer Support Officer

Neemans

Agency job

via AVE-Promagne Business Solutions LLP by Ashwin NE

Bengaluru (Bangalore)

0 - 5 yrs

₹2L - ₹3.8L / yr

Customer Support

telecalling

Sales

Customer Relationship Management (CRM)

Responsibilities

· Resolving technical support inquiries directly or indirectly through on-site and/or remote first-level support representatives.

· Performing routine assignments in the entry level to a professional job progression.

· Providing prompt recovery and problem escalation using multiple system management and problem management tools.

· Working closely with development teams, support teams and vendors to coordinate special operations, and communicate/escalate problems to meet assigned deadlines.

· Providing analytical support for the development & enhancement of system interfaces and develop/enhance those tools under technical direction from seniors.

· Assisting in daily support of the systems/products assigned, through early detection and pursuit of changes in system responses or operations.

· Working closely with support groups to refine system monitoring, reporting, and to assist them in their analysis and problem recovery.

· Providing prompt, clear, and timely communications; log, coordinate, and communicate problems using standard problem management and escalation procedures.