Cutshort logo
Leading digital testing boutique firm  logo
Test Engineer - AI/ML
Leading digital testing boutique firm
Test Engineer - AI/ML
Peak Hire Solutions's logo

Test Engineer - AI/ML

at Leading digital testing boutique firm

Agency job
5 - 8 yrs
₹11L - ₹15L / yr
Delhi
Skills
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
Software Testing (QA)
Natural Language Processing (NLP)
Analytics
pytest
TensorFlow
Model-based testing
MLFlow
skill iconPython
Data validation
CI/CD
Algorithms
skill iconData Science
ISTQB
Jupyter Notebook

Review Criteria

  • Strong AI/ML Test Engineer
  • 5+ years of overall experience in Testing/QA
  • 2+ years of experience in testing AI/ML models and data-driven applications, across NLP, recommendation engines, fraud detection, and advanced analytics models
  • Must have expertise in validating AI/ML models for accuracy, bias, explainability, and performance, ensuring decisions are fair, reliable, and transparent
  • Must have strong experience to design AI/ML test strategies, including boundary testing, adversarial input simulation, and anomaly monitoring to detect manipulation attempts by marketplace users (buyers/sellers)
  • Proficiency in AI/ML testing frameworks and tools (like PyTest, TensorFlow Model Analysis, MLflow, Python-based data validation libraries, Jupyter) with the ability to integrate into CI/CD pipelines
  • Must understand marketplace misuse scenarios, such as manipulating recommendation algorithms, biasing fraud detection systems, or exploiting gaps in automated scoring
  • Must have strong verbal and written communication skills, able to collaborate with data scientists, engineers, and business stakeholders to articulate testing outcomes and issues.
  • Degree in Engineering, Computer Science, IT, Data Science, or a related discipline (B.E./B.Tech/M.Tech/MCA/MS or equivalent)
  • Candidate must be based within Delhi NCR (100 km radius)


Preferred

  • Certifications such as ISTQB AI Testing, TensorFlow, Cloud AI, or equivalent applied AI credentials are an added advantage.


Job Specific Criteria

  • CV Attachment is mandatory
  • Have you worked with large datasets for AI/ML testing?
  • Have you automated AI/ML testing using PyTest, Jupyter notebooks, or CI/CD pipelines?
  • Please provide details of 2 key AI/ML testing projects you have worked on, including your role, responsibilities, and tools/frameworks used.
  • Are you willing to relocate to Delhi and why (if not from Delhi)?
  • Are you available for a face-to-face round?


Role & Responsibilities

  • 5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
  • Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
  • Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
  • Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
  • Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
  • Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
  • Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
  • Preferred Certifications ISTQB AI Testing TensorFlowCloud AI certifications or equivalent applied AI credentials


Ideal Candidate

  • 5 years’ experience in testing AIML models and data driven applications including natural language processing NLP recommendation engines fraud detection and advanced analytics models
  • Proven expertise in validating AI models for accuracy bias explainability and performance to ensure decisions eg bid scoring supplier ranking fraud detection are fair reliable and transparent
  • Handson experience in data validation and model testing ensuring training and inference pipelines align with business requirements and procurement rules
  • Strong skills in data science equipped to design test strategies for AI systems including boundary testing adversarial input simulation and dri monitoring to detect manipulation aempts by marketplace users buyers sellers
  • Proficient in data science for defining AIML testing frameworks and tools TensorFlow Model Analysis MLflow PyTest Python based data validation libraries Jupyter with ability to integrate into CICD pipelines
  • Business awareness of marketplace misuse scenarios such as manipulating recommendation algorithms biasing fraud detection systems or exploiting gaps in automated scoring
  • Education Certifications Bachelors masters in engineering CSIT Data Science or equivalent
  • Preferred Certifications ISTQB AI Testing TensorFlow Cloud AI certifications or equivalent applied AI credentials


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Digitide
Bengaluru (Bangalore)
6 - 9 yrs
₹5L - ₹15L / yr
Windows Azure
Data engineering
databricks
Data Factory

1. Design, develop, and maintain data pipelines using Azure Data Factory

2. ⁠Create and manage data models in PostgreSQL, ensuring efficient data storage and retrieval.

3. ⁠Optimize query performance and database performance in PostgreSQL, including indexing, query tuning, and performance monitoring.

4. Strong knowledge on data modeling and mapping from various sources to data model.

5. ⁠Develop and maintain logging mechanisms in Azure Data Factory to monitor and troubleshoot data pipelines.

6. Strong knowledge on Key Vault, Azure Data lake, PostgreSQL

7. ⁠Manage file handling within Azure Data Factory, including reading, writing, and transforming data from various file formats.

8. Strong SQL query skills with the ability to handle multiple scenarios and optimize query performance.

9. ⁠Excellent problem-solving skills and ability to handle complex data scenarios.

10. Collaborate with Business stakeholder, data architects and PO's to understand and meet their data requirements.

11. Ensure data quality and integrity through validation and quality checks.

12. Having Power BI knowledge, creating and configuring semantic models & reports would be preferred.


Read more
21knots
Chetna Nimkar
Posted by Chetna Nimkar
Thane
1 - 4 yrs
₹3L - ₹7L / yr
skill iconDjango
FastAPI
skill iconFlask
skill iconReact.js
skill iconHTML/CSS
+1 more

About Us

21 Knots is a design, engineering, and consulting firm providing services to the global maritime and oil & gas industry. In an industry constantly evolving due to dynamic regulations, economic fluctuations, and climate change mandates, we strive to deliver cutting-edge solutions with an unwavering commitment to excellence. Our comprehensive services are designed to create value for our esteemed clients while enabling them to achieve their business goals.


The Role

We’re looking for a skilled and motivated Software Developer to join our team at 21 Knots. Someone with backend development with a working knowledge of frontend technologies. The ideal candidate will have a strong command of backend frameworks such as Django, FastAPI, or Flask, and familiarity with frontend tools like HTML, CSS, JavaScript, and optionally React, Angular, or Vue. You will play a key role in building, maintaining, and optimizing scalable software solutions while collaborating with a team


Responsibilities

  • Develop,test, and maintain backend services using Django, FastAPI, or Flask.
  • Design and implement RESTful APIs for web and internal tools.
  • Work with relational and non-relational databases such as PostgreSQL, MySQL, or MongoDB.
  • Optimize application performance and implement backend security best practices.
  • Collaborate with frontend developers, designers, and cross-functional teams to deliver high-quality solutions.
  • Write clean, maintainable, and well-documented code.
  • Support basic frontend development tasks using HTML, CSS, and JavaScript.
  • Work with modern frontend frameworks like React.js, Angular, or Vue (good to have).

What You’ll Need

Experience:

  • 1–4 years of hands-on experience in backend development.
  • Exposure to full-stack development environments.
  • Experience working with RESTful APIs, databases, and cloud integration is a plus.

Education:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.

Tools & Software Proficiency:

  • Proficiency in Django, FastAPI, or Flask.
  • Familiarity with PostgreSQL, MySQL, or MongoDB.
  • Basic knowledge of frontend technologies: HTML, CSS, JavaScript.
  • Exposure to Bootstrap or Tailwind CSS for responsive UI design.
  • Good to have: experience with React, Angular, or Vue.
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and Agile/Scrum methodologies is an added advantage.

Skills & Competencies:

  • Strong problem-solving and debugging skills.
  • Understanding of RESTful architecture and secure coding practices.
  • Ability to collaborate in a cross-functional environment.
  • Good verbal and written communication skills.


Read more
StyloPAY
at StyloPAY
4 recruiters
Shashikant Kumar
Posted by Shashikant Kumar
Remote, Kolkata
3 - 7 yrs
₹4L - ₹7L / yr
skill iconAndroid Development
skill iconJava
skill iconKotlin

  • Design and build advanced applications for the Android platform
  • Collaborate with cross-functional teams to define, design, and ship new features.
  • Work with outside data sources and API's.
  • Unit-test code for robustness, including edge cases, usability, and general reliability.
  • Work on bug fixing and improving application performance.
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Read more
Nimesa
at Nimesa
5 recruiters
vidhi goyal
Posted by vidhi goyal
Bengaluru (Bangalore)
3 - 6 yrs
₹12L - ₹15L / yr
skill iconSpring Boot
Multithreading
skill iconAmazon Web Services (AWS)
skill iconJava
Hibernate (Java)
+1 more

Job Role:

As a senior R&D Java Engineer, you will work in a highly collaborative, dynamic environment. Your work will impact a lot to make world bit safer place. You’ll design creative solutions to problems faced by companies due to cyber attacks. You will work closely with other partners such as product and pre-sales managers, UI developers, and other software engineers to develop new product offerings and improve the efficiency of the solution.

 

Responsibilities:

  • Develop, modify, and implement, the software components of Nimesa Product.
  • Assist QA Engineers with the creation and review of the test cases
  • Write junits and test automation if anything required to have the coverage
  • Assist other Engineers with the creation of detailed software design specifications.
  • Keep an eye out for technology trends, and open-source projects that can be used.

Requirements:

  • Bachelor's or Master's degree in computer science or relevant fields.
  • At least 3+ years experience in end-end software development for large design and coordinating project teams in the SaaS industry.
  • Software development experience with Java and Spring / Springboot, RabbitMQ, MYSQL etc
  • Must have worked on fairly complex products from scratch
  • Strong knowledge of data structure, multithreading and other comp science concepts (SQL or NoSQL)
  • Excellent social and communication skills
  • Demonstrated expertise in building Web Applications, Enterprise Applications, Web Services, and Management at scale is a requirement.
  • Experience with Design patterns
  • Knowledge of cloud-based architectures, deployment and operational aspects of Amazon Web Services cloud
Read more
Kaleidofin
at Kaleidofin
3 recruiters
Poornima B
Posted by Poornima B
Chennai, Bengaluru (Bangalore)
2 - 4 yrs
Best in industry
skill iconMachine Learning (ML)
skill iconPython
SQL
Customer Acquisition
Big Data
+2 more
Responsibility
  • Partnering with internal business owners (product, marketing, edit, etc.) to understand needs and develop custom analysis to optimize for user engagement and retention
  • Good understanding of the underlying business and workings of cross functional teams for successful execution
  • Design and develop analyses based on business requirement needs and challenges.
  • Leveraging statistical analysis on consumer research and data mining projects, including segmentation, clustering, factor analysis, multivariate regression, predictive modeling, etc.
  • Providing statistical analysis on custom research projects and consult on A/B testing and other statistical analysis as needed. Other reports and custom analysis as required.
  • Identify and use appropriate investigative and analytical technologies to interpret and verify results.
  • Apply and learn a wide variety of tools and languages to achieve results
  • Use best practices to develop statistical and/ or machine learning techniques to build models that address business needs.

Requirements
  • 2 - 4 years  of relevant experience in Data science.
  • Preferred education: Bachelor's degree in a technical field or equivalent experience.
  • Experience in advanced analytics, model building, statistical modeling, optimization, and machine learning algorithms.
  • Machine Learning Algorithms: Crystal clear understanding, coding, implementation, error analysis, model tuning knowledge on Linear Regression, Logistic Regression, SVM, shallow Neural Networks, clustering, Decision Trees, Random forest, XGBoost, Recommender Systems, ARIMA and Anomaly Detection. Feature selection, hyper parameters tuning, model selection and error analysis, boosting and ensemble methods.
  • Strong with programming languages like Python and data processing using SQL or equivalent and ability to experiment with newer open source tools.
  • Experience in normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis.
  • Experience designing, developing, implementing and maintaining a database and programs to manage data analysis efforts.
  • Experience with big data and cloud computing viz. Spark, Hadoop (MapReduce, PIG, HIVE).
  • Experience in risk and credit score domains preferred.
Read more
India GTM partner To global brands
India GTM partner To global brands
Agency job
via Unnati by Sarika Tamhane
Mumbai, Kochi (Cochin)
2 - 3 yrs
₹6L - ₹6.6L / yr
Business Intelligence (BI)
Portfolio management

In today’s marketing-dependent consumer world, businesses demand innovative brand solutions and our client is engaged in providing brand solutions across businesses. They import renowned global brands & distribute the same. They have a dedicated eCommerce practice to build digital retail footprints for their brands in India. They focus on major categories under FMCG such as F&B, Personal care, etc. and also Home & Fabric Care.

 

Founded in 2003, our client has over 250 Pan-India Distributors and more than 300 SKUs. They deal with 25+ brands and some of the brands are Mogu Mogu, SAN REMO, Simpkins, Moccona, OMINO BIANCO, etc.

 

As a Assistant Manager - Business Intelligence, you will be responsible for support building and executing portfolio and respective brand execution strategy by mining, understanding, internalising, and creating action stands about inflow and outflow of information from different internal and external sources.


What you will do:

  • Assimilating sales & inventory data streams from different ecommerce partners daily
  • Planning different inventory streams for all portfolio brands vis--vis PO requirements
  • Building future projection models for brands to support healthy and sufficient inventory capacities

 

Desired Candidate Profile

What you need to have:

  • Self direction
  • Ability to think beyond operational hurdles
Read more
Qube Health
Qube Health
Agency job
via KPB Consultants India by Rijas Muhammed
Mumbai
2 - 6 yrs
₹8L - ₹12L / yr
skill iconFlutter
DART
RESTful APIs
MySQL
skill iconGitHub

COMPANY OVERVIEW

QubeHealth is on a mission to change the way people access healthcare.

India has one of the highest out-of-pocket-expenses in healthcare in the world. Even with group health insurance cover, the average Indian worker pays 60% of health-related expenditures out-of-pocket. Paying for and accessing, healthcare remains a massive challenge in India.

On the other hand, there’s all kinds of innovative ways one can pay for buying the smallest item on any popular e-commerce portal. We believe it’s high time we changed that, and are leading this change from the forefront.

Job brief

We are looking for a Flutter Android Developer who possesses a passion for pushing mobile technologies to the limits. This Android app developer will work with our Product team to design and build the next generation of our mobile applications. Android programming works closely with other app development and technical teams.

 

Responsibilities

  • Design and build applications for the Android platform
  • Collaborate with cross-functional teams to define, design, and ship new features
  • Work with outside data sources and APIs
  • Unit-test code for robustness, including edge cases, usability, and general reliability
  • Work on bug fixing and improving application performance
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency

Tech Skills

  • Flutter & Dart
  • Rest API
  • MySQL (good to have)
  • GitHub

 

Soft Skills

  • Good Communication
  • Team Player
  • Creative
  • Problem Solver
 

Location: Preferably based out of Mumbai & willing to work from our Mumbai office.

Read more
Oxysquad Technologies Pvt Ltd
at Oxysquad Technologies Pvt Ltd
1 video
1 recruiter
Riya Daryani
Posted by Riya Daryani
Indore
1 - 2 yrs
₹2L - ₹3L / yr
skill iconLaravel
skill iconPHP
MySQL
skill iconCodeIgniter


* Develop, record and maintain cutting edge web-based PHP applications on portal plus premium service platforms

 

* Build innovative, state-of-the-art applications and collaborate with the User Experience (UX) team

 

* Ensure HTML, CSS, and shared JavaScript is valid and consistent across applications

 

* Prepare and maintain all applications utilizing standard development tools

 

* Utilize backend data services and contribute to increase existing data services API

 

* Lead the entire web application development life cycle right from concept stage to delivery and post launch support

 

* Convey effectively with all task progress, evaluations, suggestions, schedules along with technical and process issues

 

* Document the development process, architecture, and standard components

 

* Coordinate with co-developers and keeps project manager well informed of the status of development effort and serves as liaison between development staff and project manager

 

* Keep abreast of new trends and best practices in web development
Read more
TimePay
at TimePay
3 recruiters
Animesh Kejriwal
Posted by Animesh Kejriwal
Mumbai
3 - 7 yrs
₹3L - ₹4L / yr
Tally
Software Development
English Proficiency
- Minimum 5 years of experience in tally development - Understands TDL, Tally webservices api, plugin development - Self starter, and works independently - Understanding of Accounting principles a plus
Read more
Technoloader
at Technoloader
1 video
1 recruiter
Deeksha Avasthi
Posted by Deeksha Avasthi
Jaipur
1 - 4 yrs
₹1L - ₹4L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconMongoDB
Technoloader is a blockchain development company which provides a wide array of services based on blockchain such as blockchain development, supply chain development, blockchain POC development, blockchain IOT development, blockchain game development, smart contract development, blockchain consulting services, private blockchain development, cryptocurrency wallet development and hyperledger blockchain development. We are a company which strives to attain perfection in every project. Our services have been exceptional in each aforementioned category and there is much more that we can do when it comes to blockchain. We are a global service provider of blockchain and our services have been exceptional whether it is the quality of project delivered or its time.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos