Cutshort logo
For Employers
Improving logo
AI/ML Test Engineer – GenAI
AI/ML Test Engineer – GenAI
Improving's logo

AI/ML Test Engineer – GenAI

Leena Lahari's profile picture
Posted by Leena Lahari
1 - 4 yrs
₹8L - ₹20L / yr
Hyderabad, Mumbai
Skills
Generative AI
skill iconPython
Manual testing
Automation
Prompt engineering
RESTful APIs
JSON
A/B Testing

Title: AI/ML Test Engineer – GenAI

Location - Hyderabad

Experience - 1-3 years


Technical Skills -


• Strong experience in Generative AI, LLMs, and Agentic AI systems

• Hands-on expertise with AI evaluation frameworks (RAGAS, DeepEval, TruLens, LangSmith, Promptfoo, etc.)

• Proficiency in Python and AI/ML development libraries

• Knowledge of Prompt Engineering, prompt testing, and optimization

Ability to define and track evaluation metrics such as accuracy, relevance, groundedness, hallucination rate, latency, and user satisfaction

• Experience in creating automated evaluation pipelines and benchmarking frameworks

• Strong understanding of AI safety, guardrails, bias testing, and responsible AI practices

• Familiarity with REST APIs, JSON, vector databases, and knowledge retrieval systems

• Experience in A/B testing, human-in-the-loop evaluation, and red teaming

• Strong experience in Manual Testing of AI/GenAI applications, including functional, exploratory, UAT, regression, and end-to-end testing

• Expertise in validating Agent Reasoning, Tool Calling, Workflow Execution, and Response Quality

• Hands-on experience in Automation Testing using Python frameworks


Key Responsibilities -

  • Design, execute, and automate evaluation strategies for Agentic AI applications.
  • Develop evaluation datasets, test cases, and benchmark suites.
  • Measure and improve agent performance, reasoning quality, tool usage, and workflow effectiveness.
  • Analyze model outputs and identify hallucinations, biases, safety risks, and failure patterns.
  • Collaborate with AI Engineers, Product Teams, and Domain Experts to improve agent quality and reliability.
  • Generate evaluation reports, dashboards, and actionable recommendations.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Improving

Founded :
2006
Type :
Services
Size :
1000-5000
Stage :
Raised funding

About

Improving is a leading IT professional services firm committed to helping companies achieve lasting success through modern technology. With core expertise in AI, Data, and Applications, we specialize in transforming legacy systems, building cloud-native platforms, and delivering intelligent, future-ready solutions for today’s complex business needs. Improving’s leaders are equally committed to fostering a great place to work that is inclusive and purpose-centered, empowering Improvers to bring their whole selves to work. Our team is known for its collaborative approach and long-term partnerships that prioritize measurable outcomes. By combining technical excellence with strategic insight, Improving enables all stakeholders to grow, adapt, and lead in an ever-evolving digital landscape.

Read more

Tech stack

skill iconGo Programming (Golang)
DevOps
Quality Assurance
skill iconJava
dotnet
skill iconKubernetes
skill iconDocker
Ansible
Terraform

Company social profiles

bloglinkedin

Similar jobs

Agentic AI Platform
Agentic AI Platform
Agency job
via Peak Hire Solutions by Dharati Thakkar
Gurugram
3 - 6 yrs
₹20L - ₹30L / yr
SaaS
Release Management
skill iconGit
DevOps
CI/CD
+5 more

ROLES AND RESPONSIBILITIES:

  • Plan, schedule, and manage all releases across product and customer projects.
  • Define and maintain the release calendar, identifying dependencies and managing risks proactively.
  • Partner with engineering, QA, DevOps, and product management to ensure release readiness.
  • Create release documentation (notes, guides, videos) for both internal stakeholders and customers.
  • Run a release review process with product leads before publishing.
  • Publish releases and updates to the company website release section.
  • Drive communication of release details to internal teams and customers in a clear, concise way.
  • Manage post-release validation and rollback procedures when required.
  • Continuously improve release management through automation, tooling, and process refinement.


IDEAL CANDIDATE:

  • 3+ years of experience in Release Management, DevOps, or related roles.
  • Strong knowledge of CI/CD pipelines, source control (Git), and build/deployment practices.
  • Experience creating release documentation and customer-facing content (videos, notes, FAQs).
  • Excellent communication and stakeholder management skills; able to translate technical changes into business impact.
  • Familiarity with SaaS, iPaaS, or enterprise software environments is a strong plus.


PERKS, BENEFITS AND WORK CULTURE:

  • Competitive salary package.
  • Opportunity to learn from and work with senior leadership & founders.
  • Build solutions for large enterprises that move from concept to real-world impact.
  • Exceptional career growth pathways in a highly innovative and rapidly scaling environment.
Read more
Rekise Marine
at Rekise Marine
3 candid answers
Agency job
via Smarthyrecom by Abhinay Chinnolla
Bengaluru (Bangalore)
2 - 4 yrs
₹15L - ₹35L / yr
skill iconC++
ROS
SLAM
ROS2
Gazebo
+2 more

About Rekise Marine

Rekise Marine is a startup focused on sustainably enhancing the utility of oceans through

autonomous robotic infrastructure. Our efforts center on developing advanced autonomous

technology for the maritime industry, serving both defense and commercial sectors globally. We

specialize in creating autonomous vessels—both surface and underwater—as well as

autonomous port infrastructure. Currently, we are building the flagship autonomous platform of

the Indian Navy.


About the Role

We are seeking a passionate and driven Robotics Engineer to join our team and contribute to

the development of resilient, robust autonomous marine vessels. As part of our dynamic

startup journey, you will collaborate closely with our experienced engineers and the founding

members of the company, This role offers a hands-on opportunity to gain practical experience

in cutting-edge robotics technologies, such as navigation algorithms, control systems, sensor

fusion, computer vision, ROS, ROS2, Gazebo, Unity Sim, SLAM, and other robotics

technologies. You will be responsible for developing, and testing components, systems, and

simulations for autonomy. This immersive experience will provide you with a comprehensive

understanding of the challenges and intricacies involved in developing robust autonomous

systems for marine environments.


Key Responsibilities

● Evaluate and implement algorithms for autonomous navigation, planning, control, and

perception.

● Develop modular, efficient, and well-tested code following best practices.

● Debug issues, fix bugs, and write test cases to improve code quality.

● Contribute to internal tools for visualization, performance testing, and utility scripts.

● Document processes, test results, and contribute to reports and presentations.

● Enhance the capabilities of the simulator to achieve a more realistic representation of

the vessel and its surroundings.


Required Skills & Experience

● Bachelor's or dual degree in Mechatronics, Computer Science and Engineering,

Electrical and Electronics Engineering, Electronics and Communication Engineering,

Electronics and Instrumentation Engineering

● Proficient in C++ and Python with strong debugging skills.

● Familiarity with object-oriented design methodologies and common design patterns,

along with foundational knowledge in software engineering.

● Experience using Git for version control.

● Experienced in the Linux development environment and build tools like CMake.

● Experience working with robotics frameworks, including Robot Operating System (ROS)

and Gazebo.

● Understanding of the operation and integration of common robotics sensors, such as

LIDAR, ultrasonic, and IMU sensors.

● Understanding of robotics subsystems, including planning, control systems, localization,

perception, and drivers.


Why You’ll Love Working With Us

● A chance to be part of a leading marine robotics startup in India.

● Competitive salary.

● Flexible and innovative work environment promoting collaboration.

● A role where your contributions make a real difference and drive impact.

● Opportunities for travel in relation to customer interactions and field testing

Read more
TIFIN FINTECH INDIA
at TIFIN FINTECH INDIA
1 candid answer
1 recruiter
Sneha Das
Posted by Sneha Das
Bengaluru (Bangalore)
3 - 5 yrs
₹15L - ₹20L / yr
skill iconPython
skill iconNodeJS (Node.js)
skill iconGo Programming (Golang)
FastAPI
skill iconMongoDB
+1 more

Job Description: Software Engineer - Backend ( 3-5 Years)

Location: Bangalore

WHO WE ARE:

TIFIN is a fintech platform backed by industry leaders including JP Morgan, Morningstar, Broadridge, Hamilton Lane, Franklin Templeton, Motive Partners and a who’s who of the financial service industry. We are creating engaging wealth experiences to better financial lives

through AI and investment intelligence powered personalization. We are working to change the world of wealth in ways that personalization has changed the world of movies, music and more but with the added responsibility of delivering better wealth outcomes.

We use design and behavioral thinking to enable engaging experiences through software and application programming interfaces (APIs). We use investment science and intelligence to build algorithmic engines inside the software and APIs to enable better investor outcomes.

In a world where every individual is unique, we match them to financial advice and investments with a recognition of their distinct needs and goals across our investment marketplace and our advice and planning divisions.

OUR VALUES: Go with your GUT

Grow at the Edge: We embrace personal growth by stepping out of our comfort zones to

discover our genius zones, driven by self-awareness and integrity. No excuses.

Understanding through Listening and Speaking the Truth: Transparency, radical candor,

and authenticity define our communication. We challenge ideas, but once decisions are

made, we commit fully.

●I Win for Teamwin: We operate within our genius zones, taking ownership of our work

and inspiring our team with energy and attitude to win together.

Responsibilities:

• Contribute to the entire implementation process including driving the definition of improvements based on business needs and architectural improvements.

• Review code for quality and implementation of best practices.

• Promote coding, testing, and deployment best practices through hands-on research and demonstration.

• Write testable code that enables extremely high levels of code coverage.

• Ability to review frameworks and design principles toward suitability in the project context.

• Candidates who will demonstrate an ability to identify an opportunity lay out a rational plan for pursuing that opportunity, and see it through to completion.

 

Requirements:

• Engineering graduate with 3+ years of experience in software product development.

• Proficient in Python, Django, Pandas, GitHub, and AWS.

• Good knowledge of PostgreSQL, and MongoDB.

• Strong Experience in designing REST APIs.

• Experience with working on scalable interactive web applications.

• A clear understanding of software design constructs and their implementation.

• Understanding of the threading limitations of Python and multi-process architecture.

• Familiarity with some ORM (Object Relational Mapper) libraries.

• Good understanding of Test Driven Development.

• Unit and Integration testing.

• Preferred exposure to Finance domain.

• Strong written and oral communication skills.

Read more
confidential
confidential
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
5 - 7 yrs
₹20L - ₹35L / yr
Product Management
Telecom
Documentation
Technical analysis
Integration
+6 more
About the Role:
It’s a global role responsible for managing the product throughout the product lifecycle from
planning to execute in support of organizational strategy and objectives.
Responsibilities:
• Write detailed user stories and acceptance criteria, draft user flows, and communicate
project scope effectively, and manage products through development, QA, UA
Testing, and launch
• Ability to understand business and technical requirements & conceptualize end-to-end solutions
• Ensure requirements are communicated effectively to the business, design,
operations, CS and development teams.
• Manage agile product development process from a product management point of
View
• Participate in scrum meetings, planning, reviews and retrospectives
• Maintain and prioritize the product backlog and track feature releases with different
stakeholders
• Work with QA and engineering teams to streamline system integration, test and
improve product features
• Serve as an in-house expert for our products and become the go-to person for all
functional issues
• Manage all aspects of in-life products, including customer feedback, requirements,
and issues
• Have Strong OSS/BSS requirement gathering and solution experience (Telecom
domain).
• Minimum 5-7 years of experience in Telecom products e.g CRM, SDP, Billing &
Service provisioning.
Skills and Qualifications:
• A Bachelor’s degree in Computer Science, Engineering or equivalent is preferred
• 5-7 years of experience in product development & management expertise in the
payments / mobile app/consumer application/telecom domain
• Tech savvy and passionate about building products.
• Experience in technical documentation is a must.
• Prior experience in product development or management is desirable but not
mandatory
• Excellent writing and editing skills in Microsoft Word, Excel, and PowerPoint
• Comfortable using Google Analytics, Slack, Trello, Jira, Confluence, and/or similar
analytic tools, testing platforms, and tracking tools
• Understanding and capability to define Call flows, Business flows, use case flows and
documents them
• Have worked on integrations with the multi-vendor environment
Domain Experience -Thorough understanding of Telecom Business Processes domain
knowledge in all or either of these areas·
• Mobile, Broadband & Internet of Things, MVNO/MVNE
• PCRF, OCS, IMS, AAA, Partner Management,
• Activation, Provisioning, Fulfilment
• Understanding of technical knowhow on 4G, 5G, LTE, Mobile broadband, and Wifi
solutions
• Telecom OSS and BSS system
Read more
JNJ TECHNOLOGIES  SERVICES
Remote only
4 - 6 yrs
₹4.8L - ₹6L / yr
Team leadership
Communication Skills
Team Management
Project planning

Company Name: JNJ TECHNOLOGIES & SERVICES Job Profile: Team Leader Job Description We're seeking a qualified Team Leader is responsible for developing the sales team, coordinating sales operations and implementing sales techniques that allow the business to meet and surpass its sales targets consistently. The team leader is responsible for supervising, managing, and motivating team members on a daily basis. able to act proactively to ensure smooth team operations and effective collaboration. Requirement & Skills Proven work experience as a team leader or supervisor Excellent communication and leadership skills Organizational and time-management skills Decision-making skills Experience: 4 - 5 years Job Location: Work from home Selection process:- HR round & Manager round Qualification: Any Graduate/Post Graduate Working days: 6 working days (Sundays off) Shifts: 10:00am - 7:00pm Mandatory language: English Laptop: candidates are to use their own laptops. Additional Compensation: If applicable, this will be decided on the basis of your designation

Read more
Siam Computing
at Siam Computing
1 video
2 recruiters
Rama - Siam Computing
Posted by Rama - Siam Computing
Chennai
2 - 6 yrs
₹2L - ₹6L / yr
BDM
BD
Cold Calling
B2B Sales
Business Development
+3 more
Job Description Identifying new sales leads Pitching products and/or services Maintaining fruitful relationships with existing customers When it comes to generating leads, day-to-day duties typically include: Researching organisations and individuals online (especially on social media) to identify new leads and potential new markets Researching the needs of other companies and learning who makes decisions about purchasing Contacting potential clients via email or phone to establish rapport and set up meetings Planning and overseeing new marketing initiatives Attending conferences, meetings, and industry events Managing the content writers and keep posting articles on social media. When it comes to the challenge of actually selling, other typical duties include: Preparing PowerPoint presentations and sales displays Contacting clients to inform them about new developments in the company’s products Developing quotes and proposals Negotiating and renegotiating by phone, email, and in person Developing sales goals for the team and ensuring they are met Training personnel and helping team members develop their skills Skill set - Socially adept, should be good at networking and meeting new people. Good with numbers At the beginning, he/she will have to work alone but eventually grow the team and head the sales team Strong communication and IT fluency Creative talents and the ability to solve tough problems In-depth knowledge of the industry and its current events The ability to handle pressure and meet deadlines Skill in prioritizing and triaging obligations Attention to detail Excellent time management and organisation Why Join Us? You will learn from true innovators Flat Organisational Structure Start-up Culture Collaboration with creative, enthusiastic professionals Diverse responsibilities An interesting, challenging environment Your work will be recognized & rewarded Monthly Friday Movie Nights, Binge Eating, Team Outing, etc., Much More.....
Read more
Bids and Beyond
at Bids and Beyond
1 recruiter
Seema Mehndiratta
Posted by Seema Mehndiratta
Remote only
5 - 10 yrs
₹5L - ₹15L / yr
skill iconReact.js
skill iconReact Native
Mobile App Development
skill iconNodeJS (Node.js)
electron.js

Minimum 5+ years in react

Must have worked on desktop application

Must have worked in frontend and backend both


5+ years of experience with React js, work closely with design, product management, and development teams to create elegant, usable, responsive, and interactive interfaces across multiple devices; experience with Electron js framework is a plus.


 

Read more
WhizCo
at WhizCo
2 recruiters
Keshav Jindal
Posted by Keshav Jindal
Delhi
2 - 3 yrs
₹9L - ₹12L / yr
skill iconDjango
skill iconPython
RESTful APIs
skill iconAmazon Web Services (AWS)

We are looking for 2-3 years experienced Django Developer to join immediately in Delhi.



Responsibilities


As a Backend Developer,  you will be responsible for -


  •  Building the Complete Backend of our web application and Mobile App from scratch.
  • Work closely with the Frontend Engineer to integrate the algorithmic input from the Frontend Framework.
  • Work closely with the product owners to create dynamic infographics with intuitive user controls.
  • Participate in UAT, troubleshoot, bugs and application integration issues
  • Optimize applications for best user experience
  • Create and maintain documentation related to the developed processes and applications



Qualification & Experience


  • 2-3 years of demonstrable experience designing, building, and working as a Django Developer for enterprise web application
  • Ideally, this would include the following:
    • Expert-level proficiency with Python, Django, and Django Rest Framework.
    • Understanding of REST concepts and interacting with REST APIs
    • Understanding of  Postgresql 
    • Basic Understanding of Frontend Framework like React.js
  • Deep understanding of a few Backend concepts:
    • Familiarity with Elastic Search and AWS Technology
    • Familiarity with Apache and Ngnix etc.
    • Understanding of Python coding Standards
  • In addition, the ideal candidate would have great problem-solving skills and familiarity with code versioning tools such as Github

Location:- Delhi

Read more
AQLE
at AQLE
1 recruiter
Pinky Kochar
Posted by Pinky Kochar
Gurugram
0 - 1 yrs
₹1L - ₹1L / yr
Sales
About us:
AQLE' is a multi-product business that offers premium quality beverages with a strong presence in the Indian domestic market. Taking pride in its commitment to provide beverages that are pure, healthy, and environment-friendly, AQLE' takes great effort to ensure that all its beverages meet the highest standards of taste, quality, and health. Following a clear set of values, the brand creates all its packaging with 100% pre form, ensuring that it does its bit to help save the environment. Having been entirely re-branded, AQLE' aims at launching in Tier 1 cities, starting with Delhi NCR.
Description:
Industry : Beverages /Natural Mineral water
Internship Duration : 3 months
Stipend: 10kpm-15kpm
1.Working closely with the manager or assigned staff member, and completing all allocated tasks.
2.Conducting cold calling ,interacting with the customers,gathering information through surveys or by speaking to clients and staff.
3.Attending and participating in meetings, workshops, events, and exhibitions.
4.Liaising with clients, vendors, and suppliers on behalf of the company's managers.
5.Updating documents and sales records.
6.Achieving sales performance against sales targets.
7.Observing and carrying out sales processes.
8.Identifying potential weaknesses and offering improvement suggestions.
9.Assisting managers with negotiations.
10.Keeping a log of everything learned and delivering presentations to staff and other stakeholders.
Requirements: 
1.Post graduation degree in marketing, business or similar is must.
2. Must have own two wheeler,driving licence is required.
3.Strong self-motivation.
4.Ability to work alone or as part of a team.
5.Proficiency in communication skills 
6.Superb interpersonal skills.
7.Must have professional attitude.
Read more
Asahi Technologies
at Asahi Technologies
1 recruiter
Radha Madhukumar
Posted by Radha Madhukumar
Chennai
2 - 4 yrs
₹2L - ₹6L / yr
skill iconNodeJS (Node.js)
skill iconAngularJS (1.x)
skill iconMongoDB
As a Full Stack Developer, you will be responsible for delivering web, mobile, and API capabilities across a suite of newly developed (and yet to be developed) applications for consumers. We are looking for someone who loves to roll up his or her sleeves to understand the business need and translate that into amazing technology capabilities. This team member must act by keeping the core principles of the company such as accountability,good attitude,team oriented,out of box thinking,better communication and expressing leadership abilities. Responsibilities ● Writing APIs that perform MongoDB CRUD operations. ● Writing queries with the MongoDB Aggregation Pipeline. ● Administering MongoDB, including security, monitoring, maintenance, performance optimization, replication, and sharding. ● Creating and maintaining MongoDB indexes, including geospatial indexes. ● Deploying local MongoDB databases. ● Leveraging MongoDB PaaS solutions such as MongoDB Atlas. ● Querying relational databases using T-SQL and related technologies. ● Developing for Parse Query clients using Parse Server and MongoDB. ● Developing secure Node.js endpoints using Passport, JWT, OAuth, SAML, and related technologies. ● Optimizing Node.js server performance and memory consumption. ● Deploying Node.js server solutions to the Microsoft Azure cloud or Amazon Web Services. ● Utilizing tooling such as npm, nodemon, webpack, Babel, and ESLint. ● Writing test specs using tools such as Jest, Mocha, and Chai. ● Working with an Agile Scrum team using tools such as JIRA. Skills And Qualifications ● Exceptional coding skills in JavaScript (both frontend and backend) ● Proficiency using the MongoDB shell and related tools. ● Proficiency with MongoDB data modeling and document validation. ● Advanced proficiency in MEAN Stack (NodeJS, MongoDB, Express, AngularJS) ● Proficiency and hands-on experience with one or more of the following: Backbone / KnockoutJS / EmberJS / ReactJS ● Proficiency with Data visualization and charting tools/frameworks like HighCharts and D3.JS is a huge plus! ● Proficiency with Node.js, Express, Mongoose, and popular npm packages and related tooling. ● Proficiency or certification as a MongoDB Developer (v3.2+), MongoDB DBA, or Microsoft DocumentDB developer would be an added advantage ● Thorough knowledge of software development best practices, including coding standards, code reviews, source control management, build process, continuous integration and continuous delivery. ● Exceptional verbal, written and listening skills. ● Ability to learn new technologies quickly. ● Proficient understanding of code versioning tools, such as Github,svn,etc,
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos