PythonTitle: AI/ML Test Engineer – GenAI
Location - Hyderabad
Experience - 1-3 years
Technical Skills -
• Strong experience in Generative AI, LLMs, and Agentic AI systems
• Hands-on expertise with AI evaluation frameworks (RAGAS, DeepEval, TruLens, LangSmith, Promptfoo, etc.)
• Proficiency in Python and AI/ML development libraries
• Knowledge of Prompt Engineering, prompt testing, and optimization
Ability to define and track evaluation metrics such as accuracy, relevance, groundedness, hallucination rate, latency, and user satisfaction
• Experience in creating automated evaluation pipelines and benchmarking frameworks
• Strong understanding of AI safety, guardrails, bias testing, and responsible AI practices
• Familiarity with REST APIs, JSON, vector databases, and knowledge retrieval systems
• Experience in A/B testing, human-in-the-loop evaluation, and red teaming
• Strong experience in Manual Testing of AI/GenAI applications, including functional, exploratory, UAT, regression, and end-to-end testing
• Expertise in validating Agent Reasoning, Tool Calling, Workflow Execution, and Response Quality
• Hands-on experience in Automation Testing using Python frameworks
Key Responsibilities -
- Design, execute, and automate evaluation strategies for Agentic AI applications.
- Develop evaluation datasets, test cases, and benchmark suites.
- Measure and improve agent performance, reasoning quality, tool usage, and workflow effectiveness.
- Analyze model outputs and identify hallucinations, biases, safety risks, and failure patterns.
- Collaborate with AI Engineers, Product Teams, and Domain Experts to improve agent quality and reliability.
- Generate evaluation reports, dashboards, and actionable recommendations.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Improving
About
Improving is a leading IT professional services firm committed to helping companies achieve lasting success through modern technology. With core expertise in AI, Data, and Applications, we specialize in transforming legacy systems, building cloud-native platforms, and delivering intelligent, future-ready solutions for today’s complex business needs. Improving’s leaders are equally committed to fostering a great place to work that is inclusive and purpose-centered, empowering Improvers to bring their whole selves to work. Our team is known for its collaborative approach and long-term partnerships that prioritize measurable outcomes. By combining technical excellence with strategic insight, Improving enables all stakeholders to grow, adapt, and lead in an ever-evolving digital landscape.
Tech stack
Go Programming (Golang)
Java
Kubernetes
DockerCompany social profiles
Similar jobs
Oracle Fusion HCM Functional Consultant (Oracle workforce compensation and Talent Management)
POSITION SUMMARY
· 7-9+ years experience in Oracle Cloud.
· Must have experience in Oracle Fusion Cloud HCM Modules (Oracle workforce compensation and Talent Management).
· End to end configuration of above Modules.
· Create and update configuration books.
· Support the preparation and execution of test scripts and resolve testing defects.
· Create and update functional design documents.
· Release upgrade testing.
· Securities.
· Good presentation and communication skills - Responsible for communicating and escalating project issues to the team leads.
· Responsible for project deliverables from offshore for HCM Modules.
· Exposure to structured software development life-cycle methodology.
· Experience of working with multi-cultural teams in a geographically diverse environment.
· Experience in creating workflow and security for the module.
· Good to have experience in Redwood theme and Visual builder studio.
Roles and Responsibilities:
- Owns the user experience on the website and Mobile App to provide the best-in-class experience for our online users.
- Owns the design strategies, framework, tools and governance for the Indian website and Mobile App in line with the local user needs and the Company's United Design Framework.
- Responsible for complete digital experience from the user research phase, design to the delivery of the mock-ups.
- Co-own the A/B testing strategy to run multiple usability tests on our online platforms and identify the quick wins through a data driven approach.
Business Development Representatives (BDRs) are focused on generating and qualifying leads through LinkedIn and other channels. Their main goal is to use these platforms to create connections with potential clients and identify opportunities for the sales team.
Roles and Responsibilities:
1. Lead Identification: Utilizing LinkedIn (especially tools like LinkedIn Sales Navigator) to identify and connect with potential leads that match the target profile.
2. Initial Outreach: Engaging with leads through personalized LinkedIn messages,
comments, InMails, calling, and sending emails, creating interest in the
company's products or services.
3. Qualifying Leads: Assessing the needs and interest levels of the leads, determining if they are a fit for what the company is offering.
4. Scheduling Appointments: Setting up meetings or calls between qualified leads and the sales team, ensuring a smooth handover.
5. Collaboration with Sales and Marketing: Working closely with the Sales Manager and marketing team to align outreach efforts with overall campaign strategy.
6. Monitoring and Reporting: Tracking interactions, responses, and success rates within LinkedIn and reporting these metrics to the Sales Manager.
7. Maintaining Professionalism: Representing the brand in a professional manner, adhering to LinkedIn's guidelines, and maintaining the quality of interactions.
8. Content Engagement: Sharing, liking, and commenting on relevant content to increase visibility and engage with the community within the target market.
9. Utilizing Supporting Tools: If using additional tools like CRM or other integrations, maintaining accurate records and ensuring data integrity.
Skills Required:
- Proficiency in using LinkedIn, especially LinkedIn Sales Navigator.
- Excellent communication and interpersonal skills, including phone and email etiquette.
- Ability to analyze profiles and identify potential leads.
- Self-motivated and goal-oriented approach.
- Understanding of the company’s products or services.
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
JavascriptQualifications:
• M Tech/ B Tech/ BE/ MCA/ MS in Computer Science, Information Technology, or equivalent.
• The degree must be obtained through a regular on-campus program from a recognized university.
• Proven experience as a .NET Developer with 4-9 years of relevant work experience.
• Strong proficiency in Dot Net and MVC architecture.
• Experience with MySQL database management.
• Knowledge of front-end technologies such as HTML, CSS, and JavaScript.
What is the role?
The VP Presales is a leadership role who ll work closely with the founders & CXOs on various strategic initiatives.
Responsibilities
- Setting up the inbound, outbound process globally
- Setting up smb sales engine for global markets
- Expert in defining GTM initiatives and rolling this out with proper tracking
- Liaisoning with marketing, sales and finance team to track ROI and optimise cac
- Using best of technology and practices to scale the operations
We are looking for a leader who has these skills:
- Overall experience of 8-10 years out of which atleast experience of 3 to 4 years in setting up the process for a SaaS company in india selling to global markets
- Working out of bangalore office and mostly in Usa time zone with overlap for india markets
- Hands on experience to pick initiatives and work himself and then train team on calling pitch, email formats, campaigns creation and handling inbound engine.
- Is deeply analytical, comfortable navigating data and working in ambiguity.
- Exemplary communication and relationship building skills at all levels from senior executives to Individual Contributors.
Whom will you work with?
You will closely work with the founders. You will provide constant updates to the board and the other Sr management teams.
We are
Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2500 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, Dubai.
Way forward
We look forward to connecting with you. Once we review your resume, the next step will be a discovery call followed by detailed interviews. There ll be three rounds of interviews.
Experience: 2-5 Years
Location: Sector 62, Noida
Job Description
- Research, design, develop, and test blockchain technologies
- Brainstorm and help evaluate applications for new tools and technologies as they continually evolve
- Maintain and extend current client- and server-side applications responsible for integration and business logic
- Be involved in the global blockchain community—work on implementing and integrating the latest improvement proposals
- Document new solutions as well as maintaining that of existing ones
Required Skills
- Strong software development background
- Experience working with large codebases
- Experience working with open-source projects
- Proficiency in one of the following languages: C++, Java, JavaScript
- Strong knowledge of common algorithms and data structures
- Familiarity with basic cryptography
- Familiarity with P2P networks
- Strong knowledge of bitcoin-like blockchains
- Strong knowledge of concurrency and writing efficient and safe multithreaded code
- Strong knowledge of STL, C++11
- Proficiency in the Qt Widgets module
Perks & Benefits:
- Flexibility
- Saturdays off
- Attractive Incentives & Compensation
Rejolut is one of the award winning fastest growing emerging tech company which is working on leading technology like Blockchian, ML & AI, Complex mobile & web apps, IoT etc.
The ideal candidate will be responsible for developing highly scalable and secure code.
Responsibilities:-
-Able to take the Extreme Ownership of modules/product/projects
-Able to learn & implement new technology/framework/library/networks at God Speed
-Able to come with optimal solution for the business problem
-Can handle calls with the client & customer to know their feedback
-Writing clean code & able to dig into other's code or open source code
-Brainstorm and help evaluate applications for new tools and technologies as they continually evolve
-Maintain and extend current client- and server-side applications responsible for integration and business logic
Desired Candidate Profile:-
- Setting up and configuring Full node clients for various Blockchains.
- In Depth understanding of atleast two blockchain network like Ethereum, Hedera Hashgraph, Tezos, Hyperledger, BlockApps, Algorand, Corda etc
- Working closely with DevOps to make blockchain infrastructure robust and scalable.
- Designing and writing well-structured APIs in Node.js to connect to Blockchain infrastructure.
- Develop and manage various applications to integrate Blockchain infrastructure into the main product.
- Staying up to date with new developments and news in integrated chains, like forks, main net launches, migration.
- Documenting architecture and guidelines.
- Always being on the lookout to enhance technology, by finding and making new tools, utilities, and libraries.
- Managing and enhancing a cutting edge tech stack, comprising of Node.js, ES2016/17 (Javascript), AWS, MongoDB, SQL
- Cross-team contribution whenever required.
- Familiarity with basic cryptography
- Familiarity with P2P networks
Culture
- Fast-paced, intellectually stimulating, steep learning, and growth
- Close-knit, hardworking, supportive colleagues
- Challenging work
- Flat organization with no hierarchy
- If you like problem solving, and love latest technology, there are very few better places
How we are different
-We are young and dynamic team who are obsessed with solving business problem at scale -We are a technology agnostic company who focus more on finding the optimal solution to business problem rather than technology
Why to join us
-We provide huge learning curve. Spending 1.5-2 years with us will put you 3 years ahead in the career
-We work only on cutting edge technology like React, React Native, Flutter, NodeJS, Python, Go, Svelte, ELM
-There are two technology Co-founder in the company who are pretty much hands-on and have earlier bult the Consumer application which is downloaded millions of time and are in leadership position in copanies like Samsung, Purplle, Loylty Rewardz
-Get mentored by the best in the industry
-Flexible working hours
-Perks best in the industry
Location: Okhla, Delhi
Summary:
Smart Joules’ product DeJoule is an IoT based Building Energy Management System. It hasthe
potential to save more than 5,000 Crores worth of energy annually by optimizing energy use
in central air conditioning systems, and much more by extending in future to hot water and
steam systems.
Smart Joules is looking for people who have the aptitude, expertise and experience of managing the delivery of projects.
Reporting:
You will report to the Head of Product.
What will you do?
1. Manage the on-time & high-quality execution of multiple, complex and diverse
initiatives/ projects that are designed to improve the product.
2. Focus on & be responsible for getting the initiatives executed on timelines committed
to the stakeholders
3. Own the planning, scoping, tracking, reporting budgeting and on-time delivery of the
initiatives/ projects.
4. Empower the team members of each initiative to successfully deliver it with
a. it being highly functional
b. having high quality
c. adherence to the decided standards of software engineering, coding &
documentation
d. it completing on time
e. it consuming resources under budget.
5. Optimize and push the game in efficiently, quickly and economically executing the
initiatives/ projects.
6. Effectively win the confidence of the stakeholders by giving them the right information
at the right time.
7. Own the effective resolution of any roadblock that might defeat the plan of the
initiative.
8. Proactively seek help and raise flags when and where needed.
What will you get to learn?
You will learn to manage projects across a very diverse development team that includes
embedded systems, networking, backend & frontend engineering, machine learning, platform
Reliability & UiUx.
You will learn to accurately estimate the time it would take to execute any product initiative.
You will learn (and fall in love �) with the energy efficiency industry.
You will work with some of the best developers, product, biz, energy and ops colleagues.
You will be a part of our amazing Joule Culture!
What do we need in you?
Being able to strategically, diligently & resourcefully plan and execute a technical
project.
Have the experience in managing a varied set of stakeholders ranging from product
management, software development, UiUx, co-founders and users.
Have owned and successfully delivered projects on time and under budget for at-least 2
years.
Knows & has hands-on experience in the best processes (Agile, Scrum, Hybrid) & tools
(Jira, Confluence) to manage work.
Must have excellent attention to detail, ability to identify key issues and manage an
environment of innovation with regular changes.
Excellent communication skills.
Organizational abilities, strategic thinking, problem-solving aptitude.
About Smart Joules:
Smart Joules is on a mission to stop climate change by making it easy and profitable for
businesses to eliminate wasted energy consumption. Our JoulePAYS (Pay-As-You-Save) business model offers businesses a 15% guaranteed reduction in energy compared to their
historical bills in return for a fixed share of their savings under a six-year contract. These
savings are delivered by redesigning centralized cooling systems, providing the highest
efficiency equipment, and constantly monitoring and controlling their operations with our
DeJoule technology.
Led by an MIT/Berkeley Alumnus, an award-winning engineer from the Indian Navy, and a
financial wizard, our team of 100+ professionals has a comprehensive set of capabilities
spanning project design, financing, execution, cutting-edge IOT technologies and operations.
We are united by our Core Values and motivated by our performance optimization program
– Joule IGNITE.
In a span of five years, we have saved 25 million kWh-equivalent of energy across the largest
Hospital chains in India – Apollo, Fortis, Max, CARE, Aravind, KIMS and others, spanning
fifteen cities. We have won national and international recognition, including a top prize from
the German Energy Ministry, multiple prizes in Ministry of Power’s National Energy
Conservation Awards and CII’s National Energy Management Awards, and numerous other
prizes and media mentions. In recognition of our innovative zeal, our CEO was selected as a
“Champion of Change” by the Prime Minister’s Office and Niti Aayog.
Our supporters and partners include Echoing Green, Harvard University, TATA Trusts, David
& Lucile Packard Foundation, Yes Bank, TATA Cleantech Capital, World Bank, SIDBI, Tata
Power Delhi Distribution Limited (TPDDL), Kigali Cooling Efficiency Program, BASE, UPES, DIT and other prominent institutions and investors.
We like to work hard and play hard. Inspired by MIT’s motto “Mens et Manus”, we believe in
using our minds and hands to develop and utilize technology for practical applicatio.
JavaAngularJS (1.x)
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon