Automation Tester

Job Description

MyOperator is building AI-driven conversational surfaces — chatbots and voicebots that handle real business conversations, run structured journeys, pull from knowledge bases, and hand off to human agents when needed. We're looking for a Product Manager to own this domain: someone who genuinely understands how LLMs and RAG (Retrieval-Augmented Generation) systems work, and can turn that understanding into product decisions — what to build, which model tradeoffs to make, and how to know if a chatbot or voicebot is actually working.

This is a technical AI product role. You'll be defining journeys, knowledge base behavior, and evaluation criteria for systems where outputs are probabilistic, not deterministic — so the ability to reason about model behavior, failure modes, and retrieval quality matters as much as classic product skills.

About MyOperator

MyOperator is a Business AI Operator platform that allows businesses, teams, and AI Agents to work in tandem for customer operations, i.e., handle Sales, Support, Escalation, Feedback, and Refund processes. With over 12,000+ businesses using our platform, we are the largest in the space.

MyOperator is built for people who want to work on ambitious problems at a meaningful scale. We value ownership, speed, critical thinking, and a bias for building things that create real customer and business outcomes. This is a high-expectation, high-learning environment where people are trusted to think independently, challenge ideas openly, move with urgency, and keep raising the bar as we build for long-term impact.

Key Responsibility Areas

• Own the conversational AI product roadmap — chatbot and voicebot journeys, knowledge base/RAG behavior, and model selection — writing specs that account for real LLM behavior and failure modes, not just ideal-case flows.
• Define and maintain how success is measured — partner with engineering to build and evolve eval systems that track quality (accuracy, containment, hallucination rate) so every release has a clear bar to clear.

Requirements — Must Have

• Strong practical understanding of how LLMs work — prompting, context windows, tool/function calling, and their real-world limitations in production systems.
• Solid understanding of RAG (Retrieval-Augmented Generation) systems — how retrieval, embeddings, and knowledge bases feed into model responses, and where these systems typically break down.
• Working knowledge of the AI model landscape — tradeoffs between models on cost, latency, and accuracy — and how to translate that into build/model-selection decisions for a product.
• Demonstrated ability to write specs for AI-driven product surfaces (chatbot/voicebot journeys, escalation/handover logic) that explicitly account for probabilistic model behavior and edge cases.
• 4+ years as a Product Manager, with meaningful hands-on time owning an AI/LLM-powered product end to end.

Requirements — Good to Have

• Hands-on background building or shipping chatbots or voicebots — design, integrations, and deployment.
• Experience designing conversational journeys — structured, multi-step dialogue or task flows for chat or voice agents.
• Experience building or defining eval systems/frameworks to measure chatbot or voicebot success (e.g., accuracy, containment rate, hallucination rate).
• Familiarity with prompt engineering and iterating on prompts/journeys based on eval results.
• Experience designing human-handover or escalation flows between a bot and a live agent.

This profile is not for

• Candidates who treat "AI feature" as a checkbox without understanding how LLMs and RAG systems actually behave in production, including their failure modes.
• Candidates focused purely on traditional, deterministic software product work with no interest in model behavior, prompt design, or evaluation methodology.
• Candidates uncomfortable with ambiguity — AI product behavior is probabilistic, and specs need to account for that rather than assume fixed outcomes.

Competitive Salary

About Solidatus

At Solidatus, we empower organizations to connect and visualize their data relationships, making it easier to identify, access, and understand their data. Our metadata management technology helps businesses establish a sustainable data foundation, ensuring they meet regulatory requirements, drive digital transformation, and unlock valuable insights. 

We’re experiencing rapid growth—backed by HSBC, Citi, and AlbionVC, we secured £14 million in Series A funding in 2021. Our achievements include recognition in the Deloitte UK Technology Fast 50, multiple A-Team Innovation Awards, and a top 1% place to work ranking from The FinancialTechnologist. 

Now is an exciting time to join us as we expand internationally and continue shaping the future of data management. 

About the Engineering Team

Engineering is the heart of Solidatus. Our team of world-class engineers, drawn from outstanding computer science and technical backgrounds, plays a critical role in crafting the powerful, elegant solutions that set us apart. We thrive on solving challenging visualization and data management problems, building technology that delights users and drives real-world impact for global enterprises.

As Solidatus expands its footprint, we are scaling our capabilities with a focus on building world-class connectors and integrations to extend the reach of our platform. Our engineers are trusted with the freedom to explore, innovate, and shape the product’s future — all while working in a collaborative, high-impact environment. Here, your code doesn’t just ship — it empowers some of the world's largest and most complex organizations to achieve their data ambitions.

Who We Are & What You’ll Do

Join our Data Integration team and help shape the way data flows! 

Your Mission:

To expand and refine our suite of out-of-the-box integrations, using our powerful API and SDK to bring in metadata for visualisation from a vast range of sources including databases with diverse SQL dialects.

But that is just the beginning. At our core, we are problem-solvers and innovators. You’ll have the chance to:                                                        

Design

intuitive layouts

representing flow of data across complex deployments of diverse technologies

Design and optimize API connectivity and parsers reading from source systems metadata

Explore new paradigms for representing data lineage

Enhance our data ingestion capabilities to handle massive volumes of data

Dig deep into data challenges to build smarter, more scalable solutions

Beyond engineering, you’ll collaborate with users, troubleshoot tricky issues, streamline development workflows, and contribute to a culture of continuous improvement.

What We’re Looking For

• We don’t believe in sticking to a single tech stack just for the sake of it. We’re engineers first, and we pick the best tools for the job. More than ticking off a checklist, we value mindset, curiosity, and problem-solving skills.
• You’re quick to learn and love diving into new technologies
• You push for excellence and aren’t satisfied with “just okay”
• You can break down complex topics in a way that anyone can understand
• You should have 6–8 years of proven experience in developing, and delivering high-quality, scalable software solutions 
• You should be a strong self-starter with the ability to take ownership of tasks and drive them to completion with minimal supervision.
• You should be able to mentor junior developers, perform code reviews, and ensure adherence to best practices in software engineering.

Tech & Skills We’d Love to See

Must-have:·

• Strong hands-on experience with Java, Spring Boot RESTful APIs, and Node.js
• Solid knowledge of databases, SQL dialects, and data structures

Nice-to-have:

• Experience with C#, ASP.NET Core, TypeScript, React.js, or similar frameworks
• Bonus points for data experience—we love data wizards

If you’re passionate about engineering high-impact solutions, playing with cutting- edge tech, and making data work smarter, we’d love to have you on board!

• Developing and maintaining all server-side network components.
• Ensuring optimal performance of the central database and responsiveness to front-end requests.
• Collaborating with front-end developers on the integration of elements.
• Designing customer-facing UI and back-end services for various business processes.
• Developing high-performance applications by writing testable, reusable, and efficient code.
• Implementing effective security protocols, data protection measures, and storage solutions.
• Running diagnostic tests, repairing defects, and providing technical support.
• Documenting Node.js processes, including database schemas, as well as preparing reports.
• Recommending and implementing improvements to processes and technologies.
• Keeping informed of advancements in the field of Node.js development.

About Company:

Working with a multitude of clients populating the FTSE and Fortune 500s, Audit Partnership is a people focused organization with a strong belief in our employees. We hire the best people to provide the best services to our clients.

APL offers profit recovery services to organizations of all sizes across a number of sectors. APL was borne out of a desire to offer an alternative from the stagnant service provision on offer in the profit recovery industry.

Every year we cover million of pounds for our clients and also work closely with them, sharing our audit findings to minimize future losses. Our dedicated and highly experienced audit teams utilize progressive & dynamic financial service solutions & industry leading technology to achieve maximum success.

We provide dynamic work environments focused on delivering data-driven solutions at a rapidly increased pace over traditional development. Be a part of our passionate and motivated team who are excited to use the latest in software technologies within financial services.

Headquartered in the UK, we have expanded from a small team in 2002 to a market leading organization serving clients across the globe while keeping our clients at the heart of all decisions we make.

Job description:

We are looking for a high-potential, enthusiastic SQL Data Engineer with a strong desire to build a career in data analysis, database design and application solutions. Reporting directly to our UK based Technology team, you will provide support to our global operation in the delivery of data analysis, conversion, and application development to our core audit functions.

Duties will include assisting with data loads, using T-SQL to analyse data, front-end code changes, data housekeeping, data administration, and supporting the Data Services team as a whole.  Your contribution will grow in line with your experience and skills, becoming increasingly involved in the core service functions and client delivery.  A self-starter with a deep commitment to the highest standards of quality and customer service. We are offering a fantastic career opportunity, working for a leading international financial services organisation, serving the world’s largest organisations.

What we are looking for:

• 1-2 years of previous experience in a similar role
• Data analysis and conversion skills using Microsoft SQL Server is essential
• An understanding of relational database design and build
• Schema design, normalising data, indexing, query performance analysis
• Ability to analyse complex data to identify patterns and detect anomalies
• Assisting with ETL design and implementation projects
• Knowledge or experience in one or more of the key technologies below would be preferable:
  • Microsoft SQL Server (SQL Server Management Studio, Stored Procedure writing etc)
  • T-SQL
  • Programming languages (C#, VB, Python etc)
  • Use of Python to manipulate and import data
  •  
  • Experience of ETL/automation advantageous but not essential (SSIS/Prefect/Azure)
• A self-starter who can drive projects with minimal guidance
• Meeting stakeholders to agree system requirements
• Someone who is enthusiastic and eager to learn
• Very good command of English and excellent communication skills

Perks & Benefits:

• A fantastic work life balance
• Competitive compensation and benefits
• Exposure of working with Fortune 500 organization
• Expert guidance and nurture from global leaders
• Opportunities for career and personal advancement with our continued global growth strategy
• Industry leading training programs
• A working environment that is exciting, fun and engaging

• Responsible for collecting all in-scope business requirements
• Able to prioritize requirements and negotiate on deployment timeframes on behalf of the development team
• Ability to perform detailed analysis to ensure all aspects of the business requirement are understood
• Able to formalize business requirements, ready for two way communication business communications up and technical communications down
• Capable of managing all non-technical aspects of the new requirements
• Capable of working with the test team to develop/ review test scripts and profile of test data
• Able to produce ad-hoc SQL queries/ ad-hoc reports that can be used to monitor success of the new requirement by ensuring data is being created as it should
• Must have worked on medium to large size custom application development projects and has exposure to all phases of the SDLC
• Experience in Insurance Domain is a must
• Proficient in using Microsoft Office tools
• Get actively involved in various project phases
• Act as a key interface between users and development teams
• Technology Graduate: B.Sc IT, MSc IT / B.Tech, M.Tech/ BCA, MCA