11+ Statistical semantics Jobs in Bangalore (Bengaluru) | Statistical semantics Job openings in Bangalore (Bengaluru)

Job Title: Principal Automation Engineer (AI)

Deltek is seeking a Principal Automation Engineer with deep expertise in AI-native test automation to help shape the quality engineering foundation Deltek’s next-generation, AI-first ERP platform for project-based businesses. This is not a role for someone who automates feature regression. It is a role for someone who can harness AI tools to build intelligent automation frameworks that reason, adapt, and self-heal.

You will be the automation architect behind Deltek’s in-house AI-native test automation platform combining Playwright with LLM-powered agents (Planner, Generator, Healer). You will extend, evolve, and industrialize this framework, integrating AI tools at every layer: test generation, self-healing selectors, LLM-as-a-Judge evaluation, and CI/CD-gated quality pipelines.

If you are fluent in Playwright, agentic AI workflows, and modern test engineering — and want to build something genuinely new rather than maintain legacy frameworks — we invite you to join our team. ERP domain knowledge is a strong plus and will accelerate your impact.

Responsibilities:

Architect and evolve the AI-native automation framework — extending Playwright-based agents with LLM-powered planning, test generation, and self-healing capabilities.

Use AI tools extensively (Claude, GitHub Copilot, LLM APIs) to design, generate, and augment automation suites — reducing human authoring effort while increasing scenario coverage.

Build and maintain Playwright agent pipelines for end-to-end workflow automation across Deltek’s Projects, Workforce Management, and Financials modules.

Integrate LLM-as-a-Judge (LLMaaJ) evaluation into the test pipeline to automatically score AI-generated outputs, detect hallucinations, and validate response quality against golden datasets.

Design and implement AI safety and correctness test cases: hallucination detection, bias testing, output guardrail validation, and behavioral consistency across edge cases.

Own the CI/CD automation pipeline (GitHub Actions / Azure DevOps) for AI-enabled releases — including regression gates, model-response validation, and automated quality dashboards in ReportPortal and Grafana.

Validate AI/ML outputs including prediction accuracy, recommendation relevance, natural-language responses, and inference API payloads.

Build and maintain golden datasets for AI drift detection, regression baselines, and LLM evaluation benchmarks.

Collaborate with Product Managers, AI/ML Engineers, and QE leads to define AI feature release quality gates and automation coverage targets.

Mentor QE team members on AI-assisted automation patterns, agentic testing concepts, and framework best practices.

Contribute to test strategy for data migration validation of schema fidelity and record correctness.

Qualifications:

BS/MS degree in Computer Science, Software Engineering, or a related field.

Relevant certifications in software quality, AI/ML, or cloud engineering are advantageous.

Experience:

8+ years of experience in test automation engineering, with at least 3+ years working with AI/LLM-based systems or agentic automation frameworks.

Proven hands-on experience with Playwright — including Playwright agents, fixtures, and API testing integration.

Demonstrated experience using AI tools (Claude API, OpenAI, GitHub Copilot, or equivalent) to accelerate test authoring, framework design, or output evaluation.

Track record of designing and implementing AI-based automation solutions — not just using automation tools, but building the frameworks others use.

Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps).

Experience with performance, scalability, or data-drift testing of AI features in production or pre-production ERP contexts.

ERP domain knowledge (Project Accounting, Financials, Payroll, Time & Expense) is a strong plus and will significantly accelerate onboarding and impact.

Good-to-Have Skills:

Familiarity with Ajera, Costpoint, Vantagepoint, or comparable project-based ERP systems.

Understanding of LLM fine-tuning, RAG pipelines, vector databases, and embeddings from a QA/validation perspective.

Experience building or working with self-healing automation frameworks or AIOps tooling.

Exposure to security testing for AI systems — prompt injection, output sanitization, guardrail bypass testing.

Familiarity with data privacy and compliance frameworks in AI-enabled enterprise software.

Technical Qualifications:

Deep, hands-on proficiency with Playwright — including agentic patterns, multi-step workflow automation, and integration with LLM backends.

Proficiency in TypeScript and/or Python for building automation frameworks, AI evaluation utilities, prompt-testing harnesses, and data-driven test pipelines.

Strong understanding of LLM/ML concepts from a QA perspective: prompt engineering, hallucination detection, output scoring, explainability validation, behavioral consistency testing.

Experience with REST and GraphQL API testing, including automated evaluation of LLM inference API payloads and AI-generated JSON responses.

Familiarity with ReportPortal, Grafana, or equivalent for test execution dashboards and quality metric visualization.

Strong SQL skills for data validation, training dataset verification, and ERP data pipeline testing.

Working knowledge of GitHub Actions and Azure DevOps (ADO/TFS) for CI/CD pipeline integration and issue tracking.

Good understanding of Agile/Scrum practices and AI model release cycles — shadow mode, A/B comparison, phased rollout validation.

Soft Skills:

Framework-builder mindset: thinks in systems, not scripts — builds what others use rather than executing what others built.

Strong communication skills: able to explain AI validation concepts clearly to engineers, product managers, and QE team members.

High ownership and self-direction: identifies automation gaps proactively and drives coverage improvements without waiting to be asked.

Collaborative and generous with knowledge: invests in mentoring team members and raising the team’s automation maturity.

Continuous learner: actively tracks the evolving AI tooling ecosystem and brings new techniques into the framework.

Able to manage multiple priorities in a fast-paced, distributed team environment.

Join Deltek and be at the forefront of how modern ERP quality engineering is done. You will help build the AI driven current automation framework into an industry-leading AI-native automation platform — combining Playwright agents, LLM-powered test generation, self-healing infrastructure, and intelligent quality gates.

What You'll Do

• Lead, coach, and manage a team of 2–4 SDRs/BDRs targeting SMB and mid-market accounts in the US, UK, Canada, and Australia
• Own daily standups, outreach targets, pipeline hygiene, and performance reporting
• Execute and iterate multi-channel outbound: cold email, LinkedIn, and cold calling
• Work closely with product champions to deeply understand ICP, value props, and objection handling for Dialaxy
• Build and refine outbound playbooks — sequences, scripts, and qualification frameworks (BANT/MEDDIC-lite)
• Manage lead lists using Apollo, run email sequences via Instantly/Smartlead, and LinkedIn automation via HeyReach
• Report weekly pipeline metrics to founders with honest analysis, not spin
• Hire and onboard additional SDR/BDR profiles as the team scales

What We're Looking For

• 4+ years of B2B SaaS sales experience, with at least 1–2 years in a team lead or senior SDR/BDR capacity
• Proven track record running outbound campaigns into US, UK, or Australian markets
• Strong command of English — written and spoken, client-facing quality
• Hands-on experience with tools like Apollo, HubSpot, Instantly, Smartlead, or equivalent
• High ownership mindset — you care about the number, not just the activity
• Comfortable working in a fast-moving startup with limited process and high autonomy
• Experience in cloud telephony, HR tech, or remote workforce tools is a strong plus

Responsibilities:

 Ensure product delivery is fast, low-cost and sustainable.

 Take responsibility from development to customer support.

 Research and implement things wherever needed, improve efficiency using

automation, and methods like test driven development.

 Setting up events for user, performance and error analytics.

 Participate in product and design ideation, collaborate with the team to

implement high-quality features.

Skills & Qualifications

 2 years of experience in software development preferably B2C experience.

 Experience in React native, Javascript.

 Experience with popular React workflows (such as Flux or Redux).

 Familiarity with newer specifications of ECMAScript (ES6 & ES5 ).

 Familiarity with RESTful APIs.

 Experience in working with the MERN stack or similar frameworks

You will be responsible for building and maintaining highly scalable data infrastructure for our cloud-hosted SAAS product. You will work closely with the Product Managers and Technical team to define and implement data pipelines for customer-facing and internal reports.

• Design and develop resilient data pipelines.
• Write efficient queries to fetch data from the report database.
• Work closely with application backend engineers on data requirements for their stories.
• Designing and developing report APIs for the front end to consume.
• Focus on building highly available, fault-tolerant report systems.
• Constantly improve the architecture of the application by clearing the technical backlog. 
• Adopt a culture of learning and development to constantly keep pace with and adopt new technolgies.

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

• Education - BE/MCA or equivalent
• Overall 8+ years of experience
• Expert level understanding of database concepts and BI.
• Well verse in databases such as MySQL, MongoDB and hands on experience in creating data models. 
• Must have designed and implemented low latency data warehouse systems.
• Must have strong understanding of Kafka and related systems.
• Experience in clickhouse database preferred.
• Must have good knowledge of APIs and should be able to build interfaces for frontend engineers.
• Should be innovative and communicative in approach
• Will be responsible for functional/technical track of a project

You will work with a top-notch tech team, working closely with the CTO and product team.  

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

‍

Responsibilities:

• Planning, estimation, requirement analysis, database designing, wireframing, layout design of the assigned project and other ongoing projects in a team with Project Manager / Developer / Designer.
• Handling coding works or major/complex parts of assigned projects and providing coding help and supervision to team members.
• Maintaining and auditing code/design quality as per set guidelines and standards in assigned projects.
• Testing of completed tasks in ongoing projects in the team before sending updates to reporting authority/client.
• Remove the technical impediments
• Focusing the team to ensure the on-time delivery of the agreed task.
• Reporting progress to the Project Manager.
• Facilitating code/design reuse.
• Training and mentoring of team members.
• Maintaining the skill set matrix of the team.
• Building and maintaining PWA.
• Work closely with the product team to accelerate A/B testing and maximize engagement.

Requirements:

• Excellent knowledge of HTML5, CSS3.
• Excellent knowledge of JavaScript, Jquery.
• Excellent knowledge of JavaScript MVC architecture and OOP programming style.
• Good understanding and experience of working on Vue.js/React.js.