Cutshort logo
Deltek logo
Automation Engineer - Playwright & AI
Automation Engineer - Playwright & AI
Deltek's logo

Automation Engineer - Playwright & AI

Sri Priyanka's profile picture
Posted by Sri Priyanka
7 - 15 yrs
Best in industry
Remote, Bengaluru (Bangalore)
Skills
Playwright
TypeScript
skill iconPython
Agentic AI

Job Title: Principal Automation Engineer (AI)


Deltek is seeking a Principal Automation Engineer with deep expertise in AI-native test automation to help shape the quality engineering foundation Deltek’s next-generation, AI-first ERP platform for project-based businesses. This is not a role for someone who automates feature regression. It is a role for someone who can harness AI tools to build intelligent automation frameworks that reason, adapt, and self-heal.


You will be the automation architect behind Deltek’s in-house AI-native test automation platform combining Playwright with LLM-powered agents (Planner, Generator, Healer). You will extend, evolve, and industrialize this framework, integrating AI tools at every layer: test generation, self-healing selectors, LLM-as-a-Judge evaluation, and CI/CD-gated quality pipelines.


If you are fluent in Playwright, agentic AI workflows, and modern test engineering — and want to build something genuinely new rather than maintain legacy frameworks — we invite you to join our team. ERP domain knowledge is a strong plus and will accelerate your impact.


Responsibilities:

Architect and evolve the AI-native automation framework — extending Playwright-based agents with LLM-powered planning, test generation, and self-healing capabilities.

Use AI tools extensively (Claude, GitHub Copilot, LLM APIs) to design, generate, and augment automation suites — reducing human authoring effort while increasing scenario coverage.

Build and maintain Playwright agent pipelines for end-to-end workflow automation across Deltek’s Projects, Workforce Management, and Financials modules.

Integrate LLM-as-a-Judge (LLMaaJ) evaluation into the test pipeline to automatically score AI-generated outputs, detect hallucinations, and validate response quality against golden datasets.

Design and implement AI safety and correctness test cases: hallucination detection, bias testing, output guardrail validation, and behavioral consistency across edge cases.

Own the CI/CD automation pipeline (GitHub Actions / Azure DevOps) for AI-enabled releases — including regression gates, model-response validation, and automated quality dashboards in ReportPortal and Grafana.

Validate AI/ML outputs including prediction accuracy, recommendation relevance, natural-language responses, and inference API payloads.

Build and maintain golden datasets for AI drift detection, regression baselines, and LLM evaluation benchmarks.

Collaborate with Product Managers, AI/ML Engineers, and QE leads to define AI feature release quality gates and automation coverage targets.

Mentor QE team members on AI-assisted automation patterns, agentic testing concepts, and framework best practices.

Contribute to test strategy for data migration validation of schema fidelity and record correctness.


Qualifications:

BS/MS degree in Computer Science, Software Engineering, or a related field.

Relevant certifications in software quality, AI/ML, or cloud engineering are advantageous.

Experience:

8+ years of experience in test automation engineering, with at least 3+ years working with AI/LLM-based systems or agentic automation frameworks.

Proven hands-on experience with Playwright — including Playwright agents, fixtures, and API testing integration.

Demonstrated experience using AI tools (Claude API, OpenAI, GitHub Copilot, or equivalent) to accelerate test authoring, framework design, or output evaluation.

Track record of designing and implementing AI-based automation solutions — not just using automation tools, but building the frameworks others use.

Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps).

Experience with performance, scalability, or data-drift testing of AI features in production or pre-production ERP contexts.

ERP domain knowledge (Project Accounting, Financials, Payroll, Time & Expense) is a strong plus and will significantly accelerate onboarding and impact.


Good-to-Have Skills:

Familiarity with Ajera, Costpoint, Vantagepoint, or comparable project-based ERP systems.

Understanding of LLM fine-tuning, RAG pipelines, vector databases, and embeddings from a QA/validation perspective.

Experience building or working with self-healing automation frameworks or AIOps tooling.

Exposure to security testing for AI systems — prompt injection, output sanitization, guardrail bypass testing.

Familiarity with data privacy and compliance frameworks in AI-enabled enterprise software.


Technical Qualifications:

Deep, hands-on proficiency with Playwright — including agentic patterns, multi-step workflow automation, and integration with LLM backends.

Proficiency in TypeScript and/or Python for building automation frameworks, AI evaluation utilities, prompt-testing harnesses, and data-driven test pipelines.

Strong understanding of LLM/ML concepts from a QA perspective: prompt engineering, hallucination detection, output scoring, explainability validation, behavioral consistency testing.

Experience with REST and GraphQL API testing, including automated evaluation of LLM inference API payloads and AI-generated JSON responses.

Familiarity with ReportPortal, Grafana, or equivalent for test execution dashboards and quality metric visualization.

Strong SQL skills for data validation, training dataset verification, and ERP data pipeline testing.

Working knowledge of GitHub Actions and Azure DevOps (ADO/TFS) for CI/CD pipeline integration and issue tracking.

Good understanding of Agile/Scrum practices and AI model release cycles — shadow mode, A/B comparison, phased rollout validation.


Soft Skills:

Framework-builder mindset: thinks in systems, not scripts — builds what others use rather than executing what others built.

Strong communication skills: able to explain AI validation concepts clearly to engineers, product managers, and QE team members.

High ownership and self-direction: identifies automation gaps proactively and drives coverage improvements without waiting to be asked.

Collaborative and generous with knowledge: invests in mentoring team members and raising the team’s automation maturity.

Continuous learner: actively tracks the evolving AI tooling ecosystem and brings new techniques into the framework.

Able to manage multiple priorities in a fast-paced, distributed team environment.


Join Deltek and be at the forefront of how modern ERP quality engineering is done. You will help build the AI driven current automation framework into an industry-leading AI-native automation platform — combining Playwright agents, LLM-powered test generation, self-healing infrastructure, and intelligent quality gates.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Deltek

Founded :
1983
Type :
Product
Size :
1000-5000
Stage :
Profitable

About

Project-based businesses transform the world we live in. Deltek innovates and delivers software and solutions that power them to achieve their purpose. Our industry-specific software and information solutions maximize our customers' performance at every stage of the project lifecycle by enabling superior levels of project intelligence, management and collaboration.


Deltek is the recognized global standard for project-based businesses across government contracting and professional services industries, helping more than 30,000 organizations of all sizes deliver on their mission.


With over 4,200 employees worldwide, our team of industry experts is passionately committed to creating exceptional customer experiences.

Read more

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Technology Industry
Technology Industry
Agency job
via Peak Hire Solutions by Dharati Thakkar
Kochi (Cochin)
5 - 8 yrs
₹12L - ₹27L / yr
Snowflake
Metabase
skill iconMongoDB
Data Pipelines
skill iconAmazon Web Services (AWS)
+4 more

Job Description & Specification: 

Post Title: Data Engineer

Work Mode: Kochi Onsite - UK Time zone


Role Overview: 

We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have expertise in technologies such as Metabases, Dbt, Stitch, Snowflake, Avo, and MongoDB. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support our analytics and data-driven decision-making processes.


Responsibilities:

  • Designing, developing and implementing scalable data pipelines and ETL processes using tools such as Stitch and Dbt to ingest, transform, and load data from various sources into our data warehouse (Snowflake).
  • Implement data modeling best practices and standards using Dbt to create and manage data models for reporting and analytics.
  • Collaborating with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Develop and maintain dashboards and visualizations in Metabases to enable self-service analytics and data exploration for internal teams.
  • Building and optimizing ETL processes to ensure data quality and integrity.
  • Optimizing data processing and storage solutions for performance, scalability and reliability, leveraging cloud-based technologies.
  • Implementing monitoring and alerting systems to proactively identify and address data issues.
  • Implementing data quality checks and monitoring processes to ensure the accuracy, completeness, and integrity of data.
  • Managing and optimizing databases (like MongoDB for performance and scalability).
  • Developing and maintaining documentation, best practices, and standards for data engineering processes and workflows.
  • Stay up to date with emerging technologies and trends in data engineering, machine learning, and analytics, and evaluate their potential impact on data strategy and architecture.


Requirements:

  • Bachelor's or Master's degree in Computer Science.
  • Minimum of 4 years of experience working as a data engineer with expertise in Metabases, Dbt, Stitch, Snowflake, Avo, MongoDB.
  • Strong programming skills in languages like Python, and experience with SQL and database technologies (e.g., PostgreSQL, MySQL, MongoDB).
  • Hands-on experience with data integration tools (e.g., Stitch), data modeling tools (e.g., Dbt), and BI platforms (e.g., Metabases).
  • Experience with cloud platforms such as AWS.
  • Strong understanding of data modeling concepts, database design, and data warehousing principles
  • Experience with big data technologies and frameworks (e.g., Hadoop, Spark, Kafka) and cloud-based data platforms (e.g., AWS EMR, Azure Databricks, Google BigQuery).
  • Familiarity with data integration tools, ETL processes, and workflow orchestration tools (e.g., Apache Airflow, Apache NiFi).
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills with the ability to work effectively in a global team environment.
  • Experience in the education or Edtech industry is a plus.
  • Knowledge of Avo for schema management and versioning will be an added advantage.
  • Familiarity with machine learning algorithms, data science workflows, and analytics tools (e.g., TensorFlow, PyTorch, scikit-learn, Tableau).
  • Knowledge of distributed computing concepts and containerization technologies.
  • Experience with version control systems (e.g., Git) and CI/CD pipelines.
  • Certifications in cloud computing (e.g., AWS Certified Developer, Google Cloud Professional Data Engineer) or data engineering (e.g., Databricks Certified Associate Developer) are desirable.


Benefits:

  • Competitive salary and bonus structure based on performance and achievement of goals.
  • Comprehensive benefits package including medical insurance.


Join us in shaping the future of technology by applying your expertise as a Data Engineer. If you are passionate about driving innovation and delivering impactful solutions, we invite you to be part of our dynamic team. Apply now!!

Read more
B2B business platform for SME's
B2B business platform for SME's
Agency job
via Qrata by Blessy Fernandes
Mumbai
2 - 8 yrs
₹10L - ₹25L / yr
User Experience (UX) Design
User Interface (UI) Design
Interaction Design
Information design
A UI / UX Designer to translate the research insights into simple, intuitive and delightful
experiences for the Users.
● who can own the process of delivering functional and intuitive interfaces from
scratch leveraging UX Fundamentals.
● who can collaborate with the stakeholders to deliver the best and set new
standards.
● who can create user flows, wireframes, prototype and gather validations.
● who feel at home with abstraction and sense making.
Read more
Neumeric Technologies
at Neumeric Technologies
2 recruiters
Parameshwar Kusampally
Posted by Parameshwar Kusampally
Remote only
3 - 6 yrs
₹2.5L - ₹5L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+1 more
 
  1. FULL STACK .NET CORE- 9 Open Position
  2. FRONT END DEVELOPER (Angular with .NET)- 2 Open position

 

Experience- More than 5+ years

Resourcing- Anywhere from India

Job Location- Work from Home

CTC- Up to 16-18 Lakhs per Annum

 
 
Requirements
  • At least 5+ years of software development experience
  • Experience as a full stack developer using .NET Core
  • Experience with AWS or Azure cloud services
  • Experience with Angular, React, Vue, or other front-end development framework or expert level JavaScript skills
  • Experience with relational databases such as SQL Server, MySQL, or PostgreSQL
  • Familiarity with Linux and Windows
  • Experience with Jira or Azure DevOps
  • Experience with Web Services and Object-Oriented Programming
  • Thorough understanding of relational databases
  • Familiarity with PHP and LAMP stack would be a plus
  • Associate or Bachelor’s degree in IT or CS preferred
 

Best regards

Parameshwar  K
Read more
Genius Placement Service
at Genius Placement Service
2 recruiters
Toral Prajapati
Posted by Toral Prajapati
Bhuj, Gandhidham, Junagadh
1 - 5 yrs
₹10L - ₹15L / yr
pathology
Pathologist
MD
Doctor
Experience : 1+ yrs 

Qualification : D.C.P. / D.N.B. (Pathology) / M.D. (Pathology)

Location : Junagadh , bhuj and gandhidham

Salary : 1.5 to 2.5
Read more
Qrata
at Qrata
7 recruiters
Revathi Satish
Posted by Revathi Satish
Mumbai
2 - 5 yrs
₹12L - ₹20L / yr
Marketing
Google Adwords
Facebook Marketing
Digital Marketing

(Leading Health & Nutrition based Startup in Mumbai)

  • Creating Campaigns in Google ads, Facebook marketing & other online marketing Platforms 
  • Keyword Research & Monitoring
  • Writing Ad copy/description
  • Basic knowledge of Google Sheets
  • Must be proficient in the English Language
  • Monitors the latest trends in social media, including advertising formats, channels and technologies in order to improve campaign performance and provide recommendations 
  • Compile data across several platforms and create weekly/monthly reports, including analysis for insights, optimizations and future strategy development
  • Displays organizational capabilities to track progress, execution and consistency of social advertising campaigns
  • Running Email/SMS Campaigns
  • Demonstrates understanding of and ability to facilitate and manage forecasting, budgeting and pacing, campaign creation and optimization
  • Coordinate with Ad Agencies & take regular updates
  • Coordinate with content team to get the required creatives
  • Coordinate with production team to ensure inventory is in place before running campaigns
Read more
ZF india
Sagar Sthawarmath
Posted by Sagar Sthawarmath
Hyderabad, Chennai
4 - 9 yrs
₹3L - ₹15L / yr
SAS
skill iconData Analytics
Data Visualization
Data integration
Data Warehouse (DWH)

In this role, you will: 

As part of a team focused on the preserving the customer experience across the organization, this Analytic Consultant will be responsible for: 

    • Understand business objectives and provide credible challenge to analysis requirements. 
    • Verify sound analysis practices and data decisions were leveraged throughout planning and data sourcing phases. 
    • Conduct in-depth research within complex data environments to identify data integrity issues and propose solutions to improve analysis accuracy. 
    • Applying critical evaluation to challenge assumptions, formulate a defendable hypothesis, and ensuring high quality analysis results. 
    • Ensure adherence to data management/ data governance regulations and policies. 
    • Performing and testing highly complex data analytics for customer remediation. 
    • Designing analysis projects flow and documentation that is structured for consistency, easy to understand, and to be offered to multiple levels of reviewers, partners, and regulatory agents demonstrating research and analysis completed. 
    • Investigate and ensure data integrity from multiple sources. 
    • Ensure data recommended and used is the best “source of truth”. 
    • Applies knowledge of business, customers, and products to synthesize data to 'form a story' and align information to contrast/compare to industry perspective. Data involved typically very large, structured or unstructured, and from multiple sources. 
    • Must have a strong attention to detail and be able to meet high quality standards consistently. 
    • Other duties as assigned by manager. 
    • Willing to assist on high priority work outside of regular business hours or weekend as needed. 


Essential Qualifications: 
 

    • Around 5+ years in similar analytics roles 
    • Bachelors, M.A./M.Sc. College Degree or Higher in applied mathematics, statistics, engineering, physics, accounting, finance, economics, econometrics, computer sciences, or business/social and behavioral sciences with a quantitative emphasis. 
    • Preferred programming knowledge SQL/SAS  
    • Knowledge of PVSI, Non-Lending, Student Loans, Small Business and Personal Lines and Loans is a plus. 
    • Strong experience with data integration, database structures and data warehouses. 
    • Persuasive written and verbal communication skills. 


Desired Qualifications: 

    • Certifications in Data Science, or BI Reporting tools. 
    • Ability to prioritize work, meet deadlines, achieve goals and work under pressure in a dynamic and complex environment – Soft Skills. 
    • Detail oriented, results driven, and has the ability to navigate in a quickly changing and high demand environment while balancing multiple priorities. 
    • Ability to research and report on a variety of issues using problem solving skills. 
    • Ability to act with integrity and a high level of professionalism with all levels of team members and management. 
    • Ability to make timely and independent judgment decisions while working in a fast-paced and results-driven environment. 
    • Ability to learn the business aspects quickly, multitask and prioritize between projects. 
    • Exhibits appropriate sense of urgency in managing responsibilities. 
    • Ability to accurately process high volumes of work within established deadlines. 
    • Available to flex schedule periodically based on business need. 
    • Demonstrate strong negotiation, communication & presentation skills. 
    • Demonstrates a high degree of reliability, integrity and trustworthiness. 
    • Takes ownership of assignments and helps drive assignments of the team. 
    • Dedicated, enthusiastic, driven and performance-oriented; possesses a strong work ethic and good team player. 
    • Be proactive and get engaged in organizational initiatives.
Read more
calibresource
at calibresource
1 recruiter
Sulekha Singhal
Posted by Sulekha Singhal
Remote, Bengaluru (Bangalore)
1 - 4 yrs
₹3L - ₹6L / yr
Client Servicing
Business Development
Sales
Presales
Salesforce
Hiring for Sales/ BDM for AR/VR industry.
Excellent communication & presentation skills

Location: Bangalore
Read more
Realgy Energy Services
at Realgy Energy Services
1 recruiter
Ishita Goel
Posted by Ishita Goel
Remote, Pune
5 - 12 yrs
₹20L - ₹25L / yr
ASP.NET
skill iconC#
skill icon.NET
Web
skill iconReact.js
+2 more
We are a small American company in the utility sector with a strong offshore team in Pune. Various stakeholders, internal and external, engage with us through web-based applications that we provide them. The current technology stack in use is a mix of ReactJS and ASP.NET. We follow a micro-frontend and micro-services based architecture.

Our existing software development team is general-purpose full-stack. We are looking to build consumer-focused self-service applications. With this in mind, we would like an experienced web developer who can take full ownership of all aspects of web development, from Ux design to architecture to coding to maintenance to devOps to monitoring user activity etc. Past demonstrable experience in building consumer applications that were actually used by a significant user base is a must. 

We are a small team of multi-skilled professionals who work independently in a flat hierarchy. Our work culture is very friendly and open. There is much to learn and do, and if solving real problems through software is what charges you up the most, this is a great place to work in.
Read more
Letstrack
at Letstrack
1 video
3 recruiters
Shivali Saran
Posted by Shivali Saran
NCR (Delhi | Gurgaon | Noida)
4 - 8 yrs
₹4L - ₹7L / yr
skill icon.NET
ASP.NET
skill iconC#
ASP.NET MVC
Webforms

1) Proven experience as a .NET Developer or Application Developer

2) Familiarity with the http://ASP.NET">ASP.NET framework, SQL Server and design/architectural patterns (e.g. Model-View-Controller (MVC))

3) Knowledge of at least one of the .NET languages (e.g. C#, Visual Basic .NET) and IIS

4) Familiarity with architecture styles/APIs (REST)

5) Basic knowledge Windows Application and Windows Services,

6) Excellent troubleshooting and communication skills

7) Proven Experience in Asp.net Webforms
Read more
socxo
at socxo
1 recruiter
Dhanasekaren Raghunathan
Posted by Dhanasekaren Raghunathan
Bengaluru (Bangalore)
3 - 6 yrs
₹5L - ₹8L / yr
skill iconMongoDB
DotNetNuke
MS SQLServer
SOCXO is a SaaS and Mobile based Employee Engagement & Advocacy Marketing platform which enables Enterprises to leverage its Employees to Engage with and Amplify their Brand content into their Personal Social Networks for Exponential Content Reach. SOCXO is expanding its R&D in Bangalore and looking for passionate member to be part of building the product into a Platform. SOCXO has 10+ Enteprirse customers in USA, India and expanding to UK, Singapore. The role will be in Bangalore with work that can cover new trends - Machine learning, NLP, Big Data analytics.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos