AI Automation Engineer OR LLM Automation Engineer

Job Title: Java SDET / Automation Test

Experience: 5+ Years

Location: Hyderabad

Work Mode: 4 Days WFO

Interview Process:

• L1: Case Study – GitHub Repository
• L2: Face-to-Face – Hyderabad

Job Summary

We are looking for an experienced Java SDET / Automation Test Lead with strong expertise in Java, Selenium, automation testing, and AI-powered testing tools. The candidate will be responsible for leading automation testing activities, developing robust test frameworks, ensuring product quality, and improving testing efficiency using AI tools.

Mandatory Skills

• Java
• Selenium WebDriver
• Automation Testing / SDET
• Test Automation Frameworks
• Test Planning & Test Case Development
• AI Tools for Development & Test Automation
• End-to-End Testing
• Test Data Creation
• Defect Tracking

Preferred Skills

• AI Testing Frameworks
• API Testing – Postman / SoapUI
• Performance Testing
• CI/CD
• Agile/Scrum
• Database Testing & SQL

Roles & Responsibilities

• Lead software testing activities and ensure high-quality deliverables.
• Design, develop, and execute automated test scripts using Java and Selenium.
• Develop and maintain test plans, test cases, and test data.
• Identify, document, and track defects.
• Mentor and guide junior testers.
• Collaborate with development teams to improve testability and automation strategies.
• Use AI tools to improve testing and automation efficiency.
• Participate in code reviews and contribute to testing best practices.
• Perform end-to-end testing and ensure application quality.
• Report testing progress and results to stakeholders.

📩 Interested candidates can share their updated resumes:

Email: pavithra.e @vysystems. com

Contact: 8 9 2 5 8 0 2 4 5 7

Objective of the Role:

We are looking for top-notch SDET with 6-10 years of experience, who will deliver on key initiatives, starting from the ideation phase all the way to development and product delivery

You Will :

• Development of iOS/Android test automation on mobile test harnesses

• Develop and enhance to the existing automation scripts, tools and framework using Java, TestNG and Appium

• Execute automated test plans and regression tests for iOS/Android applications

• Define testing strategies and scope for user stories and technical development tasks

• Provide estimates on testing efforts to Product and Engineering team members

• Maintain and improve the test coverage and ratio of automated test

• Advocate Automated Testing and CI/CD methodology, review and advise testing methods and best practices

• Identify, investigate, report, and track defects

• Deliver high-quality features and infrastructure to production

• Continuously learn new tools, technologies, and testing disciplines

• Able to work under minimal supervision and quick to adopt new technologies

• Work collaboratively across multiple teams

• Communicate all concerns and status with SQA manager on timely manner

Qualifications

• Bachelor’s degree in computer science or a related field or equivalent work experience

• A track record of improving quality

• 6+ years of test automation experience with expertise in iOS/Android app testing

• Experience on TestNG, Java, Appium, XCUITest with expertise in programming skills using Java

• Experience in Selenium webdriver

• Experience using Xcode instruments, Experience using BrowserStack or similar for app automation

• Expertise in software QA methodologies, tools, and processes

• Expertise in test design, test automation frameworks, and scripting tests

• Experience with MongoDB

• Experience with Git, DevOps CI/CD pipelines

• Good knowledge of data warehouses, data lakes and ETL pipelines (AWS, Athena, Redshift Spectrum, Postgres, SQL, etc) is a plus

• API Automation testing experience using JEST, Mocha, REST Assured or similar frameworks is a plus

• Excellent communication skills, both oral and written a must

• Experience with Scrum methodologies and remote teams is a plus!

Job Summary:

We are looking for a skilled SDET professional with hands-on experience in test automation and software quality assurance. The ideal candidate should have strong experience in Java, Selenium, Cypress, and automation framework development.

Key Responsibilities:

• Develop and maintain automated test scripts using Java, Selenium, and Cypress.
• Design and maintain scalable automation frameworks.
• Create and execute functional, regression, integration, and end-to-end test cases.
• Identify, troubleshoot, and report software defects.
• Collaborate with developers, QA engineers, and other stakeholders.
• Participate in test planning, execution, and defect management.
• Maintain and enhance existing automation scripts and frameworks.
• Support integration of automated tests with CI/CD pipelines.
• Prepare test reports and communicate testing status and issues.
• Follow automation and QA best practices.

Required Skills:

• 5–7 years of experience in Software Testing / SDET.
• Strong hands-on experience in Java.
• Good experience with Selenium WebDriver.
• Hands-on experience with Cypress.
• Good understanding of automation framework development.
• Experience in functional, regression, and end-to-end testing.
• Good understanding of SDLC and STLC.
• Strong debugging and problem-solving skills.
• Good communication and teamwork skills.

Looking for 3 years exp SDET - Java Selenium, API Automation, rest assured, Jmeter Writing data driven functional testscripts using java selenium Writng scripts for API automation with RestAssured Enterprise grade test frameworks, test automation and CI/CD Immediate joiner, Location: Bangalore Work from office.

Please apply with NoticePeriod:

CTC:

ECTC:

Work from office(Y/N):

Location Bangalore (Y/N):

Senior Software Development Engineer in Test (SDET)

Experience: 4–6 Years

Job Location: Bengaluru

Work Mode: Hybrid (3 days a week from office)

Notice Period: Immediate to 15 Days

Employment Type: Full-time

Job Description

We are looking for an experienced SDET with strong expertise in Backend/API Automation and Microservices Testing. The ideal candidate should have hands-on experience in Java, REST API automation, scalable test automation frameworks, and CI/CD integration.

Key Responsibilities

• Own end-to-end QA strategy for backend services and microservices.
• Design, develop, and maintain scalable automation frameworks for API and backend testing.
• Lead functional, integration, regression, and end-to-end testing across multiple services.
• Develop automation strategies for microservices, event-driven architectures, and distributed systems.
• Integrate automated test suites into CI/CD pipelines.
• Validate asynchronous workflows, messaging queues, and event-driven communication.
• Perform deployment validation in ephemeral and dynamic test environments.
• Collaborate with developers, DevOps, and Product teams to implement shift-left testing practices.
• Identify quality risks and recommend improvements in testability and deployment processes.
• Review automation code and establish testing best practices

Required Skills & Experience

• 4–6 years of experience in Software Testing with a strong focus on Backend/API Automation.
• Strong hands-on experience with Java programming.
• Expertise in REST API testing using REST Assured, HTTP Client, Postman, or similar tools.
• Experience testing Microservices-based architectures.
• Hands-on experience building scalable automation frameworks.
• Strong knowledge of TestNG, Maven/Gradle, JUnit, and CI/CD integration.
• Experience with messaging systems such as Kafka, RabbitMQ, or AWS SQS.
• Strong understanding of SQL, relational databases (MySQL, PostgreSQL, Oracle), complex queries, and joins.
• Experience with Docker, Kubernetes, and containerized applications.
• Familiarity with cloud platforms such as AWS, GCP, or Azure.
• Understanding of distributed systems, observability tools, and log analysis.

Good to Have

• Experience with NoSQL databases such as MongoDB, Redis, or Cassandra.
• Knowledge of contract testing and mocking tools such as WireMock and Pact.
• Experience with performance testing tools such as JMeter, Gatling, or k6.
• Hands-on experience with Python or Shell scripting.
• Experience with Grafana, Prometheus, Kibana, or Splunk.
• Experience validating applications in ephemeral or dynamic test environments.

Candidate Requirements

• Candidates must be currently based in Bengaluru.
• Must be comfortable working in a hybrid model (3 days from the Bengaluru office).
• Immediate joiners or candidates with a maximum notice period of 15 days are preferred.

(SDET with UI testing)

Primary

BDD Karate as framework experience is required

Core Java, Object Oriented development

Secondary

Dev Ops, CI/ CD pipeline build tools such as Maven or Gradle

REST FUL services will be advantage

Experience

8-10 years

Location

Bengaluru

Budget

27Lpa

Job Description:

We are looking for an experienced QA Automation Engineer with strong expertise in Automation Testing and Manual Testing. The candidate should have hands-on experience in Selenium-based web automation using Java/Python, API automation testing, and automation framework development. The role also requires experience with CI/CD integration, Jenkins, and Agile testing methodologies.

Key Responsibilities

1. Develop, maintain, and execute automated test scripts using Selenium.
2. Perform web application automation testing using Selenium with Java/Python.
3. Execute API automation testing using tools such as ReadyAPI, Postman, and Playwright.
4. Build and maintain automation frameworks from scratch.
5. Integrate automation scripts with CI/CD pipelines.
6. Work with Jenkins for continuous integration and automated test execution.
7. Integrate automation tools with test management tools.
8. Collaborate with cross-functional teams to ensure application quality.
9. Follow Agile testing methodologies and SDLC processes.
10. Track and manage test activities using JIRA/Azure DevOps.

Mandatory Technical Skills

Skill Requirement hands-on experience

• Selenium Strong
• Java/ Python Programming knowledge for

automation

• Playwright As specified in Posting
• ReadyAPI API testing
• Postman API testing
• Automation Framework Ability to develop framework

from scratch

• Jenkins CI/CD integration
• CI/CD Testing Automation

Integration

• JIRA Test management
• Azure DevOps Test management
• Agile Strong understanding
• SDLC Strong understanding
• 
  

Qualifications

Bachelor’s or master’s degree in computer science engineering, or a related field. 4 - 7 Years

Senior Automation Testing Engineer

Location: Bengaluru / Gurugram – Onsite

Experience: 5–11 Years

Employment Type: Full-Time

Key Responsibilities

• Develop and maintain automation test frameworks and scripts.
• Perform both manual and automation testing, including exploratory, functional, regression, and bug verification.
• Develop test cases and contribute to test planning, estimation, and Agile ceremonies.
• Perform non-functional testing for accuracy, reliability, and performance.
• Drive QA process and automation improvements.

Required Skills

• BE/B.Tech/ME/M.Tech in CS/ECE/EE or related field.
• 5–11 years of software testing experience.
• Strong hands-on experience with Python/Java, Selenium, Cucumber, and PyTest.
• Good knowledge of SDLC, testing methodologies, defect lifecycle, and risk assessment.
• Experience with version control and bug-tracking tools.

Good to Have: Linux, Qt/QML, Squish, ISTQB/CSM/PSM, and regulatory/compliance standards.

Principal Software Engineer

Location: Bangalore India

Department: AI Engineering / Quality Assurance

Experience Level: Mid to Senior

We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.

Key Responsibilities

• Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
• Develop comprehensive test suites, including:
• Unit, integration, and end-to-end (E2E)
• Functional, regression, performance, and safety testing
• Validate AI system behavior, including:
• Non-deterministic LLM outputs
• Hallucinations and edge cases
• Multi-step agent decision-making
• Design and manage evaluation systems:
• Golden datasets
• Benchmarking pipelines (accuracy, latency, reliability)
• Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
• Implement observability and telemetry to enable traceability, monitoring, and audit readiness
• Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
• Track and report quality KPIs, including test coverage, defect leakage, and system reliability
• Drive root-cause analysis and continuous improvement across the AI testing lifecycle

Required Skills

Core Engineering

• Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
• Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
• Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
• Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)

AI / ML & Agentic Systems

• Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
• Familiarity with:
• RAG architectures and vector databases (Pinecone, Weaviate)
• Agent frameworks (LangChain, LlamaIndex, AutoGen)

AI Testing Techniques

• Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
• Knowledge of evaluation methods:
• LLM-as-a-judge
• BLEU, ROUGE, semantic similarity scoring
• Experience with prompt and agent regression testing
• Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection

Tooling (Preferred)

• AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
• Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
• Monitoring: Prometheus, Grafana, OpenTelemetry

Soft Skills

• Strong analytical and problem-solving skills
• Excellent communication and cross-functional collaboration
• Data-driven mindset with focus on quality KPIs
• Detail-oriented with a strong bias toward automation and scalability

Experience Requirements

• 7+ years in QA, SDET, or test automation engineering
• Proven experience building and scaling automation frameworks
• Hands-on experience with AI/ML systems or LLM-based applications
• Experience testing RAG pipelines or agentic workflows
• Owned end-to-end AI test strategy and architecture
• Defined quality metrics and release gates
• Delivered scalable validation pipelines for production AI systems
• Supported audit and compliance readiness

Preferred

• Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
• Exposure to:
• Shift-left testing practices
• Production observability and monitoring
• Chaos or resilience testing

Senior-Level Differentiators

Education

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field

Nice-to-have:

• ISTQB certification
• Cloud/ML certifications (AWS, Azure, GCP)
• AI testing certifications

What Success Looks Like

• AI systems that are accurate, reliable, and safe
• Fully automated test pipelines integrated into CI/CD
• Measurable improvements in defect leakage and model quality
• Strong observability and auditability across AI systems
• Scalable validation frameworks supporting rapid AI innovation

Job Title: Test Automation Engineer

Experience Required: 2+ Yrs. of very recent experience

Work Location: Gurugram, Haryana (Regular Work from Office)

Work Timings: 04:30 PM 01:30 AM IST (Monday Friday)

Employer Company: Alldomainsoft.com Pvt. Ltd. (alldomainsoft.com)

US Client: Avive Solutions, Inc. (avive.life)

Note: Local candidates preferred. Unsuitable for Java based profiles.

About the Role

As a Test Automation Engineer at Avive, you will play a critical role in ensuring the quality and reliability of our software products. You will build and maintain automated test coverage using Python, Pytest, and BDD frameworks alongside Selenium, focused on validating web application behavior, data accuracy, user permissions, and simulated device communication protocols. Partnering closely with Software Engineering, you will help shape test strategy and expand coverage as new features and functionality are shipped.

What You'll Do including but not limited to:

1. Test Automation Development Design, build, and maintain automated test suites using Python, pytest, and BDD frameworks to validate web application functionality.

• Develop and maintain Selenium-based automation to verify data is displayed accurately across the website.
• Create automation that simulates device communication protocols to validate that data generated by connected devices is correctly received, processed, and reflected on the website.

2. Software Verification

• Expand and maintain automated regression suites that catch defects early and give the team confidence as new features are released.
• Identify gaps in existing test coverage and prioritize new automation based on risk and impact.
• Investigate test failures, determine root cause, and work with Software Engineering to resolve issues.

3. Process & Tooling

• Document, organize, and maintain test cases in Jira using Xray, ensuring traceability between requirements, test coverage, and results.
• Report, track, and prioritize bugs in Jira, working with Software Engineering through resolution.
• Evaluate and integrate new tools, libraries, or frameworks that improve test efficiency, coverage, or maintainability.
• Contribute to CI/CD pipeline integration for automated test execution.
• Continuously refine test strategy and best practices as the product and codebase evolve.

Who You Are

• BS/B.Tech./B.E. in Computer Science, Software Engineering, or a related field (equivalent experience considered).
• 2+ years of experience in software test automation.
• Strong proficiency in Python, with hands-on experience using pytest and BDD frameworks (e.g., pytest-bdd, Behave, or Cucumber)
• Solid experience building and maintaining automated UI tests with Selenium.
• Experience testing web applications, including validating data accuracy, user permissions/access control, and integrations with external or simulated data sources.
• Familiarity with Jira and Xray (or similar tools) for bug tracking and test case management.
• Comfortable working with APIs and simulating device or system communication protocols for test purposes.
• Exposure to CI/CD pipelines and integrating automated tests into a continuous delivery workflow is a plus.
• Strong analytical and debugging skills, with the ability to trace issues from symptom to root cause.
• Organized, independent, and results-oriented, with the ability to manage multiple test efforts simultaneously.
• Excellent communication skills and strong attention to detail, with a collaborative, process-oriented approach to working with Software Engineering.

LinkedIn: www.linkedin.com/in/rkd94

Apply Link: https://jobs.lever.co/AviveSolutions/c20d1002-7998-4e8b-9209-0a4c590d0c7c