Automation Testing with AIML at VyTCDC · Bengaluru (Bangalore), Hyderabad, Pune · 5 - 12 years · ₹3L - ₹35L / yr · Profitable · Posted 27 Jun 2025

Technical Skills – Must have
Lead the design and development of AI-driven test automation frameworks and solutions.
Collaborate with stakeholders (e.g., product managers, developers, data scientists) to understand testing requirements and identify areas where AI automation can be effectively implemented.
Develop and implement test automation strategies for AI-based systems, encompassing various aspects like data generation, model testing, and performance evaluation.
Evaluate and select appropriate tools and technologies for AI test automation, including AI frameworks, testing tools, and automation platforms.
Define and implement best practices for AI test automation, covering areas like code standards, test case design, test data management, and ethical considerations.
Lead and mentor a team of test automation engineers in designing, developing, and executing AI test automation solutions.
Collaborate with development teams to ensure the testability of AI models and systems, providing guidance and feedback throughout the development lifecycle.
Analyze test results and identify areas for improvement in the AI automation process, continuously optimizing testing effectiveness and efficiency.
Stay up-to-date with the latest advancements and trends in AI and automation technologies, actively adapting and implementing new knowledge to enhance testing capabilities.
Knowledge in Generative AI and Conversational AI for implementation in test automation strategies is highly desirable.
Proficiency in programming languages commonly used in AI, such as Python, Java, or R.
Knowledge on AI frameworks and libraries, such as TensorFlow, PyTorch, or scikit-learn.
Familiarity with testing methodologies and practices, including Agile and DevOps.
Working experience on Python/Java and Selenium also knowledge in prompt engineering.

Similar jobs (10)
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Principal Software Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.
Key Responsibilities
- Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
- Develop comprehensive test suites, including:
- Unit, integration, and end-to-end (E2E)
- Functional, regression, performance, and safety testing
- Validate AI system behavior, including:
- Non-deterministic LLM outputs
- Hallucinations and edge cases
- Multi-step agent decision-making
- Design and manage evaluation systems:
- Golden datasets
- Benchmarking pipelines (accuracy, latency, reliability)
- Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
- Implement observability and telemetry to enable traceability, monitoring, and audit readiness
- Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
- Track and report quality KPIs, including test coverage, defect leakage, and system reliability
- Drive root-cause analysis and continuous improvement across the AI testing lifecycle
Required Skills
Core Engineering
- Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
- Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
- Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
- Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)
AI / ML & Agentic Systems
- Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
- Familiarity with:
- RAG architectures and vector databases (Pinecone, Weaviate)
- Agent frameworks (LangChain, LlamaIndex, AutoGen)
AI Testing Techniques
- Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
- Knowledge of evaluation methods:
- LLM-as-a-judge
- BLEU, ROUGE, semantic similarity scoring
- Experience with prompt and agent regression testing
- Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection
Tooling (Preferred)
- AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
- Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
- Monitoring: Prometheus, Grafana, OpenTelemetry
Soft Skills
- Strong analytical and problem-solving skills
- Excellent communication and cross-functional collaboration
- Data-driven mindset with focus on quality KPIs
- Detail-oriented with a strong bias toward automation and scalability
Experience Requirements
- 7+ years in QA, SDET, or test automation engineering
- Proven experience building and scaling automation frameworks
- Hands-on experience with AI/ML systems or LLM-based applications
- Experience testing RAG pipelines or agentic workflows
- Owned end-to-end AI test strategy and architecture
- Defined quality metrics and release gates
- Delivered scalable validation pipelines for production AI systems
- Supported audit and compliance readiness
Preferred
- Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
- Exposure to:
- Shift-left testing practices
- Production observability and monitoring
- Chaos or resilience testing
Senior-Level Differentiators
Education
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field
Nice-to-have:
- ISTQB certification
- Cloud/ML certifications (AWS, Azure, GCP)
- AI testing certifications
What Success Looks Like
- AI systems that are accurate, reliable, and safe
- Fully automated test pipelines integrated into CI/CD
- Measurable improvements in defect leakage and model quality
- Strong observability and auditability across AI systems
- Scalable validation frameworks supporting rapid AI innovation
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Senior Automation Testing Engineer
Location: Bengaluru / Gurugram – Onsite
Experience: 5–11 Years
Employment Type: Full-Time
Key Responsibilities
- Develop and maintain automation test frameworks and scripts.
- Perform both manual and automation testing, including exploratory, functional, regression, and bug verification.
- Develop test cases and contribute to test planning, estimation, and Agile ceremonies.
- Perform non-functional testing for accuracy, reliability, and performance.
- Drive QA process and automation improvements.
Required Skills
- BE/B.Tech/ME/M.Tech in CS/ECE/EE or related field.
- 5–11 years of software testing experience.
- Strong hands-on experience with Python/Java, Selenium, Cucumber, and PyTest.
- Good knowledge of SDLC, testing methodologies, defect lifecycle, and risk assessment.
- Experience with version control and bug-tracking tools.
Good to Have: Linux, Qt/QML, Squish, ISTQB/CSM/PSM, and regulatory/compliance standards.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Designation: Test Lead
Location: Hyderabad_Skyview
Job Summary: We are seeking a highly skilled and motivated SDET with strong Java testing expertise and AI engineering exposure to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in software testing with 5+ years of experience, with a focus on automation testing using Selenium and Java. As a Test Lead, you will be responsible for leading testing efforts, ensuring the quality of our software products, and mentoring junior team members. Your expertise in software development and testing methodologies will be crucial in driving our testing strategy and improving our processes.
Responsibilities:
- Lead the software testing efforts for various projects, ensuring high-quality deliverables.
- Design, develop, and execute automated test scripts using Selenium with Java.
- Collaborate with development teams to understand requirements and provide feedback on testability.
- Mentor and guide junior testers in best practices for software testing and automation.
- Develop and maintain test plans, test cases, and test data.
- Identify, document, and track defects using appropriate tools.
- Participate in code reviews and provide input on testing strategies.
- Continuously improve testing processes and methodologies to enhance efficiency.
- Report testing progress and results to stakeholders, ensuring transparency and accountability.
- Stay updated with the latest industry trends and technologies in software testing.
Mandatory Skills:
- Proficiency in Selenium with Java for automated testing.
- Strong understanding of software testing methodologies and best practices.
- Experience in developing and executing test plans and test cases.
- Familiarity with defect tracking tools and test management software.
- Excellent analytical and problem-solving skills.
- Strong communication and interpersonal skills.
- Experience using AI tools for development and testing automation.
- Exposure to AI testing frameworks is preferred.
- Experience in creating test data and performing end to end testing.
Preferred Skills:
- Experience with performance testing tools.
- Knowledge of continuous integration and continuous deployment (CI/CD) processes.
- Familiarity with Agile methodologies.
- Experience in API testing and tools like Postman or SoapUI.
- Understanding of database testing and SQL.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Relevant certifications in software testing (e.g., ISTQB) are a plus.
- Proven track record of leading testing efforts in a software development environment.
Job Summary
We are looking for an experienced AI Automation Tester with hands-on experience in testing AI-powered products and applications. The ideal candidate should have strong expertise in Playwright automation, along with practical experience in LLM evaluations (Evals), Golden Datasets (Goldens), and AI Observability.
Key Responsibilities
- Design, develop and execute automated test scripts using Playwright.
- Test AI-powered applications, LLM-based products and Generative AI solutions.
- Work on Evals to assess AI response accuracy, relevance, quality and consistency.
- Create, maintain and validate Golden Datasets (Goldens) for benchmarking AI outputs.
- Implement and work with AI Observability to monitor model performance, response quality, latency and failures.
- Perform functional, regression, API and end-to-end testing.
- Identify, report and track defects to ensure product quality and reliability.
Strong Senior QA/SDET Profile with hands-on automation building and QA-function ownership
2
Mandatory (Experience 1): Must have 6+ years in QA/test automation/SDET roles with clear progression in scope (Engineer to Senior to Lead)in a B2B SaaS product company
3
Mandatory (Experience 2): Must have direct experience scaling a QA function at a SaaS company and building automation frameworks or QA processes from scratch
4
Mandatory (Tech skill 1): Must have hands-on UI automation experience with Selenium (Java + TestNG) or Playwright / Cypress (JavaScript / TypeScript) using maintainable design patterns like Page Object Model
5
Mandatory (Tech skill 2): Must have API testing & automation experience with Postman and RestAssured (or equivalent) for functional, integration, and contract testing
6
Mandatory (Tech skill 3): Must have experience with CI/CD integration (Jenkins or GitHub Actions) and Git for version control
7
Mandatory (Skill 1): Must have a strong grasp of Agile / Scrum delivery and JIRA for defect and test management
8
Mandatory (Skill 2): Must have experience leading or mentoring QA engineers and collaborating cross-functionally with developers and product teams
9
Mandatory (Skill 3): Must have solid experience using AI in test automation and manual testing exposure
10
Mandatory (Communication): Must have strong communication skills for cross-functional collaboration
11
Mandatory (Company): Must come from a B2B SaaS
The Senior Quality Assurance Analyst will lead a team of Quality Analysts assigned to a project and will be responsible for coordinating all testing efforts. The Senior Quality Assurance Analyst will create and execute test plans and test cases to ensure adherence with specified requirements. The Senior Quality Assurance Analyst will perform functional, regression, integration, and system testing using a combination of manual testing and automated tools to validate end to end system performance. The Senior Quality Assurance Analyst supports external clients through their testing cycles by providing detailed release notes with every delivery, triaging issues reported, and engaging clients to review system discrepancies as needed. The Senior Quality Assurance Analyst will provide training t
Responsibilities:
- Review requirement documentation to ensure understanding of the scope of the project and what needs to be tested.
- Create and maintain test plans and test cases designed to offer adequate test coverage and minimize escaped defects.
- Create and maintain Quality Assurance matrices of test coverage, slippage ratios, and other pertinent quality metrics.
- Follow established quality control processes, test execution methods and standards to identify, analyze, and document issues, bugs, defects, and other problems.
- Complete full regression testing and analyze test results.
- Manage code and data migrations across multiple testing and production environments.
- Perform a thorough shakeout testing after builds/installs are complete.
- Monitor defect tracking system daily and collaborate with the development team to ensure that any defects are fixed in a timely fashion.
- Actively participate in team meetings such as stand-up meetings and sprint retrospectives and provide testing status reporting on a regular basis.
- Provide mentorship and ongoing support to other Quality Assurance resources.
- Develop and document training materials and job aids aimed at fostering more efficient and consistent practices across implementations.
- Evaluate existing practices, identify, and implement process improvement initiatives.
- Take ownership of all functional areas and features on assigned client implementations.
- Reinforce the use of best practices on the team and motivate the team to be more productive.
- Assist with recruitment and onboarding of new hires.
- Lead team of 2-3 Quality Assurance resources and coordinate all testing activities on assigned projects.
- Develop, execute, and maintain automated test scripts using tools such as Katalon, Playwright, or Selenium (Java), ensuring reliable and scalable test coverage.
- Utilize Git branching strategies and CI/CD concepts to integrate automated test execution into build and deployment pipelines, supporting continuous quality validation.
- Leverage AI-powered testing tools and automation frameworks to improve test design, test data generation, defect analysis, and overall testing efficiency while reducing maintenance effort.
- Leverage AI-powered tools to support manual testing activities, including test case generation, exploratory testing, requirement analysis, test data creation, and defect investigation to improve test effectiveness and productivity.

Job Title: Java SDET / Automation Test
Experience: 5+ Years
Location: Hyderabad
Work Mode: 4 Days WFO
Interview Process:
- L1: Case Study – GitHub Repository
- L2: Face-to-Face – Hyderabad
Job Summary
We are looking for an experienced Java SDET / Automation Test Lead with strong expertise in Java, Selenium, automation testing, and AI-powered testing tools. The candidate will be responsible for leading automation testing activities, developing robust test frameworks, ensuring product quality, and improving testing efficiency using AI tools.
Mandatory Skills
- Java
- Selenium WebDriver
- Automation Testing / SDET
- Test Automation Frameworks
- Test Planning & Test Case Development
- AI Tools for Development & Test Automation
- End-to-End Testing
- Test Data Creation
- Defect Tracking
Preferred Skills
- AI Testing Frameworks
- API Testing – Postman / SoapUI
- Performance Testing
- CI/CD
- Agile/Scrum
- Database Testing & SQL
Roles & Responsibilities
- Lead software testing activities and ensure high-quality deliverables.
- Design, develop, and execute automated test scripts using Java and Selenium.
- Develop and maintain test plans, test cases, and test data.
- Identify, document, and track defects.
- Mentor and guide junior testers.
- Collaborate with development teams to improve testability and automation strategies.
- Use AI tools to improve testing and automation efficiency.
- Participate in code reviews and contribute to testing best practices.
- Perform end-to-end testing and ensure application quality.
- Report testing progress and results to stakeholders.
📩 Interested candidates can share their updated resumes:
Email: pavithra.e @vysystems. com
Contact: 8 9 2 5 8 0 2 4 5 7

Company Name: Career Guidance Technologies (CGT)(Hiring for MNC's
Job Title: Automation Test Engineer / QA Automation Engineer
Experience: 3–8 Years
Employment Type: Full-Time
Work Location: Chennai / Bangalore / Hyderabad / Pune
Work Mode: Hybrid / Work From Office
Career Gap Accepted
Job Summary:
We are looking for skilled and experienced Automation Test Engineers to join leading MNC and IT client projects. The ideal candidate should have hands-on experience in automation testing, framework development, functional testing, and API testing.
Candidates with strong knowledge of Java, Selenium WebDriver, Playwright, and API automation are encouraged to apply.

About the team
SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.
About the Role
We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.
You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.
What You’ll Do
● Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.
● Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.
● Performing functional, regression, performance, scalability and security testing to identify bugs or defects.
● Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.
● Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.
● Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.
● Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.
● Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.
● Ensuring the software meets customer and business requirements by validating the functionality and performance.
● Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.
● Supporting user acceptance testing (UAT) and assisting clients with product validation.
● Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.
Required Experience
● A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.
● 8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.
● Expertise in manual and automated testing.
● Deep domain expertise in complex system validation and advanced automation practices at scale.
● Proficiency in programming languages like Python to build and run automated test scripts.
● "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."
● Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.
● Strong communication skills for documenting test results and interacting with cross-functional teams.
● Excellent analytical skills, attention to detail, and problem-solving ability.
● Ability to work independently as well as collaboratively in a team environment.
● A curious mindset with a willingness to quickly learn new technologies and testing tools.
Required Skills & Qualifications
● Familiarity with cloud-based testing environments (GCP, AWS, Azure).
● Experience with cybersecurity products or cloud services or IDP or Web UI
The Mindset
● Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.
● Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.
● Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.
● Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.
Job Opportunity: QA Automation Engineer at FrontM
Location: Bangalore preferred / Hybrid as applicable
Experience: 5–6 years in Quality Assurance roles
Education: B.E/B.Tech in Computer Science, Engineering or a related technical discipline
Salary: Above market standards, flexible for the right candidate
Career growth: Long-term opportunity with potential to lead test automation strategy and quality engineering
About FrontM
FrontM builds software platforms for frontline workforces operating in remote and low-connectivity environments, with a strong focus on the maritime industry. The platform supports communication, collaboration, healthcare, learning, welfare and operational workflows across mobile, web, kiosk and connected device environments.
The platform is used across web, iOS, Android and integrated services in demanding real-world conditions, requiring disciplined test strategy, reliable automation and close attention to quality at every release.
Role Summary
As a QA Automation Engineer, you will bridge the gap between manual testing and automated solutions to ensure the delivery of high-quality software. You will design, develop and execute automated test scripts for FrontM’s web, mobile and API interfaces, working closely with developers and product managers so that quality is built in from the start.
This role requires strong hands-on experience with modern testing frameworks including Playwright, Appium and Cucumber, and comfort using AI tools to accelerate test case generation and script creation.
Key Responsibilities
Test Strategy & Automation Frameworks (≈40%)
- Review product requirements and technical design documents to create comprehensive, well-structured test plans and test cases covering both manual and automated strategies
- Design, build and maintain scalable automated test frameworks for web applications using Playwright
- Design, build and maintain automated tests for mobile applications on iOS and Android using Appium
- Write clear, business-readable test scenarios and implement BDD frameworks using Cucumber
- Use modern AI tools such as ChatGPT, GitHub Copilot or specialised QA AI tools to generate test cases, write boilerplate automation scripts and identify edge cases
API, Integration & CI/CD Testing (≈40%)
- Perform robust API integration testing to ensure seamless communication between microservices and external endpoints
- Integrate automated tests into the CI/CD pipeline to ensure continuous quality and rapid feedback for the development team
- Maintain and extend regression suites so they remain reliable as the platform evolves
Defect Management & Collaboration (≈20%)
- Identify, record, document and track bugs thoroughly through to resolution
- Perform thorough regression testing when bugs are resolved
- Work closely with cross-functional teams, including developers and product managers, to identify system requirements and ensure quality is built in from the start
Required Technical Skills
Test Automation & Frameworks
- Proven work experience in software quality assurance, with a strong foundation in manual testing methodologies and a transition into automation
- Strong hands-on experience writing automated tests using Playwright for web and Appium for mobile
- Solid experience implementing and maintaining Cucumber for Behaviour-Driven Development
API, Programming & CI/CD
- Deep understanding of RESTful APIs and hands-on API integration testing experience using tools such as Postman, RestAssured or Playwright API testing
- Proficiency in at least one relevant programming language such as JavaScript, TypeScript, Java or Python, with TypeScript/JavaScript highly preferred for Playwright
- Experience with Git and CI/CD tools such as Jenkins, GitHub Actions or GitLab CI
AI-Assisted Testing & Quality Practices
- Demonstrated ability to prompt and use AI coding assistants and generative AI tools to build test scripts, generate test data and brainstorm test scenarios
- Understanding of Agile/Scrum development principles
- Experience with performance and security testing
Personal Attributes
- Strong ownership mindset for product quality and release readiness
- Methodical, detail-oriented approach to testing, documentation and defect tracking
- Clear written and spoken communication in English
- Ability to work independently and collaborate effectively with developers and product managers
- Comfortable working in fast-moving engineering teams
- Curiosity and willingness to adopt new tools, including AI, to improve QA efficiency
Why join FrontM?
Long-Term Career Growth
Opportunity to shape quality engineering for software used by global maritime and remote workforce customers, with scope to grow into test automation leadership roles.
Engineering Challenges That Matter
Test applications used in remote, low-bandwidth and operationally demanding environments, where reliability matters.
Broad Technical Ownership
Take responsibility across web, mobile and API testing, BDD, CI/CD integration and AI-assisted quality practices.
Apply now
Join a team focused on building reliable software for real-world use cases and help ensure the quality of systems used across the global maritime workforce.









