QA Engineer at Opscruise · Chennai · 5 - 11 years · ₹12L - ₹30L / yr · Raised funding · Posted 21 Dec 2021
About OpsCruise
Digital business is driving a fundamental shift to cloud-native applications, creating a new set of operational and performance challenges ill-suited to the currently available solutions. At OpsCruise, we imagine a world of autonomous operations and are innovating a fundamentally different approach to performance management. OpsCruise’s vision is to automate the performance assurance of cloud applications using a model-driven closed-loop platform.
Team
The OpsCruise team represents a global and talented team that includes domain experts in IT Operations, Networking, Storage, Hyperscale Systems and AI/ML that have built market-leading solutions at companies such as Cisco, Google, Hitachi, HP, Infoblox, Oracle and VMWare among others.
Our engineering culture values creativity, pragmatism, honesty, and simplicity to solve hard problems the right way.
Role
We are looking for a Senior QA Engineer who will join our team building and rolling out our SaaS platform in the cloud AI/Ops space.
Our Technology Stack
Our product involves the following technology areas with one or more tools in use in each area:
- Container technologies, including creating Docker plugins and extensions
- Serverless technologies including instrumentation, addons
- Orchestrators including Kubernetes, OpenShift, Mesos, Swarm
- Metric generation and collection including Prometheus and tools such as Dynatrace and Datadog
- Tracing including OpenTracing, Jaeger
- Graph tools and Databases including neo4j, JanusGraph, TinkerPop/Gremlin
- TimeSeries databases such as Prometheus, OpenTSDB
- NoSQL and Indexing tools such as MongoDB, Cassandra, Solr and Elastic
- Languages including Java, Scala, Javascript, Python, R, and Go
- Messaging tools including Kafka, Akka
- Big Data tools including HDFS, YARN, Spark, Flink
- AI/ML techniques including Statistical Analysis, Classification, Deep Learning, etc.
- Cloud services: AWS, GCP, and Azure, their services in databases, networking and ML tools
- High performance User Interfaces including AngularJS, Vue, D3.js and local stores
- Authentication and Authorization including tools such as Okta and KeyCloak.
Responsibilities
- Understand user level requirements, write up the test strategy, derive test plan and test cases in detail.
- System and integration testing with automation of test cases using Python or Java.
- Use test frameworks such as Robot Framework.
- Use traffic generator tools such as JMeter for performance testing
- Set up the target test environments in AWS, Azure or GCP
- Containers based environment setup with Kubernetes and Docker, monitoring tools setup with Prometheus
- Debug incidents and issue to narrow down to a root cause
- Understand and reproduce internally issues reported by customers
Qualifications
The ideal candidate must have the following qualifications.
- B.E/B.Tech Degree from a reputed institution with at least 4 years of relevant experience.
- Hands-on experience with test automation using Python or Java.
- Experience with test frameworks such as Robot Framework or TestNG.
- Traffic generation tools usage such as curl-loader or JMeter
- QA engineers for Networking Technology products such as switches, routers, L4-L7 products testing can also apply.
- Knowledge of public clouds, AWS, Azure or GCP, is desired
- Working knowledge in Kubernetes, Docker or Openshift environments required
- Hands on experience with Linux
- Strong problem solving and debugging abilities
- Familiarity with continuous integration tools such as Jenkins or CircleCI
- Interest in machine learning (ML) and data science is a plus
Most importantly, you should be someone who is passionate about building new and innovative products that solve tough real-world problems.
LOCATION
Chennai, India

Similar jobs (10)
About the team
SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.
About the Role
We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.
You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.
What You’ll Do
● Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.
● Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.
● Performing functional, regression, performance, scalability and security testing to identify bugs or defects.
● Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.
● Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.
● Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.
● Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.
● Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.
● Ensuring the software meets customer and business requirements by validating the functionality and performance.
● Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.
● Supporting user acceptance testing (UAT) and assisting clients with product validation.
● Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.
Required Experience
● A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.
● 8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.
● Expertise in manual and automated testing.
● Deep domain expertise in complex system validation and advanced automation practices at scale.
● Proficiency in programming languages like Python to build and run automated test scripts.
● "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."
● Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.
● Strong communication skills for documenting test results and interacting with cross-functional teams.
● Excellent analytical skills, attention to detail, and problem-solving ability.
● Ability to work independently as well as collaboratively in a team environment.
● A curious mindset with a willingness to quickly learn new technologies and testing tools.
Required Skills & Qualifications
● Familiarity with cloud-based testing environments (GCP, AWS, Azure).
● Experience with cybersecurity products or cloud services or IDP or Web UI
The Mindset
● Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.
● Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.
● Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.
● Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.
QA Test Engineer – Manual & Automation
Location: Bangalore, India
Experience: 2–5 years
Employment Type: Full-time
Work Mode: On-site
About Juntrax
Juntrax is a B2B Cloud SaaS product company building business operations software for SMEs. Our platform helps businesses manage their day-to-day operations through streamlined digital workflows and tools.
We are looking for a QA Test Engineer who can ensure the quality, reliability, and usability of our product through a combination of manual and automated testing.
Key Responsibilities
- Design, develop, and execute manual and automated test cases for web-based SaaS applications.
- Perform functional, regression, integration, system, and API testing.
- Create and maintain automated test scripts for critical product workflows.
- Identify, document, track, and retest bugs using appropriate bug-tracking tools.
- Collaborate closely with developers, UI/UX designers, product teams, and other stakeholders to understand requirements and ensure product quality.
- Participate in requirement analysis and contribute to test planning and test strategy.
- Perform cross-browser and responsive testing to ensure a consistent user experience.
- Validate new features, enhancements, bug fixes, and product releases.
- Maintain clear documentation of test scenarios, test cases, defects, and test results.
- Help improve QA processes, automation coverage, and overall testing efficiency.
Required Skills & Qualifications
- 2–5 years of experience in Software Quality Assurance / Testing.
- Strong understanding of manual testing concepts and QA methodologies.
- Hands-on experience with automation testing using tools/frameworks such as Selenium, Playwright, Cypress, or similar.
- Experience with API testing using tools such as Postman or similar.
- Good understanding of SQL and database validation.
- Experience with regression, integration, functional, and end-to-end testing.
- Familiarity with Git/version control and basic CI/CD concepts.
- Ability to write clear and effective test cases and defect reports.
- Good analytical and problem-solving skills.
- Strong attention to detail and a quality-focused mindset.
Good to Have
- Experience testing B2B SaaS or cloud-based applications.
- Experience with JavaScript/TypeScript, Python, Java, or another programming language.
- Experience integrating automated tests into CI/CD pipelines.
- Familiarity with Agile/Scrum development environments.
- Experience with performance or security testing.
What We’re Looking For
- Someone who can think beyond the happy path and identify edge cases and potential failure points.
- A QA professional who is comfortable working independently as well as with cross-functional teams.
- Someone who takes ownership of product quality from requirement analysis through release.
- A continuous learner who is interested in increasing automation coverage and improving QA processes.
Why Join Juntrax?
- Work directly on a growing B2B SaaS product.
- Gain exposure to the complete software development and release lifecycle.
- Opportunity to contribute to both manual and automation QA practices.
- Work closely with engineering, product, and leadership teams.
- Be part of a fast-paced startup environment where your work has a direct impact on the product.
Strong Senior QA/SDET Profile with hands-on automation building and QA-function ownership
2
Mandatory (Experience 1): Must have 6+ years in QA/test automation/SDET roles with clear progression in scope (Engineer to Senior to Lead)in a B2B SaaS product company
3
Mandatory (Experience 2): Must have direct experience scaling a QA function at a SaaS company and building automation frameworks or QA processes from scratch
4
Mandatory (Tech skill 1): Must have hands-on UI automation experience with Selenium (Java + TestNG) or Playwright / Cypress (JavaScript / TypeScript) using maintainable design patterns like Page Object Model
5
Mandatory (Tech skill 2): Must have API testing & automation experience with Postman and RestAssured (or equivalent) for functional, integration, and contract testing
6
Mandatory (Tech skill 3): Must have experience with CI/CD integration (Jenkins or GitHub Actions) and Git for version control
7
Mandatory (Skill 1): Must have a strong grasp of Agile / Scrum delivery and JIRA for defect and test management
8
Mandatory (Skill 2): Must have experience leading or mentoring QA engineers and collaborating cross-functionally with developers and product teams
9
Mandatory (Skill 3): Must have solid experience using AI in test automation and manual testing exposure
10
Mandatory (Communication): Must have strong communication skills for cross-functional collaboration
11
Mandatory (Company): Must come from a B2B SaaS
What you'll own
The quality charter. Define and evolve the testing strategy — web application, dashboards, APIs, webhooks, and customer integrations. Establish release criteria, coverage expectations, and quality gates that engineers actually respect because they're fast and they catch real bugs. Automation at scale. Build and maintain end-to-end and API automation suites that run on every PR and give a trustworthy signal. Own the flake rate. Design for parallel execution, deterministic test data, and fast feedback — a suite nobody trusts is worse than no suite. Performance and reliability. Design and run load, stress, and soak tests against APIs and the platform. Profile results, isolate bottlenecks with the engineers who own the service, and set up the monitoring that tells us about degradation before a customer does. Leverage through tooling, including AI. Use whatever gets coverage up and cycle time down: LLM-assisted test case generation from specs, AI-assisted authoring and maintenance of automation, synthetic test data generation, log and failure triage. We expect you to be opinionated about where these tools genuinely help and where they produce impressive-looking noise. Raising the bar. Partner with product and engineering from spec through release so quality risk is surfaced during design, not after code freeze. Mentor the QA team and build the practices — bug triage discipline, root cause analysis, prevention over detection — that outlast any single release.
What we're looking for
Must have
3–6 years in QA roles, with meaningful ownership of automation frameworks rather than only executing existing suites.
Strong test automation skills with a modern framework — Playwright, Cypress, or Selenium — and solid coding ability in Python, JavaScript/TypeScript, or Java. You should be comfortable reading application code, not just testing around it.
API testing experience: REST, auth, webhooks and asynchronous event flows, contract testing, and tooling such as Postman, REST Assured, or Pact.
Hands-on CI/CD integration — GitHub Actions, GitLab CI, Jenkins, or equivalent — including making suites fast and reliable enough to gate merges.
Working knowledge of SQL for validating data correctness, and comfort with logs, traces, and observability tooling for debugging.
Rigorous, systematic thinking about edge cases and failure modes, and the communication skills to make quality risk legible to product and leadership.
Nice to have
Experience testing AI, ML, or LLM-based products, and comfort with the reality that outputs are probabilistic rather than deterministic. Familiarity with Docker, Kubernetes, or cloud infrastructure for standing up test environments.
Performance and load testing with k6, JMeter, Gatling, or Locust, plus the analytical ability to turn results into a specific, actionable bottleneck. Exposure to enterprise SaaS with real integration surface area, or to security and compliance testing expectations of enterprise buyers. - Experience as the first or most senior quality voice on a team.
What we offer
Competitive compensation with equity. Direct ownership of a charter that materially affects how enterprise customers experience our product.
Proximity to frontier AI systems in production, and the freedom to use modern tooling to do your job well.
A fast-moving team where the distance between an idea and a shipped change is short.
Senior QA Engineer
Make quality part of the engineering system.
AbleCredit builds software for complex enterprise workflows where AI, APIs, business rules, human decisions, and real-world operations have to work together reliably. We care about building products that work in production - not just in demos. We're looking for a senior quality engineer who can move quality upstream: from release-time testing to better automation, contracts, observability, and engineering practices.
What You'll Own?
• Own quality strategy across web, mobile, backend APIs, integrations, and end-to-end workflows.
• Design and maintain automated regression suites for critical customer journeys.
• Build API, integration, contract, and workflow tests that catch failures before production.
• Partner with engineering and product teams during design - not only after development is complete.
• Define release readiness, risk-based testing, and production validation practices.
• Investigate escaped defects, identify systemic causes, and drive preventive improvements.
• Improve test data, environments, tooling, and CI integration so teams can ship confidently.
What We're Looking For?
• 5+ years in software quality engineering or test automation.
• Strong API and backend testing experience, including asynchronous and integration-heavy systems.
• Experience testing mobile and web applications and understanding client/ server failure modes.
• Ability to write automation in JavaScript/ TypeScript, Python, Java, or a similar language.
• Strong debugging skills across logs, network requests, databases, and distributed services.
• Experience with CI/CD and integrating automated tests into release pipelines.
• A product mindset: prioritize risk and customer impact rather than maximizing test-case counts.
Nice to Have
• Performance, load, security, or reliability testing.
• Experience with Playwright, Cypress, Appium, Postman/ Newman, k6, or similar tooling.
• Experience with event-driven systems, queues, webhooks, and long running workflows.
• Experience testing AI-assisted or non-deterministic product behavior.
How We Think About Quality?
Quality is an engineering responsibility. Automation should create confidence, not dashboards. A production escape should improve the system that allowed it to happen. The goal is simple: ship quickly without making customers our test environment.
Job Title – Staff QA Automation Engineer
Location - India, Remote
EGNYTE YOUR CAREER. SPARK YOUR PASSION.
Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With 22,000+ customers worldwide and growing, you can make an impact by protecting their valuable data. When joining Egnyte, you’re not just landing a new career, you become part of a team of Egnyters who doers, thinkers, and collaborators are who embrace and live by our values:
- Invested Relationships
- Fiscal Prudence
- Candid Conversations
ABOUT EGNYTE
Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security, maintain compliance, prevent and detect ransomware threats, and boost employee productivity on any app, any cloud, anywhere. For more information, visit www.egnyte.com.
Egnyte is looking for an experienced Staff QA Automation Engineer to join our team and work on some exciting projects. You should possess excellent communication skills in addition to the desired technical experience.
WHAT YOU’LL DO:
What You’ll Do (but is not limited to):
- Create automated processes to build Egnyte software packages which will be deployed in production environments
- Develop automatic tools to provision build/test environments on cloud infrastructure for hosting internal development and QA activities
- Prepare deployment solutions for QA, staging and production environments
- Create and maintain tools responsible for delivering on-premise services to customer (for example, on-premises server restart and software update)
- Contribute to the development processes, including enhancements to build procedures, test frameworks, verification tools and packaging
- Provide tools and automation workflows to increase software developer productivity
- Assist in defining the process models and tool sets to enable adoption of DevOps methodologies.
Your Qualifications:
- Experience with the Linux operating system, including configuration of subsystems such as storage, networking and file systems
- Strong knowledge of CI/CD tools such Jenkins, git, puppet, ansible, terraform and hands-on experience in implementing automated branching, build, test-automation and deployment pipelines
- Demonstrated abilities of writing and troubleshooting system level scripts in python and bash
- Familiarity with Linux packaging tools such as apt and automated package update mechanisms
- Familiarity with Windows OS internals and experience with QA automation on windows..
- Ability to work with multi-cultural, globally distributed teams to a common unifying product vision and closely coordinate with cross-functional teams in different time-zones.
- Passion to deliver enterprise-grade products to customers and to continuously work with engineering team to refine the product in the field.
- Experience on using AI tools to develop skills, hooks and scheduler
Education and experience:
- Bachelor’s degree in computer science, Computer Engineering or equivalent.
- Minimum 8 years industry experience as a software developer or quality engineer with enterprise software testing.
BENEFITS
- Competitive salaries
- Medical insurance and healthcare benefits for you and your family
- Fully paid premiums for life insurance
- Flexible hours and PTO
- Mental wellness platform subscription
- Gym reimbursement
- Childcare reimbursement
- Group term life insurance
COMMITMENT TO DIVERSITY, EQUITY, AND INCLUSION:
At Egnyte, we celebrate our differences and thrive on our diversity for our employees, our products, our customers, our investors, and our communities. Egnyters are encouraged to bring their whole selves to work and to appreciate the many differences that collectively make Egnyte a higher-performing company and a great place to be.
Any employees with questions or concerns about equal employment opportunities in the workplace are encouraged to bring these issues to the attention of hrategnyte.com. Egnyte will not allow any form of retaliation against employees who raise issues of equal employment opportunity. If employees feel they have been subjected to any such retaliation, they should contact hrategnyte.com. To ensure the workplace is free of artificial barriers, violation of this policy including any improper retaliatory conduct will lead to discipline, up to and including discharge. All employees must cooperate with all investigations conducted pursuant to this policy.
Job Title: QA Automation Engineer – Playwright
Experience: 6+ Years
Location: Pune
Work Mode: 5 Days WFO
Notice Period: Immediate Joiners
Mandatory Skills:
- Strong experience in Java
- Hands-on experience with Selenium
- Strong knowledge of BDD & Cucumber
- Experience in API Testing
- Hands-on experience with Playwright
- API Testing using Playwright is mandatory
Roles & Responsibilities:
- Design, develop, and maintain automated test scripts using Java, Selenium and Playwright.
- Develop and execute BDD test scenarios using Cucumber.
- Perform API testing and automation using Playwright.
- Identify, document, and track defects throughout the testing lifecycle.
- Collaborate with development and QA teams to ensure application quality.
- Maintain and enhance automation frameworks and test suites.
QA Automation Engineer – Selenium + Java (5+ Years)
Experience: 5+ Years
Location: Noida (Work from Office/Hybrid as per client requirement)
Employment Type: Contract (1+ Year)
Working Hours: 11:00 AM – 8:30 PM IST
About the Role
We are looking for an experienced QA Automation Engineer with strong expertise in Selenium and Core Java to join our team. The ideal candidate should have hands-on experience in designing robust automation frameworks, developing scalable test libraries, and working on enterprise-level migration testing projects. This role requires excellent problem-solving skills and the ability to leverage AI-powered testing solutions to improve automation efficiency.
Key Responsibilities
Design, develop, and maintain enterprise-level automation frameworks for large-scale applications.
Build scalable, reusable, and maintainable automation libraries to improve testing efficiency.
Develop automation solutions for database migration and application migration testing.
Create comprehensive regression test scenarios using the Gherkin (BDD) language.
Convert UI-based workflows into efficient API-based automated test suites.
Integrate automation scripts into CI/CD pipelines for continuous testing.
Work closely with Developers, Business Analysts, and Product Owners to understand business requirements.
Execute functional, regression, integration, API, and end-to-end automation testing.
Utilize AI-powered testing tools and services (such as Azure Surface or similar platforms) to optimize testing workflows.
Perform root cause analysis for test failures and collaborate with development teams to resolve issues.
Ensure automation code follows coding standards, design principles, and best practices.
Develop and maintain automation documentation, knowledge base articles, and reusable assets.
Participate in code reviews and contribute to continuous improvement initiatives.
Support test data preparation and environment management.
Monitor automation execution and provide detailed test reports to stakeholders.
Required Skills
5+ years of experience in QA Automation.
Strong programming skills in Core Java.
Excellent understanding of Object-Oriented Programming (OOP) concepts.
Hands-on experience with design patterns and automation framework development.
Strong expertise in Selenium WebDriver.
Experience with BDD frameworks such as Cucumber.
Experience with Hibernate.
Strong understanding of Microservices architecture.
Experience in API testing using REST APIs.
Hands-on experience with Sybase and Microsoft SQL Server (MSSQL).
Experience working on database migration projects.
Good understanding of SQL queries, joins, stored procedures, and database validation.
Knowledge of Git for version control.
Experience using Maven for dependency management and build automation.
Hands-on experience with unit testing and integration testing frameworks.
Experience with mocking frameworks.
Exposure to AI-driven testing tools and intelligent test automation solutions.
Strong analytical and debugging skills.
Excellent written and verbal communication skills.
Preferred Qualifications
Experience with enterprise migration projects.
Exposure to cloud environments such as Microsoft Azure.
Familiarity with CI/CD tools like Jenkins or Azure DevOps.
Experience with Agile/Scrum development methodologies.
Knowledge of API automation frameworks.
Ability to mentor junior QA engineers and contribute to automation strategy.
Required Technical Skills
Core Java
Selenium WebDriver
Cucumber (BDD)
Gherkin
Hibernate
Microservices
REST API Testing
Sybase
MSSQL
Git
Maven
JUnit/TestNG
Mocking Frameworks
AI-based Test Automation
Regression Testing
Integration Testing
API Automation
Soft Skills
Excellent communication skills
Strong analytical thinking
Problem-solving ability
Team collaboration
Attention to detail
Ability to work independently in a fast-paced environment
Why Join Us?
Opportunity to work on enterprise-scale migration projects.
Exposure to AI-powered automation technologies.
Collaborative and technology-driven work environment.
Long-term contract opportunity with challenging projects.
Opportunity to work with modern QA automation frameworks and cloud technologies.
Experience: 5+ Years
Location: Noida
Contract Duration: 1+ Year
Working Hours: 11:00 AM – 8:30 PM IST
Principal Software Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.
Key Responsibilities
- Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
- Develop comprehensive test suites, including:
- Unit, integration, and end-to-end (E2E)
- Functional, regression, performance, and safety testing
- Validate AI system behavior, including:
- Non-deterministic LLM outputs
- Hallucinations and edge cases
- Multi-step agent decision-making
- Design and manage evaluation systems:
- Golden datasets
- Benchmarking pipelines (accuracy, latency, reliability)
- Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
- Implement observability and telemetry to enable traceability, monitoring, and audit readiness
- Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
- Track and report quality KPIs, including test coverage, defect leakage, and system reliability
- Drive root-cause analysis and continuous improvement across the AI testing lifecycle
Required Skills
Core Engineering
- Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
- Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
- Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
- Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)
AI / ML & Agentic Systems
- Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
- Familiarity with:
- RAG architectures and vector databases (Pinecone, Weaviate)
- Agent frameworks (LangChain, LlamaIndex, AutoGen)
AI Testing Techniques
- Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
- Knowledge of evaluation methods:
- LLM-as-a-judge
- BLEU, ROUGE, semantic similarity scoring
- Experience with prompt and agent regression testing
- Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection
Tooling (Preferred)
- AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
- Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
- Monitoring: Prometheus, Grafana, OpenTelemetry
Soft Skills
- Strong analytical and problem-solving skills
- Excellent communication and cross-functional collaboration
- Data-driven mindset with focus on quality KPIs
- Detail-oriented with a strong bias toward automation and scalability
Experience Requirements
- 7+ years in QA, SDET, or test automation engineering
- Proven experience building and scaling automation frameworks
- Hands-on experience with AI/ML systems or LLM-based applications
- Experience testing RAG pipelines or agentic workflows
- Owned end-to-end AI test strategy and architecture
- Defined quality metrics and release gates
- Delivered scalable validation pipelines for production AI systems
- Supported audit and compliance readiness
Preferred
- Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
- Exposure to:
- Shift-left testing practices
- Production observability and monitoring
- Chaos or resilience testing
Senior-Level Differentiators
Education
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field
Nice-to-have:
- ISTQB certification
- Cloud/ML certifications (AWS, Azure, GCP)
- AI testing certifications
What Success Looks Like
- AI systems that are accurate, reliable, and safe
- Fully automated test pipelines integrated into CI/CD
- Measurable improvements in defect leakage and model quality
- Strong observability and auditability across AI systems
- Scalable validation frameworks supporting rapid AI innovation
Immediate Hiring | QA Automation Engineer
📍 Location: Bangalore
💼Experience: 5 Years
We are looking for a strong QA Automation Engineer with hands-on experience in Groovy, Java and JMeter, along with a solid understanding of automation framework design, API testing and cloud-based applications.
Key Skills Required
• QA Automation & Framework Design
• Groovy + Java for automation testing
• JMeter – Performance Testing
• Go / Golang, Ginkgo – preferred
• API Integration Testing
• AWS – practical experience
• CI/CD amp; Test Automation Pipelines
• Debugging, failure investigation, flaky test analysis
• Strong aptitude, reasoning and problem-solving skills
What We’re Looking For
✔ Ability to design and maintain reusable automation frameworks
✔ Strong understanding of API, integration and end-to-end testing
✔ Experience designing performance workloads and analyzing JMeter results
✔ Ability to troubleshoot using AWS logs and monitoring
✔ Good understanding of test reliability and CI/CD environments
✔ Someone who can independently identify edge cases and investigate failures














