Software Development Engineer in Test (SDET) – Python, Automation, Dat

Principal Software Engineer

Location: Bangalore India

Department: AI Engineering / Quality Assurance

Experience Level: Mid to Senior

We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.

Key Responsibilities

• Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
• Develop comprehensive test suites, including:
• Unit, integration, and end-to-end (E2E)
• Functional, regression, performance, and safety testing
• Validate AI system behavior, including:
• Non-deterministic LLM outputs
• Hallucinations and edge cases
• Multi-step agent decision-making
• Design and manage evaluation systems:
• Golden datasets
• Benchmarking pipelines (accuracy, latency, reliability)
• Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
• Implement observability and telemetry to enable traceability, monitoring, and audit readiness
• Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
• Track and report quality KPIs, including test coverage, defect leakage, and system reliability
• Drive root-cause analysis and continuous improvement across the AI testing lifecycle

Required Skills

Core Engineering

• Strong programming skills in Python; familiarity with Bash, TypeScript, or Go
• Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
• Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
• Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)

AI / ML & Agentic Systems

• Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
• Familiarity with:
• RAG architectures and vector databases (Pinecone, Weaviate)
• Agent frameworks (LangChain, LlamaIndex, AutoGen)

AI Testing Techniques

• Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
• Knowledge of evaluation methods:
• LLM-as-a-judge
• BLEU, ROUGE, semantic similarity scoring
• Experience with prompt and agent regression testing
• Understanding of AI safety testing, including adversarial testing, bias/fairness validation, and jailbreak detection

Tooling (Preferred)

• AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
• Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
• Monitoring: Prometheus, Grafana, OpenTelemetry

Soft Skills

• Strong analytical and problem-solving skills
• Excellent communication and cross-functional collaboration
• Data-driven mindset with focus on quality KPIs
• Detail-oriented with a strong bias toward automation and scalability

Experience Requirements

• 7+ years in QA, SDET, or test automation engineering
• Proven experience building and scaling automation frameworks
• Hands-on experience with AI/ML systems or LLM-based applications
• Experience testing RAG pipelines or agentic workflows
• Owned end-to-end AI test strategy and architecture
• Defined quality metrics and release gates
• Delivered scalable validation pipelines for production AI systems
• Supported audit and compliance readiness

Preferred

• Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
• Exposure to:
• Shift-left testing practices
• Production observability and monitoring
• Chaos or resilience testing

Senior-Level Differentiators

Education

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field

Nice-to-have:

• ISTQB certification
• Cloud/ML certifications (AWS, Azure, GCP)
• AI testing certifications

What Success Looks Like

• AI systems that are accurate, reliable, and safe
• Fully automated test pipelines integrated into CI/CD
• Measurable improvements in defect leakage and model quality
• Strong observability and auditability across AI systems
• Scalable validation frameworks supporting rapid AI innovation

About the team

SecurITe’s mission is to build an Agentic‑AI driven security platform that protects critical infrastructure from modern cyber threats. Our focus is on delivering highly performant, resilient, and intelligent network security systems that help defenders stay ahead of adversaries.

About the Role

We’re looking for a seasoned Senior Quality Engineer to provide technical leadership and architectural oversight for our next‑generation cybersecurity AI platform. In this high-impact role, you will define the technical strategy for quality assurance, ensuring our agentic AI transforms cyber defense with unparalleled reliability.

You will be responsible for the end-to-end quality lifecycle, from architectural reviews to the deployment of scalable automation frameworks. Beyond technical execution, you will serve as a mentor to junior team members, fostering a culture of technical excellence and driving the strategy that ensures our solutions meet the rigorous demands of critical infrastructure protection.

What You’ll Do

●    Defining and driving comprehensive QA strategies and roadmaps for the cybersecurity platform.

●    Designing, developing, and executing test plans, test cases, and automated scripts to ensure software quality.

●    Performing functional, regression, performance, scalability and security testing to identify bugs or defects.

●    Collaborating with developers, product managers, and other stakeholders to understand product requirements and testing needs.

●    Identifying, documenting, and tracking software defects, ensuring clear communication of issues and their resolutions.

●    Leading deep-dive root-cause analysis for critical system defects and security vulnerabilities.

●    Conducting thorough reviews of product specifications and software design to identify potential areas of concern before testing.

●    Architecting and designing complex, scalable test automation frameworks to optimize CI/CD velocity.

●    Ensuring the software meets customer and business requirements by validating the functionality and performance.

●    Assisting in continuously improving QA processes, tools, and best practices to enhance software testing efficiency and effectiveness.

●    Supporting user acceptance testing (UAT) and assisting clients with product validation.

●    Mentoring junior and mid-level engineers, providing technical guidance and conducting architectural reviews.

Required Experience

●    A Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field.

●    8-10 years of proven experience in quality engineering, specifically within network cybersecurity, Identity Providers, or AI-integrated platforms.

●    Expertise in manual and automated testing.

●    Deep domain expertise in complex system validation and advanced automation practices at scale.

●    Proficiency in programming languages like Python to build and run automated test scripts.

●    "Strong knowledge of software testing methodologies, performance testing tools (e.g., JMeter, k6), and security traffic generation/simulation tools (e.g., Ixia BreakingPoint, Scapy, or Snort/Suricata traffic generators)."

●    Understanding of continuous integration/continuous deployment (CI/CD) pipelines and version control systems like Git.

●    Strong communication skills for documenting test results and interacting with cross-functional teams.

●    Excellent analytical skills, attention to detail, and problem-solving ability.

●    Ability to work independently as well as collaboratively in a team environment.

●    A curious mindset with a willingness to quickly learn new technologies and testing tools.

Required Skills & Qualifications

●    Familiarity with cloud-based testing environments (GCP, AWS, Azure).

●    Experience with cybersecurity products or cloud services or IDP or Web UI

The Mindset

●    Problem Solver: You thrive on complex, ambiguous challenges and engineer elegant solutions.

●    Ownership‑Driven: You take initiative, move fast, and deliver outcomes without hand‑holding.

●    Continuous Learner: You stay ahead of the curve in AI, ML, and emerging technologies.

●    Startup DNA: You excel in fast‑moving environments where priorities evolve and impact is immediate.

Senior Automation Testing Engineer

Location: Bengaluru / Gurugram – Onsite

Experience: 5–11 Years

Employment Type: Full-Time

Key Responsibilities

• Develop and maintain automation test frameworks and scripts.
• Perform both manual and automation testing, including exploratory, functional, regression, and bug verification.
• Develop test cases and contribute to test planning, estimation, and Agile ceremonies.
• Perform non-functional testing for accuracy, reliability, and performance.
• Drive QA process and automation improvements.

Required Skills

• BE/B.Tech/ME/M.Tech in CS/ECE/EE or related field.
• 5–11 years of software testing experience.
• Strong hands-on experience with Python/Java, Selenium, Cucumber, and PyTest.
• Good knowledge of SDLC, testing methodologies, defect lifecycle, and risk assessment.
• Experience with version control and bug-tracking tools.

Good to Have: Linux, Qt/QML, Squish, ISTQB/CSM/PSM, and regulatory/compliance standards.

SDET – Software Development Engineer in Test

Experience: 2–5 Years

Location: Bangalore / Gurugram

Employment Type: Full-Time

Mandatory Skills

• 2–5 years of relevant experience in SDET / QA Automation / Software Testing.
• Strong hands-on experience in:
• Functional Testing
• API Testing
• Performance Testing
• Good programming/coding skills with the ability to read, write, troubleshoot, and debug code.
• Experience with automation testing frameworks/tools such as Selenium, Playwright, Cypress, Appium, etc.
• Hands-on API testing experience using tools such as Postman, REST Assured, RestSharp, or similar.
• Practical experience with performance testing tools such as JMeter, LoadRunner, k6, Gatling, or equivalent.
• Good understanding of SDLC, STLC, defect lifecycle, and testing methodologies.
• Strong analytical and problem-solving skills.

Good to Have

• Experience with Java, Python, JavaScript/TypeScript, C#, or other programming languages.
• Experience with .NET / C#.
• SQL/database testing experience.
• CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps, GitLab CI, etc.
• Experience with Docker/cloud environments.
• BDD frameworks such as Cucumber or SpecFlow.
• Experience working with Agile/Scrum teams.

If Interested, share CV : snigdhaattheratebeanhr.com

Looking for 3 years exp SDET - Java Selenium, API Automation, rest assured, Jmeter Writing data driven functional testscripts using java selenium Writng scripts for API automation with RestAssured Enterprise grade test frameworks, test automation and CI/CD Immediate joiner, Location: Bangalore Work from office.

Please apply with NoticePeriod:

CTC:

ECTC:

Work from office(Y/N):

Location Bangalore (Y/N):

Senior Quality Engineer

Notice Period: Immediate

Purpose of the Job:

We are seeking a highly skilled and experienced Senior Quality Engineer to join our Enterprise Technology and Data team. This role is crucial in ensuring the delivery of high-quality data-driven solutions and applications across our enterprise systems. The ideal candidate will have deep expertise in quality engineering, automated testing, and extensive experience in testing large-scale data systems, particularly in ETL processes and working with Azure Fabric and Google Cloud data platforms such as BigQuery and Google Cloud Data Pipelines.

As a Senior Quality Engineer, you will be responsible for defining and implementing quality assurance processes, developing automated tests, identifying and mitigating risks, and ensuring the overall quality of our technology and data platforms across multi-cloud environments (Azure and Google Cloud Platform). You will work closely with cross-functional teams including developers, data engineers, and product managers to ensure that the highest standards of quality are maintained throughout the software development lifecycle.

Main Activities:

1. · Test Planning & Execution: Design detailed test strategies/plans, test cases, and test scripts to validate data accuracy, integrity, and system functionality in ETL pipelines across Azure and GCP (e.g., Dataflow, Data Fusion, BigQuery pipelines), including both functional and non-functional testing.
2. · Data Quality: Collaborate with data engineers to monitor and ensure the accuracy, completeness, and consistency of data across various data platforms including Azure Synapse/Fabric and Google BigQuery, validating transformations and data integrity in ETL pipelines.
3. · Data Pipeline Testing: Collaborate with data engineering teams to design and execute tests for Data pipelines running on Azure Fabric as well as Google Cloud services such as Dataflow, Dataproc, and Pub/Sub-based pipelines, ensuring transformation, integration, and storage processes function as expected.
4. · SQL Database Testing: SQL Database Testing: Development and execution of SQL-based automated tests for database validation, ensuring data integrity, performance, and security across multiple databases including BigQuery datasets and Azure SQL/Synapse environments.
5. · Performance Testing: Conduct performance testing to evaluate the scalability, stability, and performance of large-scale data systems across distributed cloud platforms including Azure and GCP.
6. · Automated Testing: Develop and maintain automated test frameworks for data applications, including ETL processes, APIs, and data integration systems using industry-standard tools, and extend automation to support BigQuery validation, GCP pipeline testing, and AI/ML data validation scenarios.
7. · Defect Tracking & Resolution: Work with development and operations teams to identify, report, and track defects across multi-cloud data ecosystems, ensuring timely resolution.
8. · Continuous Improvement: Propose and implement improvements to testing processes and frameworks to increase efficiency and effectiveness of quality assurance efforts across Azure and Google Cloud-based data platforms and AI-enabled data solutions.
9. · Collaboration: Partner with business stakeholders, project managers, and technical teams to ensure alignment with quality goals and deliverables across enterprise data platforms spanning multiple cloud providers.
10. · Mentorship: Provide guidance and mentorship to junior quality engineers, helping them improve their technical skills in modern data testing practices including cloud-native and AI-driven validation techniques.
11. · Compliance & Best Practices: Ensure adherence to industry standards and best practices related to software quality, particularly in relation to data systems, ETL processes, and cloud technologies including Azure and Google Cloud Platform environments.

Knowledge/Skill Requirements:

· Education:

1. o Bachelor’s degree in computer science, Information Technology, Engineering, or a related field.
2. · Experience:
3. o 5+ years of experience in software quality engineering, with at least 3 years of experience in an enterprise data environment.
4. o Proven experience in automated testing tools (e.g., Selenium, JUnit, TestNG, or similar frameworks).
5. o Hands-on experience with data validation, transformation, and data pipeline testing in cloud environments, specifically Azure and/or Google Cloud Platform (GCP).
6. o Strong understanding of data management, data warehousing, ETL processes, and data integration.
7. o Experience with data warehousing, data lakes, and cloud-based ETL tools including Azure Data Factory, Azure Synapse, Google BigQuery, Dataflow, and Dataproc is a plus.

Technical Skills:

1. o Proficient in scripting languages (e.g., Python, Java, SQL) for test automation and ETL process validation.
2. o Experience working with Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, as well as Google Cloud services such as BigQuery, Dataflow and Cloud Composer (Airflow) for data pipeline orchestration and validation.
3. o Strong knowledge of software development methodologies (Agile, Scrum, Waterfall) and experience in a continuous integration/continuous deployment (CI/CD) environment.
4. o Familiarity with version control systems (e.g., Git), CI/CD tools (e.g., Jenkins, Azure DevOps), and cloud infrastructure (e.g., Azure, GCP).
5. · Soft Skills:
6. o Strong analytical, problem-solving, and troubleshooting skills.
7. o Excellent communication skills, with the ability to collaborate effectively across departments.
8. o Detail-oriented with a passion for ensuring high-quality standards in data-driven solutions.
9. o Ability to work independently and as part of a team, managing multiple priorities in a fast-paced environment.
10. · Certifications/Additional Training – Nice-to-Have:
11. o Relevant certifications (e.g., Azure DevOps, Azure ML, ISTQB, Google Cloud Professional Data Engineer or Professional Cloud Developer) are a plus.
12. o Experience working with data governance tools such as Azure Purview and ensuring data compliance

Strong Senior QA/SDET Profile with hands-on automation building and QA-function ownership

2

Mandatory (Experience 1): Must have 6+ years in QA/test automation/SDET roles with clear progression in scope (Engineer to Senior to Lead)in a B2B SaaS product company

3

Mandatory (Experience 2): Must have direct experience scaling a QA function at a SaaS company and building automation frameworks or QA processes from scratch

4

Mandatory (Tech skill 1): Must have hands-on UI automation experience with Selenium (Java + TestNG) or Playwright / Cypress (JavaScript / TypeScript) using maintainable design patterns like Page Object Model

5

Mandatory (Tech skill 2): Must have API testing & automation experience with Postman and RestAssured (or equivalent) for functional, integration, and contract testing

6

Mandatory (Tech skill 3): Must have experience with CI/CD integration (Jenkins or GitHub Actions) and Git for version control

7

Mandatory (Skill 1): Must have a strong grasp of Agile / Scrum delivery and JIRA for defect and test management

8

Mandatory (Skill 2): Must have experience leading or mentoring QA engineers and collaborating cross-functionally with developers and product teams

9

Mandatory (Skill 3): Must have solid experience using AI in test automation and manual testing exposure

10

Mandatory (Communication): Must have strong communication skills for cross-functional collaboration

11

Mandatory (Company): Must come from a B2B SaaS

Who are we?

Trendlyne is a funded, profitable products startup in the financial markets space. We have cutting-edge analytics products built for Indian and US customers, for stock markets and mutual funds.

Our founders are IIT + IIM graduates, with strong tech and marketing experience. We have top finance and management experts on the Board of Directors.

What do we do?

We build powerful analytics in the US and Indian stock market space that are best in class. Organic growth in B2B and B2C products have already made the company profitable. We deliver 1 billion+ APIs every month to B2B customers, and have a B2C website and app.

Tech Stack :

• Postman
• Playwright
• Jenkins

Job Responsibilities :

• Design, develop, and maintain scalable UI and API automation frameworks from scratch.
• Build and execute automated test suites for frontend, backend, and API applications using tech stacks like Playwright, Selenium, and Postman.
• Develop automation for web applications, APIs, and distributed microservices.
• Perform white-box and black-box testing to ensure application quality.
• Integrate automation suites into CI/CD pipelines using tools like Newman and Bruno CLI.
• Identify, track, and resolve defects while improving test stability, execution speed, and overall automation efficiency.
• Collaborate with developers, DBAs, and product managers to ensure quality throughout the development lifecycle.
• Drive continuous improvements in automation frameworks, testing methodologies, and engineering processes.

Required Skills & Qualifications :

• 1-3 years of experience as an SDET, Automation Engineer, or Full-Stack QA.
• Experience with UI automation using Playwright and Selenium.
• Strong experience in API testing and automation using Postman.
• Proficient in JavaScript for building automation scripts, API test assertions, and test utilities.
• Experience with white-box and black-box testing, and automation design patterns such as Page Object Model (POM).
• Familiarity with BDD frameworks (e.g., Cucumber) and modern testing practices.
• Experience with Git and integrating automation suites into CI/CD pipelines using Jenkins, GitHub Actions, or GitLab CI.
• Working knowledge of SQL for database validation and backend testing.

Job Title: Test Automation Engineer

Experience Required: 2+ Yrs. of very recent experience

Work Location: Gurugram, Haryana (Regular Work from Office)

Work Timings: 04:30 PM 01:30 AM IST (Monday Friday)

Employer Company: Alldomainsoft.com Pvt. Ltd. (alldomainsoft.com)

US Client: Avive Solutions, Inc. (avive.life)

Note: Local candidates preferred. Unsuitable for Java based profiles.

About the Role

As a Test Automation Engineer at Avive, you will play a critical role in ensuring the quality and reliability of our software products. You will build and maintain automated test coverage using Python, Pytest, and BDD frameworks alongside Selenium, focused on validating web application behavior, data accuracy, user permissions, and simulated device communication protocols. Partnering closely with Software Engineering, you will help shape test strategy and expand coverage as new features and functionality are shipped.

What You'll Do including but not limited to:

1. Test Automation Development Design, build, and maintain automated test suites using Python, pytest, and BDD frameworks to validate web application functionality.

• Develop and maintain Selenium-based automation to verify data is displayed accurately across the website.
• Create automation that simulates device communication protocols to validate that data generated by connected devices is correctly received, processed, and reflected on the website.

2. Software Verification

• Expand and maintain automated regression suites that catch defects early and give the team confidence as new features are released.
• Identify gaps in existing test coverage and prioritize new automation based on risk and impact.
• Investigate test failures, determine root cause, and work with Software Engineering to resolve issues.

3. Process & Tooling

• Document, organize, and maintain test cases in Jira using Xray, ensuring traceability between requirements, test coverage, and results.
• Report, track, and prioritize bugs in Jira, working with Software Engineering through resolution.
• Evaluate and integrate new tools, libraries, or frameworks that improve test efficiency, coverage, or maintainability.
• Contribute to CI/CD pipeline integration for automated test execution.
• Continuously refine test strategy and best practices as the product and codebase evolve.

Who You Are

• BS/B.Tech./B.E. in Computer Science, Software Engineering, or a related field (equivalent experience considered).
• 2+ years of experience in software test automation.
• Strong proficiency in Python, with hands-on experience using pytest and BDD frameworks (e.g., pytest-bdd, Behave, or Cucumber)
• Solid experience building and maintaining automated UI tests with Selenium.
• Experience testing web applications, including validating data accuracy, user permissions/access control, and integrations with external or simulated data sources.
• Familiarity with Jira and Xray (or similar tools) for bug tracking and test case management.
• Comfortable working with APIs and simulating device or system communication protocols for test purposes.
• Exposure to CI/CD pipelines and integrating automated tests into a continuous delivery workflow is a plus.
• Strong analytical and debugging skills, with the ability to trace issues from symptom to root cause.
• Organized, independent, and results-oriented, with the ability to manage multiple test efforts simultaneously.
• Excellent communication skills and strong attention to detail, with a collaborative, process-oriented approach to working with Software Engineering.

LinkedIn: www.linkedin.com/in/rkd94

Apply Link: https://jobs.lever.co/AviveSolutions/c20d1002-7998-4e8b-9209-0a4c590d0c7c

We are seeking a forward-thinking Mid-Level QA Automation Engineer specializing in RPA, financial systems validation, and AI engineering. You will build and scale end-to-end automation workflows using UiPath for our financial services platform. Additionally, you will pioneer our testing evolution by leveraging prompt engineering, creating custom AI agents, and implementing Model Context Protocol (MCP) servers to bridge AI models with our testing infrastructure.

Key Responsibilities and Duties

   RPA Automation:

·    Design, develop, and maintain robust automated testing workflows using UiPath Studio.

 AI Agent Engineering:

·   Architect, build, and orchestrate custom AI agents to autonomously generate,execute, and self-heal test scripts.

Prompt Engineering:

·   Design, optimize, and manage advanced prompt templates to drive deterministic,high-quality code and test case generation from LLMs.

 MCP Integration:

·    Implement and configure Model Context Protocol (MCP) ecosystems to securely connect AI agents with local data, development tools, and testing environments. 

 Financial System Testing:

·   Validate end-to-end trade life cycles, market data processing, and capital market clearing workflows. 

Regression Orchestration

·   Manage continuous regression schedules via UiPath Orchestrator to ensure financial system stability. 

Mandatory skills

Project Mandatory Skills

Project Desired Skills

UiPath Studio and Orchestrator (UI/API automation activities)

Selenium or Playwright for web-based application testing

Building, deploying, and scripting autonomous AI agents for complex engineering workflows

Calypso treasury and capital markets platform

Prompt engineering — context injection, few-shot prompting, and guiding LLMs to exact test requirements

FitNesse for acceptance testing and collaborative documentation

Model Context Protocol (MCP) — using or developing MCP servers/clients to connect AI tools to external data sources and developer environments

TypeScript, Python, or Java to support agent tool calling and framework extensions

 Qualifications

• 3+ years of professional software QA automation or RPA development experience.
•  Strong understanding of capital markets, trading lifecycles, treasury workflows, or core banking architectures.
• Strong communication and collaboration skills to work across engineering, QA, and business teams.