Android Developer

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years

Job Summary

We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.

Key Responsibilities

• Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
• Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
• Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
• Write and maintain BDD Cucumber feature files integrated with automation suites.
• Execute manual + automated testing across diverse application layers with focus on edge cases.
• Implement Git branching strategies, code reviews, and repository best practices.
• Track defects and manage test lifecycle using ServiceNow or similar tools.
• Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.

Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)

Technical Stack

Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards

Preferred Qualifications

• Exposure to AI testing frameworks (LangSmith, Promptfoo)
• Experience with containerization (Docker) and Kubernetes
• Knowledge of performance testing for AI workloads
• AWS/GCP cloud testing experience
• ISTQB or relevant QA certifications

What We Offer

• Work on next-gen AI/LLM products with global impact
• Modern tech stack with Azure-native DevOps
• Flexible hybrid/remote work model
• Continuous learning opportunities in AI testing

Technical Proficiency: In-depth knowledge of specific technical domains relevant to the industry, such as programming languages, software applications, or machinery.

Instructional Design Expertise: Ability to develop structured training programs that cater to various learning styles and effectively convey complex information.

Communication Skills::Strong verbal and written communication skills to explain technical concepts clearly and concisely.

Analytical Abilities: Skill in evaluating training outcomes and identifying areas for improvement.

Location: Hyderabad

Work Mode: Hybrid (2 days WFO)

Experience Required: 4.5+ years

Notice Period: Immediate Joiners Preferred

Employment Type: Full-Time

Mandatory Requirements:

• 4.5+ years of experience in Java Development
• Hands-on experience with AWS in a production environment
• Must be available to join immediately
• Must be willing to work in Hybrid mode from Hyderabad

Technical Skill Requirements:

• Strong hands-on experience in Core Java, Spring Boot, and Microservices
• Solid understanding of OOP concepts, Multithreading, and REST APIs
• Practical knowledge and experience working with AWS services like EC2, Lambda, S3, RDS, SNS, etc.
• Familiarity with CI/CD tools and version control systems (Git)
• Good knowledge of SQL and NoSQL databases
• Ability to write clean, efficient, and well-documented code

Key Responsibilities:

• Design, develop, and maintain scalable Java-based backend applications
• Implement and integrate AWS services to ensure scalability and reliability
• Collaborate with cross-functional teams including QA, DevOps, and Front-end developers
• Optimize application performance and troubleshoot issues in a timely manner
• Participate in code reviews, sprint planning, and team discussions
• Ensure best practices in code quality, security, and documentation
• Handle deployments and production support if needed

Roles:

• Developing core infrastructure in Python, Django.
• Developing models and business logic (e. g. transactions, payments, diet plan, search, etc).
• Architecting servers and services that enable new product features.
• Building out newly enabled product features

• Minimum 4 years of industry or open-source experience.
• Proficient in at least one OO language: Python(preferred)/Golang/Java.
• Writing high-performance, reliable and maintainable code.
• Good knowledge of database structures, theories, principles, and practices.
• Experience working with AWS components [EC2, S3, RDS, SQS, ECS, Lambda].

Responsibilities

• Understand both functional and non-functional requirements and translate them into tasks that can be worked upon individually or in a team.
• Use your skills in programming and system design to develop robust and scalable software.
• Perform POCs and build solutions that require integration with other systems.
• Provide estimations for a Sprint or Tasks, and share inputs in design and architectural choices.
• Work in a fast-paced environment and contribute to all phases of SDLC.
• Maintain minimal yet essential engineering documentation to complement the product.
• Collaborate with engineers, product, and business teams as part of Agile delivery.
• Perform code reviews and provide guidance to the team in building software and following the defined process.
• Carry an ownership attitude when working on any solution.

Requirements

• Strong at problem-solving using Java 8 and above.
• Good understanding of SDLC using agile methodologies iterative development.
• Basic skills in HTML, CSS, and JavaScript are desired.
• Hands-on knowledge of using Spring Boot or Quarkus for building Microservices or API driven solutions.
• Good knowledge of SQL and experience in using any RDBMS like MySQL, PostgreSQL.
• Understanding or exposure to Cloud-Native development using AWS is an added advantage.
• Any experience in working on projects built using Microservice architecture, esp if using React and Java with Docker is an added advantage.

Java Elastic Search

• Java Microservices ELK stack(Elasticsearch, Logstash, Kibana, Beats, X-Pack, APM),
• Build Custom Reports

Java + NodeJS

• Java with Node.js- Microservices Development,
• Using graphql with node.js,
• Backend development with Node.JS

Java Microservices

• Working experience in Java and spring boot (microservices)
• Strong understanding of OOPs concepts
• Proficient in API design and development using RESTful services
• Knowledge and understanding of design principles behind building a scalable application
• Source code management using git

About the Role

We, at upGrad, believe in giving ownership and responsibility to each one of the team members. As an iOS Developer, you will be a part of the iOS app development team and strive to deliver the best learning experience out there to our learners that upGrad is known for. You will be responsible for developing features, taking those features to production and maintaining the existing code.

Innovative nature and pro-active involvement in the product is taken very seriously at upGrad, therefore, a major part of your role would involve thinking about new features and new ways to deliver quality learning experience to our learners.

Roles & Responsibilities

• Own end to end development and operations of high-performance software development team.
• Design the architecture and deliver clean, testable, and scalable code 
• Participate in requirement gathering and display a strong sense of ownership and delivery 
• Maintain high standards of software quality within the team by
• Participating in regular peer-reviews of solution designs and related code 
• Provide technical leadership to teammates through coaching and mentorship.

Skills Required

• Minimum 6 years of strong iOS development experience with at least 2 Apps Published on App Store of Enterprise Platform.
• Strong Swift concepts along with OOPS, Computer Science fundamentals, Memory Management, App Profiling experience.
• In depth understanding of frameworks like UIKit, Foundation classes, AutoLayout, Core Data, Networking, Collections, GCD, ARC.
• Solid understanding to write modular code, template based programming which is Unit testable (Critical Requirement)
• Solid understanding of iOS architectural patterns especially VIPER (and MVVM) and their importance in scalable software development process.
• Prior understanding of Git (must have), JIRA, Trello, Confluence, etc
• Experience in iOS UI creation using Storyboards, XIB and Code.
• Experience with standard libraries like RxSwift, Swinject, Alamofire, etc.
• Good written and verbal communication.
• Ability to collaborate with multiple teams to work on different phases of the project.
• Knowledge about App Store, publishing an app and the common rejection reasons.