
AI/LLM Test Automation Engineer (SDET)
Location: Bangalore (Hybrid preferred)
Experience: 5-8 Years
Job Summary
We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.
Key Responsibilities
- Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
- Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
- Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
- Write and maintain BDD Cucumber feature files integrated with automation suites.
- Execute manual + automated testing across diverse application layers with focus on edge cases.
- Implement Git branching strategies, code reviews, and repository best practices.
- Track defects and manage test lifecycle using ServiceNow or similar tools.
- Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.
Mandatory Skills & Experience
✅ 5+ years SDET/Automation experience
✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)
✅ Azure DevOps YAML pipelines (CI/CD end-to-end)
✅ AI/LLM testing (prompt engineering, model validation, RAG testing)
✅ Cucumber BDD (Gherkin feature files + step definitions)
✅ Git (branching, PRs, GitFlow)
✅ ServiceNow/Jira defect tracking
✅ Manual + Automation testing (web/mobile/API/backend)
Technical Stack
Programming: Java, Python, JavaScript
CI/CD: Azure DevOps, YAML Pipelines
Testing: Selenium, Playwright, REST Assured, Postman
BDD: Cucumber (Gherkin), JBehave
AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)
Version Control: Git, GitHub/GitLabDefect
Tracking: ServiceNow, Jira, Azure Boards
Preferred Qualifications
- Exposure to AI testing frameworks (LangSmith, Promptfoo)
- Experience with containerization (Docker) and Kubernetes
- Knowledge of performance testing for AI workloads
- AWS/GCP cloud testing experience
- ISTQB or relevant QA certifications
What We Offer
- Work on next-gen AI/LLM products with global impact
- Modern tech stack with Azure-native DevOps
- Flexible hybrid/remote work model
- Continuous learning opportunities in AI testing

About Ladera Technology
About
Similar jobs
Job Title: Product Owner / Product Manager
📍 Location: Hyderabad
🕓 Employment Type: Contract
🧠 Experience Required: 10+ Years
Job Purpose
We are seeking an experienced Product Owner / Product Manager to lead a team responsible for the design, development, deployment, and continuous improvement of global application products and integration platforms.
This role provides functional and technical expertise across multiple enterprise technologies — including BAI MQFT, BizTalk, MuleSoft, OpenText, Solace, and TWS (Tivoli Workload Scheduler) — ensuring delivery excellence, operational stability, and business alignment.
As part of the Global Applications Service Delivery Team, the Product Owner will collaborate with stakeholders across regions, manage vendor relationships, and drive Agile and ITIL-based service delivery and product management practices.
Key Responsibilities
Product & Service Ownership
- Own the end-to-end lifecycle management of integration and application services (BAI MQFT, BizTalk, MuleSoft, OpenText, Solace, TWS).
- Lead design, development, deployment, and support of global IT solutions aligned with business strategies.
- Drive continuous improvement and ensure products evolve effectively to meet changing business needs.
- Maintain awareness of industry trends and emerging technologies to recommend innovative, cost-effective solutions.
Delivery & Vendor Management
- Manage 3rd-party vendors, ensuring delivery excellence through defined SLAs, KPIs, and performance metrics.
- Oversee service delivery operations, ensuring availability, reliability, and performance standards are met.
- Serve as the primary escalation point for business demands and critical incidents.
Leadership & Team Development
- Lead and mentor a global team (up to 10 associates plus vendor resources), fostering a high-performance, collaborative environment.
- Develop talent and succession plans to ensure sustainability of technical and business expertise.
- Promote Agile methodologies and DevOps practices, acting as a role model for collaborative and adaptive behaviors.
Stakeholder Management
- Collaborate with business stakeholders, IT leadership, and cross-functional teams (Platform, Database, Security, Deployment, etc.) to align IT solutions with business goals.
- Provide regular progress updates to stakeholders on demands, deliverables, and service performance.
- Build and sustain a network of key users, functional experts, and product owners globally.
Governance & Financial Management
- Manage product area budgets, ensuring cost optimization and transparency.
- Contribute to strategic planning and support the HUB Talent Pipeline strategy.
- Ensure compliance with IT governance, risk management, and service introduction frameworks.
Qualifications & Experience
Education:
- Bachelor’s degree in Information Technology, Computer Science, or a related field.
Experience:
- Minimum 10+ years of experience in SAP ABAP development and product management.
- Strong technical and functional knowledge of integration technologies:
- BAI MQFT, Microsoft BizTalk, MuleSoft, OpenText, Solace, TWS (Tivoli Workload Scheduler)
- Experience managing global IT delivery teams and vendor resources.
- Exposure to FMCG (Fast-Moving Consumer Goods) industry preferred.
- Proven experience with Agile, Scrum, ITIL, DevOps frameworks.
- Certifications in ITIL, Agile/Scrum, PMI, or DevOps will be an advantage.
Key Competencies
Technical & Functional Skills:
- Product Lifecycle Management
- Service Delivery & ITIL Processes
- Stakeholder Relationship Management
- Vendor Management
- Service Level Management (SLM)
- Agile / Scrum / DevOps Methodologies
- SAP ABAP Expertise
Leadership & Behavioral Competencies:
- Strategic Thinking & Problem Solving
- Team Building & Talent Development
- Customer-Centric Mindset (“Zero Distance to Customer”)
- Dealing with Ambiguity & Complex Challenges
- Strong Communication & Collaboration Skills
Requirements:
- 7+ years in enterprise application development
- Proven track record of delivering complex digital solutions
- Advanced knowledge of React hooks, context API, and component and global state management
- Experience with atomic design, component libraries, and TypeScript
- Proficiency in React performance optimization and modern features
- Strong experience with modern .NET (6+)
- Proven track record applying Clean Architecture & Clean Code & SOLID principles & DDD patterns
- Expertise in building scalable REST APIs and microservices
- Experience with Azure Service Bus, Event Grid, and message-based architectures
- Proficiency in resources like App Insights, Function Apps, Key Vaults, and App Services
- Expertise in cloud development and deployment strategies
- Strong understanding of business needs, ability to meet them by creating cutting-edge solutions
- Brilliant communication abilities, knowing how to explain technical details and processes to a non-tech person
- Fluency in English
Nice to have:
- Test automation (Playwright/Cypress)
- Building CI/CD pipelines in Azure DevOps
- API-first development and OpenAPI specifications
- Experience with agile at scale (SAFe/Spotify)
- Proficiency with AI-powered development tools (GitHub Copilot, Cursor, etc.) to enhance productivity
- Bachelor's or Master's degree in Computer Science or a related field
Responsibilities:
- Front-end, API, and back-end development, ensuring the successful delivery of digital solutions
- Drive innovation by staying informed about emerging technologies, industry trends, and best practices
- Collaborate with the Product Manager, UX/UI Designers, and Engineering Manager to define agile technical requirements, provide technical estimation, and prioritize backlogs based on business needs and technical feasibility
- Participate in sprint planning, backlog grooming, and release planning meetings to ensure alignment between technical implementation and product roadmap
- Participate in hands-on development activities, including coding, debugging, and troubleshooting, to deliver high-quality applications
- Design, architecture, development of digital applications, ensuring adherence to best practices, coding standards, and architectural principles
- Design scalable architectures for multi-region deployment
- Implement test automation strategies and frameworks to automate testing processes and ensure the quality and reliability of applications
- Automate test cases and integrate testing into the CI/CD pipeline
- Conduct code reviews to ensure adherence to coding standards, best practices, and architectural guidelines
- Define and implement code best practices, development standards, and documentation processes to maintain code quality and readability
- Integrate digital applications with existing digital assets, backend systems, and third-party APIs, ensuring seamless data exchange and interoperability
- Collaborate with integration teams to design and implement integration solutions that meet business requirements and architectural standards
- Communicate technical concepts and solutions to non-technical stakeholders in a clear and understandable manner
Responsibilities:
1. Sales Generation:
· Identify and prospect potential clients to generate new business opportunities.
· Conduct effective sales presentations and product demonstrations to showcase the value proposition of our offerings.
· Collaborate with the sales team to develop and implement sales strategies to achieve revenue targets.
· Follow up with leads and coordinate the entire sales cycle from initial contact to closing deals.
2. Client Relationship Management (only for Senior Associate):
· Build and maintain strong relationships with clients by understanding their needs and providing tailored solutions.
· Provide exceptional customer service and address client inquiries and concerns promptly and professionally.
· Conduct regular client follow-ups to ensure client satisfaction and identify opportunities for upselling or cross-selling.
3. Market Analysis (only for Senior Associate):
· Stay updated on industry trends, market conditions, and competitor activities.
· Conduct market analysis to identify potential business opportunities and target markets.
· Gather customer feedback and market insights to contribute to product and service enhancements.
4. Sales Administration:
· Maintain accurate and up-to-date sales records, including customer profiles, sales activities, and pipeline management.
· Prepare sales reports and forecasts for management review.
· Collaborate with the sales team and other departments to streamline processes and improve sales effectiveness.
Qualifications and Skills:
· Bachelor's degree in Business, Marketing, or a related field.
· Proven track record of 1-3 years in sales or business development roles for an associate and 4-6 years in sales and business development roles for a senior associate, preferably in a B2B environment.
· Relevant experience like training Industry, HR consultancy, etc
· Strong negotiation and persuasion skills with the ability to close deals.
· Excellent communication and presentation skills, both verbal and written.
· Self-motivated and target-driven, with a demonstrated ability to work in a fast-paced sales environment.
· Strong interpersonal skills with the ability to build rapport and establish long-term client relationships.
Benefits:
· Opportunities for career growth and professional development.
· Collaborative and supportive work environment.
· Ongoing training and skill development programs.
Clinical Trials are the biggest bottleneck in bringing new drugs, devices, and vaccines to patients. On average, getting a new drug through the trial process takes nearly a decade and frequently costs $1B+. To make it worse, the process is inflicted with a great number of transparency issues. We are aiming to solve this through technology and platformization of clinical trials. We develop and offer next-generation technology platforms to pharmaceutical and biotech companies for running their clinical trials by integrating the entire process in an end-to-end workflow. Since Day 1, our vision is to make clinical trials faster, seamless, accessible to patients, and more transparent. We are driven by our technology-first approach to reduce inefficiency and increase patient-centricity in Clinical Trials. Founded by IIT Roorkee Alumni, Triomics is backed by top investors such as Y Combinator, Nexus Venture Partners, and General Catalyst.
Responsibilities:
1. Writing clean, modular, scalable, and reusable code with well-maintained documentation.
2. Working closely with the founding team to come up with product implementation architecture.
3. Designing and Implementing APIs while closely collaborating with front-end developers.
4. Implementing a stable and automated DevOps pipeline with state-of-the-art cloud services.
5. Developing database schemas and routinely evaluating them as per product requirements.
6. Maintaining a high coverage of testing by implementing Unit as well as Integration tests.
Tech Stack:
Our tech stack includes Python, Django, PostgreSQL for the backend, and ReactJS for the frontend.
We also use Celery and Redis for scheduling and multiple AWS services combined with docker for
deployment.
Requirements:
1. Bachelors in Computer Science or related field with 1-6 years of experience
2. Have implemented and deployed at least 1 or 2 production-level applications in the past.
3. Strong experience with Python (Django) as well as REST APIs.
4. Comfortable working with SQL Databases (Preferably PostgreSQL)
5. Experience with DevOps - Docker or Kubernetes, CI/CD pipelines, and AWS.
6. Prior experience of working in an early-stage startup environment is a plus.
Benefits:
1. Competitive CTC: 10-30% hike in the fixed component from your last or current salary +
ESOPs ( 10 - 25L)
2. Rent-Free accommodation in Gurugram
3. Flexible paid time off for full-time employees & paid leave for new parents
Almost a decade old, it is a venture committed to bring together a varied range of traditional crafts and techniques of dyeing, weaving, printing and hand embroidery. The founders have dedicated their life to promote Indian Block Prints and provide employment and Hand-Embroidery training to women so that numerous underprivileged women can be empowered.
What you will do:
- Handling the return filing of EPF and ESIC with a consultant
- Filing GST Return (3B and GSTR-1)
- Reconciling of sales data and preparing data for GST return (GSTR-1 & 3B)
- Managing revenue booking and its auditing
- Handling GST audit and TDS return filing
- Processing, reconciling and managing payment/refund
- Coordinating with stakeholders such as various internal departments
- Processing and reconciling invoices
- Payroll processing and its controlling and also ensuring statutory compliance while handling the same
- Handling and managing PCS rate payment
- Book-keeping and maintaining financial records and financial statements related to payroll of the company
- Maintaining up-to-date and accurate records of the financial details related to payroll and reporting the same to the management in regular intervals
Desired Candidate Profile
What you need to have:- Graduation in Commerce is a must
- Relevant work experience of 6-7 years in handling payroll (finance)
- E-commerce, retail or manufacturing background is preferred
- Proficiency in Excel
- Good in communication skills and with an eye to detail
Data Engineer - GCP - data migration/PostGres/ORACLE
Budget : 200,000 Rs/Month
Domain Knowledge : Banking
Contract Hire : 12 Months
No. of Open Position : 2 Nos
Roles and Responsibilities :
- This role will involve all aspects of data migration with respect to any microservice being migrated.
- Analyze the source schema for the service in question
- Skilled at using the migration design to produce an instance of any templates or artifacts required to migrate the data
- Deliver a working version of the migration design to migrate the data for the service in question
- Develop a suite of scripts that will allow technical verification - either automated (e.g. - rowcouts) or manual (e.g field comparisons)
- Assist in the triage and resolution of any data related defects
Mandatory skills :
- Previous experience of data migration
- Knowledge of PostGres and ORACLE
- Previous experience of Data Analysis
- We are looking for someone who is a self-learner, exhibits considerable leadership skills , and is an excellent team player. Also good at problem-solving and analytical skills.
Must-Have Skills :
- Strong foundation in data structures & algorithms, OS, I/O, concurrency, hands-on knowledge of Android Ecosystem, Java Tech Stack and Android app Development, a good understanding of UI/UX and principles of Material Design, excellent debugging and optimization skills.
Good to have skills :
- Experience of the end-to-end feature development lifecycle in-app, exposure to memory and performance enhancements










