
AI/LLM Test Automation Engineer (SDET)
Location: Bangalore (Hybrid preferred)
Experience: 5-8 Years
Job Summary
We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.
Key Responsibilities
- Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
- Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
- Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
- Write and maintain BDD Cucumber feature files integrated with automation suites.
- Execute manual + automated testing across diverse application layers with focus on edge cases.
- Implement Git branching strategies, code reviews, and repository best practices.
- Track defects and manage test lifecycle using ServiceNow or similar tools.
- Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.
Mandatory Skills & Experience
✅ 5+ years SDET/Automation experience
✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)
✅ Azure DevOps YAML pipelines (CI/CD end-to-end)
✅ AI/LLM testing (prompt engineering, model validation, RAG testing)
✅ Cucumber BDD (Gherkin feature files + step definitions)
✅ Git (branching, PRs, GitFlow)
✅ ServiceNow/Jira defect tracking
✅ Manual + Automation testing (web/mobile/API/backend)
Technical Stack
Programming: Java, Python, JavaScript
CI/CD: Azure DevOps, YAML Pipelines
Testing: Selenium, Playwright, REST Assured, Postman
BDD: Cucumber (Gherkin), JBehave
AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)
Version Control: Git, GitHub/GitLabDefect
Tracking: ServiceNow, Jira, Azure Boards
Preferred Qualifications
- Exposure to AI testing frameworks (LangSmith, Promptfoo)
- Experience with containerization (Docker) and Kubernetes
- Knowledge of performance testing for AI workloads
- AWS/GCP cloud testing experience
- ISTQB or relevant QA certifications
What We Offer
- Work on next-gen AI/LLM products with global impact
- Modern tech stack with Azure-native DevOps
- Flexible hybrid/remote work model
- Continuous learning opportunities in AI testing

About Ladera Technology
About
Similar jobs
Position Name : Senior Software Architect
📍 Location : UB City, Bengaluru (Hybrid – 3 days in office)
🕒 Experience : 11 to 18 Years
📅 Notice Period : Immediate to 1 month
👥 Open Positions : 2
Role Overview :
- We are looking for a Senior Software Architect to design, build, and scale high-performance SaaS B2B applications.
- The ideal candidate will have deep expertise in MERN stack (MongoDB, Express.js, React.js, Node.js), AWS, and microservices-based architectures.
- This role requires at least 3 Years of experience in an Architect position, with a strong background in building scalable products and handling daily releases.
Key Responsibilities :
- Architect and develop scalable SaaS B2B products using React, Node.js, GraphQL, Elasticsearch, and Micro Frontend Architecture (MFE).
- Design and implement microservices-based distributed systems and RESTful APIs.
- Optimize frontend interfaces using React, Redux, Next.js, HTML, and CSS.
- Develop robust backend APIs using Node.js, Express.js, and MongoDB/PostgreSQL.
- Utilize AWS services (EC2, S3, SQS, SNS, DocumentDB, OpenSearch) and containerization (Docker, Kubernetes).
- Implement scalable database schemas and ensure optimal performance.
- Work with GraphQL for efficient data querying and manipulation.
- Ensure security, reliability, and high availability of the platform.
- Lead and mentor development teams, conduct code reviews, and enforce best practices.
- Collaborate with cross-functional teams to deliver business-driven software solutions.
Required Skills & Experience :
✅ 3+ Years as a Software Architect and currently in an Architect role.
✅ 5+ Years of experience in full-stack development with the MERN Stack.
✅ Strong knowledge of scalable architectures, microservices, and cloud-native SaaS products.
✅ Experience in AWS deployment, cloud infrastructure, and DevOps.
✅ Hands-on experience with Micro Frontends (MFE).
✅ Experience in handling everyday releases and working in Agile environments.
✅ Strong problem-solving skills, logical thinking, and architectural decision-making.
✅ Bachelor’s or Master’s degree in Computer Science or related field.
Preferred :
- Experience in B2B SaaS product development.
- Background in product-based companies.
- No prior experience in Walmart or similar large enterprises.
- Candidates should be based in Bengaluru (Outstation candidates will not be processed).
We are looking for a DevOps Engineer with hands-on experience in managing production infrastructure using AWS, Kubernetes, and Terraform. The ideal candidate will have exposure to CI/CD tools and queueing systems, along with a strong ability to automate and optimize workflows.
Responsibilities:
* Manage and optimize production infrastructure on AWS, ensuring scalability and reliability.
* Deploy and orchestrate containerized applications using Kubernetes.
* Implement and maintain infrastructure as code (IaC) using Terraform.
* Set up and manage CI/CD pipelines using tools like Jenkins or Chef to streamline deployment processes.
* Troubleshoot and resolve infrastructure issues to ensure high availability and performance.
* Collaborate with cross-functional teams to define technical requirements and deliver solutions.
* Nice-to-have: Manage queueing systems like Amazon SQS, Kafka, or RabbitMQ.
Requirements:
* 4+ years of experience with AWS, including practical exposure to its services in production environments.
* Demonstrated expertise in Kubernetes for container orchestration.
* Proficiency in using Terraform for managing infrastructure as code.
* Exposure to at least one CI/CD tool, such as Jenkins or Chef.
* Nice-to-have: Experience managing queueing systems like SQS, Kafka, or RabbitMQ.
- Strong Data Architect, Lead Data Engineer, Engineering Manager / Director Profile
- Mandatory (Experience 1) - Must have 10+ YOE in Data Engineering roles, with at least 2+ years in a Leadership role
- Mandatory (Experience 2) - Must have 7+ YOE in hands-on Tech development with Java (Highly preferred) or Python, Node.JS, GoLang
- Mandatory (Experience 3) - Must have recent 4+ YOE with high-growth Product startups, and should have implemented Data Engineering systems from an early stage in the Company
- Mandatory (Experience 4) - Must have strong experience in large data technologies, tools like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto etc.
- Mandatory (Experience 5) - Strong expertise in HLD and LLD, to design scalable, maintainable data architectures.
- Mandatory (Team Management) - Must have managed a team of atleast 5+ Data Engineers (Read Leadership role in CV)
- Mandatory (Education) - Must be from Tier - 1 Colleges, preferred IIT
- Mandatory (Company) - B2B Product Companies with High data-traffic
Preferred Companies
MoEngage, Whatfix, Netcore Cloud, Clevertap, Hevo Data, Snowflake, Chargebee, Fractor.ai, Databricks, Dataweave, Wingman, Postman, Zoho, HighRadius, Freshworks, Mindtickle
Summary:
We are seeking an experienced Business Analyst/ERP Functional Consultant to work directly with clients, gathering and validating business requirements and mapping them to Odoo ERP functionalities. The role involves conducting GAP analyses, configuring Odoo applications, and delivering user training both remotely and on-site. The consultant will participate in project meetings, track deliverables, and provide ongoing support and guidance on best practices for using Odoo ERP effectively.
Job Responsibilities
- Provide Odoo ERP Functional Consulting expertise utilizing industry experience, strong knowledge of various business domains, business analysis, best practices, and a pragmatic mindset to facilitate our customer’s most complex business requirements.
- Prepare a detailed scope of work(SOW) resulting from personalization sessions to our customers in the pre-sales phase to provide proposed solutions for the customer’s business requirements.
- Responsible for identifying business requirements, requirements management, functional design, system analysis, GAP analysis, end-user training, Preparing BRD, prototyping, process design (including scenario design, flow mapping), testing, defining support procedures, and leading workstreams implementations and supporting end-to-end Odoo ERP implementations.
- Provide Odoo ERP applications solutions to an exclusive range of customers across high profile assignments.
- Provide architectural direction and guidance to all staff from pre-sales through the delivery cycle specifically for the use of the Odoo ERP Business Applications.
- Design and define customizations and integration requirements in collaboration with Application Developers (Technical Team) for delivering solutions to automate business processes.
- Manage the full life cycle of Odoo ERP Implementation and Testing phases.
- Develop solution design from what is available in Odoo as a standard feature(s) and lead the customer throughout the implementation and support phases.
- Assist customers maximize strategic business value from Emipro custom business solutions to provide them with a vision of their end state solution and roadmap.
- Evaluate customer’s business requirements, needs, and objectives and convert the same to company processes, solutions, and modules being implemented.
- Manage all aspects of the configuration process for the customer from configuration through to acceptance and sign-off.
- Supply ERP functional consulting and training services at customer sites upon as and when required by Emipro.
- Create, review, and contribute towards implementation deliverables such as functional specifications, test cases, technical solution/ design, standard operating procedures, etc.
- Interact with the key end-users and business owners to map applications to standard business processes and conduct a gap analysis.
- Ensure that the system accurately meets the defined expectations of the business, proper testing is implemented, and performance and security requirements are closely monitored by working with the Project & Product team of Emipro.
- Troubleshoot issues that arise during configuration sessions.
- Translate business requirements to our technical team members and translate technology solutions from our technical team to the customers.
- Create functional requirements as an input to application design.
- Conduct Cut-over, Go-Live processes, and assists the technical staff by testing the behaviour of the system.
- Supervise, Mentor, and Train junior consultants and business analysts on application and implementation methodology.
- Conduct business process mapping and requirements gathering sessions (workshops) with new customers to determine configuration requirements both on-site and remote.
- Document the settings/configurations and prepare proper guidelines that allow other consultants to do further changes or repairs with due efforts.
- Ensure proper training is given to the end-users and that the new system is usable, performing appropriately and the business flow is complete and correct.
Required Skills
- Minimum 3+ years of relevant work experience in any of the famous ERP systems like Odoo, Oracle, Microsoft Dynamics, SAP, etc.
- Strong knowledge in business domains like Sales, Purchase, Manufacturing, Logistics, Supply Chain, Procurement, Wholesale Industry, Services or Retails, etc.
- Strong business judgement and common sense
- Master in Product Demonstrations
- The initiative, creativity, and a passion to deliver results that make a difference
- Well-rounded individual with varied interests and experience
- Excellent communication (verbal, written, and presentation) and interpersonal skills (outgoing and personable)
- Ability to do multi-task, prioritise and manage time effectively
- Proven experience of working in Migration Projects
- High Focus on Customer Service and is passionate about ensuring customer requirements are met.
- Must have a natural analytical way of thinking and be able to explain difficult concepts to non-technical users.
- Team leading or people management experience can be added advantage.
Roles and Responsibilities
1. Manage client relationships, and facilitators relationship at MHFAI for training and post-training support.
2. Ideate, design, and implement program that focused on post-training support for mental health first-aiders.
3. Leverage the new products of MHFAI to the clients that ensures implementation of mental health by building tools and guidelines (for organized groups).
4. Oversee and facilitate MHFAI instructors for training and upskilling.
5. Monitor and coordinate the MHFAI Awards program with all the stakeholders involved.
6. Draft and initiate scientific research, and create tools required at workplace to measure mental health.
7. Plan and manage webinars, events and activities to promote the idea of mental health at workplaces and educational institutions.
8. Draft, design, manage and implement guidelines / resources with focus on mental health for the benefit of organized groups.
9. Keep up-to-date with the latest trends and best practices in Learning and Development and / or mental health, and incorporate them into our training programs.
10. Manage the Learning and Development budget, ensuring that resources are allocated effectively and efficiently.
11. Provide support in other operational functions of MHFA as needed.
Requirements:
· 4-10 years in Counselling psychology and / or mental health training
· Qualification: Education in Counselling / Medical Psychology
· Experience in clinical work
· Exposure to mental health training
· Experience of having previously worked in organized group is desirable
JD for Senior Software Engineer :
We are seeking an experienced and highly skilled Expert Software Developer with a strong proficiency in ASP .Net, .Net Core, and SQL Server. The ideal candidate should possess exceptional SQL knowledge, capable of working with large schemas, designing complex queries, and proficiently architecting highly scalable web and mobile applications. A desire to learn or existing knowledge of MAUI or Xamarin.Forms is highly valued. The candidate should also have a solid understanding of CI/CD processes using tools like GitHub Actions or equivalent. Beyond technical expertise, this role entails mentoring and coaching junior team members, actively participating in solution design, and contributing to the technical evolution of our projects.
Responsibilities:
- Utilize your expertise in ASP .Net, .Net Core, and SQL Server to design, develop, and maintain robust web and mobile applications.
- Demonstrate mastery in handling large schemas and crafting complex queries for optimal performance.
- Architect scalable solutions that meet the requirements of web and mobile applications.
- Stay updated with the latest industry trends and technologies, with enthusiasm to learn MAUI or Xamarin.Forms.
- Implement and improve CI/CD pipelines using GitHub Actions or equivalent tools.
- Collaborate with cross-functional teams including designers, product managers, and other developers to drive project success.
- Mentor and coach junior team members, sharing your technical knowledge and best practices.
- Contribute to architectural discussions and assist in designing innovative solutions.
- Participate in code reviews, ensuring code quality, performance, and adherence to best practices.
- Troubleshoot and debug issues, providing timely resolutions to technical challenges.
- Stay proactive in identifying opportunities for process improvement and technical optimizations.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
- Expertise in ASP .Net and .Net Core, with a proven track record of building and deploying web and mobile applications.
- Strong proficiency in SQL Server, including experience with large schemas and complex query optimization.
- Experience in designing and architecting highly scalable applications.
- Knowledge or enthusiasm to learn MAUI or Xamarin.Forms is desired.
- Proficiency in CI/CD processes using tools like GitHub Actions or equivalent.
- Excellent problem-solving skills and the ability to troubleshoot complex technical issues.
- 8 to 12 years of professional software development experience.
- Strong teamwork and communication skills, with an ability to collaborate effectively in a cross-functional environment.
- Prior experience in mentoring and coaching junior team members.
- Adaptability and willingness to learn new technologies and frameworks.
- A portfolio of past projects and contributions to showcase technical expertise.
Exp- 8 to 12 yrs
Immediate joiners required
Excellent communication skills are required, With international client experience.
- Key Responsibilities
- Grow social media pages of the company
- Strategize and execute campaigns to drive brand affinity and new consumers
- in-charge of all social media handles of the company (big social networks + new age networks)
- Partner with other brands to co-create campaigns
- Collaborate with other marketing verticals to grow the app community
- Mandatory and good to have experience/ skills.
Mandatory and good to have experience/ skills
-
- 0 to 2 years. Experience with high-growth consumer apps in India is a big plus
- Excellent written and spoken communication skills in the English language are a must. Hindi and other Indian languages are a plus
- Love social media and short video apps. SelfSelf-usage social networks with a good following are a must.
- Key areas of responsibilities:-
- Maintenance and enhancements of current websites.
- System requirement gathering, development, testing and maintenance for new websites or applications.
- Managing user access to the various components of the company’s IT infrastructure based on an assessment of the user requirement and security.
- Managing the admin section for the company’s websites.
Creating an environment for Dreamweaver editor for users to develop applications. - Documentation Designing a database and coordinating the UI design.
- Integrating the MySQL database with the PHP applications.
Maintaining web-based PHP applications. - Designing and developing applications and websites.
Resolving issues related to PHP development in different applications. - Experience and skills required:-
Skills : PHP, Mysql, MVC, JS, JQUERY,HTML,CSS, AJAX , WORDPRESS.
Experience : Min 3 year Qualification: Any technical background (MCA, BE, MSC Computer etc)









