AI Automation Engineer OR LLM Automation Engineer at Ladera Technology · Bengaluru (Bangalore) · 5 - 10 years · ₹15L - ₹20L / yr · Bootstrapped · Posted 3 Dec 2025

AI/LLM Test Automation Engineer (SDET)
Location: Bangalore (Hybrid preferred)
Experience: 5-8 Years
Job Summary
We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.
Key Responsibilities
- Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
- Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
- Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
- Write and maintain BDD Cucumber feature files integrated with automation suites.
- Execute manual + automated testing across diverse application layers with focus on edge cases.
- Implement Git branching strategies, code reviews, and repository best practices.
- Track defects and manage test lifecycle using ServiceNow or similar tools.
- Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.
Mandatory Skills & Experience
✅ 5+ years SDET/Automation experience
✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)
✅ Azure DevOps YAML pipelines (CI/CD end-to-end)
✅ AI/LLM testing (prompt engineering, model validation, RAG testing)
✅ Cucumber BDD (Gherkin feature files + step definitions)
✅ Git (branching, PRs, GitFlow)
✅ ServiceNow/Jira defect tracking
✅ Manual + Automation testing (web/mobile/API/backend)
Technical Stack
Programming: Java, Python, JavaScript
CI/CD: Azure DevOps, YAML Pipelines
Testing: Selenium, Playwright, REST Assured, Postman
BDD: Cucumber (Gherkin), JBehave
AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)
Version Control: Git, GitHub/GitLabDefect
Tracking: ServiceNow, Jira, Azure Boards
Preferred Qualifications
- Exposure to AI testing frameworks (LangSmith, Promptfoo)
- Experience with containerization (Docker) and Kubernetes
- Knowledge of performance testing for AI workloads
- AWS/GCP cloud testing experience
- ISTQB or relevant QA certifications
What We Offer
- Work on next-gen AI/LLM products with global impact
- Modern tech stack with Azure-native DevOps
- Flexible hybrid/remote work model
- Continuous learning opportunities in AI testing

About Ladera Technology
About
Similar jobs (10)
Description
6sense is a Predictive Intelligence Engine that is reimagining how B2B companies do sales and marketing. It works with big data at scale, advanced machine learning and predictive modelling to find buyers and predict what they will purchase, when and how much.
6sense helps B2B marketing and sales organisations fully understand the complex ABM buyer journey. By combining intent signals from every channel with the industry’s most advanced AI predictive capabilities, it is finally possible to predict account demand and optimize demand generation in an ABM world. Equipped with the power of AI and the 6sense Demand Platform™, marketing and sales professionals can uncover, prioritize and engage buyers to drive more revenue.
6sense is seeking a Python Developer to become part of a team designing, developing, and deploying its customer centric applications.
A Python Developer at 6sense will have the opportunity to
- Optimize components for maximum performance across multiple devices and browsers
- Write performant REST APIs for both internal and external consumption
- Build micro services and their deployment process
- Work with problems of scale, employ technologies that are distributed in nature.
- Perform code reviews
Required qualifications and must have skills
- BE/BTech/BS or equivalent
- Excellent analytical and problem-solving skills
- Proven-deep-expertise with Python programming (3 to 8 Years of minimum hands-on experience in Python).
- Hands on with Data structures & Algorithm programming.
- Experience in working with frameworks like Django, Flask, etc.
- Experience with building APIs and services using REST, SOAP, etc.
- Experience with any RDBMS and strong SQL knowledge
- Comfortable with Unix / Linux command line
- Object-oriented concepts & design patterns
Do not miss to reply back, else we will miss meeting an awesome Techies!
As a Motion Graphics Designer at Quick Radius, you do more than bringing graphics to life. You use your strong creative background to create powerful videos that capture an audience and leaves them wanting more. In addition, you have these skills and experiences:
- Strong technical skills and proven ability to use a variety of Adobe software (Photoshop, Illustrator, Premiere Pro, After Effects, Audition)
- The ability to partner with other creative team members and key stakeholders to create content used across a variety of platforms (web, mobile, social media, and more)
- Able to work in a fast paced environment and have strong project management skills
- Interact with clients to understand brief and share ideas
- Be a great communicator, receive and interpret feedback, and meet tight deadlines
- Respond to user feedback, data/analytics, and client feedback to improve the creative work in future iterations
- Ability to work on types of video - Explainer, Promotional, Marketing, SaaS product demo, Social media, Video editing, Animation, Mixed types of video
As a Digital Online Business Development Officer, you will be responsible for identifying business opportunities and developing strategies to generate revenue and grow the business through digital platforms. This is a full-time on-site role located in Mumbai Metropolitan Region, and you will be reporting directly to the Director of Business Development..
QUALIFICATION ; ANY GRADUATE AND ABOVE
EXPERIENCE ; 2 to 3 YEARS + in the same position
GENDER : ANY
PACKAGE : upto 30,000/- p.m. ctc
Job Description
1. To generate Online sales on amazon/Flipkart portal internationally .
Job Description: Customer Service Executive (Hindi Voice Process)
Company: Hippdocloud Technologies
Location: Visakhapatnam
Experience: 0-1 year
Qualification: Any Graduate
Job Overview:
As a Customer Service Executive, you will be responsible for providing excellent customer service to clients in the Hindi language.
You will handle customer inquiries, resolve complaints, and provide information about company products and services.
The role involves communicating with customers primarily through voice calls.
Responsibilities:
Handle incoming customer calls and provide assistance in a professional and courteous manner.
Address customer inquiries, complaints, and provide appropriate solutions.
Maintain accurate and detailed records of customer interactions and transactions.
Collaborate with team members and other departments to ensure customer satisfaction.
Stay updated on company products, services, and policies to provide accurate information to customers.
Follow communication scripts and guidelines to ensure consistent and effective customer interactions.
Identify and escalate priority issues to the appropriate department or supervisor.
Provide feedback and suggestions for process improvements to enhance customer experience.
Requirements:
Fluency in Hindi and Telugu languages is essential.
Excellent verbal and written communication skills in Hindi.
Strong customer service orientation and problem-solving skills.
Ability to handle customer inquiries and complaints with empathy and professionalism.
Basic computer skills and familiarity with CRM systems.
Ability to work in a fast-paced environment and handle multiple tasks simultaneously.
Prior experience in customer service or call center roles is preferred but not mandatory.
Job description
The ideal candidate is a self-motivated, multi-tasker, and demonstrated team player. You will be a lead developer responsible for the development of new software security policies and enhancements to security on existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills.
Responsibilities
- Consulting with management on the operational requirements of software solutions.
- Contributing expertise on information system options, risk, and operational impact.
- Mentoring junior software developers in gaining experience and assuming DevOps responsibilities.
- Managing the installation and configuration of solutions.
- Collaborating with developers on software requirements, as well as interpreting test stage data.
- Developing interface simulators and designing automated module deployments.
- Completing code and script updates, as well as resolving product implementation errors.
- Overseeing routine maintenance procedures and performing diagnostic tests.
- Documenting processes and monitoring performance metrics.
- Conforming to best practices in network administration and cybersecurity.
Qualifications
- Minimum of 2 years of hands-on experience in software development and DevOps, specifically managing AWS Infrastructure such as EC2s, RDS, Elastic cache, S3, IAM, cloud trail and other services provided by AWS.
- Experience Building a multi-region highly available auto-scaling infrastructure that optimises performance and cost. plan for future infrastructure as well as Maintain & optimise existing infrastructure.
- Conceptualise, architect and build automated deployment pipelines in a CI/CD environment like Jenkins.
- Conceptualise, architect and build a containerised infrastructure using Docker, Mesosphere or similar SaaS platforms.
- Conceptualise, architect and build a secured network utilising VPCs with inputs from the security team.
- Work with developers & QA to institute a policy of Continuous Integration with Automated testing Architect, build and manage dashboards to provide visibility into delivery, production application functional and performance status.
- Work with developers to institute systems, policies and workflows which allow for rollback of deployments Triage release of applications to production environment on a daily basis.
- Interface with developers and triage SQL queries that need to be executed in production environments.
- Assist the developers and on calls for other teams with post mortem, follow up and review of issues affecting production availability.
- Minimum 2 years’ experience in Ansible.
- Must have written playbook to automate provisioning of AWS infrastructure as well as automation of routine maintenance tasks.
- Must have had prior experience automating deployments to production and lower environments.
- Experience with APM tools like New Relic and log management tools.
- Our entire platform is hosted on AWS, comprising of web applications, webservices, RDS, Redis and Elastic Search clusters and several other AWS resources like EC2, S3, Cloud front, Route53 and SNS.
- Essential Functions System Architecture Process Design and Implementation
- Minimum of 2 years scripting experience in Ruby/Python (Preferable) and Shell Web Application Deployment Systems Continuous Integration tools (Ansible)Establishing and enforcing Network Security Policy (AWS VPC, Security Group) & ACLs.
- Establishing and enforcing systems monitoring tools and standards
- Establishing and enforcing Risk Assessment policies and standards
- Establishing and enforcing Escalation policies and standards
Day/ UK/ US shift available
J. P Nagar 4th Phase
Speaking to UK/ US customers and resolving querries.
• Experience in Entity Framework, SSRS, Crystal Reports
• Experience in Umbraco, Xamarin, VB6
• Experience in Sitecore
• Experience in SharePoint
• IDE- Visual Studio
• Strong scripting experience (JavaScript, JQuery, HTML, CSS, Bootstrap, HTML 5, Angular, React JS, Node JS, XML, XSLT, and XSL).
• Good Knowledge in Microsoft IIS
• Ability to write SQL queries and investigate DB logs a plus
• Good Knowledge in RDBMS (MS SQL, MySQL, Oracle)
• High degree of knowledge in networking (protocols, virtual networks, subnets, firewalls)
• Understanding and practical application of methodologies like ITIL, Agile, Scrum, DevOps, and SRE.
• Experience with ITSM tools like Service now, Salesforce….etc
Bachelor’s Degree required, preferably in Computer Science or related field
3+ years of Experience working on React.js and its core principles
Experience with popular React.js workflows (such as Flux or Redux)
Experience with cloud based technologies like AWS
Experience with data structure libraries (e.g., Immutable.js)
Knowledge of isomorphic React is a plus
Familiarity with RESTful APIs
Knowledge of modern authorization mechanisms, such as JSON Web Token
Familiarity with modern front-end build pipelines and tools
Experience with common front-end development tools such as Babel, Webpack, NPM, etc.
Ability to understand business requirements and translate them into technical requirements
A knack for benchmarking and optimization
Familiarity with code versioning tools(such as Git, SVN, and Mercurial)
- Develop and manage digital marketing campaigns
- Manage organizations website
- Optimize content for the website and social networking channels such as Facebook, Twitter, Instagram, Google Plus, etc
- Track the website traffic flow and provide internal reports regularly
- Fix any error in online content and arrange webinars and webcasts
- Attend networking events and product launches.
- Identify new digital marketing trends and ensure that the brand is in front of the industry developments.
- Work on SEO of the website pages.
- Edit and post content, videos, podcasts, and audio content on online sites.
- Promote companys product and services in the digital space.
- Execute social media efforts to improve KPIs, likes, shares, tweets, etc.
- Creating and executing SMS, and email-based marketing campaigns.












