Cutshort logo
For Employers
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer

AI Automation Engineer OR LLM Automation Engineer at Ladera Technology · Bengaluru (Bangalore) · 5 - 10 years · ₹15L - ₹20L / yr · Bootstrapped · Posted 3 Dec 2025

Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
100-1000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs (10)

6sense
at 6sense
15 recruiters
SampathKumar Venkatesh
Posted by SampathKumar Venkatesh
Remote only
4 - 9 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconFlask
Data Structures
Algorithms

Description

6sense is a Predictive Intelligence Engine that is reimagining how B2B companies do sales and marketing. It works with big data at scale, advanced machine learning and predictive modelling to find buyers and predict what they will purchase, when and how much.

6sense helps B2B marketing and sales organisations fully understand the complex ABM buyer journey. By combining intent signals from every channel with the industry’s most advanced AI predictive capabilities, it is finally possible to predict account demand and optimize demand generation in an ABM world. Equipped with the power of AI and the 6sense Demand Platform™, marketing and sales professionals can uncover, prioritize and engage buyers to drive more revenue.

 

6sense is seeking a Python Developer to become part of a team designing, developing, and deploying its customer centric applications.

 

A Python Developer at 6sense will have the opportunity to

  • Optimize components for maximum performance across multiple devices and browsers
  • Write performant REST APIs for both internal and external consumption
  • Build micro services and their deployment process
  • Work with problems of scale, employ technologies that are distributed in nature.
  • Perform code reviews

 

Required qualifications and must have skills

  • BE/BTech/BS or equivalent
  • Excellent analytical and problem-solving skills
  • Proven-deep-expertise with Python programming (3 to 8 Years of minimum hands-on experience in Python).
  • Hands on with Data structures & Algorithm programming.
  • Experience in working with frameworks like Django, Flask, etc.
  • Experience with building APIs and services using REST, SOAP, etc.
  • Experience with any RDBMS and strong SQL knowledge
  • Comfortable with Unix / Linux command line
  • Object-oriented concepts & design patterns

 

Do not miss to reply back, else we will miss meeting an awesome Techies!

Read more
Quick Radius
at Quick Radius
1 recruiter
Manish Dodiya
Posted by Manish Dodiya
Ahmedabad
1 - 5 yrs
₹2L - ₹5L / yr
Motion graphic design
Motion graphics
Graphic Designing
2D animation
Video Editing
+8 more

As a Motion Graphics Designer at Quick Radius, you do more than bringing graphics to life. You use your strong creative background to create powerful videos that capture an audience and leaves them wanting more. In addition, you have these skills and experiences:

  • Strong technical skills and proven ability to use a variety of Adobe software (Photoshop, Illustrator, Premiere Pro, After Effects, Audition)
  • The ability to partner with other creative team members and key stakeholders to create content used across a variety of platforms (web, mobile, social media, and more)
  • Able to work in a fast paced environment and have strong project management skills
  • Interact with clients to understand brief and share ideas
  • Be a great communicator, receive and interpret feedback, and meet tight deadlines
  • Respond to user feedback, data/analytics, and client feedback to improve the creative work in future iterations
  • Ability to work on types of video - Explainer, Promotional, Marketing, SaaS product demo, Social media, Video editing, Animation, Mixed types of video
Read more
Modern VR Security Force
Mumbai
3 - 4 yrs
₹3L - ₹4L / yr
Online advertising
Sales

As a Digital Online Business Development Officer, you will be responsible for identifying business opportunities and developing strategies to generate revenue and grow the business through digital platforms. This is a full-time on-site role located in Mumbai Metropolitan Region, and you will be reporting directly to the Director of Business Development..


QUALIFICATION  ; ANY GRADUATE AND ABOVE


EXPERIENCE        ; 2 to 3 YEARS + in the same position


GENDER                : ANY


PACKAGE             : upto 30,000/- p.m. ctc


Job Description          

1.   To generate Online sales on amazon/Flipkart portal internationally .

Read more
Visakhapatnam
0 - 2 yrs
₹1L - ₹2L / yr
Tally
Accounting

Job Description: Customer Service Executive (Hindi Voice Process)

Company: Hippdocloud Technologies

Location: Visakhapatnam

Experience: 0-1 year

Qualification: Any Graduate

Job Overview:


As a Customer Service Executive, you will be responsible for providing excellent customer service to clients in the Hindi language.

You will handle customer inquiries, resolve complaints, and provide information about company products and services.

The role involves communicating with customers primarily through voice calls.

Responsibilities:


Handle incoming customer calls and provide assistance in a professional and courteous manner.

Address customer inquiries, complaints, and provide appropriate solutions.

Maintain accurate and detailed records of customer interactions and transactions.

Collaborate with team members and other departments to ensure customer satisfaction.

Stay updated on company products, services, and policies to provide accurate information to customers.

Follow communication scripts and guidelines to ensure consistent and effective customer interactions.

Identify and escalate priority issues to the appropriate department or supervisor.

Provide feedback and suggestions for process improvements to enhance customer experience.

Requirements:


Fluency in Hindi and Telugu languages is essential.

Excellent verbal and written communication skills in Hindi.

Strong customer service orientation and problem-solving skills.

Ability to handle customer inquiries and complaints with empathy and professionalism.

Basic computer skills and familiarity with CRM systems.

Ability to work in a fast-paced environment and handle multiple tasks simultaneously.

Prior experience in customer service or call center roles is preferred but not mandatory.






Read more
Rheo AI Solutions
at Rheo AI Solutions
5 candid answers
1 video
Avinash S
Posted by Avinash S
Chennai
4 - 8 yrs
Best in industry
DevOps
Ansible
skill iconDocker
skill iconJenkins
skill iconAmazon Web Services (AWS)
+3 more

Job description

 

The ideal candidate is a self-motivated, multi-tasker, and demonstrated team player. You will be a lead developer responsible for the development of new software security policies and enhancements to security on existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills. 

 

 

Responsibilities

  • Consulting with management on the operational requirements of software solutions.
  • Contributing expertise on information system options, risk, and operational impact.
  • Mentoring junior software developers in gaining experience and assuming DevOps responsibilities.
  • Managing the installation and configuration of solutions.
  • Collaborating with developers on software requirements, as well as interpreting test stage data.
  • Developing interface simulators and designing automated module deployments.
  • Completing code and script updates, as well as resolving product implementation errors.
  • Overseeing routine maintenance procedures and performing diagnostic tests.
  • Documenting processes and monitoring performance metrics.
  • Conforming to best practices in network administration and cybersecurity.

 

Qualifications

  • Minimum of 2 years of hands-on experience in software development and DevOps, specifically managing AWS Infrastructure such as EC2s, RDS, Elastic cache, S3, IAM, cloud trail and other services provided by AWS.
  • Experience Building a multi-region highly available auto-scaling infrastructure that optimises performance and cost. plan for future infrastructure as well as Maintain & optimise existing infrastructure.
  • Conceptualise, architect and build automated deployment pipelines in a CI/CD environment like Jenkins.
  • Conceptualise, architect and build a containerised infrastructure using Docker, Mesosphere or similar SaaS platforms.
  • Conceptualise, architect and build a secured network utilising VPCs with inputs from the security team.
  • Work with developers & QA to institute a policy of Continuous Integration with Automated testing Architect, build and manage dashboards to provide visibility into delivery, production application functional and performance status.
  • Work with developers to institute systems, policies and workflows which allow for rollback of deployments Triage release of applications to production environment on a daily basis.
  • Interface with developers and triage SQL queries that need to be executed in production environments.
  • Assist the developers and on calls for other teams with post mortem, follow up and review of issues affecting production availability.
  • Minimum 2 years’ experience in Ansible.
  • Must have written playbook to automate provisioning of AWS infrastructure as well as automation of routine maintenance tasks.
  • Must have had prior experience automating deployments to production and lower environments.
  • Experience with APM tools like New Relic and log management tools.
  • Our entire platform is hosted on AWS, comprising of web applications, webservices, RDS, Redis and Elastic Search clusters and several other AWS resources like EC2, S3, Cloud front, Route53 and SNS.
  • Essential Functions System Architecture Process Design and Implementation
  • Minimum of 2 years scripting experience in Ruby/Python (Preferable) and Shell Web Application Deployment Systems Continuous Integration tools (Ansible)Establishing and enforcing Network Security Policy (AWS VPC, Security Group) & ACLs.
  • Establishing and enforcing systems monitoring tools and standards
  • Establishing and enforcing Risk Assessment policies and standards
  • Establishing and enforcing Escalation policies and standards
Read more
Connexions BPO Services
at Connexions BPO Services
3 recruiters
Akshaya Salian
Posted by Akshaya Salian
Bengaluru (Bangalore)
0 - 3 yrs
₹1.8L - ₹3.6L / yr
Customer Service
English Proficiency
Excellent English Communication

Day/ UK/ US shift available

J. P Nagar 4th Phase

Speaking to UK/ US customers and resolving querries. 
Read more
AES Technologies
at AES Technologies
3 recruiters
Archana KS
Posted by Archana KS
Remote only
2 - 4 yrs
₹4L - ₹5L / yr
skill icon.NET
ASP.NET
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconJavascript
+1 more
Experience in ASP.NET, C#, MVC & 2+ years in incident response and major incident management.
• Experience in Entity Framework, SSRS, Crystal Reports
• Experience in Umbraco, Xamarin, VB6
• Experience in Sitecore
• Experience in SharePoint
• IDE- Visual Studio
• Strong scripting experience (JavaScript, JQuery, HTML, CSS, Bootstrap, HTML 5, Angular, React JS, Node JS, XML, XSLT, and XSL).
• Good Knowledge in Microsoft IIS
• Ability to write SQL queries and investigate DB logs a plus
• Good Knowledge in RDBMS (MS SQL, MySQL, Oracle)
• High degree of knowledge in networking (protocols, virtual networks, subnets, firewalls)
• Understanding and practical application of methodologies like ITIL, Agile, Scrum, DevOps, and SRE.
• Experience with ITSM tools like Service now, Salesforce….etc
Read more
Eagleview
Eagleview
Agency job
via Beiing by Mukarrum Pasha
Bengaluru (Bangalore)
3 - 10 yrs
₹10L - ₹38L / yr
skill iconReact.js
skill iconRedux/Flux
Babel
webpack
skill iconGit
+3 more
Skills & Requirements
 Bachelor’s Degree required, preferably in Computer Science or related field
 3+ years of Experience working on React.js and its core principles
 Experience with popular React.js workflows (such as Flux or Redux)
 Experience with cloud based technologies like AWS
 Experience with data structure libraries (e.g., Immutable.js)
 Knowledge of isomorphic React is a plus
 Familiarity with RESTful APIs
 Knowledge of modern authorization mechanisms, such as JSON Web Token
 Familiarity with modern front-end build pipelines and tools
 Experience with common front-end development tools such as Babel, Webpack, NPM, etc.
 Ability to understand business requirements and translate them into technical requirements
 A knack for benchmarking and optimization

 Familiarity with code versioning tools(such as Git, SVN, and Mercurial)
Read more
SveltetechTechnologies Pvt Ltd
Sveltetech Tecnology
Posted by Sveltetech Tecnology
NCR (Delhi | Gurgaon | Noida)
1 - 5 yrs
₹3L - ₹7L / yr
Digital Marketing
Search Engine Optimization (SEO)
PPC
Social Media Marketing (SMM)
Search Engine Marketing (SEM)
+3 more
  • Develop and manage digital marketing campaigns
  • Manage organizations website
  • Optimize content for the website and social networking channels such as Facebook, Twitter, Instagram, Google Plus, etc
  • Track the website traffic flow and provide internal reports regularly
  • Fix any error in online content and arrange webinars and webcasts
  • Attend networking events and product launches.
  • Identify new digital marketing trends and ensure that the brand is in front of the industry developments.
  • Work on SEO of the website pages.
  • Edit and post content, videos, podcasts, and audio content on online sites.
  • Promote companys product and services in the digital space.
  • Execute social media efforts to improve KPIs, likes, shares, tweets, etc.
  • Creating and executing SMS, and email-based marketing campaigns.
Read more
HappLabs Software LLP
at HappLabs Software LLP
6 recruiters
Venktesh Guttedar
Posted by Venktesh Guttedar
Bengaluru (Bangalore)
2 - 4 yrs
₹2L - ₹7L / yr
RESTful APIs
skill iconHTML/CSS
skill iconPostgreSQL
skill iconJavascript
skill iconjQuery
+3 more
Responsibilities: Building reusable code and libraries for future use Optimization of the application for maximum speed and scalability Implementation of security and data protection Design and implementation of data storage solutions Able to understand and create Documentation according to Client requirement. Desired Skills : Proven track record in designing, architecting, developing enterprise class products and solutions Ability to write clean, commented and maintainable code. Good understanding of MVC frameworks. Good understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3 Desired experience in PHP. Understanding accessibility and security compliance. User authentication and authorization between multiple systems, servers, and environments Integration of multiple data sources and databases into one system Management of hosting environment, including database administration and scaling an application to support load changes Data migration, transformation, and scripting. Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform Creating database schemas that represent and support business processes Implementing automated testing platforms and unit tests Proficient knowledge of a back-end programming language Proficient understanding of code versioning tools, such as Git Proficient understanding of OWASP security principles
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos