Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

Bengaluru (Bangalore)
3 - 6 yrs
₹9L - ₹18L / yr
Device Driver Development
skill iconC
Board Bringup
BSP

Looking for Linux BSP Engineers for one of our clients


Skills Required: C Programming, Device Driver Development, BSP, U-Boot, Board Bring-up

Location: Bangalore

Experience 3 to 6yrs

Education/Qualification: B.E/B.Tech (EEE / ECE)


Domain: - Bootloader, Linux BSP, Device driver for Ethernet, PCIe, USB, etc

○    U-Boot and Linux porting / upgrading to ARM based SoC

○    Device drivers for SPI, I2C, Touch screen, MEMS Sensors

○    Device drivers for Audio, camera, display etc.

Additional considerations:-

Must have: - Ground up driver development and debugging experience



Read more
mediator between influencer and brands
mediator between influencer and brands
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
4 - 8 yrs
₹50L - ₹55L / yr
skill iconJava
skill iconPython

About the Idea


Company's Mission: Company is changing the way India discovers and shops new brands. How? We match brands to passionate creators who create authentic content enabling discovery of brand’s products. This also helps the creators earn sustainably and get recognised as curators in their fields!


Current Focus: To achieve our mission, we start by enabling brands and influencers to collaborate for mutual benefit. 

  • Creators on Youtube get access to D2C brand campaigns to boost income.
  • D2C brands gain sales through RoI-based marketing via authentic content from creators.

Progress: 

  • Business: We’ve already worked with 35+ influencers and 5 brands generating INR 85L+ in GMV and growing fast
  • Funding: MavX has raised seed funding from top-tier global VC funds and leading industry veteran angels

About the Role

Company is looking for a Tech Leader to oversee the tech org and own the entire building of the V1 product.


What will you do: 

  • Creating the marketplace product that helps brands and influencers
  • Designing the tech architecture, roadmap and vision
  • Hiring the right team to achieve product-market fit and the vision
  • Get involved in brainstorming and problem solving to solve critical product and business problems


What will you need: 

Skills:

  • Strong and demonstrated technical skills
  • Ability to hire and manage a team of coders
  • Cross-functional collaboration with product, business, design folks


Attitude:

  • Bias for quick action - progress over process
  • High empathy for small creators and small D2C brands
  • First principles thinking and a problem solving mindset
  • Strong accountability and ownership mindset


What will you gain:

  • Creating tech vision from scratch
  • Build in a fast-paced environment and test impact directly with users
  • Experience the thrills of 0-1 and PMF discovery
  • Work with a smart, young team that is highly committed to the mission
Read more
Upskillrai
Aditya Saxena
Posted by Aditya Saxena
Mumbai
3 - 8 yrs
₹10L - ₹28L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

⚒️ About The Role

We're looking for an experienced Frontend Engineer to breathe life into the user interface of our product. Understanding that meticulous engineering not only drives the user experience but also influences our product development process, we aim to prioritize this role from Day 1


🚀 This Role

As a Founding Frontend Engineer at Upskillr.ai, your contributions will be vital in refining the user experience of our AGI Platform. You will also participate in evaluating user interfaces and crafting the frontend landscape for future products. Further:

  • Creating and optimizing our frontend infrastructure, rendering captivating user experiences through your engineering prowess.
  • Utilizing your specialized skills to navigate frontend development, from designing responsive layouts to implementing interactive features.
  • Collaborating closely with founders on product development and with designers for harmonious UI/UX integration.



What you'll work on:

  • Leading feature development from user research to production in collaboration with designers and AI engineers.
  • Building responsive UI components using React principles and JavaScript.
  • Establishing a flexible frontend architecture with supportive APIs.
  • Demonstrating expertise in front-end performance optimization and contemporary standards.
  • Pioneering the engineering and integration of optimal human ↔ AI interfaces for enterprise operations. We're trailblazing in a fresh domain of engineering that previously didn't exist. The onus is on us to explore and incorporate a novel interface that resonates with our users.


Technical Skills:

  • Profound expertise in JavaScript and React, along with robust front-end coding abilities and an understanding of progressive web applications.
  • Must possess skills in HTML5, CSS3, JavaScript, React.js, Webpack, Enzyme, Redux, Flux, GIT, HTTP(s), Terminal, Build Tools, State Management, Type Checkers, Form Helpers, Routing, REST API, GraphQL, Utility Libraries, Internationalization, Server-Side Rendering, and Backend Framework Integration.
  • Proficiency in browser-based debugging and performance testing.
  • Experience in performance tuning, usability enhancement, automation, and continuous integration leveraging test-driven development methodologies (BDD/TDD).


🕵️ What We Look For

  • Self-starters prepared to lead significant initiatives.
  • Avid curiosity and passion for technology.
  • Familiarity with UI/UX principles from an engineering perspective.
  • Excellent communication abilities


😁 Perks & Benefits

🤝 Top-of-the-market compensation — At Upskillr.ai, we will offer top-of-the-market (90th+ percentile) compensation in both cash and equity. We believe that the best candidates deserve the best compensation, and we will ensure that it happens.

💯 High impact — You’ll be joining as a founding member of the team, and as such you will have a high level of ownership and influence over the direction of the company.

🧠 The gains — Collaborate closely with the founders. Experience the excitement of a rapidly expanding startup.



About Us

We build LLM Based Tools and Services for Enterprises.

Upskillr.ai, started by Aditya Saxena and Vikram Pandya, is a dynamic knowledge platform that combines the best of education and knowledge management powered by AGI.

What We Do

We are committed to delivering innovative and comprehensive solutions that address the diverse learning needs of individuals and organizations. The company is dedicated to leveraging Artificial General Intelligence (AGI), to provide personalized and tailored support, ensuring the success and satisfaction of its users.

Read more
Svamitva
at Svamitva
1 video
sneha k
Posted by sneha k
lalbagh
1 - 3 yrs
₹2L - ₹4L / yr
Legal
Real Estate

Job Responsibilities                      

1.      Monitor legal risk in real estate documentation and advise clients accordingly.

2.      Interpret laws, rulings and regulations for real estate transactions.

3.      Draft and negotiate real estate transactions.

4.      Draft routine leases and amendments.

5.      Manage regulatory and compliance-related services.

6.      Support legal and general advisory needs associated with a large-scale real estate portfolio.

 

Requirements:

1.      1 to 3 years’ experience minimum

2.      Kannada language is must

3.      Real estate background experience is must


Required Skills:

1.      Basic experience in real estate law and industry knowledge that includes litigation, lease transactions, property management, and purchase and sale transactions.

2.      Basic experience in title insurance underwriting, curative and claims.

3.      Basic understanding of foreclosure.

4.      Analytical thinker with basic conceptual and research skills.

5.      Natural leader who displays sound judgment and attention to detail.

6.      Proficient with Microsoft Office programs


Read more
CASEY GALAXY PVT LTD
KORAPUT
2 - 3 yrs
₹3L - ₹3.5L / yr
Business Development
New business development
Sales
Effective communication
Communication Skills

RESPONSIBILITIES:-

 As a  Business   Development  Manager   working under   FMCG   segments, an ideal candidate must perform the following responsibilities:

·      Approaching  potential  leads  a  close  them  within  a  stipulated  time  frame.

·      Create  exclusive  distributors,   exclusive super stockist and business associated for the company towards business growth.

·      Finding and developing new markets and improving sales.

 

REQUIREMENTS:

·       Bachelor’s degree in business, marketing or related field.

·       Experience in sales, marketing or related field.

·       Strong communication skills.

·       Excellent organisational skills.

Read more
Pointorgn Technologies India
Chandana MR
Posted by Chandana MR
Bengaluru (Bangalore)
2 - 8 yrs
₹6.5L - ₹10L / yr
Drupal
Drupal6
Drupal7
Drupal8
Drupal CMS

Job description

We are looking for a Drupal Developer primarily responsible for back-end/module development. This position requires a combination of programming skills (PHP, HTML, CSS, JS, etc.) and aesthetics (understanding element arrangements on the screen, the color and font choices, and so on). The best candidates should have a strong understanding of design, development and deployment and back-end knowledge.


Responsibilities

 

Responsible for designing and implementing new features and functionality, ensuring high-performance and availability, and managing all technical aspects of the CMS. Work closely with front-end developers and customers to ensure an effective, visually appealing, and intuitive implementation. Integration with open source modules.

 

Skills and Qualifications

  • Experience in developing web solutions in Drupal and PHP implementations in a LAMP environment
  • Site-building experience including deep familiarity with Drupal modules such as CTools, Views, and Panels
  • Experience creating custom Drupal modules
  • Experience building responsive websites using Drupal CMS, HTML/HTML5, CSS/CSS3, and JavaScript/jQuery
  • Knowledge of PHP, PHP files and theme functions, and knowledge of the Drupal theme layer.
  • Through understanding of the Software Development Lifecycle (e.g. Requirements, Design, Development, Testing) and exposure to Agile or iterative SDLCs.
  • 2-4 years of experience in Drupal development (samples of applications that you have worked on are required)
Read more
Workforce Management Solutions Co.
Workforce Management Solutions Co.
Agency job
via Unnati by Swati Joshi
Pune
3 - 7 yrs
₹8L - ₹15L / yr
Project Management
Project Manager
Project coordination
Project planning
PMP
+4 more
Become part of a global AI / ML team looking for smart, motivated and dedicated professionals ready to exploit technological possibilities.
 
Our client is a Europe headquartered AI-Powered process automation pioneer, which is using its intelligent solutions to help organizations handle their documentation, email and chat processes. They have created digital employees or bots, which can be delegated to act as modules to quickly handle repetitive tasks and simplifying these functions. Such automation aims to improve work quality, customer satisfaction, employee productivity and eventually to reshape business goals and performance.

Based out of Norway, and presence in many countries, their solutions are being implemented in various industries ensuring efficient and smarter automation. Within 4 years of its existence, the company has seen 3 times revenue growth and over 100 employees building global and economical solutions and a diverse organisation well prepared for the future.
 
As a Technical Project Manager-Software Development, you will have the unique opportunity to lead complex projects with diverse team of highly qualified, multidisciplinary, agile, global team located in several continents.
 
What you will do:
  • Aligning product roadmap with delivery goals to ensure prioritizations of resources and tasks during sprints
  • Coordinating with product managers, business analyst and development teams for execution of projects
  • Helping in the definition of sprint goals and objectives, involving all relevant stakeholders and ensuring technical feasibility
  • Ensuring relevant stake holders are up to date with necessary information
  • Resourcing availability and allocation
  • Developing a detailed project plan to monitor and track progress
  • Managing changes to the project scope, project schedule using appropriate verification techniques
  • Measuring project performance using appropriate tools and techniques
  • Performing risk management to minimize project risks
  • Creating and maintaining comprehensive project documentation
  • Tracking project performance, specifically to analyse the successful completion of short and long-term

 

What you need to have:
  • Bachelor’s or master’s degree in IT
  • 3+ years as Technical Project Manager
  • Experience with Agile development (Scrum/ Kanban) is must
  • Experience with task tracking systems like Jira, VSTS is must
  • Solid organizational skills including attention to detail and multitasking skills
  • Experience with project management tools like MS Project is a plus
  • Project Management Professional (PMP) / PRINCE II certification is a plus
  • Good knowledge of software life cycle and processes and various methodologies
  • Resource planning, performance management and team motivational skills are must.
Read more
It is an agritech startup that aspires to digitalize farming
It is an agritech startup that aspires to digitalize farming
Agency job
via ConsultBae by Consult Bae
Bengaluru (Bangalore)
1 - 8 yrs
₹15L - ₹30L / yr
skill iconJava
Data Structures
Algorithms
skill iconScala
skill iconC++
+3 more

Role : Senior Software Engineer/Software Engineer

Experience : 1-2 Year(s)/2-4 Year(s)

Location : Bangalore

Education : B. Tech(CSE)/similar field of study/equivalent practical experience

 

Minimum qualifications:

  • Software development experience in one or more general purpose programming languages.
  • Experience working with two or more from the following: 
    • Mobile Application Development
    • Distributed Computing
    • Machine Learning
    • Image Processing
    • Developing Large Software Systems
  • Working proficiency and communication skills in verbal and written English

Preferred qualifications:

  • Master’s degree, further education or experience in engineering, computer science or other technical related fields.
  • Understanding of agriTech domain and application of technology in farming
  • Interest and ability to learn other coding languages as needed.
Read more
Vah Vah
at Vah Vah
3 recruiters
Bhawesh Tanna
Posted by Bhawesh Tanna
Bengaluru (Bangalore)
2 - 4 yrs
₹8L - ₹16L / yr
skill iconReact Native
Fullstack Developer
skill iconJavascript
React-native developer :
- React Native Developer with 2 years of experience
- Experience in either iOS(Swift, Objective C, XCode) or Android(Android Studio, Java, Kotlin)
- Solid understanding of Javascript, NodeJS fundamentals
- We encourage all our devs to have base level of DevOps skills & Full stack understanding w.r.t CI/CD systems, Cloud Services such as AWS, Firebase, GCP

**Job Description :**
* Required skills:
- Minimum 2 years of experience in mobile app development
- Must have experience in either android or iOS app development
- At least 2 year of experience in React Native app development
- Ability to implement designs and functionality provided by UI/UX teams
- Strong knowledge of JavaScript ES6
- Programming experience with Typescript
- Understanding of production deployment of the app in the App Store and Play Store
*** Key Skills:**
- React, React - Native, iOS(swift, objective C, XCode) or Android(Android Studio, Java, Kotlin)
- NodeJS , Typescript
- Base Database design & concepts
* Good to have:
- Familiarity with Analytics integrations
- Conversant with deploying and AWS web hosting
- Knowledge of server-side technologies like Node.js and frameworks available for it (such as Express, StrongLoop, etc depending on your technology stack)
- willing to explore and work on other tech stacks

*** Responsibility:**
- Complete ownership of building and maintaining APP
- Deliver across the entire app life cycle design, build, deploy, test, release to app stores and support
- Open to work on both Android and iOS front end

***** What you get:****
- Amazing workplace and colleagues to work with
- Competitive salary at par with the best in the industry
- Immense exposure to new technologies
Read more
Online fashion shopping platform for men and women.
Online fashion shopping platform for men and women.
Agency job
Mumbai
2 - 6 yrs
₹12L - ₹25L / yr
skill iconHTML/CSS
skill iconAngular (2+)
skill iconJavascript
Your primary focus will be to implement a complete user interface in the form of a web app, with a focus on performance. Your primary duties will include creating modules and components and coupling them together into a functional app. You will work in a team with the back-end developers and communicate with the API using standard methods. A thorough understanding of all of the components of our platform and infrastructure is required.

Responsibilities:

• Ownership and delivering of complete front-end application.

• Ensuring high performance on mobile and desktop.

• Writing tested, idiomatic, and documented JavaScript, HTML, and CSS.

• Coordinating the workflow between the graphic designer, the HTML coder, and yourself.

• Cooperating with the back-end developer in the process of building the RESTful API.

• Communicating with external web services.

• Building the infrastructure for serving the front-end app and assets.

• Creating custom, general use modules, and components which extend the elements and modules of core AngularJS.

• Documenting the code inline using JSDoc or other conventions.

• Writing extensive unit tests using automated TDD tasks.

• Architecting and automating the build process for production, using task runners or scripts.

• Maintaining and deploying the frontend application.

Requirements:

• 3+ years of professional experience building and shipping code in professional consumer/B2B products.

• Expert knowledge of *AngularJS 5, HTML, CSS, Javascript and Browser compliance*. Knowledge of Build tools like *Gulp/Grunt/web pack*.

• Deep knowledge of *AngularJS* practices and commonly used modules based on extensive work experience

• Deep understanding of DOM APIs, native Javascript, libraries, and when to use them.

• Knowledge of CSS/CSS3 and its pre-processors like SASS/LESS, CSS-Modules .

• Creating self-contained, reusable, and testable modules and components.

• Thorough understanding of the responsibilities of the platform, database, API, caching layer, proxies, and other web services used in the system.

• Obsessively clean and organized code.

• Experience, and comfort, working with designers to implement their work, animations, transitions, and anything else they can dream up.

• Professional, precise communication skills.

• Self-starter and a team player
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos