Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

NeoGenCode Technologies Pvt Ltd
Divya Sharma
Posted by Divya Sharma
Hyderabad
5 - 8 yrs
₹15L - ₹20L / yr
skill iconJava
skill iconVue.js
skill iconJavascript
skill iconBootstrap
skill iconSpring Boot
+2 more

Job Title: Java Fullstack Developer

📍 Location: Hyderabad (Onsite)

🧑‍💻 Experience: 5–7 Years

Job Summary

We are seeking a highly skilled Java Fullstack Developer with strong expertise in VueJS to design, build, and maintain responsive web applications. The ideal candidate should have proven experience in both frontend and backend technologies, ensuring seamless integration and high performance of applications.

Roles & Responsibilities

  • Develop, test, and maintain responsive web applications using VueJS and Java Fullstack technologies.
  • Collaborate with product managers, designers, and backend developers to deliver high-quality features.
  • Lead the development and implementation of frontend components.
  • Mentor junior developers and provide technical guidance.
  • Participate in design and architecture discussions for scalable solutions.
  • Optimize applications for speed, scalability, and performance.
  • Conduct thorough testing, troubleshooting, and debugging.
  • Stay updated with the latest trends in frontend and fullstack development.

Mandatory Skills

  • Strong hands-on experience in Java Fullstack Development.
  • Expertise in VueJS.
  • Proficiency in HTML/HTML5, CSS/CSS3, Bootstrap, JavaScript (ES6).
  • Strong understanding of UI/UX design feasibility and responsive design principles.
  • Excellent communication, problem-solving, and collaboration skills.

Preferred Skills

  • Experience with Spring Boot, RESTful APIs, and Microservices.
  • Knowledge of Agile methodologies, CI/CD pipelines, and Git.
  • Exposure to cloud platforms (AWS, Azure, or GCP) is a plus.


Read more
Product based company
Product based company
Chennai
3 - 7 yrs
₹15L - ₹30L / yr
skill iconJava
skill iconGo Programming (Golang)
Microservices
Distributed Systems
skill iconDocker
+3 more

Responsibilities:

Lead the design and development of sophisticated, high availability, and secured

server-side applications with a primary focus on Golang.

● Collaborate with cross-functional teams to understand requirements, architect

solutions, and deliver high-quality software products.

● Mentor and guide junior engineers, sharing your engineering expertise and best

practices to foster skill development within the team.

● Analyze and optimize performance, scalability, and reliability of existing Golang

applications, making strategic improvements where necessary.

● Design and implement automated unit and integration tests to ensure code quality,

maintainability, and stability.

● Stay up-to-date with the latest advancements in software technologies,

recommending their adoption when appropriate.

● Champion code reviews, architectural discussions, and technical documentation to

maintain high development standards.

● Troubleshoot and resolve complex issues, providing innovative solutions to overcome

challenges.

● Contribute to the recruitment and hiring process by participating in interviews,

evaluating candidates, and providing input on hiring decisions.

Requirements

Bachelor's or Master's degree in Computer Science, or a related field.

● 3+ years of experience in software development, with substantial experience in

Golang and cloud infrastructure.

● Expert-level proficiency in designing and developing high-performance, concurrent

applications with Golang.

● Experience with distributed systems, microservices architecture, and containerization

(e.g., Docker, Kubernetes).

● Solid knowledge of software testing methodologies and tools, including unit testing

and integration testing for Golang applications.

● Demonstrated ability to lead projects, collaborate effectively with teams, and mentor

junior engineers.

● Excellent problem-solving and analytical skills, with the ability to tackle complex

technical challenges.

● Having prior experience in the FinTech domain would be an added advantage.


Read more
Noida, Gurugram
3 - 12 yrs
₹9L - ₹22L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+6 more

We're looking to hire expert Laravel developers with strong command over database concepts and preferably, ability to work as a full stack developer utilising Angular/Laravel or Vue as a frontend tech stack. Minimum 4 years experience is required.

 

As a senior software developer, we expect the following qualifications:

  • Has a longer IT technical training in computer science or similar
  • Have proven experience JavaScript
  • Have proven experience of developing REST-based services
  • Have proven experience in PHP and JAVA
  • Have proven experience in Laravel, Symfony, and Composer
  • Have proven experience with CSS, SASS, and HTML
  • Proven experience with Vue.js, Angular or React

 

Personal qualifications:

  • You are quick to put you into new tasks and get an overview.
  • As a person manages to get support for your suggestions and solutions.
  • Your efforts are focused and you take pride in having completed your tasks, which include seen by you adhere to deadlines.
  • Your work is characterised by being both structured and systematic which for example is seen in your documentation.

Job location : Noida / Gurugram 
Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Garima Walia
Posted by Garima Walia
Remote only
4 - 7 yrs
₹10L - ₹14L / yr
PySpark
Data engineering
Big Data
Hadoop
Spark
+2 more

Job ID: RP100

Work Location: Remote

Required Experience: 4 to 7 years

Job Description

  • Must have Google Cloud Big Query experience
  • Strong experience with data analysis, data modeling and governance, with excellent analytical and problem-solving abilities
  • Good knowledge of Data Warehouses, data flow ETL pipelines
  • Design, configuration/administration of database software in Cloud platform.
  • Monitoring, Troubleshooting, and Performance tuning the DB objects.
  • Experience on Table Partition, Clustered Table, Materialized View, External Tables etc.

Anyone RDBMS technologies

  • Good experience in DB design with knowledge of ER Diagram, PK/FK, Stored procedure, Function, Triggers, and Indexes.
  • Understanding the requirement of the App team and creating the necessary DB objects by following the best practices.
  • Managing logins and database users, as well as database roles, application roles, and other security principles within the database.
  • Deep knowledge about Indexes, Performance tuning, and Complex SQL Query patterns.
  • Monitoring, Tuning, and Troubleshooting the database-related issues.

About Us:

Mobile programming LLC is a US-based digital transformation company. We help enterprises transform ideas into innovative and intelligent solutions, governing the Internet of Things, Digital Commerce, Business Intelligence Analytics, and Cloud Programming. Bring your challenges to us, we will give you the smartest solutions. From conceptualizing and engineering to advanced manufacturing, we help customers build and scale products fit for the global marketplace.

Mobile programming LLC has offices located in Los Angeles, San Jose, Glendale, San Diego, Phoenix, Plano, New York, Fort Lauderdale, and Boston. Mobile programming is SAP Preferred Vendor, Apple Adjunct Partner, Google Empaneled Mobile Vendor, and Microsoft Gold Certified Partner.

Read more
Analogyx BI Private Limited
at Analogyx BI Private Limited
1 video
1 recruiter
Manjari Bhardwaj
Posted by Manjari Bhardwaj
Bengaluru (Bangalore)
2 - 5 yrs
₹5L - ₹8L / yr
skill iconReact Native
skill iconJavascript
Xcode
TypeScript
API
+3 more
  • Build pixel-perfect, buttery smooth UIs across both mobile platforms.
  • Leverage native APIs for deep integrations with both platforms.
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native.
  • Reach out to the open-source community to encourage and help implement mission-critical software fixes—React Native moves fast and often breaks things. 
  • Maintain code and write automated tests to ensure the product is of the highest quality.
  • Transition existing React web apps to React Native. 



 

Read more
Casey Foods
at Casey Foods
7 recruiters
Madhu smita
Posted by Madhu smita
Remote only
1 - 7 yrs
₹2L - ₹5L / yr
Business Development

Responsibilities:

  • To create new Exclusive Distributor
  • Research & identify new market opportunities
  • Maintain smooth relationship with the customer & be ready to fulfill their needs effectively.
  • Setting new goals & new strategies to run the business & revenue growth.
  • Arrange business meetings with prospective clients
  • Promote the company’s products/services

 

Requirements:

  • Bachelor’s Degree preferred
  • Experience required at least 1-2 years in related field
  • Strong convincing power
  • Representative skill with communication
  • Self-motivated & the ability to be motivated by target
Read more
Disruptive Performance Marketing
Disruptive Performance Marketing
Agency job
via Unnati by Gayatri Joshi
NCR (Delhi | Gurgaon | Noida)
2 - 5 yrs
₹8L - ₹10L / yr
Business Development
Business-to-business sales
Marketing
Sales
Key account management
+10 more
Our client is a disruptive performance marketing agency with a data-driven approach adding impetus to its client's growth. The agency has developed two proprietary tools that enables them to execute large scale marketing campaigns. Automated media buying, centralized data tracking, business intelligence reports and personalized ads are the major services offered to the clients.
 
The agency is one of the few in India that has partnerships with the biggest platforms like Facebook, Google API, Taboola and many more. They are serving more than 100 clients and is on an explosive growth path. The founder is a serial entrepreneur and an alumnus of IIT-BHU. He has assembled a unique team of seasoned data scientists, consultants, and digital strategists to deliver the best online marketing solutions.
 
As a  City Head - Business Development Leader,  you will focus on driving new customer acquisition within the region and play a key role in joining a high performing business development team for our SaaS product and solution offerings.
 
You will work closely with prospective customers as a trusted advisor to deeply understand their unique company challenges and goals, consult with current customers to evangelise solutions that will help them reach their business goals and blaze new trails within their organisations.
 
What you will do:

  • Contributing to the business growth in a fast paced, collaborative and fun atmosphere, as a valued member of our firm
  • Being a part of the business development team, locating and pitching to leading Advertisers and Brand Marketers within the region.
  • Identifying, filtering, calling, emailing and presenting f2f - offerings to new prospects and existing stakeholders.
  • Working closely with Engineering, Delivery and Marketing teams to surface opportunities and generate targeted pipeline.
  • Fostering and maintaining client relationships with key accounts, coordinating with account management teams for client handovers upon signature of a deal (and again upon occasion for renewals, or upgrades)
  • Designing and delivering online media plans / growth strategies / presentations for clients.
  • Preparing formats for Sales Collaterals like Proposals, Decks, Engagement Letters, etc.
  • Negotiating the terms of agreement and close sales.
  • Representing company at trade exhibitions, events and demonstrations.
  • During the sales process, if appropriate, managing the proof of concept with support from a product engineer.
  • Helping continue to build a strong team environment and set structure for future business development team members.

 

What you need to have:

  • Graduate from Tier1/ Tier2 college
  • 2 - 5 years of experience in SaaS or Digital Advertising or SEO technology / agency sales
  • Fluent in English and Hindi
  • Strong written, verbal, and presentation skills

Preferred Requirements:

  • Understand the changing nature of the online advertising industry and ecosystem as a whole
  • Natural ability for consultative and solution-based selling
  • Proven ability to work well as part of an extended sales team
  • Experience selling at the "C" level – CEO and CMO is a plus
  • Track record of results-oriented work.
  • Experience in a startup or entrepreneurial venture would be a big plus.
  • Being relentless in pursuit of growth
  • Engineering or Maths Honors educational background

 

Read more
Catalyst IQ
at Catalyst IQ
6 recruiters
Sidharth Maholia
Posted by Sidharth Maholia
Mumbai
2 - 5 yrs
₹10L - ₹20L / yr
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconExpress
MERN Stack
+2 more
Expertrons is an initiative by experienced professionals turned entrepreneurs (IITB alum)
having built a few of India's largest companies across multiple domains. This will be an opportunity to directly work with the founders. What we are looking for: An entrepreneurial, thoughtful, and positive mindset/approach to solving large problems, capable of adapting to changing market conditions, willing to join a growing startup, a rational and no-nonsense approach, and practical thought process.

Full-stack experience designing and building scalable applications from end-to-end
- Excellent JavaScript skills and strong proficiency in React
- Familiarity with the MERN stack (MongoDB, Express.JS, React.JS, and Node.JS)
- Working experience with React, Redux, ES6
- Experience building backend API's using NodeJs and ExpressJs
- Experience with NoSQL databases such as MongoDB, mongoose, aggregation framework
and Redis
- Experience with Web sockets and related frameworks (e.g. Socket.IO)
- Experience using RESTful APIs and basic authentication mechanisms
- Create and maintain microservices

- Ability Showcase past work via live web pages
Required Skills: Database - MongoDB, Restful, Express.JS, React.JS and Node.JS, MySQL,
NoSQL.
Read more
Veera
at Veera
1 recruiter
Varun Jain
Posted by Varun Jain
Mumbai, NCR (Delhi | Gurgaon | Noida)
2 - 15 yrs
₹1L - ₹2L / yr
Business Development
Sales
Channel Sales
Distribution
English Proficiency
+1 more
Veera is a dynamic US-Based startup, working to revolutionze the way rural markets are accessed and developed. 

The Business Development Lead will be responsible for generating sales opportunities in their region. Their role will require them to do the following:
1. Find customers willing to buy Veera products
2. Negotiate price points for volume orders that are pre-sales in nature
3. Assist with the end-to-end relationship of the account, and ensure that payments are recieved over time in the correct amount.
4. Ad-Hoc tasks as needed 

This role will be compensated primarily on commission, with rates starting at 12% and going up to 25% depending on the quality of accounts. 
Read more
MedCords
at MedCords
6 recruiters
Priyanka Mishra
Posted by Priyanka Mishra
Pune
3 - 5 yrs
₹15L - ₹22L / yr
skill iconJavascript
skill iconAngular (2+)
skill iconHTML/CSS
We are a cloud-based healthcare startup working to bring affordable and intelligent healthcare to the grassroots - we want someone who has a strong sense of understanding users, interacts with different channels of businesses and has a solid grasp on tools to execute fast. Technical Skills Required: • Angular 2/4, JS, HTML5, CSS3, javascript & web pack. *Angular 2/4 is a must. (Not Angular 1.x) • Good knowledge of Client-Server Architecture, network communication and good designing principles. • Absolute focus on elegance, ease-of-use, network optimisation and agile development will be super important. PS: Apply only if you're a startup enthusiast, willing to relocate to Pune and have at least 3 years of hands-on experience on the technologies mentioned. Early joiners will be preferred. Personal Skills: 1. Energetic & enthusiastic to work in an open and fast-paced environment. 2. Willing to learn & grow. 3. Good communication skills( ability to express thoughts). 4. Amazing problem-solving skills. 5. Ability to take initiatives & absolute ownership. 6. Startup experience is a plus.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos