Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

Webkul Software PvtLtd
Avantika Giri
Posted by Avantika Giri
Lucknow
1 - 3 yrs
₹2.5L - ₹4L / yr
skill iconPHP
skill iconLaravel
Symfony
skill iconHTML/CSS
skill iconJavascript
+5 more

Job Description:

  • Should have hands-on experience in Web Development
  • Good understanding of PHP, Laravel and Object-oriented programming paradigm.
  • Able to understand project requirements and handle projects independently.
  • Strong learning capability.
  • Having a good knowledge of JQuery.
  • Framework experience would be beneficial.
  • Should be comfortable to work with the team.
  • Should be comfortable with work on any MVC-based framework.


Skills required:


  • Sound knowledge of PHP,MySQL, Jquery, etc.
  • Able to understand project requirement and handle projects independently.
  • Strong learning capability.
  • Contribute in all phases of the development.
  • Knowledge of PHP/Codeigniter/Laravel will be preferred.
  • Basic Knowledge of JavaScript, Web Services.
Read more
fintech company
fintech company
Agency job
via Qrata by Rayal Rajan
Gandhinagar, Ahmedabad
7 - 13 yrs
₹8L - ₹19L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
Automation
Who are we?
Payfuture is a Fintech Company, a payment gateway connector formed in 2018. We specialize in offering local payments in emerging market countries spanning the Indian subcontinent, Africa, Southeast Asia and LATAM.

Payfuture lowers the barriers of entry and provides ease of market access for an eCommerce merchant’s future expansion. We are growing at a phenomenal speed and have offices in the UK, India, The Philippines and UAE.

Our Culture
We seek people who are highly capable and eager to take up new challenges. You must be motivated, enthusiastic, have an entrepreneurial mindset and possess the right temperament to handle challenging circumstances, with abilities to create novel solutions.
We believe in recognizing and rewarding talent with exceptional competencies and skills, and are building programmes to support their growth, development and career aspirations.

About the job
As a QA Test Lead, you will be responsible for leading the quality review of various applications, that includes creating test plans and strategy, test cases (in partnership with developers, business analysts and project managers) which are used to shape and verify code and check conformance to system requirements.
The role will define QA coding standards and frameworks, identify emerging technologies and evaluate their applicability to the organization’s business goals

As our QA Test Lead, you will have these main objectives:
• Design and develop test automation scripts
• Use test automation guidelines
• Research issues in software through testing
• As part of an Agile team, you will participate in all Agile ceremonies / activities and be accountable for the sprint deliverable(s)
• Support automating traceability of Stories, Acceptance Criteria and Test cases through the integration of CI and BDD frameworks and tools
• Design & build automation smoke, feature & regression tests
• Prepare Automation Test Plans for Service Level Tests, Integration Tests and UI tests, as needed
• Perform Performance and Security testing

You will be a good fit if you:
• Are aligned with our values of –
o Belief
o Transparency
o Accountability & Ownership
o Relentlessness
o Speed
• Hold a bachelor’s degree in Computer Science, IT or related scientific discipline with a minimum of 7+ years of relevant work experience
• Have prior experience of Automation with Selenium or any other tool
• Hold a good API testing experience (using POSTMAN/Swagger/SOAPUI etc)
• Have prior experience in performance testing and security testing
• Can use SQL queries for backend validations
• Are experienced with Test Driven Development - Junit, Selenium, etc
Read more
e-learning company
e-learning company
Agency job
via Qrata by Revathi Satish
Bengaluru (Bangalore)
2 - 7 yrs
₹15L - ₹22L / yr
Typography
Adobe Creative Suite
Visual Designing

 

Job Description - Sr. Visual Designer

 

About Us

We help teachers do better what they do best - teach!

 

We do this by creating intuitive technology tools that empower teachers across all stages of teaching and learning. We're reimagining how education is delivered in the classroom and we're building a world-class, product-first organisation as we scale. Our mission is to amplify teaching for 60 million K-12 educators globally and support them in delivering meaningful and personalised learning experiences.

 

Our first product is a collaboration platform for IB PYP teachers. Be it curriculum planning or parent communication, student portfolios or reports creation, we make working together simple and fun. Currently, is being used by 1,000+ progressive schools and 25,000+ teachers across the world. All our growth has been 100% organic and fuelled by positive word of mouth. Over the next 3 years, our goal is to become the preferred teaching partner of more than 50% K-12 teachers across the world.

 

Our team

We are a diverse group of people (educators, engineers, designers) who have been fortunate to study at some of the best colleges - Stanford, Harvard, Brown, IITs. We have experience of working in companies like McKinsey, Unilever, Sprinklr, Zomato, Bridge International Academies,and, Teach for India. We also own and operate a network of progressive schools (www.todden.com); this gives us the opportunity to work in a tight loop with teachers and incorporate their feedback into the products and services we build. We are backed by leading VCs and Angel Investors.

 

About the Sr. Visual Designer Role

"Good design is as little design as Possible" - Dieter Rams

 

Design is one of our core competencies and as a Visual Designer on the team, you'll lead the way. Our designers are makers and storytellers. They envision how people experience our brand and bring that vision to life in a way that feels inspired, refined and even magical.

 

 

The ideal person

  • Has an interest in designing for education
  • Is a design expert with deep understanding spanning digital, print, and experiential design
  • Is obsessed with breaking new creative ground through crafting the best ideas in design
  • Is optimistic and open to new ideas and ways of working
  • Has a diverse portfolio that shows good aesthetic judgment and attention to detail

 

You should have

  • 2+ years' of experience in designing for brands, digital products and services
  • Formal design training with an incredible eye for detail and obsessive appreciation for typography, design and layout
  • Demonstrated mastery of the Adobe Creative Suite
  • Excellent organisational, collaboration, and communication skills

 


 

Read more
Wolf of Webstreet
at Wolf of Webstreet
1 recruiter
Rohit Langde
Posted by Rohit Langde
Pune
0 - 3 yrs
₹2L - ₹4L / yr
Content Writing
Copy Writing
Blogging
Creative Writing
Technical Writing
Motive behind the company blog is to educate readers about safety and security practices to be followed while computing. The idea of these blog posts is to create long-form content packed with insights and knowledge that our audiences can – and will – actually use. Bloggers must have great technical experience and knowledge in the field of cyber security especially related to Windows OS. Most of your assignments will involve creating tutorials, testing out applications and listing tips. Responsibilities 1. Craft relevant, original content. 2. Explain highly technical topics and making them easy to understand. 3. Catering posts to suit long tail keywords for SEO is vital. We will offer guidance, but you’ll also need to know how to determine SEO factors. Skills 1. Copyediting skills. You’re a stickler for grammar and punctuation and have a deep appreciation for word and sentence variety. 2. Creative writing. You’re able to explain technical content compellingly, but can mix up your tone – especially with humor. Nor are you afraid to use a funny GIF or two. 3. Deadline-driven & detail-oriented. You must be able to meet deadlines and take pleasure in the details. The ability to work from an editorial calendar is a plus. 4. Content management/marketing skills. Working knowledge of how to format in WordPress and use SEO and this will be a walk in the park. 5. A knowledge of SEO tools like SEMRush and Ahrefs is an incredible asset.
Read more
Salesintel
at Salesintel
2 recruiters
Anju Sherki
Posted by Anju Sherki
Remote only
7 - 13 yrs
₹10L - ₹15L / yr
Hubspot
LinkedIn
Sales
Sales Operations
Work in close alignment with the Sales Leaders in driving brand penetration and a winning value proposition into prospects and customers ● Learn and be able to articulate the solution and value proposition to be able to understand the prospective customers pain points and propose unique perspective and company's ability to add value to their business
● Enhances organization reputation by accepting ownership for accomplishing new and different requests; exploring opportunities to add value to job accomplishments.
● Interact with prospects via channels such as telephone, email and social media with a high attention to detail
● Researching companies, identify key players, generate interest and develop accounts to stimulate opportunities
● Transform leads into qualified opportunities by partnering with marketing and sales to create and execute on program and outbound lead generation campaigns
● Track all relevant qualification and lead management activity using SalesforceReport on lead qualification(s) and call activity
● Have thorough knowledge of SalesIntel product and offerings to effectively communicate value propositions, handle objections and competitive questions
● Be informed about the B2B Data and Sales Intelligence industryConsistently achieve qualifies opportunity quotas to ensure territory revenue objectives ● Should be able to lead team of 6-8 Senior BDR

LOCATION: Remote (Pan India)
SHIFT TIMINGS:
● 5.30 pm to 2.30 am IST (8.00 am to 5.00 pm US-EST)
● 6.30 pm to 3.30 am IST (9.00 am to 6.00 pm US-EST)
Read more
Anika Technologies
at Anika Technologies
2 recruiters
Preeti Chhanang
Posted by Preeti Chhanang
Chennai
2 - 4 yrs
₹10L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconMongoDB
+1 more
Please find below the JD for  Mean Stack / Full Stack Developer 
 

About the Company

 

"RAP - Rapid Acceleration Partners" provides practical AI solutions for digital business transformation. With a view to democratize AI, RAP has developed RAPFlow - an AI orchestration platform for building content intelligence solutions and RAPBot - an RPA tool for end-to-end automation.

 

RAP’s vision is to provide a unified Intelligent Process Automation platform centered around Computer Vision and Natural Language Processing, combining it with RPA.

If you have the passion to be part of a fast-growing team that is geared towards redefining how IPA solutions are delivered and have that X Factor to contribute to a world class product, we have a place for you! Visit https://rapidautomation.ai/" target="_blank">https://rapidautomation.ai/ for more details about RAP.

Experience : 2 - 4 Years 
 

Team: You will be part of the Product Engineering, for development of Software that enables customers to automate of business processes with low-code/no-code. The product(s) that you will work on have web applications, web services, AI components/services, Desktop and Browser automation components, data pipelines, Analytics, Frameworks for development/testing/CICD and more. 

 

Responsibilities: Full Stack Engineer, i.e. 

  • Work on any/all layers of existing or new products,  developing end to end features 

  • Build generic or custom solutions for PoCs 

  • Package/deploy/support/maintain the product in production and dev/test environments 

 

Experience - Must Have: 

  • React 

  • Node.js 

  • TypeScript 

  • At least one database 

 

Experience – Good to have: 

  • Docker 

  • Node.RED 

  • CI/CD 

  • Cloud deployment, architecture and technologies 

Read more
AQLE
at AQLE
1 recruiter
Pinky Kochar
Posted by Pinky Kochar
Gurugram
0 - 1 yrs
₹1L - ₹1L / yr
Sales
About us:
AQLE' is a multi-product business that offers premium quality beverages with a strong presence in the Indian domestic market. Taking pride in its commitment to provide beverages that are pure, healthy, and environment-friendly, AQLE' takes great effort to ensure that all its beverages meet the highest standards of taste, quality, and health. Following a clear set of values, the brand creates all its packaging with 100% pre form, ensuring that it does its bit to help save the environment. Having been entirely re-branded, AQLE' aims at launching in Tier 1 cities, starting with Delhi NCR.
Description:
Industry : Beverages /Natural Mineral water
Internship Duration : 3 months
Stipend: 10kpm-15kpm
1.Working closely with the manager or assigned staff member, and completing all allocated tasks.
2.Conducting cold calling ,interacting with the customers,gathering information through surveys or by speaking to clients and staff.
3.Attending and participating in meetings, workshops, events, and exhibitions.
4.Liaising with clients, vendors, and suppliers on behalf of the company's managers.
5.Updating documents and sales records.
6.Achieving sales performance against sales targets.
7.Observing and carrying out sales processes.
8.Identifying potential weaknesses and offering improvement suggestions.
9.Assisting managers with negotiations.
10.Keeping a log of everything learned and delivering presentations to staff and other stakeholders.
Requirements: 
1.Post graduation degree in marketing, business or similar is must.
2. Must have own two wheeler,driving licence is required.
3.Strong self-motivation.
4.Ability to work alone or as part of a team.
5.Proficiency in communication skills 
6.Superb interpersonal skills.
7.Must have professional attitude.
Read more
finacus solutions pvt ltd
Ashwini Sakpal
Posted by Ashwini Sakpal
Mumbai
1 - 8 yrs
₹2.5L - ₹10L / yr
skill icon.NET
ASP.NET
ASP.NET MVC
skill iconC#

We are hiring for Dot Net Developer.

Job location-Andheri Seepz (Mumbai)

Key Responsibilities :             

  • Developing the web based software using computer programming languages such as ASP.net, C#, MVC, Angular JS etc.
  • Performing extensive software testing and stringent quality checks as per the QC guidelines to ensure an error free as well as optimum final product to the user.
  • Creating and maintaining the http://asp.net/">ASP.NETbased websites and their web applications as per the initial guidelines of the client.
  • Making changes to existing web applications according to the feedback received from the end users or clients. In some cases, changes are also made in order to update the application’s compatibility with the latest operating systems.
  • Testing the applications and websites on different web browsers to ensure a standard user experience for the clients across all platforms.
  • Analyze system requirements and prioritize tasks.
  • Write clean, testable code using .NET programming languages
  • Develop technical specifications and architecture
  • Test and debug various .NET applications
  • Review and refactor code
  • Deploy fully functional applications
  • Upgrade existing programs
Read more
Sela technology solutions
Vishakha kulkarni
Posted by Vishakha kulkarni
Pune
6 - 9 yrs
₹12L - ₹18L / yr
skill iconJava
Spring
API
MySQL
Data Structures
+1 more
We are looking for a dynamic and smart programmer to work on a product that we are building. The product will be an exciting tool for cloud users. We need a smart and talented individual that can work with a team of 4-5 people. The candidate should have strong analytical skills and be self-driven.
Read more
Tropicool Car Gadgets
at Tropicool Car Gadgets
2 recruiters
Khushboo Shinagare
Posted by Khushboo Shinagare
Pune
1 - 2 yrs
₹2L - ₹2L / yr
English Proficiency
Business Process Outsourcing (BPO)
Sales
Tech Support
Tropicool is a car electronics & accessories manufacturer since 2002. India's top 20 companies in car accessories. Tropicool develops products for automobile manufacturers like Tata, Mahindra, Volvo, Ashok Leyland, etc. Customer Support & Sales Coordinator responsible for handling Tropicool's customer support calls and responding to customer complaints , sales requests, etc. Involves registering customer complaint, coordinating with Service Centres to resolve the issue and communicating with customer by Email. Good Understanding and getting trained on Company's products, answer customer queries, send quotations, proforma invoices etc. Assisting the Sales team with Pre-sales activities. Timing: 9.30am -6.30pm, no late shifts.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos