Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

Intineri infosol Pvt Ltd
at Intineri infosol Pvt Ltd
2 candid answers
Shivani Pandey
Posted by Shivani Pandey
Remote, Hyderabad
10 - 20 yrs
₹10L - ₹15L / yr
BAI file
Microsoft BizTalk Server
MuleSoft
OpenText
Solace
+1 more

Job Title: Product Owner / Product Manager

📍 Location: Hyderabad

🕓 Employment Type: Contract

🧠 Experience Required: 10+ Years

Job Purpose

We are seeking an experienced Product Owner / Product Manager  to lead a team responsible for the design, development, deployment, and continuous improvement of global application products and integration platforms.

This role provides functional and technical expertise across multiple enterprise technologies — including BAI MQFT, BizTalk, MuleSoft, OpenText, Solace, and TWS (Tivoli Workload Scheduler) — ensuring delivery excellence, operational stability, and business alignment.

As part of the Global Applications Service Delivery Team, the Product Owner will collaborate with stakeholders across regions, manage vendor relationships, and drive Agile and ITIL-based service delivery and product management practices.


Key Responsibilities

Product & Service Ownership

  • Own the end-to-end lifecycle management of integration and application services (BAI MQFT, BizTalk, MuleSoft, OpenText, Solace, TWS).
  • Lead design, development, deployment, and support of global IT solutions aligned with business strategies.
  • Drive continuous improvement and ensure products evolve effectively to meet changing business needs.
  • Maintain awareness of industry trends and emerging technologies to recommend innovative, cost-effective solutions.

Delivery & Vendor Management

  • Manage 3rd-party vendors, ensuring delivery excellence through defined SLAs, KPIs, and performance metrics.
  • Oversee service delivery operations, ensuring availability, reliability, and performance standards are met.
  • Serve as the primary escalation point for business demands and critical incidents.

Leadership & Team Development

  • Lead and mentor a global team (up to 10 associates plus vendor resources), fostering a high-performance, collaborative environment.
  • Develop talent and succession plans to ensure sustainability of technical and business expertise.
  • Promote Agile methodologies and DevOps practices, acting as a role model for collaborative and adaptive behaviors.

Stakeholder Management

  • Collaborate with business stakeholders, IT leadership, and cross-functional teams (Platform, Database, Security, Deployment, etc.) to align IT solutions with business goals.
  • Provide regular progress updates to stakeholders on demands, deliverables, and service performance.
  • Build and sustain a network of key users, functional experts, and product owners globally.

Governance & Financial Management

  • Manage product area budgets, ensuring cost optimization and transparency.
  • Contribute to strategic planning and support the HUB Talent Pipeline strategy.
  • Ensure compliance with IT governance, risk management, and service introduction frameworks.


Qualifications & Experience

Education:

  • Bachelor’s degree in Information Technology, Computer Science, or a related field.


Experience:

  • Minimum 10+ years of experience in SAP ABAP development and product management.
  • Strong technical and functional knowledge of integration technologies:
  • BAI MQFT, Microsoft BizTalk, MuleSoft, OpenText, Solace, TWS (Tivoli Workload Scheduler)
  • Experience managing global IT delivery teams and vendor resources.
  • Exposure to FMCG (Fast-Moving Consumer Goods) industry preferred.
  • Proven experience with Agile, Scrum, ITIL, DevOps frameworks.
  • Certifications in ITIL, Agile/Scrum, PMI, or DevOps will be an advantage.


Key Competencies

Technical & Functional Skills:

  • Product Lifecycle Management
  • Service Delivery & ITIL Processes
  • Stakeholder Relationship Management
  • Vendor Management
  • Service Level Management (SLM)
  • Agile / Scrum / DevOps Methodologies
  • SAP ABAP Expertise

Leadership & Behavioral Competencies:

  • Strategic Thinking & Problem Solving
  • Team Building & Talent Development
  • Customer-Centric Mindset (“Zero Distance to Customer”)
  • Dealing with Ambiguity & Complex Challenges
  • Strong Communication & Collaboration Skills


Read more
Bengaluru (Bangalore)
7 - 10 yrs
$3.5K - $5K / yr
skill icon.NET
skill iconReact.js
Microsoft Windows Azure
Software architecture
Domain-driven design
+2 more

Requirements:


  • 7+ years in enterprise application development
  • Proven track record of delivering complex digital solutions
  • Advanced knowledge of React hooks, context API, and component and global state management
  • Experience with atomic design, component libraries, and TypeScript
  • Proficiency in React performance optimization and modern features
  • Strong experience with modern .NET (6+)
  • Proven track record applying Clean Architecture & Clean Code & SOLID principles & DDD patterns
  • Expertise in building scalable REST APIs and microservices
  • Experience with Azure Service Bus, Event Grid, and message-based architectures
  • Proficiency in resources like App Insights, Function Apps, Key Vaults, and App Services
  • Expertise in cloud development and deployment strategies
  • Strong understanding of business needs, ability to meet them by creating cutting-edge solutions
  • Brilliant communication abilities, knowing how to explain technical details and processes to a non-tech person
  • Fluency in English


Nice to have:


  • Test automation (Playwright/Cypress)
  • Building CI/CD pipelines in Azure DevOps
  • API-first development and OpenAPI specifications
  • Experience with agile at scale (SAFe/Spotify)
  • Proficiency with AI-powered development tools (GitHub Copilot, Cursor, etc.) to enhance productivity
  • Bachelor's or Master's degree in Computer Science or a related field

 

 Responsibilities:

 

  • Front-end, API, and back-end development, ensuring the successful delivery of digital solutions
  • Drive innovation by staying informed about emerging technologies, industry trends, and best practices
  • Collaborate with the Product Manager, UX/UI Designers, and Engineering Manager to define agile technical requirements, provide technical estimation, and prioritize backlogs based on business needs and technical feasibility
  • Participate in sprint planning, backlog grooming, and release planning meetings to ensure alignment between technical implementation and product roadmap
  • Participate in hands-on development activities, including coding, debugging, and troubleshooting, to deliver high-quality applications
  • Design, architecture, development of digital applications, ensuring adherence to best practices, coding standards, and architectural principles
  • Design scalable architectures for multi-region deployment
  • Implement test automation strategies and frameworks to automate testing processes and ensure the quality and reliability of applications
  • Automate test cases and integrate testing into the CI/CD pipeline
  • Conduct code reviews to ensure adherence to coding standards, best practices, and architectural guidelines
  • Define and implement code best practices, development standards, and documentation processes to maintain code quality and readability
  • Integrate digital applications with existing digital assets, backend systems, and third-party APIs, ensuring seamless data exchange and interoperability
  • Collaborate with integration teams to design and implement integration solutions that meet business requirements and architectural standards
  • Communicate technical concepts and solutions to non-technical stakeholders in a clear and understandable manner


Read more
MHFAIndia
Vijayalakshmi M
Posted by Vijayalakshmi M
Chennai
2 - 15 yrs
₹2L - ₹10L / yr
Inside Sales

Responsibilities:

1.     Sales Generation:

·       Identify and prospect potential clients to generate new business opportunities.

·       Conduct effective sales presentations and product demonstrations to showcase the value proposition of our offerings.

·       Collaborate with the sales team to develop and implement sales strategies to achieve revenue targets.

·       Follow up with leads and coordinate the entire sales cycle from initial contact to closing deals.


2.     Client Relationship Management (only for Senior Associate):

·       Build and maintain strong relationships with clients by understanding their needs and providing tailored solutions.

·       Provide exceptional customer service and address client inquiries and concerns promptly and professionally.

·       Conduct regular client follow-ups to ensure client satisfaction and identify opportunities for upselling or cross-selling.


3.     Market Analysis (only for Senior Associate):

·       Stay updated on industry trends, market conditions, and competitor activities.

·       Conduct market analysis to identify potential business opportunities and target markets.

·       Gather customer feedback and market insights to contribute to product and service enhancements.


4.     Sales Administration:

·       Maintain accurate and up-to-date sales records, including customer profiles, sales activities, and pipeline management.

·       Prepare sales reports and forecasts for management review.

·       Collaborate with the sales team and other departments to streamline processes and improve sales effectiveness.


Qualifications and Skills:

·       Bachelor's degree in Business, Marketing, or a related field.

·       Proven track record of 1-3 years in sales or business development roles for an associate and 4-6 years in sales and business development roles for a senior associate, preferably in a B2B environment.

·       Relevant experience like training Industry, HR consultancy, etc

·       Strong negotiation and persuasion skills with the ability to close deals.

·       Excellent communication and presentation skills, both verbal and written.

·       Self-motivated and target-driven, with a demonstrated ability to work in a fast-paced sales environment.

·       Strong interpersonal skills with the ability to build rapport and establish long-term client relationships.


Benefits:

·       Opportunities for career growth and professional development.

·       Collaborative and supportive work environment.

·       Ongoing training and skill development programs.

Read more
Health and wellness Domain
Health and wellness Domain
Agency job
via Qrata by Revathi Satish
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 6 yrs
₹40L - ₹50L / yr
skill iconPython
skill iconDjango
About the company:

Clinical Trials are the biggest bottleneck in bringing new drugs, devices, and vaccines to patients. On average, getting a new drug through the trial process takes nearly a decade and frequently costs $1B+. To make it worse, the process is inflicted with a great number of transparency issues. We are aiming to solve this through technology and platformization of clinical trials. We develop and offer next-generation technology platforms to pharmaceutical and biotech companies for running their clinical trials by integrating the entire process in an end-to-end workflow. Since Day 1, our vision is to make clinical trials faster, seamless, accessible to patients, and more transparent. We are driven by our technology-first approach to reduce inefficiency and increase patient-centricity in Clinical Trials. Founded by IIT Roorkee Alumni, Triomics is backed by top investors such as Y Combinator, Nexus Venture Partners, and General Catalyst.

Responsibilities:

1. Writing clean, modular, scalable, and reusable code with well-maintained documentation.
2. Working closely with the founding team to come up with product implementation architecture.
3. Designing and Implementing APIs while closely collaborating with front-end developers.
4. Implementing a stable and automated DevOps pipeline with state-of-the-art cloud services.
5. Developing database schemas and routinely evaluating them as per product requirements.
6. Maintaining a high coverage of testing by implementing Unit as well as Integration tests.

Tech Stack:

Our tech stack includes Python, Django, PostgreSQL for the backend, and ReactJS for the frontend.
We also use Celery and Redis for scheduling and multiple AWS services combined with docker for
deployment.
Requirements:
1. Bachelors in Computer Science or related field with 1-6 years of experience
2. Have implemented and deployed at least 1 or 2 production-level applications in the past.
3. Strong experience with Python (Django) as well as REST APIs.
4. Comfortable working with SQL Databases (Preferably PostgreSQL)
5. Experience with DevOps - Docker or Kubernetes, CI/CD pipelines, and AWS.
6. Prior experience of working in an early-stage startup environment is a plus.

Benefits:

1. Competitive CTC: 10-30% hike in the fixed component from your last or current salary +
ESOPs ( 10 - 25L)
2. Rent-Free accommodation in Gurugram
3. Flexible paid time off for full-time employees & paid leave for new parents
Read more
Wolf of Webstreet
at Wolf of Webstreet
1 recruiter
Rohit Langde
Posted by Rohit Langde
Pune
0 - 3 yrs
₹2L - ₹4L / yr
Content Writing
Copy Writing
Blogging
Creative Writing
Technical Writing
Motive behind the company blog is to educate readers about safety and security practices to be followed while computing. The idea of these blog posts is to create long-form content packed with insights and knowledge that our audiences can – and will – actually use. Bloggers must have great technical experience and knowledge in the field of cyber security especially related to Windows OS. Most of your assignments will involve creating tutorials, testing out applications and listing tips. Responsibilities 1. Craft relevant, original content. 2. Explain highly technical topics and making them easy to understand. 3. Catering posts to suit long tail keywords for SEO is vital. We will offer guidance, but you’ll also need to know how to determine SEO factors. Skills 1. Copyediting skills. You’re a stickler for grammar and punctuation and have a deep appreciation for word and sentence variety. 2. Creative writing. You’re able to explain technical content compellingly, but can mix up your tone – especially with humor. Nor are you afraid to use a funny GIF or two. 3. Deadline-driven & detail-oriented. You must be able to meet deadlines and take pleasure in the details. The ability to work from an editorial calendar is a plus. 4. Content management/marketing skills. Working knowledge of how to format in WordPress and use SEO and this will be a walk in the park. 5. A knowledge of SEO tools like SEMRush and Ahrefs is an incredible asset.
Read more
Fast Growing Ethnic Wear Brand
Fast Growing Ethnic Wear Brand
Agency job
via Unnati by Sarika Tamhane
Delhi, Noida, Gurugram
6 - 7 yrs
₹6L - ₹7L / yr
Payroll Management
Work with a well known garments brand, designing a variety of Indian style clothing. Read on to know more.
 
Our client is the most sought after traditional Indian outfit manufacturing and exporting company. Their contemporary and stylishly designed clothes are full of unique patterns, matchless embroidery, gorgeous mirror-work and beautiful block prints.

Almost a decade old, it is a venture committed to bring together a varied range of traditional crafts and techniques of dyeing, weaving, printing and hand embroidery. The founders have dedicated their life to promote Indian Block Prints and provide employment and Hand-Embroidery training to women so that numerous underprivileged women can be empowered.
 
As a Finance - Payroll Executive, you will be responsible for processing, accounting and reconciling various documents, statements and such records related to payroll of the company.

What you will do:

  • Handling the return filing of EPF and ESIC with a consultant
  • Filing GST Return (3B and GSTR-1)
  • Reconciling of sales data and preparing data for GST return (GSTR-1 & 3B)
  • Managing revenue booking and its auditing
  • Handling GST audit and TDS return filing
  • Processing, reconciling and managing payment/refund
  • Coordinating with stakeholders such as various internal departments
  • Processing and reconciling invoices
  • Payroll processing and its controlling and also ensuring statutory compliance while handling the same
  • Handling and managing PCS rate payment
  • Book-keeping and maintaining financial records and financial statements related to payroll of the company
  • Maintaining up-to-date and accurate records of the financial details related to payroll and reporting the same to the management in regular intervals

 

Desired Candidate Profile

What you need to have:

  • Graduation in Commerce is a must
  • Relevant work experience of 6-7 years in handling payroll (finance)
  • E-commerce, retail or manufacturing background is preferred
  • Proficiency in Excel
  • Good in communication skills and with an eye to detail    
Read more
Indian top MNC
Bengaluru (Bangalore)
5 - 14 yrs
₹12L - ₹24L / yr
Data migration
skill iconPostgreSQL
Oracle

Data Engineer - GCP - data migration/PostGres/ORACLE

 

Budget : 200,000 Rs/Month

Domain Knowledge : Banking

Contract Hire : 12 Months

No. of Open Position : 2 Nos

Roles and Responsibilities :

- This role will involve all aspects of data migration with respect to any microservice being migrated.

- Analyze the source schema for the service in question

- Skilled at using the migration design to produce an instance of any templates or artifacts required to migrate the data

- Deliver a working version of the migration design to migrate the data for the service in question

- Develop a suite of scripts that will allow technical verification - either automated (e.g. - rowcouts) or manual (e.g field comparisons)

- Assist in the triage and resolution of any data related defects

Mandatory skills :

- Previous experience of data migration

- Knowledge of PostGres and ORACLE

- Previous experience of Data Analysis

 

 

 
 
Read more
It is a fast-evolving platform to create and share videos
It is a fast-evolving platform to create and share videos
Agency job
via Mindhues by Ankit Bansal
Remote, Bengaluru (Bangalore)
5 - 8 yrs
₹15L - ₹20L / yr
skill iconAndroid Development
skill iconJava
Data Structures
Algorithms
Requirement :

- We are looking for someone who is a self-learner, exhibits considerable leadership skills , and is an excellent team player. Also good at problem-solving and analytical skills.

Must-Have Skills :

- Strong foundation in data structures & algorithms, OS, I/O, concurrency, hands-on knowledge of Android Ecosystem, Java Tech Stack and Android app Development, a good understanding of UI/UX and principles of Material Design, excellent debugging and optimization skills.

Good to have skills :

- Experience of the end-to-end feature development lifecycle in-app, exposure to memory and performance enhancements
Read more
Swift Techno Crafts Pvt Ltd.
Rita jadhav
Posted by Rita jadhav
Mumbai
1 - 5 yrs
₹3L - ₹6L / yr
skill iconAngular (2+)
skill iconJavascript
skill iconHTML/CSS
skill iconBootstrap
skill iconjQuery
Must have technical expertise with at least 2+ years of hands on experience in specifically angular Js Must have strong experience in JavaScript, JQuery, JSON, HTLM and CSS3 . Must have ability to analyse and alter programs to increase maintainability and improve performance. Should have ability to understand and analyse cross-system/cross functional impact of business requirements. Should have good Communication Skills. Hands on experience on windows application. Note: Please excuse Candidate with 2 & 3 Months of Notice period
Read more
NACTUS India Services Pvt Ltd
Prateek Aggarwal
Posted by Prateek Aggarwal
NCR (Delhi | Gurgaon | Noida)
1 - 5 yrs
₹2L - ₹3L / yr
Communication Skills
Field Sales
Lead Generation
Business Development
 To identify new Institutes/ Tutors/ Schools/ Colleges to be onboarded on NACTUS and walkthrough with them on the entire concept of Nactus.  To continuously interact with Institutes/ Tutors on NACTUS to get more usage of application platform  To work with the institutes/ Tutors on-boarded for student demo and student downloads  Time to Time visit to customer places for Training and other requirements of company.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos