Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

Remote only
3 - 15 yrs
₹8L - ₹12L / yr
FastAPI
skill iconPython
RESTful APIs
SQL
NOSQL Databases
+5 more

Summary:

We are seeking a highly skilled Python Backend Developer with proven expertise in FastAPI to join our team as a full-time contractor for 12 months. The ideal candidate will have 5+ years of experience in backend development, a strong understanding of API design, and the ability to deliver scalable, secure solutions. Knowledge of front-end technologies is an added advantage. Immediate joiners are preferred. This role requires full-time commitment—please apply only if you are not engaged in other projects.

Job Type:

Full-Time Contractor (12 months)

Location:

Remote

Experience:

3+ years in backend development

Key Responsibilities:

  • Design, develop, and maintain robust backend services using Python and FastAPI.
  •  Implement and manage Prisma ORM for database operations.
  • Build scalable APIs and integrate with SQL databases and third-party services.
  • Deploy and manage backend services using Azure Function Apps and Microsoft Azure Cloud.
  • Collaborate with front-end developers and other team members to deliver high-quality web applications.
  • Ensure application performance, security, and reliability.
  • Participate in code reviews, testing, and deployment processes.

Required Skills:

  • Expertise in Python backend development with strong experience in FastAPI.
  • Solid understanding of RESTful API design and implementation.
  • Proficiency in SQL databases and ORM tools (preferably Prisma)
  • Hands-on experience with Microsoft Azure Cloud and Azure Function Apps.
  • Familiarity with CI/CD pipelines and containerization (Docker).
  • Knowledge of cloud architecture best practices.

Added Advantage:

  • Front-end development knowledge (React, Angular, or similar frameworks).
  • Exposure to AWS/GCP cloud platforms.
  • Experience with NoSQL databases.

Eligibility:

  • Minimum 3 years of professional experience in backend development.
  • Available for full-time engagement.
  • Please excuse if you are currently engaged in other projects—we require dedicated availability.
Read more
gushwork
Gush Talent Team
Posted by Gush Talent Team
Bengaluru (Bangalore)
2 - 6 yrs
₹12L - ₹24L / yr
Sales
Product demonstration
Communication Skills

Gushwork is one of the fastest-growing AI startups globally, backed by Lightspeed, SIG, and B Capital . We’re building a productized services platform that helps SMBs scale using a powerful combination of human + AI-powered GTM execution.


In just over an year months, we’ve grown rapidly , serving SMBs across the US and India. And we’re only just getting started.


What You’ll Own

  • Drive end-to-end sales: from outbound prospecting to demo to close
  • Sell to SMBs in India and the US — with a clear focus on revenue impact
  • Build and manage a robust pipeline across different time zones
  • Understand client pain points and position Gushwork’s offerings as the go-to solution
  • Collaborate with product and operations to ensure high-quality onboarding and delivery
  • Bring feedback from the front lines to shape GTM strategy



What We’re Looking For

  • Experience full-cycle sales experience, ideally in SaaS or tech-enabled services
  • Proven success in closing SMB accounts — both domestic and/or international
  • Strong communication, storytelling, and objection-handling skills
  • Self-starter who thrives in fast-paced, high-growth environments
  • Comfortable with US working hours (for part of the day)



Why Join Us

  • Be part of a company scaling 6x in the next year
  • Own your revenue — zero fluff, real deals, full credit
  • Work with a lean, ambitious team solving a real market gap
  • Build your career in the future of AI x services
Read more
Ecommerce- Retail
Ecommerce- Retail
Agency job
via CIEL HR Services by Swati M
Bengaluru (Bangalore)
1 - 2 yrs
₹3L - ₹4L / yr
SQL

Experience: 1-3 years

Location: Bangalore

Notice:Immediate Joiner



ResponsibilitiesTo attend to user issue and handle tickets raised by user

  • Strong experience in SQL , PostgreSQL, PL/SQL
  • Providing L2 support depending upon the priority of issue to meet client SLA. 
  • Regularly monitoring S-MAX ticketing tool. 
  • Incident management- logging, prioritizing and resolving/debugging incidents.  Worked on various monitoring tools like open bravo, GCP. 
  • Writing the SQL queries as per the business need. 
  • JAVA  HTML, CSS  Modify existing Shell Script on Unix Platform whenever required.  Interact with Global Customers / Users.  Scheduling the jobs through Crontab. 
  • TOOLS  Regularly checking the business mail and reply to the clients or the respective  team
  • Excellent written and verbal communication skills in English with the ability to clearly articulate solutions to complex technical problems Ability to work with Business heads, administrators and developers Excellent time management skills


Read more
PHP Developer
PHP Developer
Agency job
via The Hub by Sridevi Viswanathan
Bengaluru (Bangalore)
4 - 12 yrs
₹5L - ₹15L / yr
skill iconPHP
skill iconJavascript
skill iconLaravel
MySQL
skill iconCodeIgniter
+1 more

Around 4 years of experience in creating and implementing Web-based products using PHP,

MySQL, Ajax, and JavaScript.


Ability to work in an Agile, fast-paced environment, and learn rapidly.


Bachelor degree in computer science, computer engineering or similar.


Expert in HTML, CSS, JavaScript, JQuery, JSON.


Experience in any PHP framework Laravel, CodeIgniter or Zend.


Writing clean, readable, and easily maintainable code.


Must have knowledge of project/task management tools like Jira,


Familiarity with Version Control Tortoise Bitbucket, Git etc.


Understanding of UI, cross-browser compatibility and web standards.


Good English communication skills, written and spoken.


Able to work with minimum supervision as well as perform under pressure and meet

Deadlines.

Read more
This opening is with Manufacturing Company
This opening is with Manufacturing Company
Agency job
via LK Consultants by Namita Agate
Mumbai, THANE
2 - 5 yrs
₹1L - ₹5.5L / yr
Mechanical engineering
Mechanical drawing
SolidWorks
3D modeling

Responsibilities:

1. Create detailed and accurate mechanical drawings based on project requirements.

2. Collaborate with engineers and project managers to understand design specifications and translate them into technical drawings.

3. Ensure compliance with relevant design codes and standards in the creation of mechanical drawings.

4. Utilize various software tools for drafting and design, demonstrating proficiency in industry-standard software.

5. Prepare and maintain documentation related to mechanical designs, revisions, and updates.

6. Participate in design review meetings to address any issues and incorporate feedback into drawings.

7. Stay abreast of industry trends, standards, and technological advancements to enhance drafting capabilities.

Read more
Rezo.AI
Aditya Deo
Posted by Aditya Deo
Noida
1 - 3 yrs
₹3L - ₹4L / yr
Office administration

About Us

Rezo.ai is an AI-first and NLP-first sales & support automation platform with a mission to become the leading automation/AI platform in the world. Our team has extensive experience in AI and Automation and is working extremely hard to build a state-of-art automation platform. Currently, deployed with large enterprises to automate conversations across voice, email, chat, social, and WhatsApp and enhance customer experience.

What We Are Looking For :

We are looking for a receptionist to be responsible for greeting clients, and visitors to our office and handling a variety of administrative tasks; including answering phones, receiving visitors, preparing meeting and training rooms, making travel plans, event coordination, vendor management etc.

Role &  Job Responsibilities:

  • Serves visitors by greeting, welcoming, and directing them appropriately.
  • Notifies company personnel of visitor arrival.
  • Maintains security and telecommunications system.
  • Informs visitors by answering or referring inquiries.
  • Maintains security by following procedures, monitoring the logbook and issuing visitor badges
  • Assisting with a variety of administrative tasks including copying, faxing, stay booking, food ordering, stationary and making travel plans. 
  • Preparing meeting and training rooms.
  • Performing ad-hoc administrative duties.
Read more
Magic EdTech
at Magic EdTech
3 recruiters
Jitendra Singh
Posted by Jitendra Singh
Noida, Pune
6 - 9 yrs
₹10L - ₹15L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
skill iconHTML/CSS

Role - Principle Engg | Reactjs

Skill Set - Programming

  • React js with Redux,
  • HTML5/CSS3
  • Javascript
  • Mobx (optional)
  • Storybook (optional)

Unit Test Cases: Jest & Enzyme

Code Quality:

  • SonarQube Knowledge
  • Strong hold on unit-testing frameworks and writing effective unit tests

Other Important Skills:

  • Engineering & Design Skills
  • Good analytical & problem solving skills
  • Ability to ship features end to end without much guidance
  • Experienced with Agile methodologies

Soft Skills

  • Good communication skills
  • Zeal to learn new technologies & Methodologies


Read more
ProGrad
at ProGrad
3 recruiters
Heruba C
Posted by Heruba C
Chennai
2 - 8 yrs
₹5L - ₹15L / yr
Routing & Switching
Cisco Certified Network Associate (CCNA)
CCNP
Network Security
Routing protocols
+7 more

Description:

Responsibilities

Strategy & Planning

  • The NOC Managers/ Product support Engineers' primary responsibility is to plan, organize, and manage staff and overall operations to ensure stability of customer's infrastructure.
  • Provides overall expertise with all network operations functions.
  • Ability to define, implement and enforce configuration management and change management policies and practices.


Acquisition & Deployment

  • Handle escalations and manage support from different levels.
  • Ensure adherence of operational metrics.
  • Hire, develop, and retain highly responsive and customer focused engineers to ensure the effective operation of the department
  • Manage tools, systems and procedures to ensure dynamic management of issues and customer management.
  • Ensures all members of assigned technical teams are effective and fully utilized in order to provide high resource utilization.
  • Evaluates technical skills of the team and ensures there is an appropriate level of expertise.
  • Provide procedural training to staff.
  • Perform performance objectives and performance reviews with all team members.


Operational Management

  • The NOC Manager will include hands-on technical support work related to the overall health and maintenance of customer environments.
  • This position will perform tier-2 and 3 escalation support and act as the point of contact in the NOC for all inquiries from other departments.
  • The NOC Manager will manage all related partner operational expectations.
  • Ensure continual process improvement within the NOC including but not limited to automation of NOC tasks and reporting, implementation of enterprise-wide monitoring initiatives, and routine administration tasks.
  • Identify areas for process and efficiency improvement within the NOC; recommend prioritized enhancements and oversee implementation
  • Ensure that reports are accurate and delivered on time.


Experience:

  • More than 3-6 years' experience in Microsoft product build and support experience with a high availability 24x7 including:
  • Expert knowledge of (SCCM) System Center configuration Manager 2012.
  • MS Server 2003 / 2008 Server Admin / Virtualization - MCSE / MCITP
  • VMware 410 VSphere Administrator - VCP410 Certified
  • Expert knowledge of Virtualization using VMware,MCITP
  • Good knowledge of Active Directory, DHCP, DNS, Clustering, Load Balancing, Anti-virus, backup procedures, Group policy, Disaster recovery
  • and High availability using industry standards.
  • Ability to work independently as well as in a team environment.
  • Network services experience is desired.
  • ITIL V3 Foundation Certification preferred


Location: Chennai

Read more
Indiamart Intermesh Limited
at Indiamart Intermesh Limited
1 video
8 recruiters
Yamini Singh
Posted by Yamini Singh
Surat, Vadodara
1 - 5 yrs
₹4L - ₹4.8L / yr
Field Sales
Sales
Direct sales
Communication Skills
Effective communication
  • Position holder will be an individual contributor
  • Build and manage productive, professional relationships with clients
  • Ensure clients are using and deriving benefit from IndiaMART
  • Ensure products/services in client’s e-catalog are accurately defined
  • Maximize revenue by upselling other services and achieve

fortnightly, monthly client retention and revenue targets

  • Systematic follow-up and time-bound closures
  • Prompt resolution of complaints
  • Daily 4-5 in person meetings (F2F) with clients onsite
Read more
client of peoplefirst consultants
client of peoplefirst consultants
Agency job
Chennai
6 - 12 yrs
Best in industry
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill icon.NET
ASP.NET
angular
+2 more
Hi,
   We are hiring for leading  Design and Manufacturing company for the position of senior angular developer having 6 - 12 years of experience for chennai location with strong experience in Angular development, .NET,ASP.NET.
Notice Period : Up to 5 weeks
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos