Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

RockED
at RockED
2 candid answers
1 video
Kashish Trehan
Posted by Kashish Trehan
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconReact Native
skill iconJavascript

Role: Senior Mobile Engineer (React Native) & Team Builder

Location: Bangalore 


About Us


RockED is the premier people development platform for the automotive industry, supporting the entire employee lifecycle from pre-hire and onboarding to upskilling and career transitions. With microlearning content, gamified delivery, and real-time feedback, RockED is educating the automotive workforce and solving the industry's greatest business challenges. 

The RockED Company Inc. is headquartered in Florida. Backed by top industry experts and investors, we’re a well-funded startup on an exciting growth journey. Our R&D team (Indian entity) is at the core of all product and technology innovation 

We partner with 10000+ dealerships, empower 60,000+ learners, complete 15000+ certifications, and have crossed 11 million lesson completions


Check out our website https://www.rocked.us/


Your Impact 

● Lead the architecture, design, and development of high-quality, scalable, and user-friendly mobile applications using React Native.

● Drive technical decisions and establish engineering best practices to ensure long-term scalability, maintainability, and performance.

● Partner closely with Product Managers, Designers, and Engineering leaders to translate business requirements into impactful user experiences and technical solutions.

● Own end-to-end delivery of complex features and initiatives, from technical design through production deployment.

● Design and implement reusable frameworks, components, and patterns that improve engineering velocity across teams.

● Champion application performance, reliability, security, and observability across the mobile platform.

● Lead system design discussions and contribute to architectural roadmaps for mobile and frontend platforms.

● Collaborate across teams to identify technical risks, evaluate trade-offs, and make sound engineering decisions aligned with product goals.


What skills do you need? 


● Strong proficiency in JavaScript/TypeScript with significant experience building and scaling React Native applications.

● Proven experience designing and shipping large-scale mobile applications on Android and iOS platforms.

● Strong system design skills, including application architecture, scalability, performance optimization, state management, and offline-first/mobile-first design patterns.

● Experience building reusable component libraries, design systems, and scalable frontend/mobile platforms.

● Strong product thinking with the ability to understand business requirements, customer needs, and translate them into effective technical solutions.

● Strong understanding of API design, RESTful services, backend integrations, and mobile application security best practices.

● Experience driving technical discussions, architecture reviews, and engineering best practices within a team.

● Experience working in Agile environments and collaborating with cross-functional stakeholders.


Why choose a career at RockED?


  • Build Product from Day One: Work in small, high growth product based team solving real problems and to build meaningful, user-focused products from the ground up
  • AI Exposure: We encourage engineers to leverage AI tools and emerging technologies to improve productivity, experimentation, and innovation. 
  • Learn from Industry Leaders: Our engineering crew in India is folks from IIT, ISB, and people who’ve built at Adobe, Microsoft, Walmart, and more — but the vibe is very startup: high ownership, quick decisions, and flat hierarchy.
  • Global Exposure: Be part of a diverse, high-calibre team working closely across the US and India. 
  •  Hybrid Model : In-office days are Tuesdays & Wednesdays but the office is always buzzing throughout the week
  • Wellness and Insurance support for you and your family—fully sponsored by RockED
  • Spot awards, team outings, thoughtful gifts, celebrations, fitness challenges



Read more
Work Companion
Dhruv Sharma
Posted by Dhruv Sharma
Gurugram
1 - 3 yrs
₹4L - ₹6L / yr
Customer Relationship Management (CRM)
SaaS
End-user training
Customer Retention
Communication Skills
+4 more

What is WoCo and why should you join?

WoCo is a go-to HRTech solution for new age and fast-growing businesses, built by a team of innovators, technologists, product scientists, outliers, business leaders and people's people. WoCo is truly poised to lead the People, Payroll and Productivity space with some of the best minds in the industry.

 

Location

Onsite. Gurugram.

 

What will you do every day?

We are on the lookout for dynamic individuals in the Customer Success Team who can work closely with clients helping them achieve their Digital Transformation goals.

 

What do you need to ace your role?

  • Business Advisor to our clients working towards achieving their digital transformation goals and success metrics. Ability to manage client relationships and expectations
  • Act as a techno-functional consultant and provide recommendations on process
  • Goal-oriented and data-driven to actively track performance and drive metrics like CSAT, NPS, Adoption and Usage for clients. Analyze customer data to improve the end-user experience
  • Experience with metrics like Net Revenue Retention (Upselling), Churn, Customer References & reviews. Work closely with product, sales and other cross-functional teams, (internal and external) with ease to drive these goals
  • Devise engagement plans that consider customer business goals and map product capabilities to achieve these goals
  • Support clients during critical HR events like Appraisal, Increments etc.
  • Support clients to resolve queries or bugs, as and when required
  • Gather feedback on product experience during the entire customer lifecycle via targeted surveys
  • Identify prime targets for up-sell/cross-sell and engage Sales team to execute on those opportunities
  • Share best practices with clients on how to achieve product success with WoCo
  • Identify risks proactively, mitigate and escalate as deemed appropriate
  • Passionate about Customer Experience and ability to be the customer's voice in guiding the Product Roadmap
  • Excellent communication and presentation skills.
  • Excellent relationship-building skills
  • Be a cultural champion and energy driver

 

Requirements

  • 2-4 years of experience in Customer Success in SaaS
  • Exceptional communication and presentation skills, coupled with excellent listening skills
  • Analytical and data-driven with ability to work with multiple stakeholders
  • Demonstration of good product and consumer thinking during his/her career
  • Hands-on and a quick learner. Comfortable with learning new technology
  • Basic tech skills especially knowledge of python, Power BI will be a plus
  • This role provides you access to PII for which you will abide to follow secure data handling practices to safeguard and protect such data.
  • We don’t necessarily expect to find a candidate that has done everything listed, but you should be able to make a credible case that you’ve done most of it and are ready for the challenge of adding some new things to your resume.
Read more
Saksoft
Bengaluru (Bangalore), Mumbai
8 - 16 yrs
₹20L - ₹40L / yr
Hunting
Farming
KAM
Key account management
Account Management

Job role: Key Account Manager

Location: Bangalore & Mumbai

Experience Required: 12–14 years


About the Role: We are seeking a dynamic and experienced Key Account Manager to drive strategic growth and manage relationship for Banking and Fintech domain.


The ideal candidate will have a strong background in leadership, account management, and consultative selling, with a proven ability to align IT services with client needs and build long-term partnerships.


Key Responsibilities:

• Build and strengthen relationships with the strategic accounts in the Banking and fintech domain by aligning IT solutions with their needs and finding opportunities to increase revenue.

• Develop and execute strategic account plans tailored to client needs.

• Collaborate with cross-functional teams to ensure seamless delivery and client satisfaction.

• Conduct regular business reviews to identify upselling, cross-selling, and partnership expansion opportunities.

• Lead account mapping, connect with key decision-makers, and facilitate client visits to build a strong pipeline.

• Drive client satisfaction and foster long-term partnerships for sustained growth


Skills & Qualifications:

• Education:

o Bachelor's degree in Engineering.

o MBA in Sales & Marketing (preferred).


• Extensive experience in managing accounts in Banking and Financial services domain.

• Proficient in risk analysis, effort estimation, cost estimation, and budget/resource management.

• Strong expertise in working with enterprise customers, engaging in consultative selling, and nurturing client relationships.

• Proven ability to develop and execute account and territory plans to expand customer base.

• Skilled in managing sales pipelines, assessing opportunities, and driving transactions to closure.

• Adept at understanding client requirements, providing tailored solutions, and ensuring client satisfaction and retention.

• Strategic thinker with strong techno-commercial acumen and excellent interpersonal and negotiation skills

Read more
Kynea
at Kynea
1 recruiter
Satyavani Dasika
Posted by Satyavani Dasika
Hyderabad
4 - 15 yrs
₹1L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices

About Us:

 

We’re a startup based in Hyderabad. We focus on making speech, text & structured data actionable. We are building an exciting range of products, and have paying customers.

 

Job Description

 

We are seeking an experienced Java Developer to join our dynamic team. The ideal candidate

will have 5 to 8 years of hands-on experience in Java development, with a strong understanding

of software  development principles and methodologies. The Java Developer will be

responsible for designing, developing, and maintaining high-quality software solutions that

meet our clients' needs.

 

  Responsibilities:

 

·      Designing, developing, and maintaining high-performance and scalable Java applications.

·      Collaborating with cross-functional teams to define, design, and ship new features.

·      Writing clean, maintainable, and efficient code following best practices.

·      Participating in code reviews and providing constructive feedback to peers.

·      Troubleshooting, debugging, and resolving technical issues in a timely manner.

·      Ensuring the performance, security, and scalability of applications.

·      Staying updated with the latest industry trends, technologies, and best practices.

·      Mentoring junior developers and assisting in their professional growth.

·      Develop Spring based server-side components of Enterprise applications.

·      Build self-dependent modules which can integrate with external applications.

·      Develop and manage well-functioning databases and applications

·      Test software to ensure responsiveness and efficiency

 

 

What we will bring to the table:

 

·      Focused opportunity to work on cutting edge technologies

·      Exposure to key customers in India and abroad

·      Work closely with senior leadership that has already developed world class products

·      A learning environment

·      Challenging problems to solve

Read more
Sigmoid
at Sigmoid
1 video
4 recruiters
Jayakumar AS
Posted by Jayakumar AS
Bengaluru (Bangalore), Hyderabad
2 - 5 yrs
₹12L - ₹15L / yr
PySpark
Data engineering
Big Data
Hadoop
Spark
+5 more

Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.


This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to

spend a majority of their time coding.


Location - Bengaluru and Hyderabad


Responsibilities:

● Good development practices

○ Hands on coder with good experience in programming languages like Java or

Python.

○ Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.

○ Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment

○ Self starter to be able to grasp new concepts and technology and translate them into large scale engineering developments

○ Excellent experience in Application development and support, integration development and data management.

● Align Sigmoid with key Client initiatives

○ Interface daily with customers across leading Fortune 500 companies to understand strategic requirements


● Stay up-to-date on the latest technology to ensure the greatest ROI for customer &Sigmoid

○ Hands on coder with good understanding on enterprise level code

○ Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems

○ Experience in defining technical requirements, data extraction, data

transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment


● Culture

○ Must be a strategic thinker with the ability to think unconventional /

out:of:box.

○ Analytical and data driven orientation.

○ Raw intellect, talent and energy are critical.


○ Entrepreneurial and Agile : understands the demands of a private, high growth company.

○ Ability to be both a leader and hands on "doer".


Qualifications: -

- Years of track record of relevant work experience and a computer Science or related technical discipline is required

- Experience with functional and object-oriented programming, Java must.

- hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.

- Effective communication skills (both written and verbal)

- Ability to collaborate with a diverse set of engineers, data scientists and product managers

- Comfort in a fast-paced start-up environment


Preferred Qualification:

- Technical knowledge in Map Reduce, Hadoop & GCS Stack a plus.

- Experience in agile methodology

- Experience with database modeling and development, data mining and warehousing.

- Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff

- Experience working with large, complex data sets from a variety of sources

Read more
primathonin
at primathonin
2 recruiters
Sagar Patidar
Posted by Sagar Patidar
Gurugram, Indore
3 - 6 yrs
₹3L - ₹9L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
SQL
+1 more

As a Node.js Developer at Primathon Technology, you will be responsible for designing, developing, and maintaining server-side applications using Node.js. You will collaborate with cross-functional teams to implement new features, optimize existing functionality, and ensure the best possible performance, security, and user experience. Key Responsibilities:

1. Develop and maintain server-side applications using Node.js, ensuring optimal performance and scalability.

2. Collaborate with front-end developers, designers, and other stakeholders to implement new features and enhance existing functionality.

3. Write clean, maintainable, and efficient code while adhering to coding standards and best practices.

4. Participate in code reviews to ensure code quality and consistency within the development team.

5. Troubleshoot and debug issues across the application stack, identifying and resolving performance bottlenecks and other challenges. 6. Implement security and data protection measures, ensuring the application's compliance with industry standards.

7. Optimize applications for maximum speed and scalability. Qualifications and Skills:

1. Bachelor's degree in Computer Science, Engineering, or a related field.

2. Minimum of 2 years of professional experience as a Node.js Developer

. 3. Proficient in server-side JavaScript programming using Node.js.

4. Strong understanding of asynchronous programming, including Promises and async/await.

5. Experience with RESTful API development and integration.

6. Familiarity with front-end technologies such as HTML, CSS, and JavaScript frameworks (e.g., React, Angular, Vue) is a plus.

7. Knowledge of database systems (e.g., MongoDB, MySQL, PostgreSQL) and data modeling.

8. Experience with version control systems (e.g., Git) and collaborative development workflows.

9. Good understanding of software development lifecycle (SDLC) and agile methodologies.

10. Strong problem-solving skills and attention to detail

Read more
Noida, Gurugram
5 - 10 yrs
₹7L - ₹12L / yr
Documentation
Project Management
Team Management
Client Management
uat
+1 more

Responsibilities :      

  • Requirement gathering and stakeholder management for client projects.
  • Scope software development projects, create various documents (e.g. SRS, wireframes etc) and define development roadmap along side technical lead.
  • Coordinate with clients day to day and act as a product owner to ensure the software being developed is conceptualised and delivered per client's expectations.
  • Facilitate kick off meetings, requirement meetings and status meetings.
  • Setting out quality standards for various operational areas, ensuring a high quality customer experience while adhering to the SLA’s and work processes 
  • Use tools such as JIRA for project management/tracking.
  • Verify and validate the software on a regular basis.
  • Ensure in-scope development and obtain change request approvals by evaluating against change control processes.
  • Conduct impact assessments and manage risks/resolution with least impact to project constraints.
  • Manage and mentor a team.
  • Coordinate with sales team and participate in pre-sales activities as and when required.
Read more
A global player in the telematics ecosystem.  (TM1)
A global player in the telematics ecosystem. (TM1)
Agency job
via Multi Recruit by Ayub Pasha
Bengaluru (Bangalore)
3 - 4 yrs
₹10L - ₹14L / yr
Embedded Linux
Embedded Systems
Embedded C
Embedded software
Telematics
+3 more
  • Looking engineers with 3 - 4 years of experienced embedded software and embedded Linux developers
  • Design and implement Embedded Linux based applications
  • Design and implement embedded software for telematics and IoT products
  • Code review and optimization
  • Develop board support packages for new hardware designs
  • Provide customization and field support
  • Closely work with the hardware development team

Requirements:

  • BE/BTech in ECE, EEE or CS
  • 3 - 4  years of experience in embedded software and embedded Linux development
  • Good working experience in Linux applications and drive development
  • Good C programming skills
  • Good knowledge of OS programming
  • Familiarity with configuration management tools
  • Good communication skills

 

Read more
Chennai
0 - 1 yrs
₹1L - ₹1L / yr
Business Process Outsourcing (BPO)
Communication Skills
non voice
fresher
computer

 

Greetings from Zealous Services ! 

Get Spot Offer for Freshers in BPO  US Non Voice Process 

Job Location : Chennai, Tamilnadu

Age Limit : 18-26 Years

Reference Person: Malar HR
Please Carry below documents (mandatory) :

# Updated Resume Copy
# Carry an Aadhar Xerox with you

Interview Time : Monday to Friday (10Am - 4Pm) 

Interested Candidates can Walk in to the office premises directly.

Qualifications

Qualification - Eligibility Criteria : # Any Graduate/Diploma
Desired Experience : 0-1 Year

 

 

Read more
CleverGround
at CleverGround
1 recruiter
Siddharth Pathre
Posted by Siddharth Pathre
Pune
1 - 5 yrs
₹4.5L - ₹5.5L / yr
skill iconPython
skill iconDjango
DevOps
skill iconReact.js
Experience: 0-3 years
Notice Period: 0-30 days
Mandatory Skill Set: Front End: React JS & Javascript
                                    Backend: Python-Django/ Flask

 

Responsibilities

  • Responsible for design and architecture of functional prototypes and production ready systems
  • Uses open source frameworks as appropriate Django Preferred
  • Develops Python and JavaScript code as necessary
  • Python development to support middleware for REST API
  • Communicate technical concepts with trade offs, risks, and benefits
  • Evaluate and resolve product related issues

Requirements

  • Demonstrable experience writing clean, thoughtfully crafted Python or PHP that scales
  • Strong understanding of JavaScript, HTML, and CSS3
  • Good understanding of REST API's and experience in building them.
  • Experience on asynchronous request handling, partial page updates, and AJAX
  • Proficient understanding of cross browser compatibility issues and ways to work around such issues
  • Proficient understanding of code versioning tools, such as Git / Mercurial / SVN
  • Good understanding of browser rendering behaviour and performance
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos