Cutshort logo
For Employers
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
100-1000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs (10)

Deqode
at Deqode
1 recruiter
Apoorva Jain
Posted by Apoorva Jain
Bengaluru (Bangalore), Mumbai, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Pune, Hyderabad, Jaipur, Nagpur, Indore
5 - 10 yrs
₹5L - ₹16L / yr
Drupal
skill iconPHP

Job Summary

We are looking for an experienced Drupal Developer with 5–10 years of expertise in Drupal CMS development, customization, and theming. The ideal candidate should be proficient in Drupal core APIs, custom module development, PHP, and front-end technologies (HTML5, CSS3, JavaScript/jQuery). The role involves building responsive, secure, and scalable web applications while collaborating with cross-functional teams.

Responsibilities

  • Design, develop, and maintain Drupal-based websites and applications.
  • Build and customize modules, themes, and templates for scalable solutions.
  • Ensure responsive, cross-browser, and high-performance applications.
  • Collaborate with UI/UX, QA, and backend teams to deliver end-to-end solutions.
  • Troubleshoot, debug, and upgrade existing Drupal projects.
  • Follow best practices in coding, version control, and security.

Mandatory Skills

  • Strong proficiency in Drupal (7/8/9/10) including custom module development, key contributed modules, and Drupal core API.
  • Solid knowledge of PHP, theme layer, and template systems.
  • Expertise in HTML/HTML5, CSS/CSS3, JavaScript/jQuery for responsive websites.
  • Familiarity with version control tools like Git.
  • Good understanding of web security, SEO, and performance optimization.



Read more
Rtbrick
Bengaluru (Bangalore)
2 - 7 yrs
₹10L - ₹25L / yr
Ascidocs
markdown
Technical Writing
skill iconGitHub
Scripting

Description


An exciting opportunity has arisen for an experienced technical writer to join the Rtbrick India, Bangalore and take responsibility for shaping the successful delivery of Documentation to the customer. We are looking for a technical writer to help augment our Information Development team in Bangalore.

Requirements


Experience:


Technical Writer: 2 to 6 years

  • Must have worked on Telecom/Mobile/Networking/Cloud technical documentation
  • Experience working with docs-as-code tools (Ascidocs, markdown, etc.) is needed
  • Experience with scripting languages such as Python is needed
  • Experience with version control systems is needed, experience with Github/Gitlab would be a plus
  • Experience working on software testing or technical support would be a plus
  • MCA/BE/BTech degrees would be a plus


Responsibilities

  • Work closely with engineering, product, and field teams to gather and validate information relevant to our customers.
  • Turn complex technical concepts into easily understandable text and illustrations.
  • Review and edit documents for thoroughness.
  • Use new technologies such as AI tools to improve productivity.


Benefits

Enjoy a great environment, great people, and a great package

  • Stock Appreciation Rights - Generous pre series-B stock options
  • Generous Gratuity Plan - Long service compensation far exceeding Indian statutory requirements 
  • Health Insurance - Premium health insurance for employee, spouse and children 
  • Working Hours - Flexible working hours with sole focus on enabling a great work environment 
  • Work Environment - Work with top industry experts in an environment that fosters co-operation, learning and developing skills 
  • Make a Difference - We're here because we want to make an impact on the world - we hope you do too!


Read more
Agentic AI Platform
Agentic AI Platform
Agency job
via Peak Hire Solutions by Dharati Thakkar
Gurugram
5 - 10 yrs
₹20L - ₹40L / yr
Project Management
Program Management
Project implementation
Agile/Scrum
JIRA Agile
+6 more

Review Criteria

* Strong Technical Project Manager / Program Manager / Implementation manager profile

* 4+ years in Project Management / Program management Implementation Engineer/ Consultant with a B2B SaaS company (preferably with enterprise client)

* Hands-on experience managing Agile delivery across multiple teams, including sprint planning, tracking, retrospectives, and release governance using Jira / Confluence

* Strong communication, stakeholder management, and executive-level reporting capability

* (Company) -B2B SaaS

* Not looking for implementation engineer but someone who handles the implementation projects


Role & Responsibilities

We are seeking a dynamic and detail-oriented Technical Project Manager. This is a high-impact opportunity to manage and monitor software projects across teams while also driving delivery excellence, Agile coaching, and process improvements. The ideal candidate brings experience in project management within a product or technology-driven environment, a strong understanding of Agile methodologies, and a keen interest in process governance and continuous improvement.


Project Management & Delivery Oversight:

* Plan and manage multiple concurrent technology projects across multiple teams.

* Collaborate with teams to define project plans, timelines, and resource allocations.

* Track progress using Agile tools (Jira, Confluence) and ensure timely delivery.

* Generate reports and maintain dashboards on project status, risks, and timelines.

* Facilitate daily stand-ups, sprint planning, and retrospectives.


Process Definition & Governance:

* Design and implement processes for Agile delivery, ticket management, and support workflows.

* Conduct audits, spot checks, and process reviews to ensure compliance.

* Identify delivery bottlenecks and drive continuous improvement.


Stakeholder Communication:

* Serve as the bridge between Engineering, QA, Support, and Product teams

* Regularly update leadership on delivery progress, risks, and process gaps

* Simplify technical progress and status for executive-level reporting


Ideal Candidate

* 3+ years of experience in Project Management / program management / Delivery Excellence roles within technology or SaaS organizations.

* Strong understanding of Agile/Scrum practices and tools like Jira, Confluence.

* Hands-on experience in any technical function (QA, development, testing, or project coordination).

* Ability to lead process governance, including documentation, audits, and stakeholder alignment.

* Excellent communication, analytical thinking, and stakeholder management skills.

* Self-driven, highly organized, and outcome-focused.


Desirable Qualifications:

* Certifications such as PMP, CSM, or CMMI-related are a plus.

* Exposure to process maturity models or experience contributing to CMMI audits is preferred.


Read more
Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Gurugram
20 - 25 yrs
₹40L - ₹50L / yr
Candidate must have a proven track record in commercial real...
  • Candidate must have a proven track record in commercial real estate development (e.g., malls, office buildings, industrial setups).
  • Candidate must have minimum 20 years of experience in real estate project management.
  • Need candidate having strong experience across the entire project lifecycle – including planning, government approvals, vendor management, and execution.
  • Need candidate with 10+ years of experience working with top-tier real estate firms such as DLF, Vatika, Unitech, etc.
  • Candidate must have deep knowledge of construction norms, regulatory compliance, and legal approval processes.
  • Candidate must have a well-established industry network within the real estate and construction ecosystem.

 

Read more
well-funded women-centric healthtech start-up
well-funded women-centric healthtech start-up
Agency job
via Qrata by Prajakta Kulkarni
Mumbai
5 - 12 yrs
₹25L - ₹38L / yr
Product Marketing
Product Marketer
Mobile App Marketing
Technology Marketing
Growth Hacking
+2 more
  • Accountable for conversion% of visitors at Gynoveda.com
  • Map customer journey, define use cases & service design to drive engagement & purchases
  • Build frictionless online customer experience for website & app
  • Optimize marketing funnels for customer acquisition, retention, video-content  
  • Develop mobile app for menstrual health tracking, online consultation, content marketing
  • Drive marketing automation and integrate multiple online SaaS tools using API, plugins
  • Build unified tech solutions for - 
    • Customers - online sales & support via responsive website and mobile app
    • Employees - process & tools for operations, customer service, supply chain
Read more
Victrix Systems  Labs
at Victrix Systems Labs
1 recruiter
Darshana Lokhande
Posted by Darshana Lokhande
Remote only
4 - 8 yrs
₹6L - ₹15L / yr
skill iconVue.js
skill iconHTML/CSS

As a Vue.js Developer, you will be responsible for developing user interfaces and web applications using Vue.js framework, collaborating with cross-functional teams, and implementing front-end solutions that align with business requirements.

Responsibilities:

  • Develop and maintain user-facing features using Vue.js framework.
  • Collaborate with the design and backend teams to implement intuitive and responsive user interfaces.
  • Write clean, maintainable, and reusable code using best practices and coding standards.
  • Optimize application performance and ensure scalability.
  • Participate in code reviews, bug fixing, and troubleshooting to ensure high-quality deliverables.
  • Work closely with product managers and stakeholders to understand business requirements and translate them into technical solutions.
  • Stay up-to-date with the latest trends and advancements in Vue.js and front-end development.
  • Mentor and provide guidance to junior developers when needed.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum 5 years of professional experience as a Vue.js Developer or a similar role.
  • Strong proficiency in Vue.js and its core principles.
  • Proficient understanding of HTML5, CSS3, and JavaScript.
  • Experience with Vue CLI, Vuex, Vue Router, and other relevant Vue.js libraries and tools.
  • Solid understanding of RESTful APIs and integration of front-end applications with backend services.
  • Familiarity with version control systems such as Git.
  • Experience with testing frameworks (e.g., Jest, Mocha) and writing unit tests.
  • Strong problem-solving skills and the ability to debug complex issues.
  • Excellent collaboration and communication skills.
  • Self-motivated with the ability to work independently and in a team environment.

Preferred Qualifications:

  • Experience with other front-end frameworks such as React or Angular.
  • Knowledge of server-side technologies such as Node.js or Express.js.
  • Familiarity with Agile/Scrum methodologies.
Read more
Jellyfish Technologies
at Jellyfish Technologies
7 recruiters
Sathya Narayanan
Posted by Sathya Narayanan
Noida
4 - 9 yrs
₹1L - ₹15L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
  •  Excellent Communication Skills.
  • Working knowledge of React libraries such as Redux, Redux Thunk, Redux Saga, Redux Forms, Immutable etc.
  • Highly proficient in JavaScript and ReactJs
  • Good understanding of design libraries such as Material, Ant and Semantics etc.
  • Basic understanding of front-end technologies, such as HTML5, and CSS3.
  • Sound knowledge of Testing frameworks such as Jest, Enzyme, Mocha, Protector etc.
  • Experience of writing unit, integration and E2E tests.
  • Experience of integrating third party APIs.
  • Good understanding of code versioning tools, such as Git.
Read more
AiTrillion
at AiTrillion
2 recruiters
Harshita Dubey
Posted by Harshita Dubey
Remote only
3 - 12 yrs
₹4L - ₹18L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+7 more

Senior PHP Developer

 

Experience: 5+Years
Location: India(Remote)

What’s the opportunity?

AiTrillion is looking for a Sr. Developer with experience in

  • PHP
  • Zend Framework CI
  • NodeJS, Express
  • Loopback
  • Serverless Framework & CLI
  • AWS Lambda
  • API Gateway with MySQL
  • MongoDB
  • DynamoDB database experience

What will you be doing? 

  • Strong Development/Management background with experience in Developing Products with large-scale user transactions and having critical business nature.
  • Must be able to build the technical architecture/stack of the product from scratch including server interactions, scripts, deployment stage, features with a cost-effective manner.
  • Hands-on implementation of the critical interfaces and complex modules of the systems and features as a solution architecture and design.
  • Provide timely deliverables, estimates, and complete tasks in an Agile development environment.
  • Reviewing code for coding standards and accuracy and functionality.
  • Help the team to solve complex coding problems and troubleshoot the issues.

What skills do you need?

  • Minimum 5+years of Technical Lead experience.
  • Handle on any MVC PHP Frameworks Like Zend Framework, Laravel
  • Must have experience on  NodeJS, Express, Loopback
  • Good to have hands-on Serverless Framework & CLI, AWS Lambda, API Gateway, SQS, SNS, Step Functions
  • Must have experience working with JavaScript technologies like NodeJS, AngularJS,  React.
  • Hands-on  Relation, Non-relation, MYSQL, Data Lakes, HIVE, Apache Spark, MongoDB, Apache Cassandra, Streaming Analytics, In-Memory, NoSQL Database.
  • Must have a good understanding of building and using REST APIs and Different Authentication Protocols.
  • Good to have experience with  Amazon Web Services (EC2, RDS Aurora, Lambda, API Gateway, S3, CloudFront )
  • Must have experience building microservices and customer-facing APIs.
  • Must have a sound understanding of failure modes, resiliency patterns, and techniques to enable robust, self-healing architecture.
  • Develop Business Domain-Driven Reusable Microservices.
  • Knowledge of version control systems like GIT (mandatory).
  • Experience with Google Cloud is a plus.
  • Experience with the process of automation and load testing is a plus.
  •  

At AiTrillion, we are committed to building and fostering an environment where our employees feel included, valued, and heard. Our belief is that a strong commitment to diversity and inclusion enables us to truly make commerce better for everyone. We strongly encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities and/or people with intersectional identities.

Read more
Acess meditech pvt ltd
Remote, Hyderabad
3 - 6 yrs
₹3L - ₹5L / yr
Microsoft SQL Server
Relational Database (RDBMS)
DBA
SQL server

Hi,

Greeting from Acess Meditech Pvt Ltd. is into providing of business process outsourcing services for Insurance industry.

Job Title:SQL server (DBA)(2008,2012,2016) versions

Experience:  3-4 Yrs Min

Location: Hyderabad

Qualification :Any Degree.

Job Responsibility

SQL Server DBA will be responsible for the implementation, configuration, maintenance, and performance of critical SQL Server RDBMS systems, to ensure the availability and consistent performance of our corporate applications. This is a “hands-on” position requiring solid technical skills, as well as excellent interpersonal and communication skills.

Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools

Experience with backups, restores and recovery models

Knowledge of High Availability (HA) and Disaster Recovery (DR) options for SQL Server

Experience working with Windows server, including Active Directory

Ability to organize and plan work independently

Perform scheduled maintenance and support release deployment activities after hours.

Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end.

 

Read more
SmarterHi Communications Pvt. Ltd.
Pradeep Vasudev
Posted by Pradeep Vasudev
Pune
3 - 5 yrs
₹5L - ₹10L / yr
skill iconJavascript
DOM
skill iconHTML/CSS
Agile/Scrum
AJAX
+2 more
Start from first principles, push yourself, go hungry, and slog all night. Work from home, but only on weekends, because there is too much to do at office. Get 120 days of leave per year, including Saturdays and Sundays! Get paid less than the market, but valued more than the market can imagine! Or Stop Reading Now! Still here? Cool! Keep reading! What are we: SmarterHi develops software that verifies claims – Is your drone where it is supposed to be? What is the download speed you are getting on your 4G connection? Does the user have execute permission on this command? We are the information security auditor of the new age. And we are just getting started… We are looking for some seriously self-motivated folks to join our little team – yes, it’s little and we aim to keep it like that – just a little bigger… The Question is: Are you willing to join in? See more at http://www.smarterhi.com/jobs
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos