Cutshort logo
Ladera Technology logo
AI Automation Engineer OR LLM Automation Engineer
AI Automation Engineer OR LLM Automation Engineer
Ladera Technology's logo

AI Automation Engineer OR LLM Automation Engineer

Neeraja S's profile picture
Posted by Neeraja S
5 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
yaml
Artificial Intelligence (AI)
Azure devops
Large Language Models (LLM) tuning
skill iconJava
skill iconPython
CI/CD
Cucumber

AI/LLM Test Automation Engineer (SDET)

Location: Bangalore (Hybrid preferred)

Experience: 5-8 Years


Job Summary


We are seeking a Senior Test Automation Engineer (SDET) with expertise in AI/LLM testing and Azure DevOps CI/CD to build robust automation frameworks for cutting-edge AI applications. The role combines deep programming skills (Java/Python), modern DevOps practices, and specialized LLM testing to ensure high-quality AI product delivery.


Key Responsibilities

  • Design, develop, and maintain automation frameworks using Java/Python for web, mobile, API, and backend testing.
  • Create and manage YAML-based CI/CD pipelines in Azure DevOps for end-to-end testing workflows.
  • Perform AI/LLM testing including prompt validation, content generation evaluation, model behavior analysis, and bias detection.
  • Write and maintain BDD Cucumber feature files integrated with automation suites.
  • Execute manual + automated testing across diverse application layers with focus on edge cases.
  • Implement Git branching strategies, code reviews, and repository best practices.
  • Track defects and manage test lifecycle using ServiceNow or similar tools.
  • Conduct root-cause analysis, troubleshoot complex issues, and drive continuous quality improvements.


Mandatory Skills & Experience

✅ 5+ years SDET/Automation experience

✅ Java/Python scripting for test frameworks (Selenium, REST Assured, Playwright)

✅ Azure DevOps YAML pipelines (CI/CD end-to-end)

✅ AI/LLM testing (prompt engineering, model validation, RAG testing)

✅ Cucumber BDD (Gherkin feature files + step definitions)

✅ Git (branching, PRs, GitFlow)

✅ ServiceNow/Jira defect tracking

✅ Manual + Automation testing (web/mobile/API/backend)


Technical Stack


Programming: Java, Python, JavaScript

CI/CD: Azure DevOps, YAML Pipelines

Testing: Selenium, Playwright, REST Assured, Postman

BDD: Cucumber (Gherkin), JBehave

AI/ML: Prompt validation, LLM APIs (OpenAI, LangChain)

Version Control: Git, GitHub/GitLabDefect

Tracking: ServiceNow, Jira, Azure Boards


Preferred Qualifications

  • Exposure to AI testing frameworks (LangSmith, Promptfoo)
  • Experience with containerization (Docker) and Kubernetes
  • Knowledge of performance testing for AI workloads
  • AWS/GCP cloud testing experience
  • ISTQB or relevant QA certifications


What We Offer

  • Work on next-gen AI/LLM products with global impact
  • Modern tech stack with Azure-native DevOps
  • Flexible hybrid/remote work model
  • Continuous learning opportunities in AI testing
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ladera Technology

Founded :
2017
Type :
Services
Size :
1000-5000
Stage :
Bootstrapped

About

Empowering Digital Transformation with SAP, Cloud, Data & AI, & Cybersecurity Accelerate growth and secure your digital future Our Solutions Get in Touch SAP Custom AI Adoption (CAIA) Program Ladera & SAP – Partnering for intelligent Enterprise transformation with AI Adoption Our Solutions Get in Touch Global clients  0 + Consultants 0 Years Driving Customer […]
Read more

Company social profiles

bloglinkedin

Similar jobs

Rayvat Outsourcing
at Rayvat Outsourcing
1 recruiter
HR Rayvat
Posted by HR Rayvat
Gandhinagar
0 - 2 yrs
₹1.2L - ₹3L / yr
Adobe Premiere Pro
Final Cut Pro X
DaVinci
Canva

About Us: At Jenya, we specialize in creating captivating content that connects with audiences on a global scale. Our team is dedicated to pushing creative boundaries and delivering exceptional results. We’re looking for a skilled Video Editor with a focus on YouTube videos and Shorts to join our vibrant team.

Position Overview: We are seeking a talented Video Editor with a strong background in editing YouTube videos and Shorts. In this role, you will be responsible for crafting engaging, high-quality video content that stands out on YouTube and other platforms. Your expertise will help us deliver visually compelling stories that resonate with viewers and drive channel growth.

Key Responsibilities:

  • Edit and produce engaging YouTube videos and Shorts from raw footage.
  • Develop video content that aligns with our brand’s voice and goals.
  • Collaborate with content creators, producers, and other team members to ensure video content meets project specifications.
  • Optimize videos for YouTube, including titles, descriptions, and metadata to maximize visibility and engagement.
  • Apply effective video pacing, transitions, and effects to create a polished final product.
  • Maintain organized video files and adhere to project deadlines.

Requirements:

  • Proven experience as a Video Editor with a strong portfolio showcasing your work on YouTube videos and Shorts.
  • Proficiency in video editing software (e.g., Adobe Premiere Pro, Final Cut Pro, DaVinci Resolve, Canva etc).
  • In-depth understanding of YouTube’s platform, including trends, algorithm, and best practices for Shorts.
  • Ability to create engaging video content tailored for different audiences and platforms.
  • Strong attention to detail, creativity, and problem-solving skills.
  • Excellent communication skills and ability to work collaboratively in a team environment.

Preferred Qualifications:

  • Bachelor’s degree in Film Production, Media, or a related field.
  • Experience with motion graphics, animations, and visual effects.
  • Familiarity with SEO best practices and video analytics.

What We Offer:

  • Competitive salary and comprehensive benefits package.
  • A collaborative and creative work environment.
  • Opportunities for professional growth and development.
  • Alternate Saturday off

How to Apply: If you are a dedicated Video Editor with a passion for fostering a positive workplace culture and have at least 1+ year of relevant experience, we invite you to apply for this exciting opportunity.


Join our team and contribute to our continued success as a Video Editor dedicated to the growth!

Education:

  • Bachelor's (Preferred)


Read more
LOGICAL Soft Tech
at LOGICAL Soft Tech
1 recruiter
Sumit Aryan
Posted by Sumit Aryan
Indore
0 - 2 yrs
₹1L - ₹2L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode

Urgently Hiring for Junior IOS developer(swift) for our IT company Logical Softtech, Indore(M.P)

Experience : minimum 6 Months experienced

Job Location : Indore(M.P) only

****

Responsibilities :-

1) Must have expertise in swift language for IOS ap development with json api parsing.

2) Must have done some IOS app with latest (xcode) swift technology

3)Must be expert in design and development on xcode( swift)

 

Read more
MSD Tech
MSD Tech
Agency job
via Majoris Technologies by Ayushi Jain
Hyderabad
2.5 - 6 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconC++
skill iconC
skill iconGo Programming (Golang)
Data Structures
+1 more

JD:

As a Staff Software Engineer, you will be responsible for the design, implementation and maintenance of software modules owned by a team. You will guide and mentor junior team members by reviewing their code and designs to ensure that they are writing well designed and high quality code. This role requires excellent communication skills as you will need to collaborate across teams. 

Key Skills:

  • 3 to 6 years of experience
  • Extensive experience on C/C++/Python
  • Experience on OS - Unix/Linux and Windows
  • Hands on experience in Networking and Multi-threading

Desirable Skills:

  • Experience in Cloud Technologies, system programming is a plus

Roles and responsibilities:

  • Play key role in design/development of security product. 
  • Responsible for the complete software development cycle.
  • Gathering & understanding requirements.
  • Design, development & implementation independently.
  • Responsible for ensuring timely and quality delivery.
  • Will be able to work in end to end features. 

Qualification:

  • B.Tech / B.E / M.E./ M.Tech (Computer Science) or equivalent.


Read more
App Innovation Technologies
AIT Careers
Posted by AIT Careers
Coimbatore
0 - 3 yrs
₹2L - ₹3L / yr
Salesforce
Salesforce Apex
SAP CRM

We are looking for someone to be responsible for the development and maintenance of Salesforce applications. Your primary focus will be custom Salesforce development and integration with third-party services. You will be working with other engineers and developers on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and creating quality products is essential.

Responsibilities

  • Translate functional requirements into technical requirements
  • Design and build high-performance, reusable, and reliable Apex code with best practices
  • Ensure the best possible quality of the application
  • Take ownership of project work and developing client relationships (should be a confident self-starter)
  • Identify bugs and align with requirements during debugging
  • Write test classes for the class that you develop and ensure more than 80% code coverage
  • Test bug fixes to make sure they work as per requirements, then deploy them to production

Skills and Qualifications

  • Apex development
  • Should have worked with an editor such as MavensMate or Eclipse for force.com
  • Visualforce page development
  • Ability to communicate with customers and provide consultation on Salesforce solutions
  • Good problem-solving skills and ability to give optimal solutions
  • Hands-on experience in administration setup, e.g., managing users, security controls, and data as well as creating roles, profiles, and reports.
  • Experience in designing custom objects, custom fields, picklists, page layouts, workflow, approval processes, validation rules, custom tabs, reports, Visualforce pages, dashboards, and email generation according to application requirements
  • Education: BEng (IT, CE, CS, or EC), BSc, MSc (CS), BCA, or MCA
  • Certification: Any Salesforce certification would be a plus point.
Read more
NoBroker
at NoBroker
1 video
26 recruiters
Priyanka Shukla
Posted by Priyanka Shukla
Pune, South Mumbai, Ahmedabad, Bengaluru (Bangalore)
0 - 3 yrs
₹3L - ₹7L / yr
Sales
Direct sales
B2B Marketing
Field Sales
B2C Sales
Minimum 1-5 years of proven sales track record and ability to meet targets.
Should have interest in Business development (B2C/ B2B) for Software Application
products/solutions.
Meet prospective clients, execute effective product demonstrations, emphasising product features
and benefits with focus on the value of the solution.
Meet with Committee Members of Apartments and societies to understand scope of business and
their expectations.
Prospect, educate, qualify, and generate interest for Sales Opportunities.
On-boarding new apartments on NoBrokerHood platform will be a major KRA for a BD.
Researching potential leads from open market, web searches, or digital resources.
Read more
Saas based product company
Saas based product company
Agency job
via SIlverPeople Consulting by Manasa Rao
Bengaluru (Bangalore), Gurugram
4 - 8 yrs
₹6L - ₹15L / yr
NOC
Computer Networking
Network operations
skill iconAmazon Web Services (AWS)
Windows Azure
+3 more
Hi

We have an opportunity for a Lead Operations Engineer role with our client at Bangalore /Gurgaon. Sharing the JD for your reference. Please revert if you would be interested in this opportunity and we can connect accordingly.

JOB DETAILS

Shift timing: 

9.00AM-6.00PM / 11.00AM -8.00PM / 2.00PM – 11.00PM / 7.00PM -3.00AM IST(Night shift allowance will be provided)

Position

Lead Operations Engineer

Location

Bangalore/ Gurgaon

About Our client

Who we are :

At a time when consumers are connected and empowered like never before,

Our client is helping the world's largest brands provide amazing experiences at every turn. It offers a set of powerful social capabilities that allow our clients to reach, engage, and listen to customers across 24

social channels. We empower entire organizations to work together across social, marketing, advertising,

research, and customer care to manage customer experience at scale. Most exciting, Our client works with 50% of the Fortune 500 and nine of the world's 10 most valued brands, including McDonald's, Nestle, Nike,

P&G, Shell, Samsung, and Visa.

What You'll Do

What You’ll Do As a Lead Operations Engineer at our client, you should be passionate about working on new technologies, high profile projects, and are motivated to deliver solutions on an aggressive schedule.

Candidates from product based companies only.

1. 5-7 years of exposure and working knowledge of data centers on-premise or on AWS/Azure/GCP.

2. Working Experience on Jenkins, Ansible, Git, Release & Deployments

3. Working Experience on ELK, Mongo, Kafka, Kubernetes.

4. Implement and operate SaaS environments hosting multiple applications and provide production support.

5. Contribute to automation and provisioning of environments.

6. Strong Linux systems administration skills with RHCE/Centos.

7. Have scripting knowledge in one of the following – Python/Bash/Perl.

8. Good knowledge on Gradle, Maven, etc

9. Should have knowledge of service monitoring via Nagios, Sensu, etc

10. Good to have knowledge on setting up and deploying application servers .

11. Mentoring Team members
Read more
SL
SL
Agency job
via Bohiyaanam Talent Solutions by Snehal Agarwal
Pune, Bengaluru (Bangalore), Nagpur, Indore, Goa
6 - 15 yrs
₹1L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
CI/CD
Hii All,

We are hiring for https://www.linkedin.com/feed/hashtag/?keywords=devops&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#Devops Engineer for a reputed https://www.linkedin.com/feed/hashtag/?keywords=mnc&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#MNC

Job Description:
Total exp- 6+Years
Must have:
Minimum 3-4 years hands-on experience in https://www.linkedin.com/feed/hashtag/?keywords=kubernetes&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#Kubernetes and https://www.linkedin.com/feed/hashtag/?keywords=docker&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#Docker
Proficiency in https://www.linkedin.com/feed/hashtag/?keywords=aws&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#AWS Cloud
Good to have Kubernetes admin certification

Job Responsibilities:
Responsible for managing Kubernetes cluster
Deploying infrastructure for the project
Build https://www.linkedin.com/feed/hashtag/?keywords=cicd&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#CICD pipeline

Looking for https://www.linkedin.com/feed/hashtag/?keywords=immediate&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#Immediate Joiners only
Location: Pune
Salary: As per market standards
Mode: https://www.linkedin.com/feed/hashtag/?keywords=work&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7003255016740294656" target="_blank">#Work from office
Read more
Claristaio
at Claristaio
3 recruiters
Suvrat Bansal
Posted by Suvrat Bansal
Pune
2 - 4 yrs
₹8L - ₹12L / yr
skill iconPython
skill iconDjango
SQL
skill iconMongoDB

What You'll Do

You will be part of our data platform & data engineering team. As part of this agile team, you will work in our cloud native environment and perform following activities to support core product development and client specific projects:

  • You will develop the core engineering frameworks for an advanced self-service data analytics product.
  • You will work with multiple types of data storage technologies such as relational, blobs, key-value stores, document databases and streaming data sources.
  • You will work with latest technologies for data federation with MPP (Massive Parallel Processing) capabilities
  • Your work will entail backend architecture to enable data modeling, data queries and API development for both back-end and front-end data interfaces.
  • You will support client specific data processing needs using SQL and Python/Pyspark
  • You will integrate our product with other data products through Django APIs
  • You will partner with other team members in understanding the functional / non-functional business requirements, and translate them into software development tasks
  • You will follow the software development best practices in ensuring that the code architecture and quality of code written by you is of high standard, as expected from an enterprise software
  • You will be a proactive contributor to team and project discussions

 

Who you are

  • Strong education track record - Bachelors or an advanced degree in Computer Science or a related engineering discipline from Indian Institute of Technology or equivalent premium institute.
  • 2-3 years of experience in data queries, data processing and data modeling
  • Excellent ANSI SQL skills to handle complex queries
  • Excellent Python and Django programming skills.
  • Strong knowledge and experience in modern and distributed data stack components such as the Spark, Hive, Airflow, Kubernetes, Docker etc.
  • Experience with cloud environments (AWS, Azure) and native cloud technologies for data storage and data processing
  • Experience with relational SQL and NoSQL databases, including Postgres, Blobs, MongoDB etc.
  • Familiarity with ML models is highly preferred
  • Experience with Big Data processing and performance optimization
  • Should know how to write modular, optimized and documented code.
  • Should have good knowledge around error handling.
  • Experience in version control systems such as GIT
  • Strong problem solving and communication skills.
  • Self-starter, continuous learner.

 

Good to have some exposure to

  • Start-up experience is highly preferred
  • Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
  • Agile software development methodologies.
  • Working in multi-functional, multi-location teams

 

What You'll Love About Us – Do ask us about these!

 

  • Be an integral part of the founding team. You will work directly with the founder
  • Work Life Balance. You can't do a good job if your job is all you do!
  • Prepare for the Future. Academy – we are all learners; we are all teachers!
  • Diversity & Inclusion. HeForShe!
  • Internal Mobility. Grow with us!
  • Business knowledge of multiple sectors

 

Read more
Casa2 Stays Pvt Ltd
at Casa2 Stays Pvt Ltd
5 recruiters
Sahil Malhan
Posted by Sahil Malhan
Gurugram
0 - 4 yrs
₹10L - ₹18L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Role/ Responsibilities

  • Design APIs, DB, Queues, monitoring for micro services. 
  • Writing, deploying and managing micro services. 
  • Migrate existing components into distributed micro service architecture. 
  • AWS Cloud / Google Cloud Platform (Manage Infrastructure). 
  • API integration with 3rd parties. 
  • Unit test cases, automation. 
  • Database optimisation. 
  • Design of highly concurrent backend architecture. 
  • Handling high traffic data. 

Experience required: 

  • Sound fundamentails in software design. 
  • Must have worked on distributed and micro service architecture. 
  • Sound fundamentals on scale/ performance/ memory optimisation. 
  • Sound fundamentals of authentication, authorization, payment processes, data security. 
  • Must have experience in Spring / Spring boot. 
  • Good to have experience in Kafka / JMS / RabbitMQ / AWS Elastic queue. 
  • Good to have experience in Junit / mockito unit test cases. 
  • Good to have knowledge in Mysql (or any RDBMS). 
Read more
MNC
MNC
Agency job
via Fragma Data Systems by Priyanka U
Bengaluru (Bangalore)
5 - 9 yrs
₹15L - ₹25L / yr
Data Warehouse (DWH)
dwh
warehousing
Datawarehousing
SQL
+1 more
Work Days: Sunday through Thursday
Week off: Friday & Saurday
Day Shift.


Key responsibilities:

  • Creating, designing and developing data models
  • Prepare plans for all ETL (Extract/Transformation/Load) procedures and architectures
  • Validating results and creating business reports
  • Monitoring and tuning data loads and queries
  • Develop and prepare a schedule for a new data warehouse
  • Analyze large databases and recommend appropriate optimization for the same
  • Administer all requirements and design various functional specifications for data
  • Provide support to the Software Development Life cycle
  • Prepare various code designs and ensure efficient implementation of the same
  • Evaluate all codes and ensure the quality of all project deliverables
  • Monitor data warehouse work and provide subject matter expertise
  • Hands-on BI practices, data structures, data modeling, SQL skills


Hard Skills for a Data Warehouse Developer:

  • Hands-on experience with ETL tools e.g., DataStage, Informatica, Pentaho, Talend
  • Sound knowledge of https://www.freelancermap.com/it-projects/sql-1084" target="_blank">SQL
  • Experience with SQL databases such as Oracle, DB2, and SQL
  • Experience using Data Warehouse platforms e.g., SAP, Birst
  • Experience designing, developing, and implementing Data Warehouse solutions
  • Project management and system development methodology
  • Ability to proactively research solutions and best practices

Soft Skills for Data Warehouse Developers:

  • Excellent Analytical skills
  • Excellent verbal and written communications
  • Strong organization skills
  • Ability to work on a team, as well as independently
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos