ISO AUDITOR

Senior MLOps Engineer

LLM Operations, Observability & Eval Infrastructure

📍 Mumbai (On-site) | Full-time | 5-7 years

About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior MLOps Engineer for a dedicated client engagement focused on building an AI-powered application builder platform. The platform consumes LLMs at scale through provider APIs.

This role owns the operational discipline around production LLM consumption - increasingly called LLMOps - covering observability, evaluation infrastructure, model lifecycle, cost operations, prompt deployment, and agent run reliability.

The mandatory requirement is hands-on production experience operating LLM-backed systems, with a strong DevOps or SRE foundation. This is not a model training or ML science role.

The work is making the system around the AI engineer's designs observable, controlled, reliable, and economically accountable. You will pair daily with the Senior AI Engineer, who designs prompts, evals, and agent behaviour - you operationalise those systems for production.

A typical week includes a tracing audit on a degraded agent run, an eval pipeline build for a new model release, a cost attribution review, and a staged prompt rollout.

Responsibilities:

Observability and Tracing

Build and own end-to-end tracing for agent runs: every prompt, response, tool call, token count, latency, and cost, linked to user session and project.

Stand up and operate LLM observability tooling (Langfuse, LangSmith, Braintrust, or Arize Phoenix).

Make debugging a single bad agent run among thousands a routine workflow through searchable traces, failure taxonomies, and dashboards segmented by task type.

Evaluation Infrastructure as a Production System

Operationalise the eval suite designed by the Senior AI Engineer: automated execution in CI on every prompt or model change, with results stored and trended over time.

Implement regression gates that block quality-degrading changes from shipping.

Build production sampling to continuously score a sample of real agent runs and catch quality drift that offline evals miss.

Model Lifecycle Management

Pin model versions, never "latest".

Own the upgrade process: run the eval suite against new model releases and manage eval-gated migrations.

Maintain fallback chains across providers for graceful degradation or queueing during outages.

Track provider deprecation schedules and plan migrations ahead of forced cutoffs.

Cost Operations

Implement per-user and per-task cost attribution - token spend is the platform's largest variable cost and requires the same rigour as cloud cost management.

Set up budget alerts and anomaly detection so a single user or bug cannot burn significant spend overnight.

Monitor prompt cache hit rates and quantify savings.

Manage capacity planning around provider rate limits, including quota negotiation and throughput tiering.

Prompt and Configuration Deployment

Treat prompts as production artifacts: version control for prompts and agent configurations, staged rollout infrastructure (deploy a prompt change to a percentage of traffic before full rollout), A/B testing infrastructure, instant rollback, and audit history covering which prompt version served which user and when.

Reliability Engineering for Agent Runs

Agent runs are long, stateful, and failure-prone.

Own retry and resume semantics so a run that fails mid-way does not restart from scratch.

Implement timeouts and circuit breakers on provider calls, dead-letter handling for failed runs, and queue and concurrency management for agent workloads.

SLO Ownership and Incident Response

Define and track SLOs for agent run latency and completion rates.

Lead incident response when SLOs are breached.

Write postmortems.

Surface reliability risks proactively before they reach users.

Safety and Compliance Operations

Run the moderation pipeline (prompt and output classification) in production.

Monitor for abuse patterns and own incident response when the agent misbehaves at scale.

Maintain audit logs and implement data retention and residency policies for prompts and generated code as enterprise requirements emerge.

AI-Assisted Engineering Discipline

Use Claude, Cursor, and similar tools day to day for infrastructure code, scripts, and pipelines.

Set the team standard for safe use, review, and validation of AI-generated infrastructure before it ships.

Requirements:

Hands-on production ownership of LLM-backed systems in operation (mandatory).

Must have personally shipped and operated at least one LLM-powered system in production, with operational responsibility including oncall, incident response, and reliability ownership.

Alternatively: strong DevOps or SRE background with demonstrated hands-on familiarity with LLMOps tooling (Langfuse, LangSmith, Braintrust, Arize, or equivalent).

POCs and lab work do not qualify.

5+ years of overall engineering experience

With at least 2 years in DevOps, SRE, platform engineering, or LLM operations roles.

This is not an ML science role.

A DevOps or SRE background with a substantive pivot into LLMOps is a strong qualification.

Observability and Tracing Depth

Production experience with LLM observability tooling - Langfuse, LangSmith, Braintrust, or Arize Phoenix.

Comfortable instrumenting with OpenTelemetry, Prometheus, and Grafana.

Able to build and search trace pipelines, define failure taxonomies, and surface quality signals from production traffic.

CI/CD and Quality Gate Experience

Strong with GitHub Actions or GitLab CI.

Experience building automated quality gates: eval-gated pipelines, regression enforcement, or coverage gates that block degrading changes from shipping.

Cost Management and Attribution for Usage-Based Services

Experience owning cost attribution for cloud API spend or equivalent.

Comfortable with budget alerts, anomaly detection, and per-user or per-task cost breakdowns.

Reliability Engineering for Long-Running, Stateful Workloads

Experience with queues, retry patterns, idempotency, and failure recovery on asynchronous or multi-step workloads.

Comfortable defining SLOs and being accountable for them on production systems.

Multi-Provider API Management

Familiarity with LLM provider rate limits, version pinning, fallback chains, and quota management across OpenAI, Anthropic, Google, or equivalent.

Infrastructure as Code and Deployment Automation

Hands-on with Terraform or Pulumi and Docker.

AWS working knowledge (EC2, S3, IAM, EKS or ECS).

Strong with CI/CD for deploying services and configuration changes safely.

Nice to Have

• Experience with prompt A/B testing or staged rollout infrastructure
• Workflow orchestration (BullMQ, Temporal, Celery)
• Content moderation pipeline experience
• Data residency and compliance requirements for AI systems
• Kubernetes (EKS) in production
• AWS certifications

Hiring for bde -bidding knowledge with good communication skills

fresher candidates preferred for Indore location

Job description:

At Tiluf, We are looking for a React Native & Android native (Java + Kotlin) expert, who is extremely passionate about exploring and learning new areas and interested in working on a new-age hyper-reality social network that's changing how people interact with others around them and working on AI/Ml based parallels in collaboration with "Meta" around body augmentation and generative AI in AR.

What is Tiluf?

A real-life social network leveraging Augmented Reality to make real-time interactions with new (or known) people, as effortless and habit-forming as interacting through social media. Finally, no more hesitating when approaching someone in-person. We're here to solve the real-life out-of-the-screen social problems that we face every day, and that Tinder and Instagram overlook!

Nothing can explain Tiluf better than seeing how people are using it: https://www.youtube.com/shorts/z97ist9jx4Y

Mandatory:

• Previous experience and expertise working with React-native and Android native: > 3 years
• Experience in writing node modules/bridges
• Should be comfortable with relocating to Bangalore. Team Tiluf greatly enjoys working together in the same office space.

Location: Tiluf, opp. JPMorgan, Marathalli, Bangalore.

Responsibilities:

• Making the Tiluf exosystem more efficient, scalable, instant, and user-friendly so that it can cater to millions of users around the world.
• Working in collaboration with "Meta" on AI/Ml based parallels focusing on body augmentation and generative AI in AR.
• Working on improving the in-house XR technology.
• Designing architecture for the system to make it more efficient and scalable.
• Collaborating with UI/UX team for making a world-class user experience
• Collaborating with the Marketing team to make automated marketing in-app flows.
• Collaborating with the Community team to make the product as engaging as possible.

Required Skills:

• Coding Ninja - great at writing logic and designing architecture.
• Expertise in native Android(Java + kotlin)
• Knowledge and interest in AI/Ml - https://developers.google.com/ar/develop/java/machine-learning - This will be the starting point
• Expertise in React Native
• Rock-solid at working with and writing native modules/bridges.
• Always motivated to take the lead and learn new things.
• 3 + years of a firm grasp of the JavaScript language and its nuances, including ES6+ syntax, and have the ability to write well-documented clean Javascript code.
• Experience with state management libraries like Redux, Redux-saga, AsyncStorage
• A team player - It's a cliché but it's really important that the team feels that you are always there for them and have their backs.

Other Skills:

• You'll flourish here if you are - Passionate and enthusiastic about building world-changing products!
• You are able to Thrive in uncertainty - as we are building something new so we don't have much luxury to copy from others.
• Excited to work in a startup culture with innovation and horizontal hierarchy.

• Strong Experience on Autosar 4.x BSW Diagnostics (UDS-IS014229) configuration and development.
• Strong Experience on DEM and FIM configuration and development.
• Knowledge on OEM specific service implementation.
• Knowledge and Experience on AUTOSAR standard, AUTOSAR configuration tools (EB Tresos, Vector Configurator DaVinci, ETAS isolar).
• Excellent programming skill in C language.
• knowledge on Requirements Engineering, Traceability and experience using any of the requirement engineering tools – DOORS
• Experience using the measurement/testing tools – CANoe, Trace32, MiniWiggler
• Excellent debugging, analytical, logical and communication skills
• Knowledge/Working Experience in Scripting languages – Python, CAPL.
• knowledge on Quality Management – Automotive SPICE
• Experience working in Agile-Scrum/Kanban development process

About Armentum

We are an IT Services and Product Development company, headquartered in Bangalore, that develops ERPs, Mobile Apps, and Web-Apps for our clients and customers globally.

We love JS and working on React, Node and Angular!

At Armentum, we have ensured that our teams are stable, there is no politics and no-blame game culture. If something goes down, the PM's take the lead, and then they drill down on what can be improved v/s who did the mistake etc. So culture wise, we are also looking for resources who can gel well with us. We do not believe in passing on the hot-potato. :)

Our Engineering team is looking for a Full-Stack Engineer to join our base in Bangalore, KA. Your key role will be able to work on complex tasks and projects, and be able to support to increase the engineering churn out. You should be able to write code that is error free, be able to quickly understand the problem statement and come up with logical solutions.

What you bring to the table:

• Experience in independently managing End-to-End Implementation, Design and Development of IT Projects and Products (Apps and Web-Apps)
• Experience converting Business Cases to Technology case and Building Products from scratch
• Experience in Training team and grooming them, undertaking managerial tasks such as Quarterly Skills Meeting, and Profile Evaluation, GAP Analysis
• Experience in Providing inputs to Project Budgeting, Efforts Estimations (EE), Technology Decks,
• Experience in Writing Test Cases and Managing UAT and Deployment Cycle (Automation Testing)
• Working with Client to understand provide Consulting or Business Solutions, Problem Solving Approach and Skills, Strong Analytical Skills, should be able to read between the lines
• Interacting with the Technical/Engineering team to ensure Delivery and Implementation of the Software Solution/Projects
• Client Relationship Management, Excellent at English Speaking, and Written Communication
• Understanding of Change Management, Risk Management and Project Management
• Experience working with US Clients is a Must
• Experience and Exposure working with different projects and business models will be an advantage
• Understanding of Blockchain, Healthcare, HIPAA Compliances, RPA, Payments Services, DevOps will be an asset

Management and Soft Skill :

• Excellent Written and Oral Communication Skills and Etiquettes - MUST
• Excellent Presentation Skills -
• Experience in working with Onshore and Offshore Teams and Experience handling Cross-Functional Projects, Resources and Clients and ability to provide inputs to improving ODCs (Off-shore development centres)
• Experience dealing with Pressure and Meeting strict Project Deadlines - MUST
• Leadership and Motivational Skills to ensure the Work is being done by the Resources on time and within the specified budget - MUST
• Conflict and Resolution Management – MUST

Qualifications:

• 7 -10 years of overall experience
• Experience of working on Mobile & Web Applications (across Android & iOS)
• Strong understanding of Java & MERN/ MEAN stack - Angular/Node/React/ Vue
• Ability to create APIs in REST, and GraphQL understanding of JSON, XML, Websockets, SOAP, COBRA
• Good to have experience of Office 365 - SharePoint and ASP.Net
• Understanding of Database: MySQL, MongoDB, Oracle, PostGres
• Understanding of Project Management: Agile/Scrum, Waterfall both is fine
• Previous experience of working in FinTech, eCommerce, Enterprise Projects, C2C, B2C, B2B Apps will be an added advantage

About Peppo

https://www.peppo.co.in">Peppo is a fair food ordering utility. It helps restaurants manage both the demand and the delivery sides of their business, on the cloud.

The simplest way to think of Peppo is that it is a backend for restaurants that takes them online, not on just one channel but on all of them. App publishers that integrate with Peppo, will see every restaurant that uses Peppo and can enable food ordering through their own front-end.

On the fulfilment side, Peppo allows restaurants to plug into an aggregated delivery fleet on which it helps restaurants choose between various providers to optimise between delivery costs and performance.

About the Role

We are looking for an experienced Business Development Manager with first-rate system administration and cloud systems management skills to join our retail platform team. In this role, you’ll be making some of the most significant decisions for the company. You need to have strong problem solving capabilities, be a team player and have great communication skills. You also need to be goal-oriented, have the ability to understand the core architecture and take up responsibility of product deployment and scaling. You must be a highly technical, hands-on system admin with passion for devops and scaling.

We value those with an entrepreneurial spirit and those who bring experience from established organizations. You ought to be comfortable in dealing with lots of moving pieces. You must have excellent attention to detail; and you should be flexible and  comfortable to learn new technologies and systems.

The opportunity is ideal for someone early in their career who learns by doing. This is a high-exposure role and you will learn what it really looks like in the early days of a startup.

We offer a friendly, casual, collaborative working environment that is mission-driven and results-oriented. Our small office is in a great space in Bangalore. Due to the COVID situation, we are committed to having a fully remote engagement.

Responsibilities 

• Collaborate with the Tech Lead on product deployment and scaling
•  Responsible for communicating and reporting to the tech lead
•  Setup new environments as well as maintain existing ones
• Participate in technical design and architecture reviews from the deployment and scaling point of view
•  Write technical documentation
• Automate stuff
• Infrastructure as code
• Be aware of costs and skilled enough to squeeze

Skills and Requirements

We are looking at your experience not just in terms of the years you’ve clocked but the aptitude to get things done. Here’s the skills that your job would entail, so please make sure you highlight the following in any capacity you have demonstrated - professional, freelance or hobbyist.

• 2+ years of software development experience (professional, freelance or hobbyist). Github profiles matter.
• Strong proficiency in AWS products with certifications
• Deep understanding of Infrastructure as code tool like Ansible
• Understanding of tools like Gitlab, Jenkins etc required for code management and continuous delivery 
• Python or Bash scripting skills
• Experience with deployment frameworks, practices and processes
• Demonstrated skills in deploying, releasing, and maintaining highly scalable web applications
• Bonus if you know AWS CloudFormation or Terraform
• Good communication skills and ability to work independently or in a team.

Employment Type

• Full-time
• Remote/On-Site 

Our Preferred Resume Format

• Polished resume with list of projects clearly listed (with responsibilities you held)
• Links to interesting projects that you worked on (professional, freelance or hobbyist)
• Blogs written and any other public contributions you made

1. Resume evaluation: We will screen all incoming CVs and invite candidates for next round, fitting our job profile description.
2. Case study:  If you are one of the shortlisted candidates, you will be sent a case study to solve.
3. Phone screening: we will follow up with a phone screening round for better understanding of the CV, technical proficiency, experience etc.
4. F2F Round(s): The next round is a direct face-to-face discussion over a video call.

• Small team with an opportunity to have a steep learning curve. 
• Have a meaningful impact on end customers and sellers on their experience with digital tools.
• Work on redefining the e-commerce experience by building cooperatives for the micro-services era. This makes Peppo a perfect home for those looking to pursue compassionate capitalism.
• Train under a diverse and accomplished set of team leads, mentors and investors who have worked in government and big tech.
• Holistic development guaranteed as you will grow in an environment that prizes lateral thinking allowing you to supplement your core responsibilities with additional functions.
• Competitive compensation and flexibility to work from anywhere since Peppo uses the best of productivity tools.

Peppo is an equal opportunity employer. We're excited to work with talented and empathetic people no matter their race, caste, color, gender, sexual orientation, religion, national origin, physical disability, mental well-being, or age. Our code of conduct reflects the kind of company we strive to be, and we celebrate our diversity for that truly makes us create products that cater to the world.

We are looking for a Java Developer with experience in building high-performing, scalable, enterprise-grade applications.

You will be part of a talented software team that works on mission-critical applications. Java developer roles and responsibilities include managing Java/Java EE application development while providing expertise in the full software development lifecycle, from concept and design to testing.

Java developer responsibilities include designing, developing and delivering high-volume, low-latency applications for mission-critical systems.

• Contribute in all phases of the development lifecycle
• Write well designed, testable, efficient code
• Ensure designs are in compliance with specifications
• Prepare and produce releases of software components
• Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

• BS/MS degree in Computer Science, Engineering or a related subject
• Proven hands-on Software Development experience
• Proven working experience in Java development
• Hands on experience in designing and developing applications using Java EE platforms
• Object Oriented analysis and design using common design patterns.
• Profound insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc)
• Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
• Experience in the Spring Framework
• Experience as a Sun Certified Java Developer
• Experience in developing web applications using at least one popular web framework (JSF, Wicket, GWT, Spring MVC)
• Experience with test-driven development