Strategic Alliances

Senior MLOps Engineer

LLM Operations, Observability & Eval Infrastructure

📍 Mumbai (On-site) | Full-time | 5-7 years

About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior MLOps Engineer for a dedicated client engagement focused on building an AI-powered application builder platform. The platform consumes LLMs at scale through provider APIs.

This role owns the operational discipline around production LLM consumption - increasingly called LLMOps - covering observability, evaluation infrastructure, model lifecycle, cost operations, prompt deployment, and agent run reliability.

The mandatory requirement is hands-on production experience operating LLM-backed systems, with a strong DevOps or SRE foundation. This is not a model training or ML science role.

The work is making the system around the AI engineer's designs observable, controlled, reliable, and economically accountable. You will pair daily with the Senior AI Engineer, who designs prompts, evals, and agent behaviour - you operationalise those systems for production.

A typical week includes a tracing audit on a degraded agent run, an eval pipeline build for a new model release, a cost attribution review, and a staged prompt rollout.

Responsibilities:

Observability and Tracing

Build and own end-to-end tracing for agent runs: every prompt, response, tool call, token count, latency, and cost, linked to user session and project.

Stand up and operate LLM observability tooling (Langfuse, LangSmith, Braintrust, or Arize Phoenix).

Make debugging a single bad agent run among thousands a routine workflow through searchable traces, failure taxonomies, and dashboards segmented by task type.

Evaluation Infrastructure as a Production System

Operationalise the eval suite designed by the Senior AI Engineer: automated execution in CI on every prompt or model change, with results stored and trended over time.

Implement regression gates that block quality-degrading changes from shipping.

Build production sampling to continuously score a sample of real agent runs and catch quality drift that offline evals miss.

Model Lifecycle Management

Pin model versions, never "latest".

Own the upgrade process: run the eval suite against new model releases and manage eval-gated migrations.

Maintain fallback chains across providers for graceful degradation or queueing during outages.

Track provider deprecation schedules and plan migrations ahead of forced cutoffs.

Cost Operations

Implement per-user and per-task cost attribution - token spend is the platform's largest variable cost and requires the same rigour as cloud cost management.

Set up budget alerts and anomaly detection so a single user or bug cannot burn significant spend overnight.

Monitor prompt cache hit rates and quantify savings.

Manage capacity planning around provider rate limits, including quota negotiation and throughput tiering.

Prompt and Configuration Deployment

Treat prompts as production artifacts: version control for prompts and agent configurations, staged rollout infrastructure (deploy a prompt change to a percentage of traffic before full rollout), A/B testing infrastructure, instant rollback, and audit history covering which prompt version served which user and when.

Reliability Engineering for Agent Runs

Agent runs are long, stateful, and failure-prone.

Own retry and resume semantics so a run that fails mid-way does not restart from scratch.

Implement timeouts and circuit breakers on provider calls, dead-letter handling for failed runs, and queue and concurrency management for agent workloads.

SLO Ownership and Incident Response

Define and track SLOs for agent run latency and completion rates.

Lead incident response when SLOs are breached.

Write postmortems.

Surface reliability risks proactively before they reach users.

Safety and Compliance Operations

Run the moderation pipeline (prompt and output classification) in production.

Monitor for abuse patterns and own incident response when the agent misbehaves at scale.

Maintain audit logs and implement data retention and residency policies for prompts and generated code as enterprise requirements emerge.

AI-Assisted Engineering Discipline

Use Claude, Cursor, and similar tools day to day for infrastructure code, scripts, and pipelines.

Set the team standard for safe use, review, and validation of AI-generated infrastructure before it ships.

Requirements:

Hands-on production ownership of LLM-backed systems in operation (mandatory).

Must have personally shipped and operated at least one LLM-powered system in production, with operational responsibility including oncall, incident response, and reliability ownership.

Alternatively: strong DevOps or SRE background with demonstrated hands-on familiarity with LLMOps tooling (Langfuse, LangSmith, Braintrust, Arize, or equivalent).

POCs and lab work do not qualify.

5+ years of overall engineering experience

With at least 2 years in DevOps, SRE, platform engineering, or LLM operations roles.

This is not an ML science role.

A DevOps or SRE background with a substantive pivot into LLMOps is a strong qualification.

Observability and Tracing Depth

Production experience with LLM observability tooling - Langfuse, LangSmith, Braintrust, or Arize Phoenix.

Comfortable instrumenting with OpenTelemetry, Prometheus, and Grafana.

Able to build and search trace pipelines, define failure taxonomies, and surface quality signals from production traffic.

CI/CD and Quality Gate Experience

Strong with GitHub Actions or GitLab CI.

Experience building automated quality gates: eval-gated pipelines, regression enforcement, or coverage gates that block degrading changes from shipping.

Cost Management and Attribution for Usage-Based Services

Experience owning cost attribution for cloud API spend or equivalent.

Comfortable with budget alerts, anomaly detection, and per-user or per-task cost breakdowns.

Reliability Engineering for Long-Running, Stateful Workloads

Experience with queues, retry patterns, idempotency, and failure recovery on asynchronous or multi-step workloads.

Comfortable defining SLOs and being accountable for them on production systems.

Multi-Provider API Management

Familiarity with LLM provider rate limits, version pinning, fallback chains, and quota management across OpenAI, Anthropic, Google, or equivalent.

Infrastructure as Code and Deployment Automation

Hands-on with Terraform or Pulumi and Docker.

AWS working knowledge (EC2, S3, IAM, EKS or ECS).

Strong with CI/CD for deploying services and configuration changes safely.

Nice to Have

• Experience with prompt A/B testing or staged rollout infrastructure
• Workflow orchestration (BullMQ, Temporal, Celery)
• Content moderation pipeline experience
• Data residency and compliance requirements for AI systems
• Kubernetes (EKS) in production
• AWS certifications

Job Details

- Job Title: Lead Software Engineer - Java, Python, API Development

- Industry: Global digital transformation solutions provider

- Domain - Information technology (IT)

- Experience Required: 8-10 years

- Employment Type: Full Time

- Job Location: Pune & Trivandrum/ Thiruvananthapuram

- CTC Range: Best in Industry

Job Description

Job Summary

We are seeking a Lead Software Engineer with strong hands-on expertise in Java and Python to design, build, and optimize scalable backend applications and APIs. The ideal candidate will bring deep experience in cloud technologies, large-scale data processing, and leading the design of high-performance, reliable backend systems.

Key Responsibilities

• Design, develop, and maintain backend services and APIs using Java and Python
• Build and optimize Java-based APIs for large-scale data processing
• Ensure high performance, scalability, and reliability of backend systems
• Architect and manage backend services on cloud platforms (AWS, GCP, or Azure)
• Collaborate with cross-functional teams to deliver production-ready solutions
• Lead technical design discussions and guide best practices

Requirements

• 8+ years of experience in backend software development
• Strong proficiency in Java and Python
• Proven experience building scalable APIs and data-driven applications
• Hands-on experience with cloud services and distributed systems
• Solid understanding of databases, microservices, and API performance optimization

Nice to Have

• Experience with Spring Boot, Flask, or FastAPI
• Familiarity with Docker, Kubernetes, and CI/CD pipelines
• Exposure to Kafka, Spark, or other big data tools

Skills

Java, Python, API Development, Data Processing, AWS Backend

Skills: Java, API development, Data Processing, AWS backend, Python,

Must-Haves

Java (8+ years), Python (8+ years), API Development (8+ years), Cloud Services (AWS/GCP/Azure), Database & Microservices

8+ years of experience in backend software development

Strong proficiency in Java and Python

Proven experience building scalable APIs and data-driven applications

Hands-on experience with cloud services and distributed systems

Solid understanding of databases, microservices, and API performance optimization

Mandatory Skills: Java API AND AWS

******

Notice period - 0 to 15 days only

Job stability is mandatory

Location: Pune, Trivandrum

Job Title: Android Developer

Experience: 3–5 Years

Location: Bangalore, India

Job Overview:

We are looking for a skilled Android Developer with 3–5 years of experience to join our team in Bangalore. The ideal candidate will be responsible for developing, enhancing, and maintaining high-quality Android applications, ensuring performance, quality, and responsiveness.

Key Responsibilities:

• Design and build advanced applications for the Android platform
• Collaborate with cross-functional teams to define, design, and ship new features
• Write clean, maintainable, and efficient code
• Identify and fix bugs, improve application performance
• Ensure the best possible performance, quality, and responsiveness of applications
• Continuously discover, evaluate, and implement new technologies

Required Skills:

• Strong experience in Java and/or Kotlin
• Experience with Android SDK, Android Studio
• Knowledge of MVVM / MVP architecture patterns
• Experience with RESTful APIs and third-party integrations
• Familiarity with Git or other version control tools
• Experience with SQLite / Room Database
• Understanding of UI/UX principles and Material Design guidelines

Preferred Qualifications:

• Experience with Jetpack components (LiveData, ViewModel, Navigation)
• Knowledge of Dependency Injection (Dagger/Hilt)
• Experience with Firebase services
• Familiarity with Agile/Scrum methodologies

Soft Skills:

• Strong problem-solving skills
• Good communication and teamwork abilities
• Ability to work independently and meet deadlines

Education:

• Bachelor’s degree in Computer Science, Engineering, or related field 

Responsibilities:

Lead the design and development of sophisticated, high availability, and secured

server-side applications with a primary focus on Golang.

● Collaborate with cross-functional teams to understand requirements, architect

solutions, and deliver high-quality software products.

● Mentor and guide junior engineers, sharing your engineering expertise and best

practices to foster skill development within the team.

● Analyze and optimize performance, scalability, and reliability of existing Golang

applications, making strategic improvements where necessary.

● Design and implement automated unit and integration tests to ensure code quality,

maintainability, and stability.

● Stay up-to-date with the latest advancements in software technologies,

recommending their adoption when appropriate.

● Champion code reviews, architectural discussions, and technical documentation to

maintain high development standards.

● Troubleshoot and resolve complex issues, providing innovative solutions to overcome

challenges.

● Contribute to the recruitment and hiring process by participating in interviews,

evaluating candidates, and providing input on hiring decisions.

Requirements

Bachelor's or Master's degree in Computer Science, or a related field.

● 3+ years of experience in software development, with substantial experience in

Golang and cloud infrastructure.

● Expert-level proficiency in designing and developing high-performance, concurrent

applications with Golang.

● Experience with distributed systems, microservices architecture, and containerization

(e.g., Docker, Kubernetes).

● Solid knowledge of software testing methodologies and tools, including unit testing

and integration testing for Golang applications.

● Demonstrated ability to lead projects, collaborate effectively with teams, and mentor

junior engineers.

● Excellent problem-solving and analytical skills, with the ability to tackle complex

technical challenges.

● Having prior experience in the FinTech domain would be an added advantage.

As a Junior Full Stack Developer, you will have the opportunity to work with a dynamic team and contribute to the development of our cutting-edge products. This is an excellent opportunity for motivated individual to enhance their skills and gain valuable experience in Java and React.js development.

Responsibilities:

1. Full Stack Development: Collaborate with senior developers and project teams to design, develop, and maintain web applications using Java and React.js.

2. Front-End Development: Implement user interfaces and create interactive web pages using HTML, CSS, and JavaScript frameworks like React.js.

3. Back-End Development: Design and develop server-side logic using Java, including building RESTful APIs, integrating with databases, and implementing business logic.

4. Database Management: Work with databases (e.g., MySQL, PostgreSQL) to design schemas, write queries, and optimize database performance.

5. Bug Fixing and Troubleshooting: Identify and resolve technical issues and bugs, ensuring the stability and functionality of the web applications.

6. Code Reviews: Participate in code reviews to maintain code quality, identify potential improvements, and ensure adherence to best practices and coding standards.

7. Learning and Growth: Stay updated with the latest industry trends, tools, and technologies, and continuously enhance your skills as a Full Stack Developer.

Qualifications:

1. Education: Bachelor's degree in Computer Science, Software Engineering, or a related field. Relevant work experience and projects will be considered.

2. Programming Skills:

● Strong knowledge of Java programming language and its core concepts.

● Familiarity with front-end development using React.js or similar JavaScript frameworks.

● Experience with HTML, CSS, and JavaScript.

3. Database Knowledge: Understanding of database concepts and experience working with SQL databases.

4. Web Technologies: Understanding of web development principles, RESTful APIs, and HTTP protocols.

5. Problem-Solving: Strong problem-solving skills and the ability to analyze and debug issues effectively.

6. Team Player: Demonstrated ability to work collaboratively in a team environment, share ideas, and contribute to the overall success of the project.

7. Self-Motivated: Proactive and eager to learn new technologies and tools independently.

8. Communication: Effective verbal and written communication skills to collaborate with team members and stakeholders.

9. Attention to Detail: Meticulous attention to detail and the ability to write clean, efficient, and maintainable code.

10. Enthusiasm: Passion for software development and a drive to build high-quality applications.

• Responsible for the successful technical delivery of code and design documents
• Responsible to evaluate and review design frameworks and methodologies.
• Responsible for organizing, documenting, and review work items scope from a technical point of view.
• Responsible for scoping, designing, development, reviews, and complete delivery from the technical end.
• Review and validate estimates for complex projects to ensure correct sizing of work.
• Participates in POCs, validates the complex technical solution, performs estimates and collateral consolidation.
• Lead and coach a team of junior developers

Requirement

• Strong experience in the development of microservices-based applications using JEE technologies Spring Boot, and Spring MVC, JPA, and Hibernate.
• Experience in handling integration with multiple legacy systems by creating/consuming services in SOAP/REST/MQ, Apache Camel integration framework.
• Strong experience in developing web applications using single-page architecture and a responsive design using Angular, Bootstrap, and building hybrid mobile applications
• Understanding of front-end technologies, such as HTML5, and CSS3
• Containerizing applications using Docker/Kubernetes
• Setting up CI/CD pipelines using GIT, Jenkins, SonarQube is a plus
• Setting up applications for log monitoring using ELK stack and performance monitoring using Prometheus and Grafana is a plus
• Ensure quality and timeliness of implementation of activities related to design, build and implementation of work product; participate in activities related to requirements elicitation, validation of architecture, creation, and review of design; provide pseudo code to the team; assign and review tasks for work product implementation with the objective of ensuring the highest levels of service offerings in own technology domain
• Performs high and low-level design provides pseudo-codes, implements the prototype, and does design reviews in order to deliver design documents as per customer requirements
• Provides inputs for an overall implementation plan, lead deployment of applications, infrastructure, and post-production support activities
• Interface with customer for issue resolution, provide status updates, Build customer confidence in team`s ability to deliver in order to support high customer satisfaction
• Understand client-side business requirements and provide value-led solutions. Should have strong and clear verbal and written communication skills including addressing escalations, presenting status in management meetings. Excellent client interfacing skills, mentoring skills
• Experienced in developing microservices/APIs using REST principles
• Experienced in JEE technologies, Spring Boot, Spring MVC, Hibernate, Swagger
• Experienced in using Queues (ActiveMQ/RabbitMQ, Kafka) and integration frameworks like Apache Camel
• Experienced in Front End skills include Angular, CSS, SAAS, Node, NPM, Bootstrap
• Experience with one of the application servers like Tomcat, JBoss EAP, IBM WebSphere
• Experience with relational databases like Postgres, Oracle DB2, and NoSQL databases like Elastic Search, MongoDB, Neo4J
• Experience in containerizing applications using Docker/Kubernetes
• Experience in setting up CI/CD pipelines using GIT, Jenkins, SonarQube is a plus
• Experience in setting up applications for log monitoring using ELK stack and performance monitoring using Prometheus and Grafana is a plus