Lead I - Software Engineering - AI Solutions Analyst

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

Strong Senior AI Engineer Profile with production-grade LLM and Python expertise

2

Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments

3

Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design

4

Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)

5

Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.

6

Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale

7

Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)

8

Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)

9

Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).

10

Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges

11

Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation

12

Mandatory (Company): B2B Tech/Consulting/B2B Software

About LeadSquared

LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.

Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.

Role Overview

We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.

This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.

Key Responsibilities

•

Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.

•

Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.

•

Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.

•

Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.

•

Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.

•

Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.

•

Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.

•

Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.

•

Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.

Required Qualifications

Experience

•

2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.

•

Proven experience shipping LLM-based products or agentic AI systems into production environments.

Technical Skills

•

Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.

•

Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).

•

Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.

•

Solid understanding of RAG architectures, embedding models, and semantic search.

•

Experience with vector databases and similarity search infrastructure.

•

Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).

Problem-Solving & Mindset

•

Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.

•

Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.

•

Ability to balance research exploration with engineering pragmatism to ship reliable systems.

Preferred Qualifications

•

Experience with multi-agent orchestration and agent memory systems (short-term and long-term).

•

Familiarity with fine-tuning or RLHF workflows for domain adaptation.

•

Background in NLP, information retrieval, or conversational AI.

•

Prior experience in B2B SaaS or CRM domain is a plus.

•

Contributions to open-source AI/ML projects or published research/blogs.

•

Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services

Job Summary

We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.

Key Responsibilities

• Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
• Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
• Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
• Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
• Integrate AI/ML models with enterprise applications and APIs.
• Fine-tune and evaluate ML/LLM models based on business requirements.
• Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
• Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
• Conduct model performance evaluation, optimization, and troubleshooting.
• Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
• Stay current with emerging AI/ML technologies, frameworks, and industry best practices.

Required Skills

• Strong programming experience in Python.
• Strong understanding of Machine Learning algorithms, statistics, and data structures.
• Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
• Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
• Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
• Experience with NLP, deep learning, or computer vision is an advantage.
• Experience developing and consuming REST APIs and microservices.
• Working knowledge of SQL and NoSQL databases.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Understanding of Docker, Kubernetes, CI/CD, and MLOps.
• Familiarity with Git and modern software development practices.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
• 4 years of relevant experience in AI/ML engineering or a related field.
• Experience building and deploying production-grade AI/ML solutions.
• Enterprise application development experience.
• Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
• Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
• Experience with AI/ML model monitoring, evaluation, and optimization.

What You Bring

• Strong problem-solving and analytical skills.
• Ability to translate business requirements into practical AI/ML solutions.
• Strong software engineering and debugging capabilities.
• Ability to work independently as well as collaboratively in a cross-functional environment.
• Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.

Keywords

AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI

Location: Gurugram

Work mode: Hybrid

Senior AI Engineer

Code Generation, Agent Architecture & LLM Systems

📍 Mumbai (On-site) | Full-time | 5+ years

About the Role:

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies.

We are hiring a Senior AI Engineer for a dedicated client engagement focused on building an AI-powered application builder platform - a product where users describe software in plain English and the system generates, previews, and iteratively refines working code.

The mandatory requirement for this role is hands-on production experience shipping LLM-powered systems with agent architectures, with experience in code generation or developer tooling contexts a strong advantage.

The role is product-focused and deeply hands-on. You will own everything between the user's prompt and correct code landing in the project: the agentic loop, code generation pipeline, context management, evaluation suite, and model cost strategy.

You will work alongside the Senior MLOps Engineer who operationalises the infrastructure around your system, and collaborate closely with backend, frontend, and DevOps engineers.

Responsibilities:

Agent Architecture

Design and own the agentic loop for the platform - request interpretation, planning, tool-calling sequence (read file, edit file, run build, search code, install package), and stop conditions.

Make and revisit architectural decisions on single-agent vs. multi-agent designs, including planner/executor splits and dedicated build-repair sub-agents.

Code Generation Pipeline

Own the end-to-end generation flow: task classification, context gathering, planning, targeted edits, verification, and commit.

Implement diff/search-replace-based file editing with fuzzy matching and fallback strategies.

Enforce scope discipline so the agent makes minimal diffs and does not modify code it was not asked to touch.

Self-Repair Loop

Build and tune the automated repair loop that pipes compiler, lint, build, and runtime errors back to the model with retry budgets and model escalation.

This loop is the primary quality lever - the difference between 60-70% and 90%+ build success rates.

Context Management

Build file-relevance retrieval so the agent sees the right files, not the whole codebase: dependency graphs, AST/tree-sitter-based chunking, embeddings, recency signals, and hybrid retrieval.

Implement conversation summarisation and memory for long sessions, and address long-project degradation through codebase summaries and periodic consistency passes.

Own token budgeting and prompt caching strategy.

Prompt Engineering as a Discipline

Own the system prompt and per-task prompt variants (new feature, bug fix, styling change).

Maintain few-shot examples and enforce coding conventions, stack rules, and prohibited behaviours such as no hardcoded secrets and no whole-file rewrites.

Version prompts like code with changelogs and rollback capability.

Evaluation and Quality Measurement

Design and own the evaluation suite: representative test prompts run on every prompt and model change, scored on build success rate, instruction adherence, and output quality including LLM-as-judge and visual/screenshot checks where relevant.

Define regression gates that block quality-degrading changes from shipping.

Treat evals the way engineers treat automated testing: versioned, automated, and tracked over time.

This responsibility is non-negotiable at this level.

Model Strategy and Cost

Design model routing - cheap and fast models for classification and small edits, frontier models for complex generation.

Drive cost optimisation through prompt caching, diff-based edits over full-file rewrites, and tighter context selection.

Track cost per agent run and tokens per task; evaluate new model releases against the eval suite and lead migrations when results justify it.

Safety and Reliability of Agent Behaviour

Defend against prompt injection from user content and fetched web content.

Ensure secrets never appear in generated client code.

Define what the agent's tools may and may not do in collaboration with the platform team.

Contribute to output moderation and abuse-pattern awareness.

Mentorship and Engineering Standards

Run code reviews, define engineering conventions for AI work, and raise the engineering bar across the AI team.

Work closely with the Senior MLOps Engineer on handoff of eval design, prompt configurations, and model routing logic.

Requirements:

Hands-on Production Ownership of LLM-Powered Systems with Agent Architectures (Mandatory)

Must have personally shipped and operated at least one complex production AI system - agentic, multi-step, or code generation - with end-to-end ownership of architecture, evaluation, and cost.

POCs, internal demos, and tutorial-grade work do not qualify.

5+ Years of Professional Software or AI Engineering Experience

With at least 3 years focused on LLM applications, AI engineering, or production AI systems.

Candidates with strong backend backgrounds and a clear, substantive pivot into LLM systems qualify.

Strong Python Proficiency and Service Development

Production-grade Python with FastAPI or equivalent: type hints, async patterns, streaming responses, testing, and packaging.

Not notebook-only.

Depth Across LLM APIs and Agent Systems

Production experience with at least two of OpenAI, Anthropic Claude, Google Gemini, or open-weight models (vLLM, Ollama, Together).

Production experience with at least one agent framework (LangGraph, CrewAI, AutoGen, LlamaIndex Agents) or hand-rolled equivalent.

Hands-on with tool calling, structured outputs, and multi-step reasoning.

Demonstrated, Systematic Evaluation Practice - Non-Negotiable

Must have built evaluation harnesses that gate production releases, not ad-hoc testing.

Hands-on with at least one of LangSmith, Langfuse, Promptfoo, Ragas, or DeepEval.

Candidates with no systematic answer to evaluation should not be considered at senior level regardless of other strengths.

Cost Discipline for Production AI

Track record of measurable cost optimisation on production AI features.

Able to speak in specifics: cost per request, savings achieved through caching or model routing, context reduction decisions.

AWS Working Knowledge

Hands-on with EC2, S3, IAM, and Docker.

Comfort with CI/CD workflows and deploying AI services.

Awareness of LLM Security Failure Modes

Familiar with prompt injection patterns, understands that system prompt rules alone are insufficient, and has experience with output validation and content safety in production.

Nice to Have

• Experience with AST/tree-sitter tooling, diff-based editing systems, or compiler-adjacent work
• MCP server authoring
• Open-source AI contributions
• Published technical writing on LLM systems
• Multi-modal model experience
• Fine-tuning exposure (LoRA, QLoRA, PEFT)

Strong AI Engineer / Machine Learning Engineer profiles.

2

Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

3

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

4

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

5

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

6

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

7

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

8

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.

Product Engineer — Role Summary

We are looking for a Product Engineer to build user-facing products that combine AI capabilities with practical applications. You will work at the intersection of software engineering and AI, developing autonomous, agent-driven systems that solve complex educational and research problems.

Key Responsibilities:

• Product Development: Design, build, and deploy production-ready applications powered by LLMs and AI agents.
• Data Engineering: Build scalable ETL/ELT pipelines to process structured and unstructured data, including text and audio, for RAG and model fine-tuning.
• Agentic Workflows: Develop multi-step AI agents with tool calling, APIs, databases, search, reasoning, and memory.
• Rapid Prototyping: Turn ideas and research concepts into interactive, production-ready applications.
• AI Integration: Use frameworks such as LangChain, LlamaIndex, AutoGen, or custom orchestrators to integrate AI into scalable systems.
• User Experience: Transform raw AI outputs into reliable, intuitive, and responsive user experiences.
• Collaboration: Work closely with ML researchers and data engineers to integrate custom and fine-tuned models.
• Observability: Monitor agent behavior, manage edge cases, reduce hallucinations, and improve reliability in production.

The ideal candidate combines strong software engineering, AI/LLM expertise, data engineering, and product thinking, with the ability to take an AI concept from prototype to production.

Applied AI Engineer

About the Role

We are building an AI-powered platform that transforms credit origination by automating manual processes and enabling lenders to underwrite more loans with greater accuracy and lower risk.

We are looking for an experienced Applied AI Engineer to design and build production-grade Agentic AI systems capable of complex, multi-step reasoning across financial data, legal documents, and other unstructured information.

As an early engineering team member, you will take ownership of core AI architecture, multi-agent orchestration, reasoning workflows, evaluation frameworks, and scalable AI infrastructure.

Key Responsibilities

• Design and develop stateful, multi-agent AI systems for complex reasoning and decision-making.
• Build and optimize LLM pipelines using frameworks such as LangChain, DSPy, and GEPA.
• Implement RAG, prompt optimization, memory management, tool integration, and human-in-the-loop workflows.
• Develop AI evaluation frameworks using LLM-as-a-Judge and scenario-based testing.
• Implement AI observability and monitoring to track accuracy, latency, cost, and system performance.
• Build ETL pipelines and work with structured and unstructured data, SQL/NoSQL databases, vector databases, and graph-based data models.
• Integrate external tools and systems using modern agent protocols such as Model Context Protocol (MCP).
• Deploy and maintain AI services on AWS or Azure.
• Implement CI/CD pipelines, containerization, and Infrastructure as Code for reliable production deployments.

Required Qualifications

• 5+ years of professional software development experience in Python or JavaScript.
• Proven experience building and deploying production-level Agentic AI systems or complex LLM reasoning applications.
• Hands-on experience with LangChain and LLMOps, including tools such as Langfuse, Weights & Biases (W&B), or Helicone.
• Strong understanding of LLMs, RAG, prompt engineering, multi-agent orchestration, memory management, and tool calling.
• Experience with DSPy, GEPA, or advanced LLM inference and optimization techniques.
• Strong data engineering fundamentals, including ETL, SQL/NoSQL databases, and vector databases.
• Familiarity with MCP and human-in-the-loop workflows.
• Experience with AWS or Azure and modern DevOps practices, including Docker, CI/CD, and Infrastructure as Code.

Good to Have

• Experience with RLHF or RLAIF.
• Knowledge of model fine-tuning techniques such as LoRA and QLoRA.
• Experience with graph databases and graph-based data models.
• Exposure to financial services, credit underwriting, risk analysis, or document-intensive AI applications.

Why Join Us?

• Work on advanced Agentic AI and complex reasoning systems beyond conventional chatbot applications.
• Build foundational AI architecture and production-grade LLM workflows.
• Take ownership of technical decisions and system design as an early engineering team member.
• Solve challenging problems at the intersection of AI, finance, and intelligent automation.

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS