LLM Engineer

LLM/AI Model Engineer – Training, Evaluation & Benchmarking

Location: New Delhi, India (On-site)

Employment Type: Full-time

Experience: 3–5 years

Industry: Enterprise AI / Generative AI / Machine Learning / NLP

About QubeLabs

QubeLabs is building the next generation of Enterprise AI Systems that transform workforce operations and intelligence for the financial services industry.

Our platform combines Conversational AI, Agentic AI, workflow automation, proprietary language models and enterprise intelligence. Our flagship product, QubeLabs Workmate, serves banks, NBFCs, MFIs, wealth management firms, insurance companies and fintechs across India and Europe.

At the core of our AI platform is the Vectro Series, our proprietary family of language models designed for enterprise and financial-services use cases.

We are looking for an LLM/AI Model Engineer to build the training pipelines, datasets and evaluation infrastructure required to continuously improve the Vectro Series.

Role Overview

You will work closely with the Head of AI, Research Partners and engineering teams to implement and operationalize LLM training approaches and build a reliable model improvement lifecycle:

Data Preparation → Training → Evaluation → Benchmarking → Error Analysis → Model Improvement

The role combines hands-on LLM fine-tuning, dataset engineering, tokenization, evaluation framework development and model quality management.

Key Responsibilities

1. LLM Training & Fine-tuning

Build and maintain pipelines for training and fine-tuning open-source foundation models for the Vectro Series.

Implement supervised fine-tuning (SFT), parameter-efficient fine-tuning (PEFT), LoRA/QLoRA and domain adaptation techniques; support continued pre-training where required.

Manage training configurations, checkpoints, model versions and experiment tracking.

Optimize training workflows for computational efficiency, reproducibility and reliability.

Translate model development approaches defined with the Head of AI and Research Partners into practical, scalable training pipelines.

2. Training Data & Tokenization

Build data pipelines to collect, clean, filter, normalize, deduplicate and validate training data.

Develop instruction-tuning, SFT and domain-specific datasets for financial-services and enterprise use cases.

Implement tokenization workflows, tokenizer configuration, vocabulary management, sequence packing, truncation and padding.

Address data representation challenges involving financial terminology, numerical values and multilingual content.

Maintain dataset versioning, lineage and quality controls, incorporating identified data gaps and relevant model failures into future training data.

3. Golden Dataset & Model Evaluation

Build and maintain QubeLabs' Golden Dataset to evaluate key model capabilities and target use cases.

Develop automated evaluation pipelines and reusable evaluation harnesses, combining automated metrics with human assessment where appropriate.

Evaluate accuracy, reasoning, factuality, instruction following, safety, multilingual performance and financial-domain capabilities.

Establish consistent evaluation methodology and regression tests to measure changes across model versions.

4. Benchmarking & Error Analysis

Evaluate Vectro against relevant public benchmarks and proprietary QubeLabs BFSI/enterprise benchmarks.

Compare results with relevant open-source and commercial models using consistent evaluation conditions.

Analyze failures, identify root causes across data, training and model behavior, and translate findings into actionable improvements.

Maintain reproducible benchmark results and reports to track model strengths, limitations and progress.

5. Model Quality & Release

Define model release quality gates and ensure each major release meets agreed evaluation and benchmark criteria.

Support red-teaming, robustness and safety testing.

Coordinate with the Head of AI, Research Partners and engineering teams to ensure validated model improvements are suitable for integration into production systems.

Experience

3–5 years in Machine Learning, Deep Learning, NLP, Generative AI or related fields.

Hands-on experience training or fine-tuning LLMs using open-source foundation models.

Practical experience building training pipelines, preparing datasets and evaluating model performance.

Experience with GPU-based training; distributed training is an advantage.

Financial-services, multilingual AI or enterprise AI experience is preferred.

Required Skills

LLM & Machine Learning: Large Language Models, Transformer architectures, Generative AI, NLP, Deep Learning, SFT, PEFT, LoRA/QLoRA, fine-tuning and continued pre-training.

Frameworks & Infrastructure: Python, PyTorch, Hugging Face Transformers, Hugging Face Tokenizers, GPU computing, experiment tracking and ML pipelines.

Data & Tokenization: Tokenization, tokenizer configuration, text preprocessing, sequence packing, dataset construction, data quality, versioning and lineage.

Evaluation & Benchmarking: Golden datasets, LLM evaluation, evaluation harnesses, automated and human evaluation, LLM-as-a-Judge, public and domain-specific benchmarks, regression testing and error analysis.

The role requires the ability to build both the model training pipeline and the measurement system that determines whether the model has actually improved.

What Success Looks Like

Reliable and reproducible training and fine-tuning pipelines for the Vectro Series.

High-quality training datasets, tokenization workflows and a comprehensive Golden Dataset.

Automated evaluation and benchmarking infrastructure with measurable model quality gates.

Clear, reproducible evidence of model performance against public, proprietary BFSI and relevant competing-model benchmarks.

A continuous improvement loop that converts evaluation findings into measurable gains across successive Vectro releases.

Key Performance Indicators

Training pipeline reliability and experiment throughput.

Training data quality and coverage.

Golden Dataset and evaluation coverage.

Benchmark reproducibility and model performance improvement.

Accuracy of error diagnosis and effectiveness of regression detection.

Time required to complete training, evaluation and benchmarking cycles.

Compliance with model release quality criteria.

Why Join QubeLabs?

Build the proprietary Vectro Series of enterprise and financial-services language models.

Develop model training, evaluation and benchmarking infrastructure from the ground up.

Work closely with the Head of AI and Research Partners.

Solve real-world AI challenges across financial services.

Develop proprietary datasets, benchmarks and model improvement systems.

Contribute directly to production AI systems serving customers across India and Europe.

Preferred Candidate Profile

B.Tech, M.Tech, MS or PhD in Computer Science, AI, ML, Mathematics or a related field.

3–5 years of relevant experience with strong practical skills in Python, PyTorch, LLM fine-tuning and training data pipelines.

Working knowledge of tokenization, evaluation datasets, benchmarking and regression testing.

Experience with open-source models such as Llama, Qwen, Mistral or similar is preferred.

Ability to independently build reliable model training and evaluation systems from scratch.

QubeLabs is an equal opportunity employer and values diversity and inclusion. We encourage applications from qualified candidates regardless of background or identity.

Title: AI Engineer - Product & Adoption Capability

Experience: 4-7 years

Location: Hyderabad

Mode of work: Hybrid

Role Summary:

P99Soft is hiring for an applied AI engineering role that also requires GTM-type capability - the ability to think about how AI tools actually get adopted by end users, not a dedicated go-to-market or marketing title. The engineer is expected to understand user workflows, spot adoption barriers, and shape how tooling gets rolled out, while remaining hands-on with applied AI work day to day.

Key Responsibilities:

• Build and support the rollout of AI-powered tools, driving awareness, onboarding, and adoption among target end users.
• Understand and map user workflows to identify where and why adoption of new AI tooling breaks down, and design solutions to close those gaps.
• Partner closely with engineering and architecture stakeholders to translate what's technically possible into what users will actually adopt and use.
• Gather and synthesize user feedback to inform product decisions and prioritization for the AI tooling roadmap.
• Apply hands-on applied AI knowledge to evaluate tool capability and limitations firsthand, rather than relying solely on engineering input.
• Communicate technical AI concepts to non-technical stakeholders in a way that drives buy-in and correct usage.

Required Experience & Skills:

• Applied, hands-on AI experience is non-negotiable - genuine exposure to building or working closely with generative/agentic AI systems, not just using AI assistants as an end user.
• Working GTM-type capability: comfort defining requirements, prioritizing based on user needs, and driving adoption of a tool - this can come from prior product exposure rather than a formal GTM title.
• Strong user empathy and the ability to identify practical adoption barriers for enterprise tools, distinct from purely technical blockers.
• Comfort operating with generative/applied AI systems (LLMs, agentic tools) as distinct from traditional data science approaches (regression, classification).
• Background can come from startup, founder, or self-taught paths — a traditional data science or enterprise pedigree is not required, provided applied AI fundamentals are genuinely strong.

Nice to Have:

• Some depth in AI systems internals (e.g., exposure to debugging model-serving or library/version compatibility issues) is a plus, though this role does not require building custom training pipelines from scratch.
• Experience operating in a regulated, quality-driven, or highly technical enterprise environment.

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive health insurance.
• Paid time off and flexible working hours.
• Professional development opportunities and support for continuing education.
• Udemy Learning Licenses to enhance skills and stay up-to-date with the latest technology.

P99Soft is an Equal-Opportunity Employer

P99soft is an equal-opportunity employer. At P99soft, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.

Life @ P99Soft

At P99soft, we believe in creating a work environment that balances professional excellence with personal well-being. Our vibrant office culture is built on mutual respect, inclusivity, and a shared passion for innovation. We host regular team-building activities, workshops, and social events to foster a sense of community and collaboration among our employees. Join us and be part of a team that values your contributions and supports your growth.

About Us

P99soft is a leading IT Services and IT Consulting company dedicated to making our customers' business operations seamless by providing them with digital services and applications using the latest technologies. We are committed to bringing excellence to all our creations. We need passion, empathy, and being customer-focused to achieve technical excellence. We believe in transparency through open communication and work with honesty and integrity while dealing with our customers and partners.

Our Vision: “To lead digital transformation for our customers, delighting them at every step, while empowering our employees and fostering success.”

Our Mission: “To attain our objectives within a framework of integrity, transparency, and respect for our clients, employees, partners, and the community, fostering mutual trust and sustainable growth.”

Journey towards digital transformations begins here. Our talented teams help you make informed decisions, enhance operation efficiencies, create state-of-the-art visual interfaces, and design dynamic workflows to bring a better customer experience. Our engineering teams take complete ownership of assigning the right talent and architecting solutions using the latest technologies.

Role Overview

We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.

Key Responsibilities

• Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
• Build LLM-based applications and AI agents using LangChain and LangGraph.
• Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
• Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
• Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
• Work with embeddings, prompt engineering, semantic search, and document processing.
• Develop scalable APIs and backend services using Python, FastAPI, or Flask.
• Build and integrate AI solutions with existing applications and enterprise systems.
• Deploy and maintain AI/ML solutions on cloud platforms.
• Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.

Required Skills

• Strong hands-on experience in Python programming.
• Strong experience in AI/ML and Generative AI.
• Hands-on experience with LLMs and LLM-based application development.
• Strong experience with LangChain and/or LangGraph.
• Experience building AI Agents / Agentic AI workflows.
• Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
• Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
• Experience developing REST APIs using FastAPI/Flask.
• Good understanding of Machine Learning, NLP, and deep learning concepts.
• Experience with Azure / AWS / GCP cloud platforms.

Good to Have

• Experience with multi-agent systems and agent orchestration.
• Knowledge of MLOps / LLMOps.
• Experience with Docker, Kubernetes, and CI/CD.
• Knowledge of LLM evaluation, monitoring, observability, and AI governance.
• Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.

About LeadSquared

LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.

Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.

Role Overview

We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.

This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.

Key Responsibilities

•

Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.

•

Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.

•

Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.

•

Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.

•

Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.

•

Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.

•

Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.

•

Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.

•

Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.

Required Qualifications

Experience

•

2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.

•

Proven experience shipping LLM-based products or agentic AI systems into production environments.

Technical Skills

•

Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.

•

Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).

•

Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.

•

Solid understanding of RAG architectures, embedding models, and semantic search.

•

Experience with vector databases and similarity search infrastructure.

•

Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).

Problem-Solving & Mindset

•

Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.

•

Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.

•

Ability to balance research exploration with engineering pragmatism to ship reliable systems.

Preferred Qualifications

•

Experience with multi-agent orchestration and agent memory systems (short-term and long-term).

•

Familiarity with fine-tuning or RLHF workflows for domain adaptation.

•

Background in NLP, information retrieval, or conversational AI.

•

Prior experience in B2B SaaS or CRM domain is a plus.

•

Contributions to open-source AI/ML projects or published research/blogs.

•

Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services

AI Engineer

Experience: 2–4 Years

Employment Type: Full-Time

Work Mode: Coimbatore / Hybrid

About Techjays

Techjays is an AI Reimagination Company focused on building intelligent, scalable, and impactful software solutions. We help businesses solve complex challenges through AI, automation, and modern software engineering.

We are looking for an AI Engineer who is passionate about building AI-powered applications and integrating modern AI technologies into real-world products.

Key Responsibilities

• Design, develop, and deploy AI-powered applications using Python and modern AI frameworks.
• Build and implement LLM-based applications, including Retrieval-Augmented Generation (RAG) systems.
• Work with LLM APIs such as OpenAI, Gemini, and Anthropic.
• Develop AI agents and workflows using frameworks such as LangChain and LangGraph.
• Integrate vector databases and implement efficient embedding and semantic search solutions.
• Develop scalable backend services and REST APIs.
• Work with databases, data processing pipelines, and cloud-based services.
• Collaborate with frontend and backend teams to integrate AI capabilities into applications.
• Evaluate AI model performance, improve response accuracy, and optimize application performance.
• Debug, test, and maintain production-grade AI applications.

Required Skills

• 2–4 years of experience in software development, AI engineering, or a related field.
• Strong programming knowledge in Python.
• Hands-on experience with LLMs and Generative AI applications.
• Understanding of RAG architecture, embeddings, and semantic search.
• Experience with frameworks such as LangChain, LangGraph, or LlamaIndex.
• Knowledge of vector databases such as Pinecone, FAISS, ChromaDB, or Qdrant.
• Experience in building REST APIs using FastAPI or Flask.
• Good understanding of SQL and NoSQL databases.
• Familiarity with Git, Docker, and basic cloud services.
• Strong problem-solving and analytical skills.

Good to Have

• Experience building AI agents and multi-agent systems.
• Knowledge of React or other frontend frameworks.
• Exposure to AWS, Azure, or GCP.
• Understanding of model evaluation, prompt engineering, and fine-tuning.
• Experience deploying AI applications in production environments.

What We’re Looking For

• Someone who enjoys solving real-world problems using AI.
• Ability to take ownership of tasks and deliver solutions independently.
• Strong learning mindset and willingness to explore emerging AI technologies.
• Good communication and collaboration skills.

The Role

We’re looking for a Senior Applied AI & Data Engineer to become our first dedicated AI and data engineer.

You’ll build conversational AI experiences across web, mobile, and in-store channels while developing the data foundation behind them. You’ll make key technical decisions and own your work through to production.

What You’ll Do

• Build AI assistants using tool calling to work with real product, search, and order systems

• Design guardrails and evaluation sets to ensure AI responses are accurate and safe

• Build real-time and voice-enabled AI experiences

• Improve product data quality through AI-assisted enrichment and review workflows

• Build data pipelines, analytics, and personalisation systems

• Work closely with web and mobile developers and help guide technical implementation

What You’ll Need

• 6+ years of experience building and running production backend systems

• Strong Python skills, plus experience with JavaScript/TypeScript backends

• Experience shipping at least one LLM-powered feature to real users

• Experience with search and relevance

• Experience building data pipelines and analytics stores

• Comfortable deploying and monitoring services on a major cloud platform

• Strong communication skills and the ability to work independently

Nice to Have

• Experience with speech or voice AI

• E-commerce or retail technology experience

• Experience building multilingual products

Product Engineer — Role Summary

We are looking for a Product Engineer to build user-facing products that combine AI capabilities with practical applications. You will work at the intersection of software engineering and AI, developing autonomous, agent-driven systems that solve complex educational and research problems.

Key Responsibilities:

• Product Development: Design, build, and deploy production-ready applications powered by LLMs and AI agents.
• Data Engineering: Build scalable ETL/ELT pipelines to process structured and unstructured data, including text and audio, for RAG and model fine-tuning.
• Agentic Workflows: Develop multi-step AI agents with tool calling, APIs, databases, search, reasoning, and memory.
• Rapid Prototyping: Turn ideas and research concepts into interactive, production-ready applications.
• AI Integration: Use frameworks such as LangChain, LlamaIndex, AutoGen, or custom orchestrators to integrate AI into scalable systems.
• User Experience: Transform raw AI outputs into reliable, intuitive, and responsive user experiences.
• Collaboration: Work closely with ML researchers and data engineers to integrate custom and fine-tuned models.
• Observability: Monitor agent behavior, manage edge cases, reduce hallucinations, and improve reliability in production.

The ideal candidate combines strong software engineering, AI/LLM expertise, data engineering, and product thinking, with the ability to take an AI concept from prototype to production.

Job Description – Python & Generative AI Engineer

Python & Generative AI Engineer

Location: Bangalore, India

Experience: 4+ Years

Employment Type: Full-time

Job Summary

We are looking for an experienced Python & Generative AI Engineer with 4+ years of software development experience and strong hands-on expertise in Python, LLMs, Generative AI, and AI application development.

The ideal candidate should be comfortable building production-grade AI solutions, integrating LLMs with enterprise applications, and developing scalable APIs and services using Python.

Key Responsibilities

• Design, develop, and deploy Generative AI applications using Python and modern AI/ML frameworks.
• Work with Large Language Models (LLMs) such as GPT, Claude, Gemini, Llama, or similar models.
• Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases and embedding models.
• Build AI-powered applications using frameworks such as LangChain, LangGraph, LlamaIndex, or equivalent.
• Develop scalable REST APIs and backend services using FastAPI, Flask, or Django.
• Integrate LLM APIs, prompt engineering, function/tool calling, and structured outputs into enterprise applications.
• Work with vector databases such as FAISS, Pinecone, Weaviate, Milvus, or Azure AI Search.
• Implement document processing, chunking, embeddings, semantic search, and knowledge retrieval solutions.
• Evaluate LLM responses for accuracy, relevance, hallucination, latency, and cost.
• Build and maintain production-ready AI pipelines with appropriate monitoring, logging, security, and error handling.
• Collaborate with data scientists, ML engineers, software engineers, and business stakeholders to deliver AI solutions.
• Write clean, reusable, testable, and well-documented Python code.
• Participate in architecture discussions, code reviews, testing, deployment, and production support.

Required Skills

• 4+ years of experience in software/Python development.
• Strong proficiency in Python and object-oriented programming.
• Hands-on experience with Generative AI and LLM-based applications.
• Experience with OpenAI/Azure OpenAI, Anthropic, Google Gemini, or open-source LLMs.
• Strong understanding of Prompt Engineering and LLM application patterns.
• Experience implementing RAG pipelines.
• Knowledge of embeddings, vector databases, semantic search, and document retrieval.
• Experience with LangChain, LangGraph, LlamaIndex, or similar frameworks.
• Strong experience developing REST APIs using FastAPI/Flask/Django.
• Familiarity with Git, CI/CD, Docker, and cloud platforms such as AWS, Azure, or GCP.
• Good understanding of SQL and databases.
• Strong problem-solving and communication skills.

Good to Have

• Experience with AI agents / Agentic AI and tool/function calling.
• Experience with multi-agent frameworks.
• Knowledge of MLOps/LLMOps and model evaluation.
• Experience with Kubernetes and containerized deployments.
• Knowledge of NLP, machine learning, or deep learning.
• Experience with Azure AI, AWS Bedrock, Amazon SageMaker, or Google Vertex AI.
• Understanding of responsible AI, data privacy, and LLM security.

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS

About the role

We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.

Responsibilities

• Build and iterate on prompt pipelines and multi-agent workflow components
• Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
• Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
• Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
• Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
• Debug and maintain pipeline stages in production

What you bring:  

• (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
• Solid Python fundamentals clean, working, readable code
• Hands-on experience with LLM APIs and prompt engineering (personal projects count)
• Comfort with Git, REST APIs, and working in a Linux environment
• A feel for content and narrative you can judge whether generated output is actually good, not just valid
• Curiosity and clear communication you ask good questions and don't stay stuck silently

 Preferred

• Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
• Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
• Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
• Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
• Experience writing evals or LLM-as-judge scoring
• Node.js and Fastapi familiarity, or experience deploying on AWS