AI Architecture Intern at PGAGI · Bengaluru (Bangalore) · 0 - 0.5 years · ₹10000 - ₹20000 / mo · Bootstrapped · Posted 12 Oct 2026

Job Title: AI Architecture Intern
Company: PGAGI Consultancy Pvt. Ltd.
Location: Remote
Employment Type: Internship
Position Overview
We're at the forefront of creating advanced AI systems, from fully autonomous agents that provide intelligent customer interaction to data analysis tools that offer insightful business solutions. We are seeking enthusiastic interns who are passionate about AI and ready to tackle real-world problems using the latest technologies.
Duration: 6 months
Key Responsibilities:
- AI System Architecture Design: Collaborate with the technical team to design robust, scalable, and high-performance AI system architectures aligned with client requirements.
- Client-Focused Solutions: Analyze and interpret client needs to ensure architectural solutions meet expectations while introducing innovation and efficiency.
- Methodology Development: Assist in the formulation and implementation of best practices, methodologies, and frameworks for sustainable AI system development.
- Technology Stack Selection: Support the evaluation and selection of appropriate tools, technologies, and frameworks tailored to project objectives and future scalability.
- Team Collaboration & Learning: Work alongside experienced AI professionals, contributing to projects while enhancing your knowledge through hands-on involvement.
Requirements:
- Strong understanding of AI concepts, machine learning algorithms, and data structures.
- Familiarity with AI development frameworks (e.g., TensorFlow, PyTorch, Keras).
- Proficiency in programming languages such as Python, Java, or C++.
- Demonstrated interest in system architecture, design thinking, and scalable solutions.
- Up-to-date knowledge of AI trends, tools, and technologies.
- Ability to work independently and collaboratively in a remote team environment
Perks:
- Hands-on experience with real AI projects.
- Mentoring from industry experts.
- A collaborative, innovative and flexible work environment
Compensation:
- Stipend: Base is INR 8000/- & can increase up to 20000/- depending upon performance matrix.
After completion of the internship period, there is a chance to get a full-time opportunity as an AI/ML engineer.
Preferred Experience:
- Prior experience in roles such as AI Solution Architect, ML Architect, Data Science Architect, or AI/ML intern.
- Exposure to AI-driven startups or fast-paced technology environments.
- Proven ability to operate in dynamic roles requiring agility, adaptability, and initiative.

Similar jobs (10)
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
About Nexora Group
Nexora Group is a technology and innovation-driven organization dedicated to building intelligent solutions that leverage Artificial Intelligence, Machine Learning, Data Analytics, and emerging technologies. We are committed to fostering talent by providing aspiring professionals with practical exposure, mentorship, and opportunities to work on real-world projects.
Internship Overview
Nexora Group is looking for enthusiastic and driven AI/ML Interns to join our team. This internship is ideal for students and recent graduates who are passionate about Artificial Intelligence, Machine Learning, Deep Learning, and Generative AI. Interns will gain hands-on experience working on real-world AI projects, developing intelligent models, and solving complex business challenges using data-driven approaches.
Key Responsibilities
- Assist in developing, training, and evaluating Machine Learning models.
- Collect, clean, and preprocess datasets for AI/ML applications.
- Conduct exploratory data analysis and feature engineering.
- Work on Deep Learning, Natural Language Processing (NLP), and Computer Vision projects.
- Research and implement AI algorithms and emerging technologies.
- Support the development of Generative AI and Large Language Model (LLM)-based solutions.
- Optimize model performance and evaluate results using industry-standard metrics.
- Document project workflows, findings, and technical reports.
- Collaborate with cross-functional teams to develop innovative AI solutions.
Required Skills
- Basic understanding of Machine Learning and Artificial Intelligence concepts.
- Knowledge of Python programming.
- Familiarity with libraries such as NumPy, Pandas, Scikit-learn, TensorFlow, PyTorch, or Keras.
- Understanding of data structures, algorithms, and statistics.
- Basic knowledge of Deep Learning, NLP, or Computer Vision concepts.
- Strong analytical and problem-solving skills.
- Good communication and teamwork abilities.
- Willingness to learn and adapt to new technologies.
Preferred Qualifications
- Experience with AI/ML projects, hackathons, or research work.
- Knowledge of Generative AI, Prompt Engineering, and LLMs.
- Familiarity with cloud platforms and AI deployment tools.
- Certifications in AI, Machine Learning, or Data Science are a plus.
- GitHub projects or portfolio showcasing AI/ML work.
Eligibility
- Undergraduate or postgraduate students pursuing Computer Science, Artificial Intelligence, Machine Learning, Data Science, Information Technology, or related fields.
- Recent graduates seeking practical industry experience.
- Candidates with a strong interest in AI innovation and research.
What You'll Gain
- Hands-on experience with real-world AI and Machine Learning projects.
- Mentorship from experienced AI professionals.
- Exposure to cutting-edge AI tools, frameworks, and technologies.
- Internship Completion Certificate.
- Letter of Recommendation based on performance.
- Opportunity for a Pre-Placement Offer (PPO) for outstanding performers.
- Professional networking and career development opportunities.
About PGAGI:
We're at the forefront of creating advanced AI systems, from fully autonomous agents that provide intelligent customer interaction to data analysis tools that offer insightful business solutions. We are seeking enthusiastic interns who are passionate about AI and ready to tackle real-world problems using the latest technologies.
About the Role
We are at the forefront of building advanced AI systems — from fully autonomous agents that power intelligent customer interactions, to data analysis tools that deliver actionable business insights. This internship combines hands-on AI/ML engineering with robust backend development, giving you a complete picture of how production-grade AI systems are built, deployed, and scaled.
You will work across the full stack: designing and fine-tuning AI models on one end, and architecting the APIs, databases, and server-side infrastructure that bring those models to life on the other.
Key Responsibilities
AI / ML ENGINEERING
Design, experiment with, and fine-tune large language models (LLMs) and NLP pipelines for real-world use cases.
Develop and iterate on prompt engineering strategies to optimise model performance and output quality.
Integrate and deploy models using Hugging Face and OpenAI platforms; evaluate open-source alternatives.
Build deep learning workflows including training, evaluation, and continuous improvement loops.
Collaborate on data collection, preprocessing, and feature engineering for ML pipelines.
BACKEND ENGINEERING
Architect and develop scalable RESTful APIs and GraphQL endpoints using Node.js / FastAPI / Express.
Build and maintain full-stack features using Next.js (App Router), integrating server-side rendering, API routes, and React components.
Design and manage relational and NoSQL databases (PostgreSQL, MongoDB, or equivalent); write efficient queries and manage schema migrations.
Implement authentication, authorisation, and security best practices (JWT, OAuth 2.0, role-based access control).
Containerise services with Docker and contribute to CI/CD pipelines for reliable, automated deployments.
Integrate AI/ML model inference endpoints into backend services, handling async processing, queuing, and latency optimisation.
Write clean, well-tested, and well-documented backend code; participate actively in code reviews.
VERSION CONTROL & COLLABORATION
Use Git and GitHub for all version control workflows — branching strategies, pull requests, and code reviews.
Contribute to technical documentation, architecture decision records, and internal knowledge bases.
Duration & Compensation
Duration: 6 Months
Stipend: Base ₹8,000/month — up to ₹15,000/month based on performance
Post-Internship: Full-time opportunity as AI/ML Engineer (₹6–8 LPA) based on performance
Perks & Benefits
Hands-on experience shipping real AI products used by actual customers.
Mentorship from senior engineers and industry experts in AI/ML and backend development.
Exposure to the full development lifecycle — from model training to production deployment.
Collaborative, innovative, and flexible work environment.
Accelerated growth path with a clear route to a full-time engineering role.
How to Apply
Interested candidates are invited to submit their resume and complete the assignment using
the link : https://pgagi.in/jobs/28df1e98-f0c3-4d58-9509-d5b1a4ea9754
Shortlisted candidates will be contacted for an interview.
Selection Process
Initial Screening: We'll review your application for evidence of your skills, experience, and a strong foundation in AI.
Task Assignment: Candidates need to submit assignment which is already being attached in careers page , designed to assess your practical skills.
Performance Review: Our experts will evaluate your task submission, with excellence in this stage being crucial for further consideration.
Interview: Impressive task performers will be invited for an interview to discuss their potential contribution to our team.
Onboarding: Successful candidates will join our team, with exciting projects ahead
Requirements
MUST-HAVE SKILLS
Strong proficiency in Python for AI/ML development and scripting.
Solid understanding of JavaScript / TypeScript; experience with Node.js and Next.js (or a strong willingness to learn quickly).
Familiarity with REST API design principles and at least one backend framework (Express, FastAPI, Django, etc.).
Working knowledge of at least one database system (PostgreSQL, MySQL, MongoDB).
Experience with Git and GitHub version control workflows.
Exposure to AI/ML platforms such as Hugging Face and OpenAI.
Understanding of prompt engineering concepts and the model fine-tuning process.
GOOD TO HAVE
Hands-on experience with Next.js App Router, React Server Components, or similar modern full-stack frameworks.
Familiarity with Docker, basic DevOps concepts, or cloud platforms (AWS, GCP, or Azure).
Experience with message queues (Redis, RabbitMQ) or background task processing.
Knowledge of LLM orchestration tools such as LangChain or LlamaIndex.
SOFT SKILLS & MINDSET
Strong problem-solving instincts and a genuine curiosity about AI technology.
Ability to own tasks end-to-end and communicate progress clearly.
Comfortable working in a fast-moving environment where requirements evolve.
A growth mindset — eager to learn, receive feedback, and level up continuously.
TECH YOU'LL WORK WITH
Python
Next.js
Node.js
FastAPI
LLMs / NLP
PostgreSQL
React
Docker
HuggingFace
OpenAI API
GitHub
REST / GraphQL
Apply now to embark on a transformative career journey with PGAGI, where innovation and talent converge!
#artificialintelligence #Machinelearning #AI #AIML #LLM #FastAPI #NLP #openAI #AImodels #AIMLInternship #AIintern #Internship #aimlgraduate #Python
Role Overview:
As an AI Executor/AI Automation Engineer, you will be responsible for designing and integrating AI capabilities into production systems using Python and key ML libraries. This role requires a strong backend development foundation and a proven track record of deploying AI use cases using tools like TensorFlow, Keras, or OpenAI APIs. You'll work cross-functionally to deliver scalable AI-driven solutions.
Key Responsibilities:
- Design and develop backend solutions using Python, with a focus on AI-driven features.
- Implement and integrate AI/ML models using tools like OpenAI, Hugging Face, or Lang Chain.
- Use core Python libraries (NumPy, Pandas, TensorFlow, Keras) to process data, train, or implement models.
- Translate business needs into AI use cases and deliver working solutions.
- Collaborate with product, engineering, and data teams to define integration workflows.
- Develop REST APIs and micro services to deploy AI components within applications.
- Maintain and optimize AI systems for scalability, performance, and reliability.
- Keep pace with advancements in the AI/ML landscape and evaluate tools for continuous improvement.
Required Skills & Qualifications:
- 2+ years of professional experience as an AI/ML Engineer, including strong backend development expertise in Python.
- Proficiency in libraries such as NumPy, Pandas, TensorFlow, and Keras
- Practical exposure to AI platforms/APIs (e.g., OpenAI, LangChain, Hugging Face)
- Solid understanding of REST APIs, micro services, and integration practices
- Ability to work independently in a remote setup with strong communication and ownership
- Excellent problem-solving and debugging capabilities
- Experience with the MERN stack will be an added advantage.
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Location: Hyderabad, India. Based at the KnackLabs headquarters, with occasional travel to client locations for workshops and reviews. This role does not involve extended onsite deployments.
About the Role
You will work as an AI Architect who designs the systems behind our client engagements: AI agents, RAG systems, automation platforms, and the conventional backend systems around them.
This is a hands-on design role, not a slideware role. You will scope architectures with clients, make the hard technical decisions, defend them in review, and stay accountable for how the systems perform in production.
You will work directly with clients. Everyone at KnackLabs does. You will sit in design discussions with client engineering teams, present architecture decisions to technical and business stakeholders, and answer for the choices you make.
A full KnackLabs engineering team in Hyderabad builds with you. You own the technical design and the quality of what ships.
What you'll own
- Architecture - Design AI agents, RAG systems, integrations, and the scalable backend systems around them, for multiple client engagements.
- Technical scoping - Work directly with clients to turn a business problem into a system design, with clear trade-offs and clear reasons.
- Scale and reliability - Make sure what we build handles real load: data stores, queues, caching, horizontal scaling, and fault tolerance.
- Design reviews - Review designs and builds across engagements. Set the technical bar and hold it.
- Evaluation strategy - Define how we measure accuracy, safety, latency, and cost for the AI systems we ship.
- Guiding engineers - Raise the level of the engineers building with you, through reviews and direct pairing.
- Feedback to the platform - Feed what you learn across engagements back into our platform and internal tools.
What we are looking for
- Around 7 or more years of software engineering experience, including direct work with customers on design or delivery.
- Full-stack development experience with strength in backend technologies.
- Experience designing and building scalable applications. You understand how large-scale distributed systems work: data partitioning, queues, caching, horizontal scaling, and fault tolerance.
- At least 2 years of strong, hands-on AI experience with large language models in production.
- You build with AI coding tools like Claude Code or Codex as your default way of working. You understand Claude Skills, have written skills yourself, use them actively, and have contributed to them.
- Hands-on experience building retrieval-augmented generation (RAG) systems: chunking, embeddings, vector databases, retrieval, and reranking.
- Hands-on experience building AI agents.
- Strong programming skills in Python. Working knowledge of TypeScript or JavaScript.
- Experience with at least one cloud platform (AWS, Azure, or GCP).
- Clear communication. You can explain an architecture decision to an engineer and to a business leader, and defend it under questioning.
- High ownership and comfort with ambiguity. You can take an unclear problem and turn it into a design.
Nice to have
- Experience building evaluations to measure accuracy, safety, latency, and cost.
- Experience with observability and tracing tools such as LangSmith or Braintrust.
- Experience with on-premises or private cloud (VPC) deployments.
- Experience deploying AI systems in regulated industries such as insurance, banking, or the public sector.
- Experience with data engineering and pipelines.
- A history of side projects, open source contributions, or products you shipped end-to-end.
- Experience working at a consulting or professional services firm in a client-facing delivery role.
Stack and tools
- Languages: Python and TypeScript.
- Models: Claude and other frontier or open-source models, chosen to fit the customer.
- AI patterns: RAG, agents, prompt engineering, skills, and evaluations.
- Vector and retrieval: vector databases and retrieval pipelines.
- Cloud: AWS, Azure, or GCP, on public or private cloud.
- Integration: REST APIs and enterprise system connectors.
Build AI where the work actually happens.
Celeco works inside real businesses to understand critical workflows, ship production AI systems and stay through adoption.
We are hiring our first Intelligence Architect (Forward-Deployed AI Engineer).
⌁
Full-time · Remote-first · Optional hybrid in Bengaluru
At least one year of professional engineering experience. Customer travel when the work requires it.
The role
An Intelligence Architect enters a customer environment with an unfinished question and leaves behind a working, measurable system.
This is a hands-on engineering role at the boundary of product, operations and customer delivery. You will learn the domain, inspect the existing systems and data, decide what should be built, and write the code that puts it into production.
What you will own
- Interview and shadow the people doing the work, then map the real workflow, including hand-offs, exceptions and workarounds.
- Understand the customer's application stack, APIs, data, identity model, security constraints and deployment environment.
- Turn business goals into a technical scope, system design, delivery plan and measures of success.
- Build across the stack: AI workflows, data pipelines, integrations, backend services and the interfaces people use.
- Choose the simplest reliable approach. The answer may combine agents, retrieval, rules and conventional software.
- Create evals from representative cases, define quality and failure metrics, inspect traces, red-team the system and set launch thresholds.
- Make practical trade-offs across accuracy, latency, cost, privacy, security and speed.
- Take prototypes into production with tests, monitoring, access controls, documentation and a plan for failure and recovery.
- Work beside customer teams during rollout and improve the system until it becomes part of the workflow.
- Turn what works into reusable components, evaluation sets and playbooks for future Celeco deployments.
You will probably thrive here if
- You have at least one year of professional software or product engineering experience.
- You have shipped a real system used by other people and can explain what you owned, what broke and what you changed.
- You are strong in Python or TypeScript and comfortable moving across unfamiliar codebases, APIs, databases and cloud services.
- You have built with language or multimodal models and understand prompting, structured outputs, retrieval, tool use and model failure modes.
- You use Cursor, Codex, Claude Code or similar tools as part of your engineering workflow, while still reviewing, testing and understanding the code you ship.
- You can create an evaluation set, choose useful quality metrics and improve a system through error analysis instead of prompt guesswork.
- You can speak with an operator, an engineering team and a senior leader without losing the thread of the problem.
- You work well with incomplete requirements, write clearly and surface risks early.
- You care about whether people use what you build and whether it changes a business outcome.
- You can commit full-time and travel to customer sites when discovery or rollout is better done in person.
Experience with cloud deployment, containers, CI/CD, observability, enterprise integrations, authentication or security is useful. We do not expect one person to arrive knowing every framework, cloud or industry.
What you will get
- Direct ownership of live customer problems from discovery through production.
- Close collaboration with Celeco's founders and customer leadership teams.
- Exposure to different industries, operating models and technical environments.
- The freedom to choose the technical approach and the responsibility to prove that it works.
- A role in defining Celeco's engineering methods, reusable systems and technical culture while the company is early.
- A remote-first setup, with the option to work together in Bengaluru.
If the work sounds like you but your background is unconventional, apply. We care more about what you have built, how you think and how quickly you learn than pedigree.
About the Role
We are looking for enthusiastic LLM Interns to join our team remotely for a 3-month internship. This role is ideal for students or graduates interested in AI, Natural Language Processing (NLP), and Large Language Models (LLMs). You will gain hands-on experience working with cutting-edge AI tools, prompt engineering, and model fine-tuning. While this is an unpaid internship, interns who successfully complete the program will receive a Completion Certificate and a Letter of Recommendation.
Responsibilities
- Research and experiment with LLMs, NLP techniques, and AI frameworks.
- Design, test, and optimize prompts and workflows for different use cases.
- Assist in fine-tuning or integrating LLMs for internal projects.
- Evaluate model outputs and improve accuracy, efficiency, and reliability.
- Collaborate with developers, data scientists, and product managers to implement AI-driven features.
- Document experiments, results, and best practices.
Requirements
- Strong interest in Artificial Intelligence, NLP, and Machine Learning.
- Familiarity with Python and ML libraries (e.g., TensorFlow, PyTorch, Hugging Face Transformers).
- Basic understanding of LLM concepts such as embeddings, fine-tuning, and inference.
- Knowledge of APIs (OpenAI, Anthropic, Hugging Face, etc.) is a plus.
- Good analytical and problem-solving skills.
- Ability to work independently in a remote environment.
What You’ll Gain
- Practical exposure to state-of-the-art AI tools and LLMs.
- Mentorship from AI and software professionals.
- Completion Certificate upon successful completion.
- Letter of Recommendation based on performance.
- Experience to showcase in research projects, academic work, or future AI roles.
Internship Details
- Duration: 3 months
- Location: Remote (Work from Home)
- Stipend: Unpaid
- Perks: Completion Certificate + Letter of Recommendation
About the Job :
We are looking for a passionate and driven AI Intern to join our dynamic team. As an intern, you will have the opportunity to work on real-world projects, develop AI models, and collaborate with experienced professionals in the field. This internship is designed to provide hands-on experience in AI and machine learning, offering you the chance to contribute to impactful projects while enhancing your skills.
Job Description:
We are seeking a talented Artificial Intelligence Specialist to join our dynamic team. As an AI Specialist, you will be responsible for developing, implementing, and optimizing AI models and algorithms. You will collaborate closely with cross-functional teams to integrate AI capabilities into our products and services. The ideal candidate should have a strong background in machine learning, deep learning, and natural language processing, with a passion for applying AI to real-world problems.
Responsibilities:
- Design, develop, and deploy AI models and algorithms.
- Conduct data analysis and pre-processing to prepare data for modeling.
- Implement and optimize machine learning algorithms.
- Collaborate with software engineers to integrate AI models into production systems.
- Evaluate and improve the performance of existing AI models.
- Stay updated with the latest advancements in AI research and apply them to enhance our products.
- Provide technical guidance and mentorship to junior team members.
Requirements:
- Any Graduate / Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; Master's degree preferred.
- Proven experience in developing and implementing machine learning models and algorithms.
- Strong programming skills in languages such as Python, R, or Java.
Benefits :
- Internship Certificate
- Letter of Recommendation
- Performance-Based Stipend
- Part-time work from home (2-3 hours per day)
- 5 days a week, fully flexible shift
About NonStop io Technologies
NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.
Brief Description:
We're seeking an AI/ML Engineer to join our team. As AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real-world business problems. You will work closely with engineering teams, including software engineers, domain experts, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms and data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.
Responsibilities
● Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI
● AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.
● Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data
● Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics
● Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behaviour, and performance metrics
● Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems
● Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes
● Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions
● Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference.
Qualifications & Skills
● Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus
● Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects
● Proficiency in programming languages commonly used for AI/ML. Preferably Python
● Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.
● Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.
● Strong understanding of machine learning algorithms, statistics, and data structures
● Experience with data preprocessing, data wrangling, and feature engineering
● Knowledge of deep learning architectures, neural networks, and transfer learning
● Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment
● Solid understanding of software engineering principles and best practices for writing maintainable and scalable code
● Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions
● Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders
Hiring for Junior AI Engineer
Exp : 4 - 6 yrs
Edu : BE/B.Tech/MCA
Work Location : Pune WFO
Skills :
- Min 3 years strong programming experience in Python is a MUST
- Min 2 years hands-on experience in AI with LLMs, RAG pipelines, and AI frameworks
- Experience with cloud platforms (AWS/Azure/GCP)
About the role
We are building AI systems that read, understand and act on real business documents, bank statements, financial reports, policy documents and forms and putting them into production where accuracy and cost both matters.
This is not a research role and it is not a prompt-writing role. You will own features end to end: pick and deploy open-source models, build the pipelines around them, measure whether they actually work on our documents, drive the cost per document down, and keep the whole thing running in production.
You will work closely with the engineering and product teams, and your work will be directly used by business users from day one.
What you will do
Deploy and evaluate open-source models
- Select, deploy and benchmark open-source LLMs and vision-language models for specific, narrow use cases not general chat.
- Build evaluation sets from real documents and define what "good" means numerically (field-level accuracy, extraction recall, hallucination rate) before shipping.
- Run structured comparisons between models and approaches, and write up the trade-offs so the team can make a decision.
- Apply quantization, batching and other optimizations to fit models into a sensible GPU budget.
Build and optimize AI orchestration
- Design multi-step pipelines that combine deterministic code, ML models and LLM calls and know when not to use an LLM.
- Optimize for latency, cost and reliability: caching, batching, request routing, fallback tiers, retries and graceful degradation.
- Instrument pipelines so failures are visible and traceable rather than silent.
Ship to production
- Package models and services with Docker, expose them behind clean APIs, and deploy them to our GPU and CPU infrastructure.
- Handle the unglamorous production concerns: cold starts, timeouts, concurrency limits, versioning, rollback and monitoring.
- Own on-call-style responsibility for the AI features you build, including cost tracking.
Must-have skills
Programming & engineering
- Strong Python: type hints, async/await, dataclasses/Pydantic, clean module design, testing.
- REST API development with FastAPI (or Flask/Django with a willingness to move to FastAPI).
- Git, code review discipline, and the ability to write code someone else can maintain.
- Comfortable in Linux and on the command line.
Machine learning fundamentals
- Working knowledge of PyTorch and the Hugging Face ecosystem (transformers, tokenizers, accelerate).
- Understanding of inference-time concepts: tokenization, context windows, batching, precision (FP16/BF16/INT8), memory footprint.
- Ability to read a model card and a paper well enough to judge whether a model fits a use case.
Document processing
- Hands-on experience with at least two of: pypdfium2, PyMuPDF, pdfplumber, pdfminer.six, Docling, Unstructured, Surya, DocTR, LayoutLM family.
- Practical OCR experience (Tesseract, PaddleOCR, or a cloud OCR) and an understanding of when OCR is the wrong tool.
- Experience extracting tables from PDFs and dealing with merged cells, multi-line rows, and inconsistent column layouts.
Strongly preferred
You will be a much stronger candidate with any of these. We do not expect all of them.
Model serving & optimization
- vLLM, TGI, Ollama, llama.cpp, or Triton Inference Server.
- Quantization formats and tooling: GGUF, AWQ, GPTQ, bitsandbytes, ONNX Runtime, INT8 export.
- Serverless GPU platforms: Modal, RunPod, Replicate, Baseten including cold-start and container-lifecycle management.
- LoRA / QLoRA fine-tuning with PEFT for narrow, task-specific improvements.
Vision-language models
- Practical use of open VLMs: Qwen2.5-VL, InternVL, Granite Vision, Molmo, Phi-Vision, or similar.
- Awareness of where VLMs hallucinate especially on numeric and financial content and patterns for constraining them (using the model for layout only, sourcing values from the text layer, constrained decoding).
Orchestration & pipelines
- Workflow orchestration: Dagster, Airflow, Prefect, or Temporal.
- Async job patterns: Celery, RQ, or platform-native spawn/poll patterns.
- LLM orchestration frameworks (LangGraph, LlamaIndex, Haystack) with the judgement to know when plain Python is a better answer.
- Structured output enforcement: Instructor, Outlines, XGrammar, JSON schema / tool-use modes.
Evaluation & observability
- Building golden datasets and regression suites for extraction tasks.
- Eval tooling: promptfoo, DeepEval, Ragas, or in-house harnesses.
- LLM tracing and monitoring: Langfuse, Arize Phoenix, LangSmith, OpenTelemetry.
Nice extras
- Rule engines and policy evaluation (Open Policy Agent / Rego, Drools, rule-engine).
- Experience in fintech, lending, insurance or accounting documents.
- Handling of PII and data-security practices in document pipelines.
- Contributions to open-source ML or document-processing projects.
Why join us
- Real production ownership from month one your work goes to actual users, not a demo.
- Genuinely hard technical problems in document AI, not wrappers over an API.
- Small team, short decision cycles, direct access to leadership.
- Budget and freedom to evaluate and adopt new open-source models as they land.
To apply: send your CV along with a short note on one AI system you have taken to production what it did, what the accuracy was, and what broke.












