AI/ML Engineer (Open-Source LLM – BFSI Domain) at Impacto Digifin Technologies · Bengaluru (Bangalore) · 3 - 5 years · ₹7L - ₹12L / yr · Bootstrapped · Posted 12 Aug 2026

AI/ML Engineer (Open-Source LLM – BFSI Domain)
AI/ML Engineer (Open-Source LLM – BFSI Domain)
Job Title: AI/ML Engineer (Open-Source LLM – BFSI Domain)
Location: Brookefield, Bengaluru
Employment Type: Full-Time
Work Schedule: Monday to Saturday (Alternate Saturdays Off)
Working Hours: 9:00 AM – 6:00 PM (Extendable based on project requirements)
About the Role
We are seeking a talented AI/ML Engineer with hands-on experience in building, fine-tuning, and deploying Open-Source Large Language Models (LLMs) for the Banking, Financial Services, and Insurance (BFSI) domain. The ideal candidate will have practical experience developing production-ready AI solutions and a passion for leveraging Generative AI to solve real-world business challenges.
In this role, you will collaborate with Product, Engineering, and Data Science teams to design intelligent AI solutions that enhance customer experience, automate business processes, and improve operational efficiency.
Key Responsibilities
Design, develop, fine-tune, and deploy Open-Source LLMs for BFSI use cases.
Build AI-powered applications using modern LLM frameworks and orchestration tools.
Collaborate with Product Managers, Data Scientists, and Software Engineers to understand business requirements and deliver scalable AI solutions.
Conduct model experimentation, evaluation, optimization, and performance benchmarking using real-world datasets.
Implement Retrieval-Augmented Generation (RAG), prompt engineering, vector databases, and AI workflows where applicable.
Monitor model performance in production environments and continuously improve model accuracy, latency, and scalability.
Ensure AI solutions comply with enterprise security, privacy, and regulatory standards.
Develop APIs and integrate AI models into enterprise applications.
Maintain technical documentation, architecture diagrams, and deployment procedures.
Stay updated with the latest advancements in Artificial Intelligence, Machine Learning, and Open-Source LLM technologies.
Required Qualifications
Education
Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related technical field.
Equivalent practical experience will also be considered.
Experience
Minimum 2+ years of hands-on AI/ML development experience.
Experience in the BFSI domain is preferred.
Proven experience building and deploying AI/ML solutions in production environments.
Technical Skills
Programming Languages
Python (Mandatory)
Java (Preferred)
AI/ML Frameworks
PyTorch
TensorFlow
Scikit-learn
Open-Source LLM Technologies
Experience with one or more of the following:
LangChain
LangGraph
Ollama
Hugging Face Transformers
Llama
Mistral
DeepSeek
Qwen
vLLM
FastAPI
Generative AI
Prompt Engineering
Fine-Tuning LLMs
Retrieval-Augmented Generation (RAG)
Embeddings
Vector Databases (FAISS, ChromaDB, Milvus, Pinecone, etc.)
Model Evaluation and Optimization
Additional Skills
Docker
Kubernetes (Preferred)
REST APIs
Git
Linux
CI/CD pipelines
Core Competencies
Strong analytical and problem-solving skills.
Excellent understanding of AI/ML concepts and LLM architectures.
Ability to communicate technical concepts to non-technical stakeholders.
Strong interpersonal and collaboration skills.
Self-motivated with a passion for continuous learning and innovation.
Preferred Experience
Experience in any of the following areas will be an added advantage:
Banking & Financial Services applications
Fraud Detection
Credit Risk Assessment
Intelligent Document Processing
Loan Processing Automation
Customer Support Chatbots
Regulatory Compliance
OCR & Document AI
Agentic AI and Multi-Agent Systems
Interview Process
Round 1 – Technical Interview
Conducted by: Senior AI Engineer
Assessment includes:
Python Programming
Machine Learning Fundamentals
Open-Source LLMs
LangChain & RAG
Coding and Problem Sol…

About Impacto Digifin Technologies
About
Impacto Digifin Technologies empowers businesses to embrace digital transformation with intelligent, AI-driven solutions. Our platforms simplify document management, data verification, and compliance processes, reducing manual effort, enhancing accuracy, and accelerating results. From fast-growing fintechs to established enterprises, our solutions are designed to adapt to unique operational needs, whether it’s streamlining customer onboarding, automating back-office workflows, or eliminating paperwork bottlenecks.
What sets Impacto Digifin apart is our hybrid approach—leveraging automation for speed while maintaining human oversight where it matters most. This ensures efficiency without compromising trust, enabling organizations to operate with clarity and control. More than just a technology provider, we act as a digital partner, helping teams scale smarter, optimize processes, and transform their operations with confidence.
Candid answers by the company
Impacto Digifin Technologies provides AI-powered solutions that streamline document management, data verification, and compliance for businesses.
Connect with the team
Similar jobs (10)
Kody Technolab Limited is seeking an experienced AI/ML Engineer to design, develop, and deploy cutting-edge Artificial Intelligence and Machine Learning solutions. The ideal candidate will have
strong expertise in Machine Learning, Deep Learning, Generative AI, LLMs, MLOps, and cloud-based AI deployments.
Key Responsibilities
• Design, develop, and deploy Machine Learning and Deep Learning models for classification, regression, recommendation systems, NLP, Computer Vision, and Generative AI applications.
• Build and maintain end-to-end ML pipelines including data preprocessing, feature engineering, model training, validation, evaluation, and deployment.
• Develop AI solutions using PyTorch, TensorFlow, Scikit-learn, Hugging Face, and related frameworks.
• Work with Large Language Models (LLMs) and foundation models such as GPT, BERT, Llama, Claude, and Stable Diffusion.
• Collaborate with product, engineering, and business teams to translate requirements into scalable AI solutions.
• Optimize model performance, scalability, and reliability for production environments.
• Implement MLOps best practices using tools such as MLflow, Docker, Kubernetes, and Kubeflow.
• Stay updated with emerging trends and research in AI, ML, Deep Learning, and Generative AI.
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a related field.
• 7+ years of hands-on experience in AI/ML product development.
• Strong proficiency in Python and ML frameworks including Scikit-learn, TensorFlow, PyTorch, and Hugging Face.
• Experience with Generative AI, LLMs, GANs, VAEs, diffusion models, and prompt engineering.
• Strong understanding of the ML lifecycle including model training, tuning, deployment, monitoring, and optimization.
• Experience with MLOps tools such as MLflow, Docker, Kubeflow, and CI/CD pipelines.
• Experience with AWS, Azure, or GCP cloud platforms.
• Strong problem-solving and analytical skills.
Preferred Skills
• Fine-tuning and deployment of Large Language Models.
• Experience with RAG (Retrieval Augmented Generation) architectures.
• Contributions to open-source AI projects or research publications.
• Knowledge of model interpretability, data annotation, and feature engineering.
• C++ experience for high-performance AI applications.
Why Join Kody Technolab Limited?
Opportunity to work on innovative AI products, Generative AI solutions, robotics integrations,
and enterprise-scale applications while collaborating with a highly skilled technology team.
Visit the Website to know more about us.
Company Website - Kody Technolab | Deep Tech Company in Robotics & AI Solution
Kody Robots | Robotics Company in India for Autonomous Robots
AI/ML Engineer AI Operating System for Capital Markets Location Bangalore/Chennai Experience 5+ years Function Artificial Intelligence / Machine Learning Employment Type About Transient.AI Full-time Transient.AI is building a next-generation AI Operating System for capital markets — a unified intelligence layer that connects research, trading, compliance, and sales functions at banks and hedge funds. Today, these teams largely operate on disconnected legacy systems, forcing manual, expensive workarounds. Transient.AI replaces that fragmentation with a single AI-native layer built for institutional-grade compliance, security, and auditability. The company already has live products in market, including Caddie.AI (a research automation tool that cuts hedge fund research time significantly), ClarityRIA (helping sales teams identify the right investors in seconds), and CapFlo.AI (automated parsing of complex derivatives contracts). Founded by former traders and technologists from Goldman Sachs, Credit Suisse, UBS, and McKinsey, Transient.AI is headquartered in New York, with teams in Miami, Singapore, and India. The company has raised Series A funding and is scaling its engineering and product organization globally. Role Overview Transient.AI is hiring an experienced AI/ML Engineer to join its India engineering team in Bangalore/Chennai. This is a hands-on, build-from-scratch role — you'll be designing and shipping the core machine learning systems that power the company's flagship products, working closely with founders and senior engineers rather than inheriting existing infrastructure. Key Responsibilities • Design, build, and deploy machine learning and AI models that power Transient.AI's core products (research automation, document intelligence, investor matching, and workflow orchestration). • Workonapplied NLP/LLMsystems, including retrieval-augmented generation, structured extraction from unstructured financial documents, and model evaluation pipelines. • Partner closely with product and founding engineers to translate capital markets workflows into scalable AI systems. • Ownmodelperformance, reliability, and cost — from experimentation through production deployment. • Build and maintain data pipelines, feature stores, and evaluation frameworks to support rapid iteration. • Ensuresystems meet the compliance, auditability, and security standards required in regulated financial environments. What We're Looking For • 5+years ofexperience building and deploying machine learning or AI systems in production.• Strong hands-on experience with Python and modern ML/AI frameworks (PyTorch, TensorFlow, Hugging Face, LangChain, or equivalent). • Experience with LLMs — fine-tuning, prompt engineering, RAG architectures, or agentic systems — is highly valued. • Solid grounding in data structures, distributed systems, and MLOps practices (model serving, monitoring, versioning). • Prior experience at a strong product company, high-growth startup, or a top-tier engineering background • Comfort operating in an early-stage, high-ownership environment with limited process and high ambiguity. • Exposure to fintech, capital markets, or other regulated industries is a plus, though not mandatory. WhyJoin Transient.AI • Build core AI systems from the ground up — not maintain legacy code. • Workdirectly with founders who have deep, first-hand Wall Street experience (Goldman Sachs, Credit Suisse, UBS, McKinsey). • JoinaSeries A-funded company solving a real, expensive problem for institutional finance. • Bepart ofasmall, global team with outsized ownership and impact. .
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 30 Years
11
Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.
12
Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..
13
Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.
14
Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies
15
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 28 Years
11
Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.
12
Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..
13
Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.
14
Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies
15
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
About NonStop io Technologies
NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.
Brief Description:
We're seeking an AI/ML Engineer to join our team. As AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real-world business problems. You will work closely with engineering teams, including software engineers, domain experts, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms and data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.
Responsibilities
● Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI
● AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.
● Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data
● Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics
● Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behaviour, and performance metrics
● Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems
● Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes
● Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions
● Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference.
Qualifications & Skills
● Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus
● Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects
● Proficiency in programming languages commonly used for AI/ML. Preferably Python
● Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.
● Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.
● Strong understanding of machine learning algorithms, statistics, and data structures
● Experience with data preprocessing, data wrangling, and feature engineering
● Knowledge of deep learning architectures, neural networks, and transfer learning
● Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment
● Solid understanding of software engineering principles and best practices for writing maintainable and scalable code
● Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions
● Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 28 Years
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 5+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
9
Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.
10
Mandatory (Age) - Candidate's Age should be below 30 Years
11
Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.
12
Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..
13
Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.
14
Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies
15
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Job Description:
We are seeking a highly skilled Machine Learning Engineer to join our team. The ideal candidate will have a strong background in Natural Language Processing (NLP), Large Language Models (LLMs), and Python programming.
You will work closely with data scientists, product managers, and data engineers to design, develop, and deploy high-performance AI/ML models and integrate generative AI solutions into existing workflows.
Your responsibilities will include:
- Collaborating with cross-functional teams to design and deliver high-performance AI models, including NLP, computer vision, semantics engines, linguistic analysis, risk management, and time-series prediction models. Integrating generative AI solutions into existing workflow systems.
- Developing and maintaining the ML Operations CI/CD pipeline for seamless deployment and monitoring. Training, tuning, and optimizing AI models and algorithms for enhanced performance.
- Implementing complex real-time data and AI/ML applications to capture knowledge and automate decision-making processes.
- Creating ML/AI models for business teams and establishing metrics to track their accuracy and performance. Overseeing the full lifecycle of algorithm development, from ideation to deployment and monitoring. Evaluating and ranking ML algorithms based on their potential success in solving specific problems.
- Serving as an internal resource for AI/ML needs, providing guidance and insights to stakeholders during strategic discussions.
Required Experience and Skills:
Machine Learning:
- Proficient in generative AI techniques, prompt engineering, and Retrieval-Augmented Generation (RAG) (3+ years).
- Experience with Large Language Models (LLMs) such as OpenAI, Gemini, LLAMA, and other state-of-the-art models (3+ years).
- Expertise in using ML/AI libraries such as Pandas, NumPy, PyTorch, TensorFlow, Keras, BERT, LayoutLM, and traditional ML algorithms (5+ years).
- Experience with distributed ML/AI training libraries/models: Koalas, Horovod, DDP.
Python Programming and Software Engineering:
- Expertise in Pythonic clean coding practices, including the use of decorators, generators, and descriptors (5+ years).
- Strong understanding of software design principles such as DRY, OAOO, YAGNI, KIS, EAFP/LBYL, and defensive programming (2+ years).
- Proficient in software design concepts focusing on cohesion and coupling (2+ years). Knowledge of SOLID principles (2+ years).
Education and Experience:
- Minimum Bachelor's degree or foreign equivalent in Computer Science, Electrical Engineering, or a closely related field.
- At least 5 years of experience as a software engineer and 5 years of ML-related programming.
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Key Responsibilities
• Design, build, and deploy machine learning and AI models that power Transient.AI's core products (research
automation, document intelligence, investor matching, and workflow orchestration).
• Work on applied NLP/LLM systems, including retrieval-augmented generation, structured extraction from
unstructured financial documents, and model evaluation pipelines.
• Partner closely with product and founding engineers to translate capital markets workflows into scalable AI
systems.
• Own model performance, reliability, and cost — from experimentation through production deployment.
• Build and maintain data pipelines, feature stores, and evaluation frameworks to support rapid iteration.
• Ensure systems meet the compliance, auditability, and security standards required in regulated financial
environments.
What We're Looking For
• 5+ years of experience building and deploying machine learning or AI systems in production.• Strong hands-on experience with Python and modern ML/AI frameworks (PyTorch, TensorFlow, Hugging Face,
LangChain, or equivalent).
• Experience with LLMs — fine-tuning, prompt engineering, RAG architectures, or agentic systems — is highly
valued.
• Solid grounding in data structures, distributed systems, and MLOps practices (model serving, monitoring,
versioning).
• Prior experience at a strong product company, high-growth startup, or a top-tier engineering background
• Comfort operating in an early-stage, high-ownership environment with limited process and high ambiguity.
• Exposure to fintech, capital markets, or other regulated industries is a plus, though not mandatory
About the role
We are building AI systems that read, understand and act on real business documents, bank statements, financial reports, policy documents and forms and putting them into production where accuracy and cost both matters.
This is not a research role and it is not a prompt-writing role. You will own features end to end: pick and deploy open-source models, build the pipelines around them, measure whether they actually work on our documents, drive the cost per document down, and keep the whole thing running in production.
You will work closely with the engineering and product teams, and your work will be directly used by business users from day one.
What you will do
Deploy and evaluate open-source models
- Select, deploy and benchmark open-source LLMs and vision-language models for specific, narrow use cases not general chat.
- Build evaluation sets from real documents and define what "good" means numerically (field-level accuracy, extraction recall, hallucination rate) before shipping.
- Run structured comparisons between models and approaches, and write up the trade-offs so the team can make a decision.
- Apply quantization, batching and other optimizations to fit models into a sensible GPU budget.
Build and optimize AI orchestration
- Design multi-step pipelines that combine deterministic code, ML models and LLM calls and know when not to use an LLM.
- Optimize for latency, cost and reliability: caching, batching, request routing, fallback tiers, retries and graceful degradation.
- Instrument pipelines so failures are visible and traceable rather than silent.
Ship to production
- Package models and services with Docker, expose them behind clean APIs, and deploy them to our GPU and CPU infrastructure.
- Handle the unglamorous production concerns: cold starts, timeouts, concurrency limits, versioning, rollback and monitoring.
- Own on-call-style responsibility for the AI features you build, including cost tracking.
Must-have skills
Programming & engineering
- Strong Python: type hints, async/await, dataclasses/Pydantic, clean module design, testing.
- REST API development with FastAPI (or Flask/Django with a willingness to move to FastAPI).
- Git, code review discipline, and the ability to write code someone else can maintain.
- Comfortable in Linux and on the command line.
Machine learning fundamentals
- Working knowledge of PyTorch and the Hugging Face ecosystem (transformers, tokenizers, accelerate).
- Understanding of inference-time concepts: tokenization, context windows, batching, precision (FP16/BF16/INT8), memory footprint.
- Ability to read a model card and a paper well enough to judge whether a model fits a use case.
Document processing
- Hands-on experience with at least two of: pypdfium2, PyMuPDF, pdfplumber, pdfminer.six, Docling, Unstructured, Surya, DocTR, LayoutLM family.
- Practical OCR experience (Tesseract, PaddleOCR, or a cloud OCR) and an understanding of when OCR is the wrong tool.
- Experience extracting tables from PDFs and dealing with merged cells, multi-line rows, and inconsistent column layouts.
Strongly preferred
You will be a much stronger candidate with any of these. We do not expect all of them.
Model serving & optimization
- vLLM, TGI, Ollama, llama.cpp, or Triton Inference Server.
- Quantization formats and tooling: GGUF, AWQ, GPTQ, bitsandbytes, ONNX Runtime, INT8 export.
- Serverless GPU platforms: Modal, RunPod, Replicate, Baseten including cold-start and container-lifecycle management.
- LoRA / QLoRA fine-tuning with PEFT for narrow, task-specific improvements.
Vision-language models
- Practical use of open VLMs: Qwen2.5-VL, InternVL, Granite Vision, Molmo, Phi-Vision, or similar.
- Awareness of where VLMs hallucinate especially on numeric and financial content and patterns for constraining them (using the model for layout only, sourcing values from the text layer, constrained decoding).
Orchestration & pipelines
- Workflow orchestration: Dagster, Airflow, Prefect, or Temporal.
- Async job patterns: Celery, RQ, or platform-native spawn/poll patterns.
- LLM orchestration frameworks (LangGraph, LlamaIndex, Haystack) with the judgement to know when plain Python is a better answer.
- Structured output enforcement: Instructor, Outlines, XGrammar, JSON schema / tool-use modes.
Evaluation & observability
- Building golden datasets and regression suites for extraction tasks.
- Eval tooling: promptfoo, DeepEval, Ragas, or in-house harnesses.
- LLM tracing and monitoring: Langfuse, Arize Phoenix, LangSmith, OpenTelemetry.
Nice extras
- Rule engines and policy evaluation (Open Policy Agent / Rego, Drools, rule-engine).
- Experience in fintech, lending, insurance or accounting documents.
- Handling of PII and data-security practices in document pipelines.
- Contributions to open-source ML or document-processing projects.
Why join us
- Real production ownership from month one your work goes to actual users, not a demo.
- Genuinely hard technical problems in document AI, not wrappers over an API.
- Small team, short decision cycles, direct access to leadership.
- Budget and freedom to evaluate and adopt new open-source models as they land.
To apply: send your CV along with a short note on one AI system you have taken to production what it did, what the accuracy was, and what broke.







