Software Engineer (Machine learning & Recommendation) at Mercari, Inc · Bengaluru (Bangalore) · 6 - 9 years · Profitable · Posted 14 Apr 2026

Introduction
About Us:
Mercari is a Japan-based C2C marketplace company founded in 2013 with the mission to “Create value in a global marketplace where anyone can buy & sell.” From being the first tech unicorn from Japan before its IPO in 2018 we have come a long way towards becoming a global player and continuously and diligently work towards our transformation journey with a strong focus on our mission.
Since its inception, Mercari Group has worked to grow its services, investing in both our people and technology. Over time Mercari has expanded from being the top player in the C2C marketplace in Japan to new geographies like the U.S. We have also successfully launched new businesses such as Merpay, which is a mobile payment service platform with a vision to create a society where anyone can realize their dreams through a new ecosystem centered not only on payment service but also on credit. Today, Mercari Group is made up of multiple subsidiary businesses including logistics, B2C platform, blockchain, and sports team management.
For our services to be utilized by people worldwide; however, there is still a mountain of work ahead of us. This endeavor naturally requires the capability of the best talent and minds, and that is exactly the reason for us to launch the India Center of Excellence. With your help, we will continue to take on the world stage and strive to grow into a successful global tech company.
Our Culture:
To achieve our mission at Mercari, our organization and each of our employees share the same values and perspectives. Our individual guidelines for action are defined by our four values: Go Bold, All for One, Be a Pro and Move Fast. Our organization is also shaped by our four foundations: Sustainability, Diversity & Inclusion, Trust & Openness, and Well-being for Performance. Regardless of how big Mercari gets, the culture will remain essential to achieving our mission and something we want to preserve throughout our organization. We invite you to read the Mercari Culture Doc which summarizes the behaviors and mindset shared by Mercari and its employees. We continue to build an environment where all of our members of diverse backgrounds are accepted and recognized, and where they can thrive while holding dear to Mercari’s culture.
Work Responsibilities
- Machine learning engineers working in the Recommendation domain develop the functions and services of the marketplace app Mercari through the development and maintenance of machine learning systems like Recommender systems while leveraging necessary infrastructure and companywide platform tools.
- Mercari is actively applying advanced machine learning technology to provide a more convenient, safer, and more enjoyable marketplace. Machine learning engineers use the cloud and Kubernetes to operate and improve machine learning systems.
Bold Challenges
- We are looking for people who are interested in our services, mission, and values, and want to work where engineers can go bold, use the latest technology, make autonomous decisions, and take on challenges at a rapid pace.
- Develop and optimize machine learning algorithms and models to enhance recommendation system to improve discovery experience of users
- Collaborate with cross-functional teams and product stakeholders to gather requirements, design solutions, and implement features that improve user engagement
- Conduct data analysis and experimentation with large-scale data sets to identify patterns, trends, and insights that drive the refinement of recommendation algorithms
- Utilize machine learning frameworks and libraries to deploy scalable and efficient recommendation solutions.
- Monitor system performance and conduct A/B testing to evaluate the effectiveness of features.
- Continuously research and stay updated on advancements in AI/machine learning techniques and recommend innovative approaches to enhance recommendation capabilities.
Minimum Requirements:
- Over 5-9 years of professional experience in end-to-end development of large-scale ML systems in production
- Strong experience demonstrating development and delivery of end-to-end machine learning solutions starting from experimentation to deploying models, including backend engineering and MLOps, in large scale production systems.
- Experience using common machine learning frameworks (e.g., TensorFlow, PyTorch) and libraries (e.g., scikit-learn, NumPy, pandas)
- Deep understanding of machine learning and software engineering fundamentals
- Basic knowledge and skills related to monitoring system, logging, and common operations in production environment
- Communication skills to carry out projects in collaboration with multiple teams and stakeholders
Preferred skills:
- Experience developing Recommender systems utilizing large-scale data sets
- Basic knowledge of enterprise search systems and related stacks (e.g. ELK)
- Functional development and bug fixing skills necessary to improve system performance and reliability
- Experience with technology such as Docker and Kubernetes
- Experience with cloud platforms (AWS, GCP, Microsoft Azure, etc.)
- Microservice development and operation experience with Docker and Kubernetes
- Utilizing deep learning models/LLMs in production
- Experience in publications at top-tier peer-reviewed conferences or journals
Employment Status
Full-time
Office
Bangalore
Hybrid workstyle
- We believe in high performance and professionalism. We work from office for 2 days/week and work from home 3 days/week
- To build a strong & highly-engaged organization in India, we highly encourage everyone to work from our Bangalore office, especially during the initial office setup phase
- We will continue to review and update the policy to address future organizational needs
Work Hours
- Full flextime (no core time)
*Flexible to choose working hours other than team common meetings
Media
Owned Media
- Mercari Engineering Portal
- AI at Mercari portal
- Mercan - Introduces the people that make Mercari
- Mercari US Blog
Related Articles
- Development Platforms and Platformers: On Rising to the Global Standard Ken Wakasa, Mercari CTO | mercan
- “I'm Not a Talented Engineer” Insists the Member-Turned-Manager Revamping Our Internal CS Tool | mercan
- Personalize to globalize:How Mercari is reshaping their app, their company, and the world | mercan
- The Providers of the Safe and Secure Mercari Experience: The TnS Team, Introduced by Its Members! | mercan

About Mercari, Inc
About
Launched in 2013 and becoming the first Unicorn company in Japan, Mercari Group is a Japan-based corporate group operating in both Japan and the US. Our mission is to create value in a global marketplace where everyone can buy and sell.
Mercari is the largest marketplace platform with over 20 million monthly users in Japan. Through the Mercari app, users can sell their used or unwanted items to those who need them just by taking a photo and entering in some basic information. We are constantly developing our app to provide an environment where anyone can conduct transactions easily, safely, and securely. As part of these efforts, we have invested in the latest technologies such as AI and machine learning, and have released various functions such as escrow payment, AI listing, and barcode listing.
The app currently operates in Japan and the US, with 5.6 million monthly users in the US (as of 2022.3).
We have also successfully launched new businesses such as our mobile payment service Merpay. Today, Mercari Group is made up of multiple subsidiary businesses, including those involved in logistics, B2C e-commerce, blockchain, and sports team management.
Mercari India located in Bengaluru will harness the infinite power of technology to create high-quality service where our people come together to build products that will further strengthen our leadership position in a global product market.
Website
Industry
Technology, Information and Internet
Company video
Candid answers by the company
Similar jobs (10)
ABOUT
The Persona Labs is building a new kind of social platform focused on something most social products do not explicitly optimize for: helping people become real friends.
We want to help people discover interesting people around them, find meaningful common ground, start low-pressure interactions, continue promising conversations, create shared experiences, and ultimately build real-life friendships.
DISCOVER → CURIOSITY → COMPATIBILITY → INTERACTION → UNDERSTAND → IRL EXPERIENCE → FRIENDSHIP
THE AI LAYER - COMPANION INTELLIGENCE
Alongside the platform, we are building a proactive personal AI companion that learns about the user and helps them navigate this journey through personalized recommendations, suggestions, reminders, conversations, and experiences.
THE OPPORTUNITY
We are looking for a Founding ML Engineer to build the intelligence layer of the platform from the ground up. This is a 0→1 Applied AI / ML role where you will work directly with the founder and Product Engineer to turn ambiguous problems around users, relationships, recommendations and personal intelligence into working systems.
You will be expected to:
Understand the problem → identify the signals → design the intelligence system → prototype → evaluate → deploy → learn → improve.
WHAT YOU WILL BUILD & OWN
USER INTELLIGENCE
User representations, behavioural models, interests, preferences, contextual signals, and evolving understanding of the user. MEMORY Short- and long-term memory, episodic/preference/relationship memory, retrieval, relevance and updating.
RECOMMENDATION & MATCHING
People discovery, compatibility, activity/experience recommendations, and personalized ranking.
INTENT & INTEREST
Infer what the user is trying to do and learn what they care about from behaviour, not only declared interests.
RANKING
Decide what should appear first across potentially thousands of relevant people, activities or experiences.
CONTENT INTELLIGENCE
Classification, toxicity, spam, policy signals, quality, relevance, and semantic understanding.
RELATIONSHIP INTELLIGENCE
Reciprocity, interaction health, shared interests, progression, declining engagement and shared activity.
NEXT-BEST-ACTION
Determine the most useful action now: show a person, suggest a question, recommend an activity, reconnect, or do nothing.
TRUST / SAFETY INTELLIGENCE
Fake-account signals, spam, abuse, behavioural anomalies, risky interactions and moderation assistance.
COMPANION INTELLIGENCE
Use signals and outputs to help the companion decide what to say, suggest, recommend or not do.
WHAT YOUR DAY-TO-DAY LOOKS LIKE
• Translate ambiguous product problems into ML/AI system designs.
• Build models and intelligence pipelines using behavioural, relational and contextual signals.
• Develop recommendation, matching and personalization systems.
• Design memory and retrieval systems that help the companion understand the user over time.
• Build and evaluate LLM-powered and agentic workflows.
• Decide when to use traditional ML, rules, retrieval, ranking or LLMs.
• Prototype quickly, test assumptions and iterate based on real user behaviour.
• Work closely with the founder and Product Engineer to turn intelligence into product experiences.
• Design APIs and production systems that bring ML/AI capabilities into the application.
• Build evaluation, monitoring and feedback loops so the intelligence improves over time.
WHO SHOULD APPLY
• Experience: 0–4 years’ experience, including exceptional fresh graduates. Strong 1–3 year engineers and experienced 3–4 year product builders are welcome.
• Strong foundations in ML, Python, statistics and software engineering.
• Evidence of Building: Experience with AI/ML projects, recommendation systems, LLM applications or personalization is highly valued.
• Strong evidence of building: Shipped projects, research, hackathons, internships, open source or startup work.
WHAT WE LOOK FOR
MACHINE LEARNING DEPTH
Can you understand the modelling problem underneath the application?
RECOMMENDATION & PERSONALIZATION
Can you reason about relevance, ranking, cold start and behavioural signals?
AI ENGINEERING
Can you turn LLMs and agents into reliable product capabilities rather than simple API wrappers?
USER INTELLIGENCE
Can you design systems that gradually understand a person from sparse and changing signals?
SYSTEMS THINKING
Can you move from a model to a production system with APIs, data, latency, cost and monitoring?
EVALUATION MINDSET
Can you determine whether the intelligence actually helped the user?
PRODUCT JUDGMENT
Can you decide what the system should do when there is no predefined answer?
SPEED OF EXECUTION
Can you move from idea → prototype → evaluation → production quickly and responsibly?
BUILD WITH US
You will join at a stage where many of the answers do not exist yet. You will not simply implement a model someone else selected; you will help decide how the product learns to understand people.
CAREERS:
Apply with your resume, GitHub, portfolio or shipped work.
https://forms.gle/12YpUSBY2Sqs5xjp8
www.thepersonalabs.com
Strong AI Engineer / Machine Learning Engineer profiles.
2
Mandatory (Experience 1) – Must have minimum 3+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.
3
Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.
4
Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.
5
Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.
6
Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.
7
Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.
8
Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.
Mandatory ( Pedigree) - B.TECH / M.TECH from Tier 1 Colleges (IIT's, NIT's, BITS) are Considered.
Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
We are looking for a Data Science & Machine Learning Senior Associate with 3–5 years of relevant experience in data science, machine learning, and analytics. The candidate will be responsible for developing predictive models, analyzing complex datasets, building scalable ML solutions, and supporting production-grade data science applications on cloud platforms.
Key Responsibilities
- Develop and implement machine learning and predictive analytics models.
- Perform data analysis, statistical modeling, and optimization to solve business problems.
- Build demand forecasting and predictive models using time-series and other advanced techniques.
- Work with large datasets using Python, SQL, PySpark, and cloud-based data platforms.
- Develop and maintain scalable data pipelines for ML model development and deployment.
- Implement MLOps practices including model deployment, monitoring, retraining, and data-drift detection.
- Collaborate with software engineers, product teams, and business stakeholders to convert business requirements into analytical solutions.
- Validate models for accuracy, robustness, bias, and production readiness.
- Create meaningful visualizations and communicate analytical insights to technical and non-technical stakeholders.
Required Skills
- Python
- SQL
- Data Science & Machine Learning
- Predictive Modeling
- Statistical Analysis
- Machine Learning Algorithms
- Optimization Techniques
- Google Cloud Platform (GCP)
- BigQuery
- Dataflow
- Dataproc
- Data Fusion
- Cloud SQL
- Airflow
- PySpark
- PostgreSQL
- Terraform
- Tekton
- APIs
- MLOps
Preferred Skill
- Java
Good to Have
- Demand Forecasting
- Time-Series Analysis
- Neural Networks
- Ensemble Methods
- Support Vector Machines (SVM)
- Regression and Cluster Analysis
- ML Model Testing
- Bias Detection and Data Drift Monitoring
- Production ML Deployment
- QlikSense
- Automotive or Supply Chain Analytics
Education
Bachelor's degree in Computer Science, Data Science, Engineering, Statistics, Mathematics, or a related technical field.Master's degree in a relevant quantitative or technical field is preferred.

Role Summary
We are seeking an Advanced Machine Learning Engineer to design, build, train, deploy, and operate scalable machine learning systems. This hands-on ML engineering role focuses on implementing models and production systems—not solely conducting data analysis or research. It requires strong Python and deep-learning expertise, experience with frameworks such as PyTorch or TensorFlow, and the ability to own the end-to-end model lifecycle, from behavioral/event data preparation and feature engineering through model development, large-scale training, deployment, inference optimization, and monitoring. The engineer will work with Snowflake, Databricks, Spark, and GPU-based training infrastructure to deliver reliable, efficient, and maintainable ML capabilities.
Must have - Buulding and operated production ML systems using Python + PyTorch /TensorFlow + Snowflake/Databricks + MLOps.
Key Responsibilities
Machine Learning Engineering
- Implement and optimize machine learning algorithms and models for business use cases, including classification, regression, clustering, and recommendation systems as applicable.
- Translate model requirements into robust, reusable, and testable Python components.
- Build model training, validation, scoring, and inference workflows that can be integrated into production applications.
- Evaluate model performance against agreed technical and business metrics and implement improvements to accuracy, latency, robustness, and resource efficiency.
- Apply appropriate validation, error analysis, and model testing practices to ensure reliable behavior.
Train models efficiently on GPU infrastructure using techniques such as mixed-precision training, gradient accumulation, checkpointing, memory optimization, and distributed training strategies where appropriate.
Use PyTorch, TensorFlow,Pyspark or equivalent frameworks to implement experiments and production-ready training code; apply rigorous evaluation, error analysis, and reproducibility practices.
Build model-training workflows covering event/token sequence preparation, tokenization, temporal and positional representations, self-supervised pretraining, and downstream fine-tuning when appropriate to the use case.
Design, implement, train, and optimize deep-learning models; develop custom architectures where required, including transformer- and attention-based models for sequential or behavioral data.
Deep Learning & Model Architecture
Data Platforms & ML Pipelines
- Use Snowflake and SQL to access, query, and prepare enterprise data required by machine learning applications.
- Use Databricks for scalable data processing, feature preparation, model development, and ML pipeline execution.
- Develop and maintain reliable pipelines for data preparation, feature generation, training, batch scoring, and inference.
- Use PySpark and distributed processing techniques where appropriate for large-scale workloads.
- Work with data engineering teams to integrate upstream data sources and ensure dependable data contracts, quality checks, and pipeline operation.
Productionization & MLOps
- Productionize ML solutions and integrate them with services, APIs, data products, or downstream business workflows.
- Implement model and code versioning, experiment tracking, reproducible builds, automated testing, and release practices.
- Monitor model outputs and pipeline health; troubleshoot failures, data changes, drift, and performance degradation.
- Improve operational reliability, scalability, observability, and maintainability of ML systems.
- Collaborate with platform, cloud, and DevOps teams on deployment automation and production support.
Build observable production ML systems with appropriate logging, alerting, performance tracking, and operational safeguards.
Optimize inference latency, throughput, memory use, and serving cost through model architecture choices, batching, and serving-side optimizations.
Software Engineering & Technical Ownership
- Develop clean, modular, documented, and maintainable code following engineering standards and design principles.
- Contribute to technical design, code reviews, testing strategies, and architectural decisions for ML systems.
- Own assigned ML engineering deliverables from technical design through implementation, release, and ongoing support.
- Identify performance bottlenecks and improve runtime, resource utilization, and processing efficiency.
- Collaborate with cross-functional engineering and product teams to deliver dependable ML capabilities.
Required Skills & Qualifications
- Strong proficiency in Python and software engineering practices, including object-oriented design, modular development, testing, debugging, and code quality.
- Strong ML foundation and mathematical understanding
- Strong understanding of the end-to-end ML lifecycle, including model architecture, training, evaluation, optimization, inference, production integration, and monitoring.
- Strong SQL skills and experience working with structured data and data pipelines.
- Hands-on experience with Snowflake for querying and preparing data for ML workflows.
- Hands-on experience with Databricks for data processing and/or ML pipeline development.
- Strong hands-on experience with PyTorch, TensorFlow, or a similar deep-learning framework; experience with scikit-learn is also useful where appropriate.
- Understanding of production ML concepts, including reproducibility, model versioning, deployment, monitoring, and troubleshooting.
- Ability to design reliable, scalable, and maintainable software components and pipelines.
Familiarity with GPU training concepts and distributed strategies such as Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), or equivalents is an advantage for large-model workloads.
Understanding of model optimization, inference efficiency, and integration with production services or applications.
Experience developing and deploying ML solutions at scale, including end-to-end model lifecycle ownership.
Preferred Skills
- PySpark, Apache Spark, and distributed processing for large-scale behavioral or event data.
- MLflow or similar tooling for experiment tracking, model registry, reproducible training, and model lifecycle management.
- Experience integrating Snowflake and Databricks within enterprise ML workflows.
- Cloud experience with AWS, Microsoft Azure, or Google Cloud.
- REST APIs, containers, CI/CD, automated testing, logging, and observability.
- Experience with fraud detection, anomaly detection, behavioral modeling, identity or account-abuse signals, recommendation systems, or other large-scale ML applications.
- Exposure to Generative AI, LLM integration, embeddings, or RAG as an additional advantage.
Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, Computer Engineering, or a related field, or equivalent practical experience.
- At least 5 years of professional experience building, deploying, and supporting machine learning solutions at scale, or equivalent experience demonstrating the required engineering depth.
- Demonstrated ability to take ownership of engineering deliverables and work through implementation, deployment, and operational issues.
- Senior Machine Learning Engineer – Vertex AI
- Senior Generative AI Engineer – GCP
- Google Cloud AI/ML Engineer
- MLOps Engineer – Vertex AI
- LLM Engineer – RAG, Gemini, and Vertex AI

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.
Job Summary
We are looking for an experienced AI/ML Engineer to design, develop, deploy, and maintain machine learning and AI solutions that address complex business problems. The ideal candidate should have strong hands-on experience in Python, Machine Learning, Generative AI, LLMs, and AI/ML deployment, with the ability to work across the complete AI/ML lifecycle.
Key Responsibilities
- Design, develop, and deploy scalable Machine Learning and AI models for real-world business use cases.
- Build and optimize ML pipelines covering data preparation, feature engineering, model development, evaluation, and deployment.
- Develop solutions using Generative AI, Large Language Models (LLMs), NLP, and deep learning.
- Work with LLMs, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
- Integrate AI/ML models with enterprise applications and APIs.
- Fine-tune and evaluate ML/LLM models based on business requirements.
- Implement MLOps practices for model versioning, deployment, monitoring, and continuous improvement.
- Collaborate with Data Scientists, Software Engineers, Architects, Product Managers, and business stakeholders.
- Conduct model performance evaluation, optimization, and troubleshooting.
- Ensure AI solutions meet requirements around security, scalability, reliability, responsible AI, and data privacy.
- Stay current with emerging AI/ML technologies, frameworks, and industry best practices.
Required Skills
- Strong programming experience in Python.
- Strong understanding of Machine Learning algorithms, statistics, and data structures.
- Hands-on experience with ML frameworks such as TensorFlow, PyTorch, Scikit-learn, or equivalent.
- Experience with Generative AI and LLMs such as OpenAI, Azure OpenAI, Claude, Gemini, or open-source models.
- Strong knowledge of Prompt Engineering, RAG, embeddings, vector databases, and AI agents.
- Experience with NLP, deep learning, or computer vision is an advantage.
- Experience developing and consuming REST APIs and microservices.
- Working knowledge of SQL and NoSQL databases.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Understanding of Docker, Kubernetes, CI/CD, and MLOps.
- Familiarity with Git and modern software development practices.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field.
- 4 years of relevant experience in AI/ML engineering or a related field.
- Experience building and deploying production-grade AI/ML solutions.
- Enterprise application development experience.
- Experience with Azure OpenAI, AWS Bedrock, Vertex AI, or similar managed AI platforms.
- Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks is a plus.
- Experience with AI/ML model monitoring, evaluation, and optimization.
What You Bring
- Strong problem-solving and analytical skills.
- Ability to translate business requirements into practical AI/ML solutions.
- Strong software engineering and debugging capabilities.
- Ability to work independently as well as collaboratively in a cross-functional environment.
- Good communication skills with the ability to explain complex AI concepts to technical and non-technical stakeholders.
Keywords
AI Engineer | ML Engineer | Machine Learning | Generative AI | LLM | Python | NLP | Deep Learning | RAG | Prompt Engineering | AI Agents | Azure OpenAI | AWS Bedrock | MLOps | TensorFlow | PyTorch | Scikit-learn | Vector Database | Cloud AI
Location: Gurugram
Work mode: Hybrid
Strong Data Scientist / AI Engineer / Generative AI Engineer profile.
2
Mandatory (Experience 1) - Must have 3+ years of hands-on experience in Data Science, Artificial Intelligence, Machine Learning, Deep Learning, NLP, or Generative AI application development.
3
Mandatory (Experience 2) - Must have strong hands-on experience in Python programming, backend development, API development, and production-grade application support.
4
Mandatory (Experience 3) - Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, or Scikit-learn.
5
Mandatory (Experience 4) - Must have hands-on experience in NLP use cases such as text classification, sentiment analysis, entity recognition (NER), semantic search, embeddings, or document understanding.
6
Mandatory (Experience 5) - Must have experience working with Large Language Models (LLMs) such as GPT, LLaMA, Mistral, Phi, Claude, Gemini, or similar models.
7
Mandatory (Experience 6) - Must have hands-on experience building or implementing Retrieval Augmented Generation (RAG) solutions, vector search, semantic search, or knowledge-based AI applications.
8
Mandatory (Experience 7) - Must have experience with Prompt Engineering and Generative AI frameworks such as LangChain, LangGraph, AI Agents, Azure OpenAI, or similar technologies.
9
Mandatory (Experience 8) - Must have experience developing, consuming, or integrating APIs using Python frameworks such as FastAPI, Flask, or similar technologies.
Mandatory (Education) - B.TECH / M.TECH from Tier 1 Colleges (IIT, NIT, BITS, IIIT, DTU, NSUT) are considered.

About NonStop io Technologies
NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.
Brief Description:
We're seeking an AI/ML Engineer to join our team. As AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real-world business problems. You will work closely with engineering teams, including software engineers, domain experts, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms and data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.
Responsibilities
● Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI
● AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.
● Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data
● Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics
● Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behaviour, and performance metrics
● Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems
● Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes
● Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions
● Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference.
Qualifications & Skills
● Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus
● Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects
● Proficiency in programming languages commonly used for AI/ML. Preferably Python
● Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.
● Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.
● Strong understanding of machine learning algorithms, statistics, and data structures
● Experience with data preprocessing, data wrangling, and feature engineering
● Knowledge of deep learning architectures, neural networks, and transfer learning
● Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment
● Solid understanding of software engineering principles and best practices for writing maintainable and scalable code
● Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions
● Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders
This is a senior individual contributor role. You'll work as a peer to the other AI engineers on the team and own your problems completely: you choose the approach, build it, measure it, ship it and keep it working. If you've led a project or a small team before, that experience will help, because your work will often pull in backend, app and hardware engineers.
We're hiring from a core ML background on purpose. Much of the work ahead is model work: training and fine-tuning on data we're allowed to use, building evaluation sets, and deciding when our own model should replace a paid API. It is hands-on work, and you'll write and ship the code yourself.
What you'll own
- Speech and speaker identity. Improve speech-to-text on real-world audio, separate speakers reliably, and recognize who is speaking across conversations, including when several known people are in the same conversation.
- Memory and retrieval. Turn transcripts into memories that are accurate and grounded in what was said, with no invented people or facts. A line from the TV or a stranger at the next table should not become a fact about the user. When the user asks weeks later, the right memory should come back.
- Agents and actions. Build tool-using agents on top of memory, for example reminders and follow-ups that act on what a user committed to in a conversation.
- Our own models for cost and latency. Fine-tune or distill smaller models that match large API models on our tasks, and prove it on our evaluations before they ship.
Across all of these, you'll build the evaluation sets that tell us whether a change helped, and you'll keep tracking quality, latency and cost after launch. You'll start with one or two of these areas, chosen around your strengths and the product's needs, and take on more through the first year.
What end to end means here
- Define the problem with a metric and a baseline.
- Build or collect the data, within our privacy rules on what data a model may use.
- Train, fine-tune or choose the model, and run the experiments.
- Prove the change on an evaluation set we trust, including its cost and latency.
- Ship it into the product with the backend and app engineers.
- Watch it in production and fix what real users find.
Your first 90 days
- Own one live problem, such as speaker identity or memory accuracy, with a written baseline and an evaluation set the team trusts.
- Ship at least one measured improvement to production, with before and after numbers for quality, latency and cost.
- Write a plan, with its data needs, for one place where our own model should replace an API call.
What we're looking for
- Experience. 4 to 6 years of industry experience building ML systems, with a core ML foundation. You have trained, fine-tuned and evaluated models yourself, and you can explain why a model fails.
- GenAI depth. About 2 years of hands-on work with transformers and generative AI. That could be fine-tuning language or speech models, building agents, voice AI, retrieval systems or similar work.
- Shipped work. At least one model you took into a live product and owned after launch: the data, training, evaluation, serving and the fixes once users found the edge cases.
- Ownership. You have taken a loosely defined problem, broken it down yourself and carried it into production.
- Fundamentals. Solid probability, linear algebra and optimization. You can read a paper, implement it and tell us whether it helped on our data.
- Engineering. Strong Python and PyTorch, and enough backend skill to put a model behind a service and debug it in production.
- Education. A B.Tech, M.Tech, MS or dual degree from an IIT, NIT, BITS or IIIT Hyderabad. If you studied elsewhere and have exceptional public work, such as widely used open-source projects, apply and show us.
- Clear writing. You can explain a trade-off to an engineer, a product manager and a founder.
Nice to have
- Speech work: speech recognition, diarization, speaker verification or voice activity detection.
- Experience leading a project or a small team.
- Distillation, quantization, or serving models under tight latency and cost budgets.
- Work with multilingual or code-mixed language data.
- Papers or open-source work in speech, retrieval, long-term memory or agents.
How we work
- On-site in Bengaluru. Device, app and AI engineers sit together, and many bugs need a real Neo and a real phone to reproduce.
- We decide with evaluations and numbers. A change ships when it beats the baseline on quality without breaking our cost and latency budgets.
- We use AI coding tools every day, and we expect you to as well.
What we offer
- Competitive salary and ESOPs.
- Ownership of problems that decide whether the product works for its users.
- Unsolved problems in ambient speech and long-term memory, with room to train our own models.
- Direct work with the CTO.
Requirements
Must haves:
- 4 to 6 years of experience with a core ML background. They should have trained, fine-tuned and evaluated models themselves
- About 1-2 years of hands-on GenAI work: fine-tuning LLMs or speech models, agents, voice AI or retrieval
- At least one model they took to production and owned after launch
- B.Tech, M.Tech or MS from an IIT, NIT, BITS or IIIT Hyderabad. Share someone from elsewhere only if their open-source work is exceptional and tell us why
- Bengaluru, on-site
It's a hands on IC role. Past lead experience is a plus.
Please avoid:
- PhDs, they'll be too senior for this role
- Backend engineers who have only called LLM APIs or built prompt wrappers
- Research profiles with nothing in production
Strong Senior AI Engineer Profile with production-grade LLM and Python expertise
2
Mandatory (Experience 1): Must have at least 3+ years of professional AI/ML engineering experience with demonstrated track record of delivering production-grade AI systems in real-world environments
3
Mandatory (Tech skill 1): Must have strong programming skills in Python and SQL, with hands-on ML/data libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow), plus REST API design
4
Mandatory (Experience 2): Must have hands-on experience building and deploying production-grade ML/LLMs including RAG pipelines, document parsing, information extraction, and text processing on large-scale unstructured data (preprocessing, chunking, embeddings, feature engineering)
5
Mandatory (Tech skill 2): Must have strong NLP / extraction-focused ML depth — transformers, embeddings, vector databases, RAG, LLM integrations, and agentic workflows.
6
Mandatory (Tech skill 3): Must have hands-on experience with AWS (SageMaker, Bedrock, EC2, Lambda) and Azure (AI Foundry, Azure OpenAI) for model training, fine-tuning, deployment, and inference at scale
7
Mandatory (Tech skill 4): Must have experience with multi-agentic frameworks / orchestration tools (Claude Code, LangGraph, LangChain, CrewAI)
8
Mandatory (Tech skill 5): Must have hands-on experience with MLOps ecosystem including experiment tracking (MLflow, Weights & Biases), model versioning/registry, automated retraining, and CI/CD (GitHub Actions, Azure DevOps, Docker, Kubernetes)
9
Mandatory (Tech skill 6): Must have experience with evaluation frameworks (precision, recall, F1, field-level accuracy) and iterative model improvement, plus AI observability (Prometheus, Grafana, SLOs).
10
Mandatory (Team Leadership): Must have experience leading projects or teams, managing technical deliverables, and mentoring, with strong problem-solving in ambiguous challenges
11
Mandatory (Education) - B.Tech or B.E. If graduated in BCA or BCS, they should have a Maters or Post graduation
12
Mandatory (Company): B2B Tech/Consulting/B2B Software









