AI Engineer at Bitscale · Gurugram · 1 - 3 years · ₹10L - ₹20L / yr (ESOP available) · Posted 19 Nov 2026

Software Engineer - AI (Early Career)
At Bitscale, we're a tight-knit, ambitious team of IIT Kanpur grads building a signal-first GTM automation platform that makes SDRs and growth teams 10x more effective.
We've spent years at places like JP Morgan, HSBC, Nanonets, and CityMall, and now we're building the next big thing from the ground up - with real customers, real data, and real scale.
Bitscale has grown 10x in the last few months and is one of the fastest-growing startups out of India building for the world.
We're now building out a serious AI roadmap - agents that reason over data, browse the web, and automate entire GTM workflows end to end. We want people who are obsessed with AI to help us build it.
What are we looking for?
- Fresh grad or 2 - 3 years of experience - what you've built matters more than years on a resume
- You've shipped something with AI: an agent, an LLM-powered app, a fine-tuned model, anything real
- Comfortable with Python or Go (or hungry to pick them up fast)
- You ship things. You take ownership. You don't wait to be told what to do.
- Genuinely excited about how AI is changing the way B2B teams work.
What will you do?
- Build AI agent pipelines and LLM-powered workflows that run at scale
- Work on backend systems in Python/Golang that process high volumes of data
- Integrate with LLM providers, build prompt systems, and make agents reliable in production
- Ship features that go live within days, used by hundreds of GTM teams globally
- Work directly with the founders - product, architecture, roadmap decisions included
Tech Stack:
Python, Golang, LLMs/AI APIs, Postgres, AWS - must have comfort in at least some of these. We care more about how you think than whether you've used every tool.
Good to Have:
- Prior startup or project experience
- Built something with AI outside of coursework
- Interest in system design and how things scale
Location:
Gurgaon (in-office)
What's in it for you?
- Work directly with founders on product and tech
- Real ownership from day one - not tickets at the bottom of a backlog
- Build at the cutting edge of AI in real GTM workflows
- Attractive compensation + ESOPs
- See your work used by fast-growing B2B companies within weeks of shipping it

About Bitscale
About
Similar jobs (10)
About LeadSquared
LeadSquared is a leading sales execution and marketing automation platform trusted by 2,000+ businesses globally, including healthcare, education, financial services, and real estate. Headquartered in Bengaluru with offices across the US, UK, UAE, and Southeast Asia, we empower sales teams to close faster, smarter, and at scale.
Our AI team is at the forefront of integrating cutting-edge large language model capabilities into enterprise workflows — building intelligent agents, copilots, and automation systems that redefine how businesses operate.
Role Overview
We are looking for a Senior AI Engineer with hands-on experience building LLM-powered agents and agentic AI systems. You will design, develop, and deploy autonomous AI pipelines that solve complex, multi-step business problems — from lead qualification and follow-up automation to intelligent CRM workflows and beyond.
This role is ideal for someone who is deeply excited about the frontier of AI, can move fast, and wants their work to directly impact millions of sales professionals worldwide.
Key Responsibilities
•
Design and build LLM-powered agentic systems using frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI to automate complex, multi-step workflows.
•
Develop and maintain Retrieval-Augmented Generation (RAG) pipelines with vector databases (Pinecone, Weaviate, Chroma, pgvector) for domain-specific knowledge grounding.
•
Build and integrate tool-use and function-calling capabilities into AI agents, enabling dynamic interaction with internal APIs, databases, and third-party services.
•
Implement prompt engineering strategies including chain-of-thought, few-shot prompting, and structured output parsing to ensure reliable agent behavior.
•
Design evaluation frameworks and observability pipelines (LangSmith, Helicone, custom metrics) to monitor agent performance, accuracy, and cost.
•
Collaborate with product, sales, and domain teams to translate business requirements into AI-driven solutions and features.
•
Optimize LLM inference for latency and cost using techniques like caching, model distillation, quantization, and batching.
•
Stay current with the rapidly evolving LLM ecosystem and proactively propose improvements and new approaches.
•
Contribute to internal best practices, documentation, and knowledge-sharing across the engineering org.
Required Qualifications
Experience
•
2–4 years of professional software engineering experience, with at least 1–2 years focused on LLM/AI systems.
•
Proven experience shipping LLM-based products or agentic AI systems into production environments.
Technical Skills
•
Strong proficiency in Python and familiarity with async programming patterns for AI pipelines.
•
Hands-on experience with LLM APIs: OpenAI (GPT-4o), Anthropic (Claude), Google (Gemini), or open-source models (Llama, Mistral).
•
Experience with agentic frameworks: LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, or similar.
•
Solid understanding of RAG architectures, embedding models, and semantic search.
•
Experience with vector databases and similarity search infrastructure.
•
Knowledge of REST APIs, microservices architecture, and containerization (Docker/Kubernetes).
Problem-Solving & Mindset
•
Strong ability to decompose ambiguous, open-ended problems into structured AI system designs.
•
Experience with prompt debugging, LLM evaluation, and iterative refinement workflows.
•
Ability to balance research exploration with engineering pragmatism to ship reliable systems.
Preferred Qualifications
•
Experience with multi-agent orchestration and agent memory systems (short-term and long-term).
•
Familiarity with fine-tuning or RLHF workflows for domain adaptation.
•
Background in NLP, information retrieval, or conversational AI.
•
Prior experience in B2B SaaS or CRM domain is a plus.
•
Contributions to open-source AI/ML projects or published research/blogs.
•
Experience with cloud platforms: AWS, GCP, or Azure — particularly AI/ML services
Role Overview
We are looking for an experienced AI/ML Engineer with strong expertise in Python, Generative AI, LLMs, LangChain, and LangGraph. The candidate will be responsible for designing and developing AI-powered applications, intelligent agents, and scalable LLM-based solutions.
Key Responsibilities
- Design and develop AI/ML and Generative AI applications using Python and modern LLM technologies.
- Build LLM-based applications and AI agents using LangChain and LangGraph.
- Develop agentic workflows involving tool calling, memory, reasoning, and multi-step orchestration.
- Integrate LLMs such as OpenAI, Azure OpenAI, Anthropic, Gemini, or other foundation models.
- Develop RAG (Retrieval-Augmented Generation) pipelines using vector databases.
- Work with embeddings, prompt engineering, semantic search, and document processing.
- Develop scalable APIs and backend services using Python, FastAPI, or Flask.
- Build and integrate AI solutions with existing applications and enterprise systems.
- Deploy and maintain AI/ML solutions on cloud platforms.
- Collaborate with data scientists, software engineers, and product teams to develop business-focused AI solutions.
Required Skills
- Strong hands-on experience in Python programming.
- Strong experience in AI/ML and Generative AI.
- Hands-on experience with LLMs and LLM-based application development.
- Strong experience with LangChain and/or LangGraph.
- Experience building AI Agents / Agentic AI workflows.
- Strong understanding of RAG, embeddings, vector databases, and prompt engineering.
- Experience with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
- Experience developing REST APIs using FastAPI/Flask.
- Good understanding of Machine Learning, NLP, and deep learning concepts.
- Experience with Azure / AWS / GCP cloud platforms.
Good to Have
- Experience with multi-agent systems and agent orchestration.
- Knowledge of MLOps / LLMOps.
- Experience with Docker, Kubernetes, and CI/CD.
- Knowledge of LLM evaluation, monitoring, observability, and AI governance.
- Experience with Azure OpenAI, Azure AI Foundry, or AWS Bedrock.
Product Engineer — Role Summary
We are looking for a Product Engineer to build user-facing products that combine AI capabilities with practical applications. You will work at the intersection of software engineering and AI, developing autonomous, agent-driven systems that solve complex educational and research problems.
Key Responsibilities:
- Product Development: Design, build, and deploy production-ready applications powered by LLMs and AI agents.
- Data Engineering: Build scalable ETL/ELT pipelines to process structured and unstructured data, including text and audio, for RAG and model fine-tuning.
- Agentic Workflows: Develop multi-step AI agents with tool calling, APIs, databases, search, reasoning, and memory.
- Rapid Prototyping: Turn ideas and research concepts into interactive, production-ready applications.
- AI Integration: Use frameworks such as LangChain, LlamaIndex, AutoGen, or custom orchestrators to integrate AI into scalable systems.
- User Experience: Transform raw AI outputs into reliable, intuitive, and responsive user experiences.
- Collaboration: Work closely with ML researchers and data engineers to integrate custom and fine-tuned models.
- Observability: Monitor agent behavior, manage edge cases, reduce hallucinations, and improve reliability in production.
The ideal candidate combines strong software engineering, AI/LLM expertise, data engineering, and product thinking, with the ability to take an AI concept from prototype to production.
About Asha Health
Asha Health helps medical practices launch their own AI clinics. We're backed by Y Combinator, General Catalyst, 186 Ventures, Reach Capital and many more. We recently raised an oversubscribed seed round from some of the best investors in Silicon Valley. Our team includes AI product leaders from companies like Google, physician executives from major health systems, and more.
About the Role
We're looking for a top 0.01% Software Engineer to join our engineering team in our Bangalore office.
4.6 fundamentally changed the game, which means that high intelligence, high agency engineers can now do the work of 10+ good engineers. It doesn't make sense to have anyone but the best on the team.
Since low level coding has become easier, what we expect from engineers on our team has expanded. Engineers on our team are expected to:
- Ship features end to end at a rapid pace
- Deeply research the domain and be their own product managers
- Ensure reliability and quality is best-in-class
- Design robust eng architecture, and develop testing and observability tools for each feature pre-launch
- Build each feature with deep customer empathy, meaning planning out and building stellar UX yourself
This means to thrive in a startup environment like ours, you not only need to be a stellar engineer, but you need to:
- Be super adept with AI development tools and building the AI systems that build your features for you (Conductor, Browser agents, QA agents, Ralph loops, adverserial agents, and more).
- Have exceptional product and UX taste, meaning you can ship features that are more effective than those historically designed by teams of product managers and designers.
- Take the highest level of ownership around feature outcomes, reliability, and observability.
Other Points to Note
- We are growing rapidly, our work has impact on tens of thousands of patients if not more.
- On our team, everything you do is on the bleeding edge of applied AI.
- We expect a high level of commitment from everyone on the team, most folks work 6 days and lead every project with intensity. It's a high ask, and we only bring on the best people. We compensate significantly above market, accordingly.
Dear Candidate,
Thanks for showing interest towards the opportunity!!!
As discussed, we have an immediate opening for Python + Agentic AI Developer with Mphasis for Bangalore location.
Experience: 4 Years
Mandatory Skills: Python, Agentic AI, Generative AI (GenAI), LLMs, AI Agents.
Kindly share your updated resume and availability for the opportunity.
About the role
We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.
Responsibilities
- Build and iterate on prompt pipelines and multi-agent workflow components
- Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
- Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
- Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
- Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
- Debug and maintain pipeline stages in production
What you bring:
- (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
- Solid Python fundamentals clean, working, readable code
- Hands-on experience with LLM APIs and prompt engineering (personal projects count)
- Comfort with Git, REST APIs, and working in a Linux environment
- A feel for content and narrative you can judge whether generated output is actually good, not just valid
- Curiosity and clear communication you ask good questions and don't stay stuck silently
Preferred
- Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
- Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
- Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
- Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
- Experience writing evals or LLM-as-judge scoring
- Node.js and Fastapi familiarity, or experience deploying on AWS
About the role
We are seeking an AI Engineer to build and implement AI systems for content production at scale. You'll work at the intersection of engineering and content designing prompt pipelines, integrating generative models, and building the tooling that turns source material into finished creative output. The ideal candidate is technically strong but also has taste: someone who understands story and craft, and can tell the difference between output that's technically correct and output that's actually good.
Responsibilities
- Build and iterate on prompt pipelines and multi-agent workflow components
- Design and integrate agentic workflows orchestrate multi-step, tool-using agents that plan, call models, and hand off between stages in production
- Deploy and serve open-source models set up inference endpoints, manage GPU compute, and optimize for latency and cost
- Write evals compare outputs against references, quantify quality, and feed results back into the pipeline
- Work on data pipelines: structured extraction from messy source text, localization, similarity/dedup
- Debug and maintain pipeline stages in production
What you bring:
- (1+/3+) years of engineering experience, or a strong portfolio of shipped projects
- Solid Python fundamentals clean, working, readable code
- Hands-on experience with LLM APIs and prompt engineering (personal projects count)
- Comfort with Git, REST APIs, and working in a Linux environment
- A feel for content and narrative you can judge whether generated output is actually good, not just valid
- Curiosity and clear communication you ask good questions and don't stay stuck silently
Preferred
- Exposure to agent/orchestration frameworks (LangGraph, LangChain, CrewAI)
- Familiarity with vector databases, embeddings, or RAG (Qdrant, pgvector)
- Hands-on work with open-source generative media models Flux, LTX, Wan, or similar
- Experience deploying open-source models for inference (vLLM, ComfyUI, Replicate/Cog, Docker + GPU)
- Experience writing evals or LLM-as-judge scoring
- Node.js and Fastapi familiarity, or experience deploying on AWS
Design and develop Agentic AI systems using LLMs, tools, memory,
workflows, and MCP.
Build production-grade RAG pipelines, including ingestion, chunking,
embeddings, retrieval, reranking, and evaluation.
Implement context engineering strategies for improving LLM accuracy,
relevance, and reliability.
Develop and integrate MCP-based tools and services for AI agents.
Work with LLMs, SLMs, quantized models, and model optimization
techniques for efficient inference.
Develop scalable backend services and APIs for AI applications.
Design databases and data models supporting AI/agentic applications.
Implement AI observability covering latency, token usage, cost, failures,
quality, and agent/tool execution.
Apply AI governance and responsible AI practices, including security,
access control, data privacy, and auditability.
Optimize AI systems for latency, scalability, cost, and reliability.
Collaborate with engineering and product teams to take AI solutions from
POC to production.
Strong hands-on experience with GenAI, LLMs, and Agentic AI.
Experience building RAG applications.
Strong understanding of Context Engineering and prompt/context
optimization.
Role Overview
We are looking for a hands-on AI/ML Engineer to design, develop, and deploy
production-ready GenAI and Agentic AI applications. The role involves building
intelligent agents, RAG pipelines, AI APIs, backend services, and scalable AI
infrastructure with a strong focus on context engineering, observability,
governance, and model optimisation.
Key Responsibilities
Required Skills
Practical experience with MCP (Model Context Protocol).
Experience with frameworks such as LangChain, LangGraph,
LlamaIndex, or equivalent.
Knowledge of LLM/SLM deployment and quantization techniques.
Strong Python backend development experience.
Experience developing REST APIs using FastAPI/Flask or equivalent.
Strong understanding of SQL/NoSQL databases and database design.
Experience with vector databases such as Qdrant, Pinecone, Weaviate,
ChromaDB, or FAISS.
Understanding of AI observability, evaluation, monitoring, and
governance.
Experience with cloud platforms and production deployment is preferred.
Strong understanding of software engineering principles, Git, testing, and
CI/CD.
5-8 years building production software, with .NET (C#, ASP.NET Core) as your primary stack. Python you have shipped and maintained — services, pipelines or AI components other people depend on, not occasional scripting. Hands-on work with LLMs in production: retrieval-augmented generation, prompt and agent design, and a clear account of how you evaluated whether it worked. Comfortable across SQL, REST and asynchronous integration patterns, on Azure or AWS, with CI/CD, containers and infrastructure as code. deliered inside a regulated environment: code review, change control, a real audit trail. Based in, or able to relocate to, Bengaluru or Mumbai for the engagement
Key Skills:
• Agentic AI / AI Agents
• Python or Java
• LLMs & Generative AI
• RAG & Vector Databases
• LangChain / LangGraph / AutoGen / CrewAI
• REST APIs & Microservices
• Prompt Engineering
• AI Workflow Automation
Roles & Responsibilities:
• Design and develop AI agents and agentic workflows
• Build scalable backend services using Python or Java
• Integrate LLMs, APIs, tools, and external systems into AI workflows
• Develop RAG-based solutions and intelligent automation
• Design multi-step AI workflows with tool/function calling
• Evaluate, monitor, and optimize AI agent performance
• Collaborate with engineering and product teams to deliver production-ready AI solutions












