Cutshort logo
Terrabase logo
Senior Software Engineer, AI Agents & Evals
Senior Software Engineer, AI Agents & Evals
Terrabase's logo

Senior Software Engineer, AI Agents & Evals

Jainit Purohit's profile picture
Posted by Jainit Purohit
3 - 15 yrs
₹20L - ₹50L / yr
Remote only
Skills
skill iconPython
Large Language Models (LLM)
AI Agents
Performance Evaluation
Generative AI
Agentic AI
LangGraph

Experience: 5+ years production software engineering, with 2+ years working directly on LLM or agent systems in production. 

Location: Remote 

To streamline and fast-track screening, please submit your details here (if you haven’t already): https://airtable.com/appbtkr4odapnb5I6/pagqo91lKv3VJg3GT/form 


We’ll review your responses as part of the initial screening process. Please make sure you complete and submit all details through the form to be considered for the next stage. Submissions outside the form may not be considered.


Why This Role Matters

Terrabase builds agent infrastructure that enterprise customers rely on daily for SQL generation, forecasting, data analysis, and artifact delivery. Our orchestration layer routes between specialized sub-agents, manages typed handoff contracts, runs structured eval suites, and enforces correctness across every turn.


This is not a research-prototype role. You will build and evolve agent architecture, but always in service of making the system observable, typed, evaluated, recoverable, and boringly reliable in production.



What You Will Do


Own the harness architecture and middleware stack. Our LangGraph orchestrator routes between sub-agents through a layered middleware stack: file upload handling, source resolution, local context, workspace sync, state hydration, aggregation barriers, and typed handoff contracts. You will extend this stack, enforce its contracts in code, and keep it operational as routing logic and agent surfaces evolve.


Maintain typed contracts and boundaries. Agent handoffs at Terrabase carry typed contracts with barrier conditions and retry predicates. You will design these contracts, enforce them with strict typing, manage backward compatibility when contracts change, and write the contract tests that prevent silent regressions.


Own the eval suites. We run structured eval suites across routing decisions, context-resolution accuracy, multi-turn coherence, visual reference alignment, and artifact correctness. You will extend coverage, write new evals where gaps exist, and build CI gates that block releases when regressions are detected. A routing change or prompt change with no eval coverage does not ship.


Triage production failures and close the loop. When an agent turn fails in production, you will trace it in LangSmith, identify the failure class, and convert it into a durable regression test. You will own the release gates, keep prompts and runtime contracts in sync, manage feature flag rollout risk, and remove dead paths as the system evolves.


Own SQL and artifact correctness. Our agents generate SQL over customer schemas and produce structured artifacts (reports, dashboards, data sheets) under a strict schema contract. You will own the correctness layer: source grounding, schema-aware validation, provenance surfaces, and the eval infrastructure that catches generated artifact failures before they reach customers.


Build and maintain HITL workflows. Human-in-the-loop checkpoints let users intervene, redirect, or approve mid-chain. You will design these workflows, enforce their resumable state contracts, and ensure they degrade gracefully when interrupted.


Instrument for traceability. You will extend LangSmith tracing coverage, add structured span annotations, and build the tooling that lets us diagnose a bad agent turn from production trace data alone, without requiring a local reproduction.


What We Are Looking For


  • 5+ years production software engineering, with strong Python fundamentals
  • 2+ years working hands-on with LLM-based systems: agent loops, tool use, context management, or inference pipelines
  • Experience with LangGraph, LangChain, OpenAI/Anthropic tool-use systems, or equivalent multi-step agent/runtime orchestration
  • Practical eval engineering: you have built or extended eval harnesses, written automated test cases for agent behavior, and treated evaluation as an ongoing engineering discipline
  • Strong engineering hygiene: strict typing, small interfaces, contract tests, clear schema migrations, and CI discipline
  • Ability to debug from production traces and artifacts, not only local reproductions
  • Comfort working across prompts, Python runtime code, TypeScript product surfaces, data systems, and eval infrastructure
  • Systems thinking: you design for observability, recovery, and state management, not just the happy path
  • Maintenance ownership mindset: you triage, close loops, and leave systems more debuggable than you found them
  • Pragmatic judgment: you can distinguish between reliability-critical infrastructure and speculative abstraction

Bonus Points

  • HITL workflow design: checkpoints, approvals, mid-chain interrupts, resumable state
  • Context engineering depth: chunking strategies, retrieval-augmented generation, semantic routing, re-ranking
  • Experience with LangSmith, Weights and Biases, or similar trace and evaluation platforms
  • Prior work shipping agent systems to enterprise customers where SQL or data correctness is a hard requirement
  • Experience with mypy, Pydantic contracts, or strict typing disciplines in a production Python codebase


Life at Terrabase

We are a sharp, focused, fully remote team building agent infrastructure that enterprise customers trust with their data. You will work directly alongside the engineer who designed this harness, with broad ownership, generous compute budgets, and a culture that treats reliability as a product requirement, not a research topic.


Terrabase is an equal-opportunity employer. We celebrate diversity and are committed to building an inclusive environment for every team member.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Terrabase

Founded :
2025
Type :
Products & Services
Size :
0-20
Stage :
Bootstrapped

About

Terrabase connects to the systems where your business knowledge already lives, turns it into governed primitives and reusable skills, and lets your teams execute long-horizon analytical workflows with human review and auditability built in.
Read more

Company social profiles

N/A

Similar jobs

Euphoric Thought Technologies
Noida
3 - 5 yrs
₹8L - ₹13L / yr
skill iconPython
Microsoft Windows Azure

Company Overview:


Euphoric Thought Technologies is a technology-driven firm specializing in building scalable digital solutions and enterprise-grade software applications. Operating at the intersection of cloud computing and data-driven development, the company serves a diverse portfolio of clients across the fintech, e-commerce, and logistics sectors. With a focus on engineering excellence and agile delivery, Euphoric Thought Technologies fosters a collaborative environment where developers are encouraged to solve complex architectural challenges and drive innovation in a fast-paced, high-growth landscape.


Role Overview:


As a Python Developer specializing in Azure, you will be responsible for designing, developing, and deploying robust backend services that power our core business applications. You will work closely with cross-functional teams, including product managers and cloud architects, to translate business requirements into high-performance technical solutions. Your work will directly influence the scalability and reliability of our platforms, ensuring seamless integration between our Python-based services and Azure cloud infrastructure to provide an optimal experience for our end users.


Key Responsibilities:


- Architect and maintain scalable backend services using Python to ensure high availability for enterprise applications.


- Develop and optimize RESTful APIs using Django and Flask frameworks to facilitate efficient data exchange between front-end systems and cloud databases.


- Implement and manage cloud-native solutions on Azure, including App Services, Functions, and SQL databases, to enhance system performance and reduce latency.


- Collaborate with the DevOps team to automate deployment pipelines and integrate CI/CD workflows, ensuring rapid and error-free software releases.


- Troubleshoot and resolve complex production issues by performing root cause analysis to maintain system integrity and minimize downtime for stakeholders.


- Mentor junior developers by conducting code reviews and promoting best practices in clean, maintainable, and secure coding standards.


Required Skillset:


- Demonstrated expertise in building production-grade applications using Python, with a deep understanding of Django and Flask frameworks.


- Proven ability to design, deploy, and manage cloud infrastructure on Microsoft Azure, including familiarity with Azure DevOps and cloud security protocols.


- Strong proficiency in database management and optimization, specifically with SQL and NoSQL databases integrated within cloud environments.


- Excellent analytical and problem-solving skills, with the ability to communicate complex technical concepts to non-technical stakeholders effectively.


- A collaborative mindset with the ability to thrive in a hybrid work environment based in Noida/Greater Noida, contributing to team goals through proactive communication.


- A Bachelor’s degree in Computer Science, Information Technology, or a related field, supported by 3 to 5 years of hands-on experience in backend development and cloud integration.

Read more
Vigorus AI Private Limited
at Vigorus AI Private Limited
1 candid answer
Pranali Nawale
Posted by Pranali Nawale
Pune
5 - 7 yrs
₹7L - ₹9L / yr
skill iconDjango
skill iconFlask
skill iconPython
RESTful APIs
Project Management

Key Responsibilities

1. Full Stack Development • Design, develop, and maintain scalable web applications using Python and Django. • Build and maintain REST APIs using Django REST Framework. • Work on backend architecture, business logic, database schema, and API integrations. • Integrate frontend applications with backend APIs and ensure smooth end-to-end functionality. • Write clean, reusable, testable, and maintainable code. • Optimize application performance, database queries, API response time, and server-side logic. • Debug and resolve production and staging issues in a structured manner. • Review code written by team members and enforce coding standards. • Prepare and maintain technical documentation, API documentation, and deployment notes. • Participate in architecture decisions and suggest scalable technical solutions. Senior Full Stack Django Developer cum Project Manager JD | Hinjawadi, Pune

2. Project Management and Delivery • Understand client and internal product requirements and convert them into actionable technical tasks. • Prepare project plans, sprint plans, milestones, and delivery timelines. • Assign tasks to developers, QA, UI/UX, and support team members based on priorities. • Track daily progress, remove blockers, and ensure timely completion of planned work. • Conduct daily stand-ups, sprint reviews, release planning, and internal status meetings. • Coordinate between product, development, QA, implementation, support, and management teams. • Identify delivery risks early and take corrective action before timelines are impacted. • Ensure proper UAT support, bug tracking, release notes, and production deployment coordination. • Maintain task boards and project documentation using Jira, ClickUp, Trello, Asana, or similar tools.

3. Team Leadership • Lead and manage a team of approximately 8 members, including developers, testers, and other technical contributors. • Mentor junior and mid-level developers on technical implementation and best practices. • Ensure task ownership, accountability, and disciplined execution within the team. • Conduct code reviews and guide the team on better architecture, security, and performance practices. • Help team members resolve technical blockers and improve delivery quality. • Support onboarding and training of new developers when required. • Build a positive, structured, and performance-driven engineering culture.

4. Client Communication and Product Demos • Handle client calls, requirement discussions, project update meetings, and product walkthroughs. • Conduct confident and professional client demos for developed modules and product features. • Explain technical and product workflows to clients in simple business language. • Collect client feedback and convert it into clear development tasks. • Coordinate with clients during UAT, go-live, training, and post-deployment support. • Communicate timelines, dependencies, risks, and progress updates clearly. • Build trust with clients by ensuring structured communication and timely delivery.

Read more
Unstudio AI
Ayush Dubey
Posted by Ayush Dubey
Gurugram
2 - 5 yrs
₹12L - ₹18L / yr
skill iconNodeJS (Node.js)
skill iconPython
skill iconAmazon Web Services (AWS)
skill iconPostgreSQL
DevOps
+1 more

We are looking for a skilled Backend Developer with strong experience in building, scaling, and optimizing server-side systems. The ideal candidate is proficient in Node.js, FastAPI (Python), and database design, with hands-on experience in cloud infrastructure on AWS or GCP.


Responsibilities:


Design, develop, and maintain scalable backend services and APIs using Node.js and FastAPI


Build robust data models and optimize performance for SQL and NoSQL databases


Architect and deploy backend services on GCP/AWS, leveraging managed cloud services. 


Implement clean, modular, and testable code with proper CI/CD and observability (logs, metrics, alerts)


Ensure system reliability, security, and high availability for production environments


Requirements:


2–5 years of backend development experience


Strong proficiency in Node.js, FastAPI, REST APIs, and microservice architecture


Solid understanding of PostgreSQL/MySQL, MongoDB/Redis or similar NoSQL systems


Hands-on experience with AWS or GCP, Docker, and modern DevOps workflows


Experience with caching, queueing, authentication, and API performance optimization


Good to Have:


Experience with event-driven architecture, WebSockets, or serverless functions


Familiarity with Kubernetes or Terraform



Job Location: Gurugram, Haryana, India

Industry: Artificial Intelligence

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Bengaluru (Bangalore)
5 - 11 yrs
Best in industry
skill iconPython
snowflake
SQL

 

● 5+ years of experience as a Data engineer or related role.

● 5+ years of experience in application development using Python

● Strong experience with SQL and good to have NoSQL.

● Experience with Agile engineering practices.

● Preferred experience in writing queries for RDBMS, cloud-based data warehousing solutions like

Snowflake.

● Ability to work independently or as part of a team.

● Experience with cloud platforms, preferably AWS, is good to have

● Experience with ETL/LT tools and methodologies.

● Experience working on real-time Data Streaming and Data Streaming platforms

Read more
Well established B2C mobile app to control subscriptions
Well established B2C mobile app to control subscriptions
Agency job
via The Hub by Sridevi Viswanathan
Bengaluru (Bangalore)
3 - 6 yrs
₹7L - ₹14L / yr
skill iconPython
skill iconDjango

Our client has a B2C startup in the Fintech space building the payment system for the

subscription economy. We have raised pre-seed funding from some of the leading

investors in the country. A small brief about their product - To build the payment

system for the subscription economy and make it easier to discover and manage

subscription payments in India and abroad. To give subscription merchants the

power to increase their offering by providing user subscription data, multiple login

authentication, distribution and one click subscription checkouts. To enable users to

participate in the subscription economy & increase adoption of new subscriptions.

The core team come from strong backgrounds having been alumni of IIT Madras,

IIM Calcutta as well as having worked with some of the top startups in the

ecosystem including Swiggy, Mckinsey, Barclays, etc..

What we're looking for

We are looking for an experienced Python developer to join our engineering team

and help us develop our mobile application. In this role, you will be responsible for

writing and testing scalable code, developing back-end components, and integrating

user-facing elements in collaboration with front-end developers.

To be successful as a Python developer, you should possess in-depth knowledge of

object-relational mapping, experience with server-side logic, and above-average

knowledge of Python programming.

As one of the earliest members in engineering, you will have the flexibility to design

the application and systems from ground up. As any early-stage start-up, we expect

you to be comfortable wearing various hats, and be proactive contributor in building

something truly remarkable.

Responsibilities

Coordinating with development teams to determine application requirements.Python Backend Developer

2

Writing scalable code using Python programming language.

Developing back-end components.

Implement business logic in the backend

Integrating user-facing elements using server-side logic.

Create restful APIs for a seamless integration with our mobile front end

Testing and debugging applications.

Assessing and prioritizing client feature requests.

Integrating data storage solutions.

Coordinating with front-end developers.

Reprogramming existing databases to improve functionality.

Developing digital tools to monitor online traffic.

Qualifications

4+ years of experience in Python, Django, Mongo, Express, MySQL, etc

Have built applications capable of serving high volume with low latency in

production

Following practices of agile development with continuous integration/deployment

A deep understanding and multi-process architecture and the threading

limitations of Python.

Experience in deploying applications in AWS cloud

Ability to collaborate on projects and work independently when required.

Knowledge in building applications for Fintech/payments domain is a bonus

Bachelor's or Master's degree in CS or equivalent from a reputed institution

Read more
Emipro Technologies
at Emipro Technologies
2 recruiters
Urvish Dave
Posted by Urvish Dave
Rajkot
2 - 8 yrs
₹3L - ₹7L / yr
Odoo (OpenERP)
skill iconPython
skill iconDjango
skill iconJavascript
skill iconHTML/CSS
+2 more

Summary

We are looking for an efficient technocrat as Odoo Developer, who will be responsible for developing, customizing Odoo ERP business applications with other systems, and providing ongoing support and future enrichments of those solutions to support business processes and functions. You'll be required to apply your hands-on experience of Odoo Framework, programming knowledge, and expertise to all aspects of the Software Development Lifecycle including Programming, Coding, Application Development, bug fixing, production support, version control system, object-oriented programming, Linux/Unix, UAT, Debugging, Tracing, and Logging, GIT, Cloud Services, Internet Technologies and leverage best technical solution by understanding business requirements from a techno-functional aspect, and partner continuously with Emipro's stakeholders daily to stay focused on common goals. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of Emipro's enterprise customers globally.

 

Job Responsibilities

  • Application development using Odoo Framework & its components.
  • Carrying out Odoo development activities for Customisations, Module Migration, Data Migration & Import, Generating BI Reports, Output Documents, Automation Test & Unit Test.
  • Work in coordination with Technical Lead as needed to implement, test, support, and enhance ERP Business applications and it's features/solutions.
  • Be part of Sprint meetings to discuss project development progress and also assist the ERP Technical Lead in preparing the Sprint report.
  • Make sure to follow the prescribed coding and development best practices to give high-quality output as per the requirement.
  • Adherence to the latest development methods like continuous deployment & integration.
  • Documents and demonstrates solutions by developing documentation, flowcharts, algorithms, data-flow diagrams, layouts, user-flow diagrams, charts, code comments, and keeping code clean and optimized.
  • Must possess a strong learning curve and should be willing to keep themselves abreast and continuously updating their job knowledge by studying state-of-the-art development tools, programming techniques for personal upscaling and in turn meeting organizational needs as well.
  • Developing technical documentation to guide future software development projects.

Required Skills

  • 1-2 years of hands-on experience in developing applications of Odoo.
  • Proficiency in Python and Odoo framework components - model, fields, modifiers, actions, views, menu, security, controllers.
  • Should be aware of core Odoo modules such as Sales, Purchase, Delivery, Accounting.
  • Should proactively look for ways to make the architecture, code, and operations better.
  • Must be a self-starter & be able to work with minimum supervision.
  • Hands-on experience in Linux/Unix development environments is expected.
  • Hands-on knowledge of version control systems like GIT, Bitbucket, etc including branching and merging.
 

Nice to have

  • Experience in writing SQL queries for PostgreSQL.
  • Nice to have experience in Module migration, code
  • Experienced with Scrum/Agile development methodologies
  • Outstanding written and verbal communication and interpersonal skills.
  • Sound knowledge of Internet technologies like SSH/SFTP/FTP,  Linux/UNIX shell scripting (eg. bash)
  • Understanding of Cloud services like SaaS (Software as a Service), PaaS (Platform as a Service) & IaaS(Infrastructure as a Service)
Read more
A edu-tech platform.
A edu-tech platform.
Agency job
via zyoin by Sowmya Rani
Bengaluru (Bangalore)
4 - 15 yrs
₹12L - ₹42L / yr
Data Structures
Algorithms
skill iconGo Programming (Golang)
skill iconPython
skill iconRuby on Rails (ROR)
+1 more
  • Understands detailed requirements and demonstrates excellent problem solving skills
  • Deep understanding of software engineering practices, Design Patterns, Data Structures, Algorithms
  • Excellent programming skills in ROR, Golang, NodeJS, Python or Java
  • Strong communication skills
  • Strong sense of ownership, drive and ability to deliver results
  • 2+ years of experience in product driven organization
Read more
RaiFox is a technology firm based out of  Bangalore.
RaiFox is a technology firm based out of Bangalore.
Agency job
via Gracira Technologies LLP by Sreeja Gummalla
HSR Layout, Bengaluru (Bangalore)
2 - 7 yrs
₹5L - ₹13L / yr
skill iconPython
skill iconDjango
skill iconHTML/CSS
skill iconGit
SVN
+2 more
Job Description We are looking for a Python Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well. Responsibilities Writing reusable, testable, and efficient code Design and implementation of low-latency, high-availability, and performant applications Integration of user-facing elements developed by front-end developers with server side logic Implementation of security and data protection Integration of data storage solutions (may include databases, key-value stores, blob stores, etc.) Skills And Qualifications Should be an Expert in Python and the Django Framework Knowledge of Any other Python Framework like Flask etc will be a bonus Familiarity with some ORM (Object Relational Mapper) libraries Able to integrate multiple data sources and databases into one system Understanding of the threading limitations of Python, and multi-process architecture Good understanding of server-side templating languages (such as Django Templating, Jinja 2, Mako, etc depending on your technology stack) Basic understanding of front-end technologies, such as JavaScript, HTML, and CSS Understanding of accessibility and security compliance Knowledge of user authentication and authorization between multiple systems, servers, and environments Understanding of fundamental design principles behind a scalable application Familiarity with event-driven programming in Python Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform Able to create database schemas that represent and support business processes Strong unit test and debugging skills Proficient understanding of code versioning tools (such as Git, Mercurial or SVN)
Read more
Kwantics
at Kwantics
1 recruiter
Anant Tripathi
Posted by Anant Tripathi
Noida, NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹5L - ₹7L / yr
skill iconPython
skill iconData Science
skill iconMachine Learning (ML)
1. The candidate will work on building RNN based speech recognition systems 2. The candidate will work on building NLP based solution suite for speech data analytics 3. Adhoc Python coding will be required on a regular basis to support the application and data science team.
Read more
Atyeti Inc
at Atyeti Inc
3 recruiters
Yash G
Posted by Yash G
Mumbai
5 - 12 yrs
₹10L - ₹30L / yr
skill iconJava
KDB
skill iconPython
Requirements: Must Have Skills • Strong Development experience in KDB/Q. • Good exposure to (OOPs), Core Java, Python, Data Structure, Algorithms • Good Exposure in Database (SQL and/or NOSQL). • Fairly good experience working within Unix/Linux environment. • Exposure to version control tools like Git, svn. • Experience with real time trading and technology systems. • Familiarity with algorithmic trading, Knowledge of equities, options, FX, or futures trading microstructure (tick data). • Exposure to dealing with large data sets, data quality controls, data validation. • Basic knowledge of data modeling Desirable Skills • Exposure to Cognos reporting. • Interest in Reporting and data analysis. • Experience in scripting languages. • Exposure to Big Data Technologies – Apache Storm, Kafka, Cassandra etc. • Front Office Investment banking experience. • Exposure to TDD and test Automation Education: BE / B. Tech / MCA Experience: 9 Years to 10 Years Work Timings: 11.30 am to 8.30 pm IST Job Location: Malad, Mumbai
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos