Cutshort logo
Terrabase logo
Senior Software Engineer, AI Agents & Evals
Senior Software Engineer, AI Agents & Evals
Terrabase's logo

Senior Software Engineer, AI Agents & Evals

Jainit Purohit's profile picture
Posted by Jainit Purohit
3 - 15 yrs
₹20L - ₹50L / yr
Remote only
Skills
skill iconPython
Large Language Models (LLM)
AI Agents
Performance Evaluation
Generative AI
Agentic AI
LangGraph

Experience: 5+ years production software engineering, with 2+ years working directly on LLM or agent systems in production. 

Location: Remote 

To streamline and fast-track screening, please submit your details here (if you haven’t already): https://airtable.com/appbtkr4odapnb5I6/pagqo91lKv3VJg3GT/form 


We’ll review your responses as part of the initial screening process. Please make sure you complete and submit all details through the form to be considered for the next stage. Submissions outside the form may not be considered.


Why This Role Matters

Terrabase builds agent infrastructure that enterprise customers rely on daily for SQL generation, forecasting, data analysis, and artifact delivery. Our orchestration layer routes between specialized sub-agents, manages typed handoff contracts, runs structured eval suites, and enforces correctness across every turn.


This is not a research-prototype role. You will build and evolve agent architecture, but always in service of making the system observable, typed, evaluated, recoverable, and boringly reliable in production.



What You Will Do


Own the harness architecture and middleware stack. Our LangGraph orchestrator routes between sub-agents through a layered middleware stack: file upload handling, source resolution, local context, workspace sync, state hydration, aggregation barriers, and typed handoff contracts. You will extend this stack, enforce its contracts in code, and keep it operational as routing logic and agent surfaces evolve.


Maintain typed contracts and boundaries. Agent handoffs at Terrabase carry typed contracts with barrier conditions and retry predicates. You will design these contracts, enforce them with strict typing, manage backward compatibility when contracts change, and write the contract tests that prevent silent regressions.


Own the eval suites. We run structured eval suites across routing decisions, context-resolution accuracy, multi-turn coherence, visual reference alignment, and artifact correctness. You will extend coverage, write new evals where gaps exist, and build CI gates that block releases when regressions are detected. A routing change or prompt change with no eval coverage does not ship.


Triage production failures and close the loop. When an agent turn fails in production, you will trace it in LangSmith, identify the failure class, and convert it into a durable regression test. You will own the release gates, keep prompts and runtime contracts in sync, manage feature flag rollout risk, and remove dead paths as the system evolves.


Own SQL and artifact correctness. Our agents generate SQL over customer schemas and produce structured artifacts (reports, dashboards, data sheets) under a strict schema contract. You will own the correctness layer: source grounding, schema-aware validation, provenance surfaces, and the eval infrastructure that catches generated artifact failures before they reach customers.


Build and maintain HITL workflows. Human-in-the-loop checkpoints let users intervene, redirect, or approve mid-chain. You will design these workflows, enforce their resumable state contracts, and ensure they degrade gracefully when interrupted.


Instrument for traceability. You will extend LangSmith tracing coverage, add structured span annotations, and build the tooling that lets us diagnose a bad agent turn from production trace data alone, without requiring a local reproduction.


What We Are Looking For


  • 5+ years production software engineering, with strong Python fundamentals
  • 2+ years working hands-on with LLM-based systems: agent loops, tool use, context management, or inference pipelines
  • Experience with LangGraph, LangChain, OpenAI/Anthropic tool-use systems, or equivalent multi-step agent/runtime orchestration
  • Practical eval engineering: you have built or extended eval harnesses, written automated test cases for agent behavior, and treated evaluation as an ongoing engineering discipline
  • Strong engineering hygiene: strict typing, small interfaces, contract tests, clear schema migrations, and CI discipline
  • Ability to debug from production traces and artifacts, not only local reproductions
  • Comfort working across prompts, Python runtime code, TypeScript product surfaces, data systems, and eval infrastructure
  • Systems thinking: you design for observability, recovery, and state management, not just the happy path
  • Maintenance ownership mindset: you triage, close loops, and leave systems more debuggable than you found them
  • Pragmatic judgment: you can distinguish between reliability-critical infrastructure and speculative abstraction

Bonus Points

  • HITL workflow design: checkpoints, approvals, mid-chain interrupts, resumable state
  • Context engineering depth: chunking strategies, retrieval-augmented generation, semantic routing, re-ranking
  • Experience with LangSmith, Weights and Biases, or similar trace and evaluation platforms
  • Prior work shipping agent systems to enterprise customers where SQL or data correctness is a hard requirement
  • Experience with mypy, Pydantic contracts, or strict typing disciplines in a production Python codebase


Life at Terrabase

We are a sharp, focused, fully remote team building agent infrastructure that enterprise customers trust with their data. You will work directly alongside the engineer who designed this harness, with broad ownership, generous compute budgets, and a culture that treats reliability as a product requirement, not a research topic.


Terrabase is an equal-opportunity employer. We celebrate diversity and are committed to building an inclusive environment for every team member.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Terrabase

Founded :
2025
Type :
Products & Services
Size :
0-20
Stage :
Bootstrapped

About

Terrabase connects to the systems where your business knowledge already lives, turns it into governed primitives and reusable skills, and lets your teams execute long-horizon analytical workflows with human review and auditability built in.
Read more

Company social profiles

N/A

Similar jobs

A cloud tech firm offering secure, scalable hybrid storage s
A cloud tech firm offering secure, scalable hybrid storage s
Agency job
Gurugram
3 - 6 yrs
₹8L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
skill iconDocker
skill iconRedis
+4 more

Role: Python Developer (Immediate Joiner)

Location: Gurugram, India (Onsite)

Experience: 4+ years

Company: Mizzle Cloud Pvt Ltd

Working Days: 6 Days( 5 days- WFO, Sat- WFH)

 


 

Job Summary

We are seeking a skilled Python Django Developer with expertise in building robust, scalable, and efficient web applications. Must have 3+ years of core work experience. The ideal candidate will have hands-on experience with RabbitMQ, Redis, Celery, and PostgreSQL to ensure seamless background task management, caching, and database performance.

 

Key Responsibilities

  • Develop, maintain, and enhance Django-based web applications and APIs.
  • Design and implement message broker solutions using RabbitMQ to manage asynchronous communication.
  • Integrate Redis for caching and session storage to optimize performance.
  • Implement and manage task queues using Celery for background processes.
  • Work with PostgreSQL for database design, optimization, and query tuning.
  • Collaborate with front-end developers, DevOps engineers, and stakeholders to deliver high-quality software solutions.
  • Write clean, modular, and well-documented code following best practices and standards.
  • Debug, troubleshoot, and resolve issues across the application stack.
  • Participate in code reviews, system design discussions, and team meetings.
  • Ensure scalability, reliability, and security of applications.

 

Technical Skills:

  • Must have minimum 4+ years of relevant work experience.
  • Strong proficiency in Python and Django framework.
  • Experience with message brokers, particularly RabbitMQ.
  • Familiarity with Redis for caching and session management.
  • Hands-on experience with Celery for distributed task queues.
  • Proficiency in PostgreSQL, including database design and optimization.
  • Knowledge of RESTful API design and development.
  • Understanding of Docker and containerized applications.

 

Preferred Skills:

  • Experience with CI/CD pipelines.
  • Familiarity with cloud platforms (AWS, GCP).
  • Knowledge of Django ORM and its optimizations.
  • Basic understanding of front-end technologies (HTML, CSS, JavaScript).

 

Soft Skills:

  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork abilities.
  • Ability to work in an agile environment and adapt to changing requirements.

 

Educational Requirements

  • Bachelor’s degree in Computer Science, Software Engineering, or a related field.


Read more
Us healthcare company
Us healthcare company
Agency job
via People Impact by Ranjita Shrivastava
Hyderabad, Chennai
4 - 8 yrs
₹20L - ₹30L / yr
ai/ml
TensorFlow
skill iconPython
Google Cloud Platform (GCP)
Vertex

·                    Design, develop, and implement AI/ML models and algorithms.

·                    Focus on building Proof of Concept (POC) applications to demonstrate the feasibility and value of AI solutions.

·                    Write clean, efficient, and well-documented code.

·                    Collaborate with data engineers to ensure data quality and availability for model training and evaluation.

·                    Work closely with senior team members to understand project requirements and contribute to technical solutions.

·                    Troubleshoot and debug AI/ML models and applications.

·                    Stay up-to-date with the latest advancements in AI/ML.

·                    Utilize machine learning frameworks (e.g., TensorFlow, PyTorch, Scikit-learn) to develop and deploy models.

·                    Develop and deploy AI solutions on Google Cloud Platform (GCP).

·                    Implement data preprocessing and feature engineering techniques using libraries like Pandas and NumPy.

·                    Utilize Vertex AI for model training, deployment, and management.

·                    Integrate and leverage Google Gemini for specific AI functionalities.

Qualifications:

·                    Bachelor’s degree in computer science, Artificial Intelligence, or a related field.

·                    3+ years of experience in developing and implementing AI/ML models.

·                    Strong programming skills in Python.

·                    Experience with machine learning frameworks such as TensorFlow, PyTorch, or Scikit-learn.

·                    Good understanding of machine learning concepts and techniques.

·                    Ability to work independently and as part of a team.

·                    Strong problem-solving skills.

·                    Good communication skills.

·                    Experience with Google Cloud Platform (GCP) is preferred.

·                    Familiarity with Vertex AI is a plus.


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Poornima Varadarajan
Posted by Poornima Varadarajan
Mumbai
1 - 8 yrs
₹8L - ₹20L / yr
Object Oriented Programming (OOPs)
Data Structures
Algorithms
skill iconPython

Experience in Python (Only Backend), Data structures, Oops, Algorithms, Django, NumPy etc.

• Good understanding of writing Unit Tests using PYTest.

• Good understanding of parsing XML’s and handling files using Python.

• Good understanding with Databases/SQL, procedures and query tuning.

• Service Design Concepts, OO and Functional Development concepts.

• Agile Development Methodologies.

• Strong oral and written communication skills.

• Excellent interpersonal skills and professional approach Skills desired.


Read more
Deqode
at Deqode
1 recruiter
Sneha Jain
Posted by Sneha Jain
Mumbai, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Pune, Indore, Jaipur, Kolkata, Chennai, Bengaluru (Bangalore)
3.5 - 7 yrs
₹8L - ₹13L / yr
AWS Lambda
skill iconPython
Microservices
Amazon EC2

We are seeking a highly skilled and motivated Python Developer with hands-on experience in AWS cloud services (Lambda, API Gateway, EC2), microservices architecture, PostgreSQL, and Docker. The ideal candidate will be responsible for designing, developing, deploying, and maintaining scalable backend services and APIs, with a strong emphasis on cloud-native solutions and containerized environments.


Key Responsibilities:

  • Develop and maintain scalable backend services using Python (Flask, FastAPI, or Django).
  • Design and deploy serverless applications using AWS Lambda and API Gateway.
  • Build and manage RESTful APIs and microservices.
  • Implement CI/CD pipelines for efficient and secure deployments.
  • Work with Docker to containerize applications and manage container lifecycles.
  • Develop and manage infrastructure on AWS (including EC2, IAM, S3, and other related services).
  • Design efficient database schemas and write optimized SQL queries for PostgreSQL.
  • Collaborate with DevOps, front-end developers, and product managers for end-to-end delivery.
  • Write unit, integration, and performance tests to ensure code reliability and robustness.
  • Monitor, troubleshoot, and optimize application performance in production environments.


Required Skills:

  • Strong proficiency in Python and Python-based web frameworks.
  • Experience with AWS services: Lambda, API Gateway, EC2, S3, CloudWatch.
  • Sound knowledge of microservices architecture and asynchronous programming.
  • Proficiency with PostgreSQL, including schema design and query optimization.
  • Hands-on experience with Docker and containerized deployments.
  • Understanding of CI/CD practices and tools like GitHub Actions, Jenkins, or CodePipeline.
  • Familiarity with API documentation tools (Swagger/OpenAPI).
  • Version control with Git.


Read more
Xemplar
Xemplar
Agency job
via Fruges IT services by Nishanthi Y
Hyderabad
10 - 15 yrs
₹10L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+7 more

Job Responsibilities

✓ Perform the role of Technical Lead on assigned projects to drive solution design (especially backend) and API services development.

✓ Be the thought leader and champion for above mentioned technologies.

✓ Drive technical analysis for new projects including planning and driving proof-of-concepts, if needed.

✓ Drive tasks related to backend development by providing architectural and technical leadership to mid-tier and database developers.

✓ Conduct peer reviews as the lead into Git to confirmed that developed code meets acceptable standards and guidelines.

✓ Work closely with the rest of the leads, mid-tier development, front-end developers, database developers, etc. to ensure end-to-end integrity of the solution being developed.

✓ Work closely with the rest of the tech leads and senior engineering leadership team to ensure reuse where applicable to increase productivity and throughput.

✓ Conduct technical interview to staff open positions in the backend team.

✓ Delegate work and assignments to team members

✓ Collaborate with their team to identify and fix technical problems

✓ Analyze users' needs and then finding applications to serve them

✓ Drive assigned tasks related to SOC 2 certification and ensure compliance to defined controls for areas under lead’s purview.

✓ Guiding their team through technical issues and challenges

✓ Prepare Technical design documents which would help the team to understand the technical flow

✓ Active participation in customer calls especially discussions related to Technical/Architectural and provide inputs.

 

Required Experience: 

✓ Backend Lead around 14 years of experience

✓ Server less Computing Architecture

✓ NodeJS, MySQL, Jenkins, Python, GitLab Technologies

✓ Good knowledge of AWS Cloud

✓ Full cycle AWS implementation experience

✓ Project experience in development and maintenance support for AWS web service and Cloudbased implementations

✓ Experience leading teams of up to 10 + professionals

Ability to manage multiple tasks and projects in a fast-moving environment 

 

Educational Qualifications: 

Engineering graduate or B. Tech/MCA with relevant major subjects like Computer Science

Read more
Validus Techfin Solutions
Sura  Mukkavilli
Posted by Sura Mukkavilli
Hyderabad
3 - 20 yrs
Best in industry
ERPnext
Frappe
ERP Next
MariaDB
skill iconPython
+2 more
Experienced in Javascript with a special focus on Frappe Framework, ERPNext, Python, JS & MariaDB

Good Experience & Understanding of CRM & ERP processes & Design

  • 3+  years of hands-on experience in ERPNext Platform and Frappe Framework, Python, JavaScript and MySQL/MariaDB
  • Strong knowledge of configuration and customisation of the ERPNext platform
Read more
Revvster Technologies Pvt Tld
Remote only
0 - 3 yrs
₹1L - ₹5L / yr
skill iconJava
skill iconPython
skill iconObjective C
Object Oriented Programming (OOPs)
DART
+1 more
Company Profile - 
Baetho is a solution focused company aimed at creating and democratizing
the development of customer experience applications through our
proprietary no code platform.
At Baetho, we offer a fun environment and the chance to work with a highly
skilled and motivated team. Our culture is focused on employee happiness,
customer satisfaction and high-quality execution. If you have the right vibe
and believe in fairness and freedom, you’re a great fit for us.
Working Days: 5 days a week, Monday to Friday (some weekend work
required)

Experience required - 
Responsibilities -
  Develop and deploy software applications using our framework. Follow the best practices while developing the app and keep everything structured and well documented. Test and document the software applications. Contribute ideas and solutions for the continuous evolution of our platform and applications.   
Requirements - 
 Education Qualification: BCA/UG/BE/B.Tech Experience: 1 to 3 years Knowledge of the software development life-cycle. 
Expertise in Object Oriented Programming (JAVA, C++, Dart, Python, C#) 
Knowledge of REST APIs is an added advantage. 
Strong in problem-solving, debugging, logical and analytical skills. 
Ability to work as a team player and coordinate with other departments. Good communication skills.   
Read more
Fulfil.IO
Remote only
4 - 8 yrs
₹15L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconPostgreSQL
Celery

Fulfil’s software engineers develop the next-generation technologies that change how millions of customer orders are fulfilled by merchants. Our products need to handle information at massive scale. We're looking for engineers who bring fresh ideas from all areas into our technology.


As a senior software engineer, you will work on our python based ORM and applications that scales to handle millions of transactions every hour. This is mission critical software and your primary focus will be building robust and scalable solutions that are easy to maintain.


In this role, you will be collaborating closely with the rest of the team working on different layers of infrastructure in an international environment. Therefore, a commitment to collaborative problem solving, sophisticated design, and quality product are important.


What You’ll Do:

  • Own definition and implementation of API interfaces (REST and GraphQL). We take pride in our 100% open API with over 600 endpoints.
  • Implement simple solutions to complex business logic that enables our merchants to manage financials, orders and shipments across millions of transactions.
  • Build reusable components and packages for future use.
  • Translate specs and user stories into reviewable, test covered patches.
  • Peer review code and refactor existing code.
  • Integrate with our eCommerce partners (Shopify, BigCommerce, Amazon), shipping partners (UPS, USPS, FedEx, DHL) and EDI.
  • Manage Kubernetes and Docker based global deployment of our infrastructure.


Requirements We’re Looking for Someone With:

  • Experience working with ORMs like SQLAlchemy or Django (2-3 years)
  • Experience with SQL and databases (Postgres preferred)
  • Experience in developing large server side applications and microservices
  • Ability to create high quality code
  • Experience with python testing tools (pytest) and test automation
  • Familiarity with code versioning tools like GIT
  • Strong sense of ownership and leadership quality
  • Experienced in the tools of our web stack- Python, Celery, Postgres, Redis, RabbitMQ


Nice to Haves:

  • Prior experience at a growth stage Internet/Software company
  • Experience with ReactJS, Google Cloud, Heroku
  • Cloud deployment and scaling experience
Read more
Doctor Insta
at Doctor Insta
3 recruiters
Ruchika Chauhan
Posted by Ruchika Chauhan
NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹7L - ₹12L / yr
skill iconAngularJS (1.x)
skill iconHTML/CSS
skill iconJava
skill iconPython
skill iconJavascript
+4 more
Skills Required: 1. Hands on experience with Python, Django, Databases like MySQL 2. Hands-on software development, team management and project management experience. 3. Experience with Cloud technologies like AWS, CI/CD Processes 4. Good understanding of HTML, CSS, JAVA Script, Angular JS 5. Data structure and implementing optimized algorithms 6. Experience using code versioning systems like SVN, GIT is desirable 7. Additional Qualifications –node.js, npm, NoSQL (Redis) 8. Quick Learner, Creative Problem Solver and Resourceful Education Qualifications: BTech/ BE
Read more
StrawberryBox Media Pvt Ltd
Vidhi S Bangoria
Posted by Vidhi S Bangoria
Bengaluru (Bangalore)
4 - 6 yrs
₹5L - ₹6L / yr
Fullstack Developer
Web
skill iconPHP
skill iconPython
skill iconHTML/CSS
+2 more
Good Knowledge on Full Stack. Strong Basics. We are looking for an outstanding Web Developer to be responsible for the coding, innovative design, and layout of our website. Write well designed, testable, efficient code by using best software development practices Create website layout/user interface by using standard HTML/CSS practices Integrate data from various back-end services and databases Gather and refine specifications and requirements based on technical needs Create and maintain software documentation Be responsible for maintaining, expanding, and scaling our site Stay plugged into emerging technologies/industry trends and apply them into operations and activities.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos