
Experience: 5+ years production software engineering, with 2+ years working directly on LLM or agent systems in production.
Location: Remote
To streamline and fast-track screening, please submit your details here (if you haven’t already): https://airtable.com/appbtkr4odapnb5I6/pagqo91lKv3VJg3GT/form
We’ll review your responses as part of the initial screening process. Please make sure you complete and submit all details through the form to be considered for the next stage. Submissions outside the form may not be considered.
Why This Role Matters
Terrabase builds agent infrastructure that enterprise customers rely on daily for SQL generation, forecasting, data analysis, and artifact delivery. Our orchestration layer routes between specialized sub-agents, manages typed handoff contracts, runs structured eval suites, and enforces correctness across every turn.
This is not a research-prototype role. You will build and evolve agent architecture, but always in service of making the system observable, typed, evaluated, recoverable, and boringly reliable in production.
What You Will Do
Own the harness architecture and middleware stack. Our LangGraph orchestrator routes between sub-agents through a layered middleware stack: file upload handling, source resolution, local context, workspace sync, state hydration, aggregation barriers, and typed handoff contracts. You will extend this stack, enforce its contracts in code, and keep it operational as routing logic and agent surfaces evolve.
Maintain typed contracts and boundaries. Agent handoffs at Terrabase carry typed contracts with barrier conditions and retry predicates. You will design these contracts, enforce them with strict typing, manage backward compatibility when contracts change, and write the contract tests that prevent silent regressions.
Own the eval suites. We run structured eval suites across routing decisions, context-resolution accuracy, multi-turn coherence, visual reference alignment, and artifact correctness. You will extend coverage, write new evals where gaps exist, and build CI gates that block releases when regressions are detected. A routing change or prompt change with no eval coverage does not ship.
Triage production failures and close the loop. When an agent turn fails in production, you will trace it in LangSmith, identify the failure class, and convert it into a durable regression test. You will own the release gates, keep prompts and runtime contracts in sync, manage feature flag rollout risk, and remove dead paths as the system evolves.
Own SQL and artifact correctness. Our agents generate SQL over customer schemas and produce structured artifacts (reports, dashboards, data sheets) under a strict schema contract. You will own the correctness layer: source grounding, schema-aware validation, provenance surfaces, and the eval infrastructure that catches generated artifact failures before they reach customers.
Build and maintain HITL workflows. Human-in-the-loop checkpoints let users intervene, redirect, or approve mid-chain. You will design these workflows, enforce their resumable state contracts, and ensure they degrade gracefully when interrupted.
Instrument for traceability. You will extend LangSmith tracing coverage, add structured span annotations, and build the tooling that lets us diagnose a bad agent turn from production trace data alone, without requiring a local reproduction.
What We Are Looking For
- 5+ years production software engineering, with strong Python fundamentals
- 2+ years working hands-on with LLM-based systems: agent loops, tool use, context management, or inference pipelines
- Experience with LangGraph, LangChain, OpenAI/Anthropic tool-use systems, or equivalent multi-step agent/runtime orchestration
- Practical eval engineering: you have built or extended eval harnesses, written automated test cases for agent behavior, and treated evaluation as an ongoing engineering discipline
- Strong engineering hygiene: strict typing, small interfaces, contract tests, clear schema migrations, and CI discipline
- Ability to debug from production traces and artifacts, not only local reproductions
- Comfort working across prompts, Python runtime code, TypeScript product surfaces, data systems, and eval infrastructure
- Systems thinking: you design for observability, recovery, and state management, not just the happy path
- Maintenance ownership mindset: you triage, close loops, and leave systems more debuggable than you found them
- Pragmatic judgment: you can distinguish between reliability-critical infrastructure and speculative abstraction
Bonus Points
- HITL workflow design: checkpoints, approvals, mid-chain interrupts, resumable state
- Context engineering depth: chunking strategies, retrieval-augmented generation, semantic routing, re-ranking
- Experience with LangSmith, Weights and Biases, or similar trace and evaluation platforms
- Prior work shipping agent systems to enterprise customers where SQL or data correctness is a hard requirement
- Experience with mypy, Pydantic contracts, or strict typing disciplines in a production Python codebase
Life at Terrabase
We are a sharp, focused, fully remote team building agent infrastructure that enterprise customers trust with their data. You will work directly alongside the engineer who designed this harness, with broad ownership, generous compute budgets, and a culture that treats reliability as a product requirement, not a research topic.
Terrabase is an equal-opportunity employer. We celebrate diversity and are committed to building an inclusive environment for every team member.

About Terrabase
About
Similar jobs
Great engineers aren’t built by watching.
They’re built by solving real problems.
At AbleCredit, interns don’t work on toy projects or isolated assignments. From your first few weeks, you’ll contribute to production systems used by enterprise customers, collaborate with experienced engineers, and learn what it takes to build reliable software at scale.
If you’re curious, enjoy building things, and want to accelerate your engineering career, we’d love to work with you.
What You’ll Build?
As an Engineering Intern, you’ll work alongside our engineering team to build and improve products used by real customers.
Depending on your interests and the team’s priorities, you’ll:
● Build backend services, APIs, and platform features.
● Develop user-facing features across our web applications.
● Work with databases, cloud services, and third-party integrations.
● Debug production issues and improve system reliability.
● Participate in code reviews and technical design discussions.
● Write clean, maintainable, and well-tested code.
● Learn how modern software is designed, built, deployed, and monitored.
Your work won’t be a demo project—it will ship to production.
What We’re Looking For?
We’re looking for people who enjoy solving problems more than collecting technologies on their résumé.
You’ll likely succeed if you:
● Are pursuing or have recently completed a Bachelor’s or Master’s degree in Computer Science or a related field.
● Have strong programming fundamentals and problem-solving skills.
● Understand data structures, algorithms, and object-oriented programming.
● Are comfortable with at least one programming language such as JavaScript, TypeScript, Python, Java, or Go.
● Understand the basics of databases, REST APIs, and Git.
● Learn quickly and enjoy exploring unfamiliar technologies.
● Communicate clearly and work well in a collaborative environment.
Bonus Points:
Experience with any of these is helpful but not required:
● Node.js, FastAPI, Spring Boot, or Django
● React and modern frontend development
● SQL and NoSQL databases
● AWS, GCP, or Azure
● Docker, Kubernetes, or CI/CD
● AI, LLMs, or workflow automation
Don’t worry if you haven’t worked with everything on this list. We care more about your ability to learn than your current toolkit.
What You’ll Learn?
During your internship, you’ll gain practical experience with:
● Building production software
● Backend engineering and API design
● Modern web application development
● Cloud infrastructure
● Distributed systems and asynchronous workflows
● Software testing and debugging
● Git-based development workflows
● Code reviews and engineering collaboration
You’ll also learn how engineering teams operate inside a fast-moving startup—from
turning ideas into products to shipping features used by customers.
Why Join AbleCredit?
You’ll join a small, high-ownership engineering team where your contributions matter from day one.
You’ll have the opportunity to:
● Build software used by real enterprise customers.
● Receive mentorship from experienced engineers.
● Learn modern engineering practices and tools.
● Work across the backend, frontend, and cloud stack.
● Take ownership of meaningful features instead of isolated tasks.
● Convert your internship into a full-time engineering role based on your
performance and available opportunities.
We Think You’ll Enjoy This Role If...
● You build side projects because you enjoy learning.
● You like understanding how systems work—not just using them.
● You’re excited to write code that reaches production.
● You ask questions, experiment, and learn quickly.
● You want an internship where you’ll build, not just observe.
Key Responsibilities
AI/ML & Python Development
- Design, develop, and integrate AI-powered solutions and intelligent features using Python.
- Build and implement Retrieval-Augmented Generation (RAG) pipelines to enhance knowledge retrieval and contextual AI responses.
- Develop AI applications using modern frameworks and tools such as LangChain, LlamaIndex, and AI Agents/Autonomous Workflows.
- Integrate Large Language Model (LLM) APIs, including OpenAI and similar platforms, into enterprise-grade applications.
- Design, implement, and manage vector databases to enable semantic search and AI-driven information retrieval.
- Collaborate with cross-functional teams to evaluate, fine-tune, and optimize AI models for performance, scalability, and accuracy.
- Stay updated with emerging AI technologies, frameworks, and industry best practices to drive innovation.
Role & Responsibilities:
We are seeking a Software Developer with 2-10 year’s experience with strong foundations in Python, databases, and AI technologies. The ideal candidate will support the development of AI-powered solutions, focusing on LLM integration, prompt engineering, and database-driven workflows. This is a hands-on role with opportunities to learn and grow into advanced AI engineering responsibilities.
Key Responsibilities
• Develop, test, and maintain Python-based applications and APIs.
• Design and optimize prompts for Large Language Models (LLMs) to improve accuracy and performance.
• Work with JSON-based data structures for request/response handling. • Integrate and manage PostgreSQL (pgSQL) databases, including writing queries and handling data pipelines.
• Collaborate with the product and AI teams to implement new features. • Debug, troubleshoot, and optimize performance of applications and workflows.
• Stay updated on advancements in LLMs, AI frameworks, and generative AI tools.
Required Skills & Qualifications
• Strong knowledge of Python (scripting, APIs, data handling).
• Basic understanding of Large Language Models (LLMs) and prompt engineering techniques.
• Experience with JSON data parsing and transformations.
• Familiarity with PostgreSQL or other relational databases.
• Ability to write clean, maintainable, and well-documented code.
• Strong problem-solving skills and eagerness to learn.
• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).
Nice-to-Have (Preferred)
• Exposure to AI/ML frameworks (e.g., LangChain, Hugging Face, OpenAI APIs).
• Experience working in startups or fast-paced environments.
• Familiarity with version control (Git/GitHub) and cloud platforms (AWS, GCP, or Azure).
What We Offer
• The opportunity to define the future of GovTech through AI-powered solutions.
• A strategic leadership role in a fast-scaling startup with direct impact on product direction and market success.
• Collaborative and innovative environment with cross-functional exposure.
• Growth opportunities backed by a strong leadership team.
• Remote flexibility and work-life balance.
We are seeking a highly skilled and motivated Python Developer with hands-on experience in AWS cloud services (Lambda, API Gateway, EC2), microservices architecture, PostgreSQL, and Docker. The ideal candidate will be responsible for designing, developing, deploying, and maintaining scalable backend services and APIs, with a strong emphasis on cloud-native solutions and containerized environments.
Key Responsibilities:
- Develop and maintain scalable backend services using Python (Flask, FastAPI, or Django).
- Design and deploy serverless applications using AWS Lambda and API Gateway.
- Build and manage RESTful APIs and microservices.
- Implement CI/CD pipelines for efficient and secure deployments.
- Work with Docker to containerize applications and manage container lifecycles.
- Develop and manage infrastructure on AWS (including EC2, IAM, S3, and other related services).
- Design efficient database schemas and write optimized SQL queries for PostgreSQL.
- Collaborate with DevOps, front-end developers, and product managers for end-to-end delivery.
- Write unit, integration, and performance tests to ensure code reliability and robustness.
- Monitor, troubleshoot, and optimize application performance in production environments.
Required Skills:
- Strong proficiency in Python and Python-based web frameworks.
- Experience with AWS services: Lambda, API Gateway, EC2, S3, CloudWatch.
- Sound knowledge of microservices architecture and asynchronous programming.
- Proficiency with PostgreSQL, including schema design and query optimization.
- Hands-on experience with Docker and containerized deployments.
- Understanding of CI/CD practices and tools like GitHub Actions, Jenkins, or CodePipeline.
- Familiarity with API documentation tools (Swagger/OpenAPI).
- Version control with Git.
We are looking for an experienced Senior API Developer with expertise in Python to join our talented development team. The candidate should have over 8 years of hands-on experience in designing and developing APIs, with a strong emphasis on performance and scalability. Proficiency with Swagger/OpenAPI specifications is required. This role is pivotal to our mission of delivering top-tier solutions that power our core business functions.
Key Responsibilities:
- API Development: Design, develop, and maintain high-quality APIs using Python frameworks such as Django Rest Framework or FastAPI.
- Documentation with Swagger/OpenAPI: Employ Swagger/OpenAPI tools to produce clear and thorough API documentation.
- Integration: Implement and manage integrations between APIs and various internal and external services.
- Optimize Performance: Monitor and enhance the performance of APIs to ensure fast response times and low latency.
- Team Collaboration: Work closely with other developers, product owners, and stakeholders to understand requirements and deliver optimal solutions.
- Code Quality: Uphold best practices in code quality, testing, and deployment. Participate in peer code reviews.
- Debugging and Support: Troubleshoot and resolve issues in development, test, and production environments.
- Continuous Learning: Stay informed about emerging technologies and methodologies in Python and API development.
Qualifications:
- Education: Bachelor's degree in Computer Science, Information Technology, or a related discipline.
- Experience: At least 8 years of professional experience in API development with a focus on Python.
Technical Skills:
- Proficiency in Python programming language.
- Strong experience with API design, development, and RESTful services.
- Expertise with Swagger/OpenAPI specifications.
- Familiarity with Python frameworks like Django, Flask, or FastAPI.
- Experience with ORMs such as SQLAlchemy or Django ORM.
- Knowledge of version control systems, particularly Git.
- Experience working with relational databases like PostgreSQL or MySQL.
Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong verbal and written communication.
- Ability to collaborate effectively within a team and across departments.
Preferred Qualifications:
- Experience with cloud platforms like AWS, GCP, or Azure.
- Knowledge of microservices architecture and distributed systems.
- Familiarity with CI/CD pipelines and tools like Jenkins or GitLab CI.
- Understanding of asynchronous programming and event-driven architecture.
What We Offer:
- Competitive Compensation: Reflective of your experience and the value you bring.
- Growth Opportunities: Support for professional development, training, and certifications.
- Flexible Work Environment: Remote work options and flexible hours to promote work-life balance.
💥 What will you do?
As a Backend Engineer, you will
- Create and maintain server-side code
- Designing database schemas to support business requirements
- Building reusable code and libraries for future use
- Troubleshoot and debug applications
- Write unit tests
- Stay up to date with current best practices
- Collaborate with front end engineers
- Optimization of the application for maximum speed and scalability
- Work with stakeholders including the Executive, Product, Data, and Design teams to assist with web-application-related technical issues and support their requirements.
🙋 What are we looking for?
While we do not have a strict list of requirements for candidates interested in this role, some indicators that you would fit this role and our engineering culture are
- 2+ years of relevant work experience as a Backend engineer using Python frameworks like Django, Flask, etc
- Experience with relational databases like MySQL, PostgreSQL
- Good understanding of OOP concepts
- Understanding of code versioning tools, such as Git
- Basic understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3.
- Experience writing unit tests for the application is a plus
- Experience with building REST APIs
- Superior analytical, conceptual, and problem-solving skills.
- Strong verbal and written communication skills in English.
- Work with stakeholders and fellow developers.
- Design and implement Python code using the Django framework.
- Identify and fix bottlenecks that may arise from inefficient code.
- Identify and fix software bugs.
- Create a wide variety of unit tests to verify the functionality of software.
- Manage the security of the platform.
- Write detailed documentation around the code.
- Knowledge of front end languages.

Basic Qualifications
Candidates for this role must have:
- Bachelor’s degree in computer science or a related field
- At least three years of experience writing production code of increasing complexity
- Strong understanding of computer science fundamentals, including algorithms, complexity analysis, data structures, problem solving, and object-oriented analysis and design
- Proficiency in at least one of the following: Java, C, C++, C#, Ruby, Scala, Python
- Experience refactoring code and evolving architectures
- Experience crafting unit, integration, functional and regression tests
Preferred Qualifications
- Master’s degree in computer science or a related field
- Experience developing in a Linux environment
- Experience applying service-oriented architecture techniques to production use cases
- Experience in developing secure, multi-platform mobile applications
1. Ability to read the documentation and perform 3rd party API integrations
2. Experience with Postgres and Redis
3. Experience with AWS - EC2, RDS, DynamoDB, etc
4. Experience with Python
Dashboard
Skills
1. Experience with Django
a. Django Web
b. Django REST
c. Django Channels
d. Django Celery (Queues and Brokers)
2. Experience creating a dashboard with login, user profiles, roles and permissions, reports
3. Experience with Facebook and Twitter OAuth
4. Experience with handling database migrations
Chatbot
Skills
1. Basic understanding of NLP - intents and entities
2. Strong understanding of dialogue management and conversation flow
3. Integrations with Facebook and Twitter APIs.
4. Creating and managing Facebook and Twitter apps
5. Understanding of webhooks and REST APIs.










