DevOps Engineer

Job Title: Lead Backend Web App Developer

Experience: 10–15 Years

Location: Bengaluru (Hybrid)

Role Overview:

We are seeking an experienced Lead Backend Web App Developer to design and maintain scalable, cloud-based backend systems. This role demands expertise in microservices, AWS, and backend technologies to deliver efficient and high-performing applications.

Key Responsibilities:

• Build and maintain scalable backend systems for cloud-based web applications.
• Develop microservices using AWS (Lambda, SQS, SNS) and databases (MySQL, NoSQL).
• Design and implement REST APIs for seamless communication between systems.
• Create containerized solutions with Docker for efficient deployment.
• Solve real-world problems with enterprise-class product designs.
• Contribute to key decisions on product and technology direction.
• Promote frameworks, standards, and new technologies within the team.

Required Skills:

• Experience: 10+ Years in Backend Development; 3+ Years in large-scale, microservices-based projects.
• Backend Technologies: Proficiency in Python, Node.js, and Java.
• Cloud Expertise: Strong experience with AWS services (Lambda, SQS, SNS).
• Database Skills: Expertise in MySQL and NoSQL databases.
• Microservices Architecture: Deep understanding of distributed systems and scalability.
• DevOps Tools: Hands-on experience with Docker.
• API Development: Proven expertise in designing and consuming REST APIs.
• Soft Skills: Excellent problem-solving and communication abilities.

Why Join Us?

• Work on impactful projects with real-world applications.
• Solve complex problems in a dynamic, fast-paced environment.
• Collaborate with a team of skilled professionals.

Experience: 5+ years production software engineering, with 2+ years working directly on LLM or agent systems in production. 

Location: Remote 

To streamline and fast-track screening, please submit your details here (if you haven’t already): https://airtable.com/appbtkr4odapnb5I6/pagqo91lKv3VJg3GT/form 

We’ll review your responses as part of the initial screening process. Please make sure you complete and submit all details through the form to be considered for the next stage. Submissions outside the form may not be considered.

Why This Role Matters

Terrabase builds agent infrastructure that enterprise customers rely on daily for SQL generation, forecasting, data analysis, and artifact delivery. Our orchestration layer routes between specialized sub-agents, manages typed handoff contracts, runs structured eval suites, and enforces correctness across every turn.

This is not a research-prototype role. You will build and evolve agent architecture, but always in service of making the system observable, typed, evaluated, recoverable, and boringly reliable in production.

What You Will Do

Own the harness architecture and middleware stack. Our LangGraph orchestrator routes between sub-agents through a layered middleware stack: file upload handling, source resolution, local context, workspace sync, state hydration, aggregation barriers, and typed handoff contracts. You will extend this stack, enforce its contracts in code, and keep it operational as routing logic and agent surfaces evolve.

Maintain typed contracts and boundaries. Agent handoffs at Terrabase carry typed contracts with barrier conditions and retry predicates. You will design these contracts, enforce them with strict typing, manage backward compatibility when contracts change, and write the contract tests that prevent silent regressions.

Own the eval suites. We run structured eval suites across routing decisions, context-resolution accuracy, multi-turn coherence, visual reference alignment, and artifact correctness. You will extend coverage, write new evals where gaps exist, and build CI gates that block releases when regressions are detected. A routing change or prompt change with no eval coverage does not ship.

Triage production failures and close the loop. When an agent turn fails in production, you will trace it in LangSmith, identify the failure class, and convert it into a durable regression test. You will own the release gates, keep prompts and runtime contracts in sync, manage feature flag rollout risk, and remove dead paths as the system evolves.

Own SQL and artifact correctness. Our agents generate SQL over customer schemas and produce structured artifacts (reports, dashboards, data sheets) under a strict schema contract. You will own the correctness layer: source grounding, schema-aware validation, provenance surfaces, and the eval infrastructure that catches generated artifact failures before they reach customers.

Build and maintain HITL workflows. Human-in-the-loop checkpoints let users intervene, redirect, or approve mid-chain. You will design these workflows, enforce their resumable state contracts, and ensure they degrade gracefully when interrupted.

Instrument for traceability. You will extend LangSmith tracing coverage, add structured span annotations, and build the tooling that lets us diagnose a bad agent turn from production trace data alone, without requiring a local reproduction.

What We Are Looking For

• 5+ years production software engineering, with strong Python fundamentals
• 2+ years working hands-on with LLM-based systems: agent loops, tool use, context management, or inference pipelines
• Experience with LangGraph, LangChain, OpenAI/Anthropic tool-use systems, or equivalent multi-step agent/runtime orchestration
• Practical eval engineering: you have built or extended eval harnesses, written automated test cases for agent behavior, and treated evaluation as an ongoing engineering discipline
• Strong engineering hygiene: strict typing, small interfaces, contract tests, clear schema migrations, and CI discipline
• Ability to debug from production traces and artifacts, not only local reproductions
• Comfort working across prompts, Python runtime code, TypeScript product surfaces, data systems, and eval infrastructure
• Systems thinking: you design for observability, recovery, and state management, not just the happy path
• Maintenance ownership mindset: you triage, close loops, and leave systems more debuggable than you found them
• Pragmatic judgment: you can distinguish between reliability-critical infrastructure and speculative abstraction

Bonus Points

• HITL workflow design: checkpoints, approvals, mid-chain interrupts, resumable state
• Context engineering depth: chunking strategies, retrieval-augmented generation, semantic routing, re-ranking
• Experience with LangSmith, Weights and Biases, or similar trace and evaluation platforms
• Prior work shipping agent systems to enterprise customers where SQL or data correctness is a hard requirement
• Experience with mypy, Pydantic contracts, or strict typing disciplines in a production Python codebase

Life at Terrabase

We are a sharp, focused, fully remote team building agent infrastructure that enterprise customers trust with their data. You will work directly alongside the engineer who designed this harness, with broad ownership, generous compute budgets, and a culture that treats reliability as a product requirement, not a research topic.

Terrabase is an equal-opportunity employer. We celebrate diversity and are committed to building an inclusive environment for every team member.

Requirements:

• Expert in Python, with good knowledge in Django technology.
• Able to integrate multiple data sources and databases into one system.
• Understanding of the threading limitations of Python, and multi-process architecture.
• Knowledge of user authentication and authorization between multiple systems, servers, and environments.
• Experience in Flask will be an add-on
• Understanding of fundamental design principles behind a scalable application.
• Familiarity with event-driven programming in Python.
• Able to create database schemas that represent and support business processes.
• Proficient understanding of code versioning tools.
• Good communication skills.

Must Haves

• Programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
• 1+ years of experience contributing to the architecture and design (architecture, design patterns, reliability, and scaling) of new and current systems.
• 4+ years’  work experience in  software development
• BS degree or higher in Computer Science, Engineering or related field
• Understanding of operating system fundamentals (Linux)
• Understanding of scalable computing systems, software architecture, data structures, and algorithms
• Knowledge of professional software engineering best practices for the full software development life cycle
• Strong verbal and written communication skills
• Strong analytical skills, with excellent problem solving abilities
• Working experience with Kubernetes
• Experienced working with distributed databases at scale

Good to haves

• Experience in developing software using AWS native services & technologies.
• Experience taking a lead role in building and operating scalable distributed systems
• Experience in Agile/SCRUM enterprise-scale software development
• Familiar with building secure software using modern security principles
• Demonstrated ability to achieve goals in a highly innovative and fast-paced environment

Why us

We're hiring a set of highly skilled, enthusiastic, and passionate people who thrive in a high-growth environment. We believe the best way to grow is to give everyone the opportunity to pursue their interests. At Lucidity, you have complete freedom to work on projects that interest you. Plus, with benefits like flexible hours, company offsites, unlimited leaves, we ensure you enjoy the journey as much as we do. We are also offering healthy founding team ESOP's.

• B Tech/BE or M.Tech/ME in Computer Science or equivalent from a reputed college.
• Experience level of 7+ years in building large scale applications.
• Strong problem solving skills, data structures and algorithms.
• Experience with distributed systems handling large amount of data.
• Excellent coding skills in Java / Python / Node / Go.
• Very good understanding of Web Technologies.
• Very good understanding of any RDBMS and/or messaging.

• You will be responsible for design, development and testing of Products
• Contributing in all phases of the development lifecycle

• Writing well designed, testable, efficient code
• Ensure designs are in compliance with specifications

• Prepare and produce releases of software components

• Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

• Some of the technologies you will be working on: Core Java, Solr, Hadoop, Spark, Elastic search, Clustering, Text Mining, NLP, Mahout and Lucene etc.