Low Latency C++ Developer - Core Systems

Role & Responsibilities

As a Senior GenAI Engineer you will own the AI layer of our product — building the features that make Zenskar intelligent. This is not a research role and not a prompt-engineering role. You will build production AI systems that enterprise clients depend on, which means reliability, observability, and rigorous evals matter as much as the AI capability itself. You own the full vertical — the model, the pipeline, and the UI.

• Build and own CS Copilot — a real-time assistant for customer success teams, spanning STT pipelines, live transcription, and LLM-powered suggestions
• Build LLM-powered document understanding features — extracting structured, reliable data from unstructured enterprise documents
• Own AI feature UIs end-to-end — you build the interface, not just the model integration layer
• Design and maintain an eval framework — define what 'working' means for each AI feature and catch regressions before users do
• Drive model selection and integration decisions — choosing the right provider and approach for each use case, managing latency and cost
• Own AI platform reliability — observability, fallback behaviour, and graceful degradation when models fail
• Work closely with product, customer success, and the full-stack engineer — AI features only matter if they are usable and trusted by real users

THE IMPACT YOU'LL MAKE-

• You will define what AI means at Zenskar — the features you ship will be the most visible and differentiated parts of the product
• CS Copilot, if done well, changes how enterprise customer success teams operate every single day — this is a high-stakes, high-visibility surface
• You will establish the engineering culture around AI reliability at Zenskar — evals, observability, and disciplined iteration
• Your work will directly accelerate enterprise deals — AI features are increasingly a buying criterion for our clients
• You will be the person who brings engineering rigour to a domain where most companies ship demos and call it a feature

Ideal Candidate

• Strong Senior GenAI / AI Backend Engineer Profiles
• Mandatory (Experience 1) – Must have 4+ years of total software development experience, with at least 2+ years working on AI/LLM-based features in production
• Mandatory (Experience 2) – Must have strong backend engineering experience using Python (FastAPI / Django preferred) and building production-grade systems
• Mandatory (Experience 3) – Must have hands-on experience building LLM-based applications, including OpenAI / Gemini / similar models in real projects
• Mandatory (Experience 4) – Must have experience with RAG (Retrieval Augmented Generation) including chunking, embeddings, and retrieval pipelines
• Mandatory (Experience 5) – Must have experience designing end-to-end AI pipelines, including chaining, tool usage, structured outputs, and handling failure cases
• Mandatory (Experience 6) – Must have experience building agentic AI systems (multi-step workflows, tool orchestration like LangGraph / CrewAI or custom agents)
• Mandatory (Experience 7) – Must have strong coding and system design skills, not just prompt engineering or experimentation
• Mandatory (Experience 8) – Must have experience shipping AI features in production, not just POCs or research projects
• Mandatory (Experience 9) – Must have experience working with APIs, backend services, and integrations
• Mandatory (Experience 10) – Must have understanding of AI system reliability, including latency, cost optimization, fallback handling, and basic eval thinking
• Mandatory (Company) – Product companies / startups, preferably Series A to Series D
• Mandatory (Note) - Candidate's overall experience should not be more than 7 Yrs
• Mandatory (Tech Stack) – Strong in Python + AI/LLM ecosystem, experience with modern AI tooling and frameworks
• Mandatory (Exclusion) – Reject profiles that are only Prompt Engineers, Data Scientists, or Frontend Engineers without strong backend + system building experience
• Preferred (Skill) – Experience with fine-tuning (LoRA / QLoRA) or open-source model deployment (vLLM / Ollama)
• Preferred (Frontend) – Basic ability to build or contribute to frontend (React or similar)
• Highly Preferred (Education) – Candidates from Tier-1 institutes (IITs, BITS, NITs, IIITs, top global universities)

8+ years backend engineering experience in production systems

Proven experience architecting large-scale distributed systems (high throughput, low latency, high availability)

Deep expertise in system design including scalability, fault tolerance, and performance optimization

Experience leading cross-team technical initiatives in complex systems

Strong understanding of security, privacy, compliance, and secure coding practices

At Egnyte we develop content governance and collaboration products that are deployed across several large companies such as Yamaha and Red bull. The Egnyte platform supports daily, business critical operations for a million-plus user base interacting with a multi-petabyte content set.

We store, analyze, organize, and secure billions of files and petabytes of data with millions of users. We observe more than 1M API requests per minute on average. To make that possible and to provide the best possible experience, we rely on great engineers. For us, people who own their work from start to finish are integral. Our Engineers are part of the process from design to code, to test, to deployment, and back again for further iterations.  

We’re looking for Senior Software Engineers and he should be able to take a complex problem and work with product managers, devops and other team members to execute end to end.

• Design and develop scalable cloud components that seamlessly integrates with on-premises systems.
• Challenge and redefine existing architecture or make 10x improvements in performance and scalability.
• Ability to foresee post-deployment design challenges, performance and scale bottlenecks.
• Hire and mentor junior engineers
• Doing code reviews, unit and performance testing of the code.
• Monitor and manage 3000+ nodes using modern DevOps tools and APM solutions.

• Demonstrated success designing and developing complex cloud based solutions
• Solid CS fundamentals with one or more areas of deep knowledge
• Experience with the following technologies: Java, SQL, Linux, Python, Nginx, Haproxy, BigQuery, HBase, New Relic, memcache, Elasticsearch, docker.
• Data driven decision process
• Relies on automation testing instead of manual QA
• Experience in working with Google cloud, AWS or Azure is preferred

• Previous working experience as a Python Web Developer for min 2 years.

• Hands-on experience with Django, Flask, or other Python frameworks.

• Experience with Design implementation of objects and data models.

• Working knowledge in JavaScript, HTML5, CSS3.

• Understanding of CI/CD practices.

• Familiarity with some ORM (Object Relational Mapper) libraries.

• Proficient understanding of code versioning tools such as Git, Mercurial, or SVN.

• Hands-on experience with complex scripts in Python to capture business logic and automate system management tasks.

Role Summary: Back-end Developer who would contribute towards building a highly flexible and scalable Back- end by bringing deep core technology expertise.

Job Description:

- Develop modules keeping micro services architecture philosophies in check. - Implement and/or oversee implementation of different modules as part of an integrated development team. - Drive evolution of application performance. - Ensure project scalability by having good project architecture

Skill Requirements:

- Strong Node.js. - Strong database technology skillsets, namely MongoDB, MySQL

- Should have experience of using Rabbit MQ.

- Python (Django) skills are a plus. - A skilled and pragmatic approach.

- Experience with user-centred design, test-driven development, iterative/incremental and agile practices. - Experience with AWS deployment a definite plus.

Individual applying to the role should ideally have the following attributes.

-Passionate about back-end Development and continually follow the platform & innovations

-Strong and innovative approach to problem solving and finding solutions

- Excellent communicator (written and verbal, formal and informal)

- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution

- Ability to multi-task under pressure and work independently with minimal supervision.

- Ability to prioritize when under pressure.