Data Engineer

Location: Pune/Bengaluru

As a Senior Software Engineer, you will tackle a highly challenging role within our Cyber Security Engineering integration development team. You will be responsible for the End-to-End (E2E) delivery of projects from gathering customer requirements to deploying high-performance data exchange solutions on-prem or in the cloud. We are looking for a Systems-Level Thinker who can seamlessly transition between building complex integrations and architecting high-throughput, low-latency backends. Because each integration may require a different technical approach, we value engineers who love reskilling, following agile best practices, and maintaining an evolving mindset.

Core Responsibilities

Technical Leadership and Architecture

● Systems Engineering: Design, build, and optimize high-throughput, low-latency backend systems and data-exchange layers.

● Architecture and Integration: Participate in planning, defining, and exploring solution alternatives. Architect and estimate deep technical custom solutions and integrations across diverse enterprise tech stacks. ● Stream Processing: Implement event-driven architectures, manage backpressure, and handle real-time state management across security platforms.

● Delivery Ownership: Own projects end-to-end, defining and implementing enablers to evolve solution intent directly alongside our Agile teams.

Team Leadership and Quality

● Mentorship: Actively lead, coach, and mentor junior developers, providing technical guidance to foster professional development.

● Engineering Excellence: Oversee code reviews, build robust CI/CD pipelines, enforce strict quality checks, and ensure rigorous adherence to coding standards.

● Agile Execution: Actively participate in Agile development, including writing, breaking down, and estimating User Stories.

Customer and Stakeholder Collaboration

● Customer Delight: Maintain a strong customer-first attitude while designing, building, and deploying products.

● Technical Communication: Articulate complex technical trade-offs clearly to both business stakeholders and engineering teams.

● Pipeline Management: Manage customer relationships effectively to ensure a continuous flow of project scope, maintaining clear team backlogs.

Job Requirements

● Experience: 5+ years of proven software engineering experience, with a track record of leading small engineering teams or mentoring junior devs.

● High-Throughput Backend Focus: 5+ years of experience engineering robust, real-time backends specifically using Go (Golang) or Java.

● Polyglot and Integration Capability: Deep expertise in at least one or two additional languages/frameworks from our ecosystem: Python, TypeScript, Node.js, React.js, Angular, C#, or C++.

● Computer Science Fundamentals: Excellent knowledge of complex Data Structures, algorithms, and their correct situational usage.

● Adaptability: A passionate programmer who is genuinely open and excited to learn new software development skills as required by changing project demands.

Bonus / Added Advantages

● AI & Intelligent Automation: Hands-on knowledge of AI concepts, Large Language Models (LLMs), and experience building or integrating AI agents to automate complex workflows or security processes.

● Cybersecurity Domain: Experience in the cybersecurity space (SIEM, SOAR, or platform security).

● Modern Web Tech: Strong experience in developing software using modern web technologies.

● E2E Lifecycle: Proven background handling a project completely from discovery to cloud/on-prem deployment.

● Open Source: Active contributions to the Open Source community. (Please share your GitHub/GitLab links in your application!)

Strong Staff Software Engineer / FDE profile (full-stack + production GenAI, multi-team technical leadership)

Mandatory (Experience 1) – Must have 7+ years of relevant professional software engineering experience, with demonstrated full-stack delivery across backend and frontend.

Mandatory (Experience 2) – Must have deep production experience with Python AND JavaScript/TypeScript, working comfortably across the full stack.

Mandatory (Experience 3) – Must have hands-on experience architecting production generative AI applications — LLM integrations, vector databases, RAG systems, and evaluation pipelines

Mandatory (Experience 4) – Must have strong experience with modern frontend frameworks (Next.js / React) and backend API development.

Mandatory (Experience 5) – Must have extensive experience with cloud platforms (AWS preferred; Azure/GCP valued), including infrastructure-as-code (CloudFormation / Terraform).

Mandatory (Experience 6) – Must have working knowledge of multiple database paradigms — relational (PostgreSQL), document, and key-value (Redis) — with ability to select the right storage per problem.

Mandatory (Experience 7) – Must have strong experience with CI/CD pipelines (e.g. GitHub Actions), containerization, and production deployment strategies.

Mandatory (Experience 8) – Must have demonstrable fluency with AI coding tools (Claude Code, Cursor, GitHub Copilot, or similar) and proven ability to design agentic engineering workflows and train teams on them

Build backend systems that make complex workflows reliable, maintainable, and easier to evolve. You’ll work on production Python services, modernize existing applications, and deliver APIs and integrations used by real teams.

The role is focused on backend development using Python, Django, and FastAPI, with occasional contributions to frontend applications built with React or Next.js. You will work across API development, system integrations, data workflows, background processing, and the modernization of existing services.

You will help improve reliability and operational maturity using AWS, practical Site Reliability Engineering principles, and observability platforms such as Datadog, Grafana, CloudWatch, Prometheus, or similar tools.

This is a backend-first role for an engineer who understands that testing, security, reliability, and observability are core parts of production software development.

What you'll do

• Own the delivery and day-to-day reliability of clearly scoped backend features and APIs built with Python, Django, and FastAPI.
• Improve the maintainability of existing services by simplifying legacy workflows, business logic, data models, and integrations.
• Deliver secure, well-documented APIs that enable frontend applications, internal tools, and third-party integrations.
• Keep data workflows reliable through safe schema changes, migrations, backfills, validation, and failure recovery.
• Build background jobs and asynchronous workflows that handle retries, timeouts, rate limits, idempotency, and operational failures.
• Raise confidence in releases through automated tests, thoughtful code reviews, and production-readiness checks.
• Improve performance and reliability using profiling, query optimization, caching, monitoring, and practical fault handling.
• Make services easier to operate by maintaining useful logs, metrics, dashboards, alerts, and runbooks.
• Contribute to React or Next.js integrations and internal administration interfaces when needed to deliver complete product outcomes.
• Collaborate with product, frontend, platform, DevOps, SRE, and operations teammates to ship well-scoped solutions and document technical decisions.

What we're looking for

Required

• 3–5 years of professional software engineering experience, mainly in backend development.
• Good proficiency in Python and production experience with either Django or FastAPI, with willingness to learn the other.
• Practical experience designing REST APIs and integrating with third-party or internal services.
• Working knowledge of SQL, relational databases, an ORM such as Django ORM or SQLAlchemy, and database migrations.
• Experience writing automated tests and diagnosing defects or production issues.
• Good problem-solving, communication, documentation, and collaboration skills.

Preferred

• Familiarity with background jobs or asynchronous processing using Celery, SQS, RabbitMQ, Kafka, or similar tools.
• Experience deploying or supporting applications on AWS or another cloud platform.
• Familiarity with structured logging, metrics, dashboards, alerts, and observability tools.
• Exposure to React or Next.js integrations.
• Experience with Docker, Redis, webhooks, queues, or event-driven systems.
• Familiarity with CI/CD pipelines, infrastructure-as-code, secrets management, and least-privilege access.
• Experience helping with production incidents, performance testing, or safe deployment practices.

Strong Senior Backend Engineer profiles

Mandatory (Experience 1) – Must have 5+ years of hands-on Backend Engineering experience building scalable, production-grade systems

Mandatory (Experience 2) – Must have strong backend development experience using one or more frameworks (FastAPI / Django (Python), Spring (Java), Express (Node.js).

Mandatory (Experience 3) – Must have deep understanding of relevant libraries, tools, and best practices within the chosen backend framework

Mandatory (Experience 4) – Must have strong experience with databases, including SQL and NoSQL, along with efficient data modeling and performance optimization

Mandatory (Experience 5) – Must have experience designing, building, and maintaining APIs, services, and backend systems, including system design and clean code practices

Mandatory (Domain) – Experience with financial systems, billing platforms, or fintech applications is highly preferred (fintech background is a strong plus)

Mandatory (Company) – Must have worked in product companies / startups, preferably Series A to Series D

Mandatory (Education) – Candidates from top engineering institutes (IITs, BITS, or equivalent Tier-1 colleges) are preferred

Job Description

Build and maintain bots on Azure platform.  Integration with Active directory, WEB API based integration with external systems. Training and Integrate bots as per users’ requirements. Work in line with design guidelines, best practices and standards of bot deliverable. Creative approach to the conversation flow design, human aspects in the bot responses and sentiments

Qualifications

1. a) 5 years of experience in software development with clear understanding of the project life cycle
   b) Min 2-3 years of hands-on experience in Microsoft Azure Bot Framework , LUIS and other Cognitive services offered by Azure
   c) Hands on experience with Machine Learning based chat bots
   d) Experience with Azure bot services like Text Analytics etc.
   e)Strong database skills and hands-on experience on databases like SQL Server/Oracle
2. f) Strong experience on Azure Active directory and adaptive cards integration in Chat bot.
3. g) Strong experience designing and working with

with service-oriented architectures (SOA) and WebAPIs.

1. h) A strong experience on Microsoft Azure, ASPNET / MVC and programming languages such as C# / VBNET
2. i) Knowledge of Python and NodeJS is a plus
3. j) Ability to design and optimize SQL Server 2008 stored procedures.
4. k) Experience with JQuery, CSS3, HTML5 or similar technologies.
5. l) Ability to adapt quickly to an existing, complex environment.

Python Backend Developer (5+ years experience)

We are seeking an experienced Python Backend Developer with at least 5 years of hands-on experience in Python and Django development. The ideal candidate will have a strong background in MySQL and MongoDB databases, as well as knowledge of HTML, CSS, JavaScript frameworks, and cloud technologies like AWS, Azure or Google Cloud.Key Responsibilities:

• Design and develop scalable, high-performance Python applications using the Django framework
• Write clean, maintainable, and well-documented code
• Optimize database queries and schema design for improved performance
• Integrate applications with various APIs and third-party services
• Collaborate with cross-functional teams to gather requirements and deliver solutions
• Participate in code reviews, testing, and deployment processes
• Continuously learn and stay updated with the latest technologies and best practices

Required Skills and Experience:

• Bachelor's or Master's degree in Computer Science, Information Technology or a related field
• 5+ years of professional experience in Python and Django development
• Proficient in MySQL and MongoDB databases, with the ability to write complex queries and optimize database performance
• Hands-on experience with HTML, CSS, and at least one JavaScript framework (e.g., React, Angular, Vue.js)
• Knowledge of cloud technologies like AWS, Azure, or Google Cloud is preferred
• Strong problem-solving and algorithmic skills
• Excellent communication and teamwork skills
• Passion for continuous learning and innovation

Preferred Qualifications:

• Experience in developing and deploying applications on cloud platforms
• Knowledge of containerization technologies like Docker and Kubernetes added advantages

1. Relevant Experience required 3 to 5 years.
2. Strong proficiency in python programming language along with expertise in backend development framework such as
3. Django or Flask. (DSA and Design patterns are mandatory).
4. Hand on Experience in REST API development and database such as PostgreSQL.
5. Good knowledge of versions control systems like GIT, Bitbucket
6. Implementation testing strategies such as unit testing (PyTest), integration testing and end to end testing 
7. Basic knowledge of Docker/Podman and Jenkins.
8. Good have if they basic knowledge in Mainframe tech such JCL, and TWs.

About the Role-

Thinking big and executing beyond what is expected. The challenges cut across algorithmic problem solving, systems engineering, machine learning and infrastructure at a massive scale.

Reason to Join-

An opportunity for innovators, problem solvers & learners.  Working will be Innovative, empowering, rewarding & fun. Amazing Office, competitive pay along with excellent benefits package.

Requiremets and Responsibilities- (please read carefully before applying)

• The overall experience of 3-6 years in Java/Python Framework and Machine Learning.
• Develop Web Services, REST, XSD, XML technologies, Java, Python, AWS, API.
• Experience on Elastic Search or SOLR or Lucene -Search Engine, Text Mining, Indexing.
• Experience in highly scalable tools like Kafka, Spark, Aerospike, etc.
• Hands on experience in Design, Architecture, Implementation, Performance & Scalability, and Distributed Systems.
• Design, implement, and deploy highly scalable and reliable systems.
• Troubleshoot Solr indexing process and querying engine.
• Bachelors or Masters in Computer Science from Tier 1 Institutions