Senior Azure Data Engineer

JobTitle : Mission Control Software Engineer – Java Backend

Experience : 4+ Years

Location : Bengaluru, Karnataka (On-site)

Employment Type : Full-time

Industry : Space Technology

🧠 Role Overview :

As a Mission Control Software Engineer – Java Backend, you will be a founding member of the Mission Control Software team. You will design and develop the backend core of a distributed, high-reliability system responsible for streaming, processing, and routing satellite data.

This role offers high ownership and the opportunity to directly influence system architecture as it evolves from a single-node deployment to a scalable multi-node system.

🛠️ Tech Stack :

Java 11+, gRPC, REST APIs, PostgreSQL, Docker, Linux, WebSockets, Git, CI/CD

⚙️ Key Responsibilities :

• Design, develop, and maintain backend services in Java (11+) for data ingestion, processing, and control workflows
• Build and enhance gRPC and REST APIs for internal and external system integrations
• Develop modular plugins and middleware for routing, persistence, and automation
• Work with PostgreSQL and other databases for structured and time-series data
• Collaborate with frontend teams to support real-time dashboards via WebSockets/event streaming
• Ensure system scalability, reliability, and observability through logging, metrics, and testing
• Contribute to containerized deployments (Docker) and CI/CD pipelines
• Write clean, maintainable, and well-documented code with strong test coverage

🧩 Required Skills & Experience :

• 4+ years of experience in backend or distributed systems development.
• Strong proficiency in Java (11+), including concurrency and networking concepts.
• Experience with frameworks like Spring Boot, Vert.x, or similar.
• Hands-on experience with gRPC and REST API design.
• Strong knowledge of SQL databases (PostgreSQL preferred) and schema design.
• Experience working in Linux environments, with Git and Docker.
• Familiarity with event-driven systems / messaging queues (Kafka, RabbitMQ, MQTT, etc.).
• Ability to design scalable architectures and write automated tests.

⭐ Good to Have :

• Experience with real-time systems, telemetry, IoT, or satellite systems
• Exposure to distributed systems / microservices / high-availability architectures
• Working knowledge of Python for scripting or integrations
• Experience with monitoring tools like Prometheus and Grafana
• Interest in hardware-software integrated systems

Role & Responsibilities

We are looking for a hands-on Camunda Developer with strong experience in workflow orchestration and backend development. The ideal candidate should be able to design, build, and optimize end-to-end business processes using Camunda (preferably Camunda 8) and work closely with engineering and business teams to implement scalable and resilient workflows.

Key Responsibilities:

• Translate business requirements into BPMN workflows using Camunda (preferably Camunda 8)
• Design and implement end-to-end process orchestration across systems
• Build and manage service integrations (REST APIs, event-driven systems)
• Develop and maintain Zeebe workers / microservices (Python)
• Collaborate with stakeholders to refine workflows and handle edge cases
• Implement error handling, retries, and compensation mechanisms
• Analyse and improve workflows for scalability, reliability, and performance
• Ensure data consistency and idempotent process execution
• Work with cross-functional teams including data and analytics for process observability

Ideal Candidate

• Strong Senior Camunda Developer / Workflow Orchestration Engineer Profiles
• Mandatory (Experience 1) – Must have 4+years of hands-on experience in backend development and workflow systems, demonstrable through production-grade work on business process automation or backend service development.
• Mandatory (Experience 2) – Must have strong hands-on experience with Camunda and BPMN 2.0, including designing, building, and deploying end-to-end business process workflows in production.
• Mandatory (Experience 3) – Must have hands-on experience with Zeebe workers and the Camunda 8 stack, built and maintained as part of real orchestration systems.
• Mandatory (Experience 4) – Must have strong production-level coding skills in Python, used for building and maintaining Zeebe workers and microservices.
• Mandatory (Experience 5) – Must have experience designing and working within microservices architecture and distributed systems, with clear understanding of service decomposition, inter-service communication, and distributed system failure modes.
• Mandatory (Experience 6) – Must have hands-on experience building and consuming REST APIs and working with event-driven systems (message brokers, pub/sub, event streams).
• Mandatory (Skills) – Must have strong debugging and problem-solving skills in production workflow environments, with specific examples of resolving complex issues such as stuck processes, race conditions, or data inconsistency bugs.
• Preferred (Experience 1) – Exposure to cloud platforms (AWS / GCP / Azure) and experience with data platforms (e.g., Snowflake).
• Preferred (Experience 2) – Understanding of finance-related workflows (billing, reconciliation, etc.).

About the role: 

· Understand the project test requirements.

· Execute and evaluate automated test cases/suites and report test results to ensure that system functionality satisfies acceptance criteria.

· Create and maintain automation scripts using the Robot Framework

· Help create acceptance criteria for user stories.

· Log bug reports based on test execution.

· Collaborate with the development team to prioritize test scenarios.

· Collaborate with the development team to perform root cause analysis.

· Other duties assigned.

Position Requirements:

Essential Skills:

· Knowledgeable in Software Automation using Robot Framework

· Knowledgeable in API testing (Postman)

· Experience working in an Agile environment using Scrum or Kanban

· Proficiency in scripting and programming languages (Python preferred)

· Experience with REST API testing and the relevant testing tools.

· Understanding the differences between JSON, YAML, and XML.

· Experienced with CI/CD.

· Experience testing web applications and different types of testing approaches and test environments.

· Experience in test risk management.

· Experience in using GIT repositories would be great.

· A passion for software product quality assurance with a positive mindset and good communication skills.

· Keen eye for detail.

Good to Have

· ISTQB foundation level certification

· Familiar with other automation testing tools like Selenium and Katalon Studio

· Suggest / make framework improvements to accommodate the scripting needs

· Implemented automation framework using Behavior-Driven Development (BDD) approach

· Familiarity with the Test Pyramid would be great.

· Experience working with JIRA

Non-technical requirements:

● You are available to join us in our Bangalore office from Day 1.

● You have strong communication skills.

● You have strong analytical skills.

● You are customer friendly and service minded.

● You are a team player.

Skills:

• Expertise in Python 3 on AWS serverless
• Experience in AWS serverless stack Appsync, Lambda, Cognito, API Gateway, DynamoDB, Elasticsearch, SQS, S3, Code commit & Code Deploy.
• Proficient in modern microservice-based architectures and methodologies.
• Experience in a database technology, preferably No-SQL such as AWS DynamoDB.
• Build human-centric UX with us using technologies like React, TypeScript, GraphQL, and CSS-in-JS.
• Experience building data processing pipelines (SQS, Kinesis, DynamoDB, AWS Lambda, or similar)
• Deep technical hands-on experience developing in REST/JSON or SOAP/XML, combined with strong knowledge of concepts such as CORs (Cross Origins Resources), headers, security, JSON and http concept.
• Experience with Github and advanced Github features (good to have).
• Must have worked as a part of Agile Teams and DevOps practices such as continuous Integration tools (e.g. Jenkins), code repository, creating CI/CD pipelines is required.

About us

At Lucidity, we are a year and a half old company and we work on helping large enterprises manage their cloud storage platform. 

Our founders bring with them more than a decade of experience working with top tech Gaints in the world, building and selling large tech products from zero to one. We are seeing a lot of early traction and expanding aggresively.

We are a B2B product based startup building the next generation of storage orchestration system for cloud. We are hiring agressively across multiple roles and looking for passionate engineers to join a very young and energetic team at Lucidity.

What you'll do

Technology is at the heart of our organization. As part of the tech team you will

• Understand product requirements and brainstorm ways to address them.
• Build features from scratch and have complete ownership for it.
• Deliver efficient, reliable, scalable code with high automated test coverage.
• Contribute to team decisions in the overall architecture and practices of the company.

What you'll need

Must haves

• At least 1 year experience in a product based company.
• Experience working with distributed environments.
• Comfortable with at least one Object Oriented Programming language.
• Hands on with AWS or at least one other public cloud.

Good to have

• Experience handling highly scalable systems.
• Experience with at least one among C++, Java.
• Experience with docker and Kubernetes.
• Experience with Linux file systems.

Additional

• B Tech/M Tech in Computer Science or equivalent from a reputed college.
• Good problem solving skills.
• Deeply technical with a track record of successful delivery.

Why us
We're hiring a set of highly skilled, enthusiastic and passionate people who thrive in a high growth environment. We believe the best way to grow is to give everyone the opportunity to pursue their interests. At Lucidity, you have complete freedom to work on projects that interest you. Plus, with benefits like flexible hours, company offsites, unlimited leaves, we ensure you enjoy the journey as much as we do.

• As a polyglot developer Ideally, you should have:
• 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
• Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
• Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
• Good communication and ability to work in a consulting environment is essential

• Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
• Build custom software using the latest technologies and tools Craft your own career path

• Providing solution to real problems in Bigdata world.
• RnD on using the latest tools,techniques and cloud services.
• Automating the manual-timetaking tasks.
• Hands-on coding, usually in a pair programming environment.
• Working in highly collaborative teams and building quality code
• Working in lots of different domains and client environments
• Understanding the business domain deeply