Azure Data Engineer

About Us

We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 

Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 

Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 

Job Description

This is a remote position.

Experience Level​

This role is ideal for engineers with 3–15 years of experience and a strong background in building secure, scalable platforms.

We are looking for hands-on DevOps and Backend Engineers with real-world experience in handling production incidents, distributed systems, and modern infrastructure challenges.

What You’ll Do as a Software Craftsperson

• Design and document real-world DevOps and backend scenarios based on production incidents such as outages, scaling challenges, and secure deployments
• Translate real engineering experiences into benchmark tasks that contribute to training next-generation AI systems
• Contribute to building secure, scalable, Kubernetes-native architectures across modern infrastructure environments
• Work across critical engineering domains including CI/CD pipelines, observability, identity & access management, infrastructure-as-code, and backend services
• Collaborate with internal teams to design and simulate realistic engineering workflows and system behaviors
• Apply practical engineering judgment to model distributed systems challenges and improve system resilience and reliability

Requirements

What You’ll Bring

5–15 years of experience in DevOps and Backend Engineering with a strong foundation in building secure, scalable systems.

Strong hands-on expertise in DevOps and backend technologies including:

• Kubernetes, Terraform, and CI/CD pipelines
• Tools such as k9s, k3s (GitLab CI preferred)
• Backend technologies such as Go, Python, or Java
• Experience with Docker, gRPC, and Kubernetes-native services

Demonstrated experience working with secure, offline or air-gapped deployments (highly preferred)

Familiarity with distributed systems and backend architecture, with exposure to ML or distributed pipelines being a plus.

Hands-on experience across multiple core functional areas, with exposure to at least five of the following:

• Identity & Access Management
• Observability (Prometheus + Grafana)
• CI/CD Pipelines
• Keycloak
• GitLab CI
• Terraform OSS
• Kubernetes ecosystem tools

Strong problem-solving ability with real-world experience in handling production systems, incidents, and infrastructure challenges

Ability to work across multiple layers of the stack, from infrastructure to backend services, while ensuring scalability, reliability, and security

Benefits

Life at Incubyte

We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered.

Our environment is built for crafters: experimenting with real-world systems, solving complex infrastructure challenges, and contributing to cutting-edge AI initiatives. We are all lifelong learners, and our work is our passion.

​

Perks

Dedicated learning & development budget

Sponsorship for conference talks

Comprehensive medical & term insurance

Employee-friendly leave policies

Home Office fund

Medical Insurance

Job Summary:

We are seeking a highly skilled and self-driven Java Backend Developer with strong experience in designing and deploying scalable microservices using Spring Boot and Azure Cloud. The ideal candidate will have hands-on expertise in modern Java development, containerization, messaging systems like Kafka, and knowledge of CI/CD and DevOps practices.Key Responsibilities:

• Design, develop, and deploy microservices using Spring Boot on Azure cloud platforms.
• Implement and maintain RESTful APIs, ensuring high performance and scalability.
• Work with Java 11+ features including Streams, Functional Programming, and Collections framework.
• Develop and manage Docker containers, enabling efficient development and deployment pipelines.
• Integrate messaging services like Apache Kafka into microservice architectures.
• Design and maintain data models using PostgreSQL or other SQL databases.
• Implement unit testing using JUnit and mocking frameworks to ensure code quality.
• Develop and execute API automation tests using Cucumber or similar tools.
• Collaborate with QA, DevOps, and other teams for seamless CI/CD integration and deployment pipelines.
• Work with Kubernetes for orchestrating containerized services.
• Utilize Couchbase or similar NoSQL technologies when necessary.
• Participate in code reviews, design discussions, and contribute to best practices and standards.

Required Skills & Qualifications:

• Strong experience in Java (11 or above) and Spring Boot framework.
• Solid understanding of microservices architecture and deployment on Azure.
• Hands-on experience with Docker, and exposure to Kubernetes.
• Proficiency in Kafka, with real-world project experience.
• Working knowledge of PostgreSQL (or any SQL DB) and data modeling principles.
• Experience in writing unit tests using JUnit and mocking tools.
• Experience with Cucumber or similar frameworks for API automation testing.
• Exposure to CI/CD tools, DevOps processes, and Git-based workflows.

Nice to Have:

• Azure certifications (e.g., Azure Developer Associate)
• Familiarity with Couchbase or other NoSQL databases.
• Familiarity with other cloud providers (AWS, GCP)
• Knowledge of observability tools (Prometheus, Grafana, ELK)

Soft Skills:

• Strong problem-solving and analytical skills.
• Excellent verbal and written communication.
• Ability to work in an agile environment and contribute to continuous improvement.

Why Join Us:

• Work on cutting-edge microservice architectures
• Strong learning and development culture
• Opportunity to innovate and influence technical decisions
• Collaborative and inclusive work environment

We are seeking an experienced Senior Backend Engineer to join our passionate team. If you have a strong background in backend development, a track record of delivering scalable and reliable solutions, and are eager to contribute to complex projects, we would love to hear from you.

Responsibilities:

• Design and develop robust, high-performance backend solutions using Python and related technologies.
• Lead the architecture and design discussions for major backend components and services.
• Collaborate closely with cross-functional teams to gather and analyze software requirements.
• Mentor and guide junior and mid-level engineers, fostering their technical growth.
• Review code and provide constructive feedback to ensure code quality and adherence to best practices.
• Identify and address performance bottlenecks, scalability challenges, and technical issues.
• Participate in sprint planning, task estimation, and agile development processes.
• Keep up-to-date with industry trends, tools, and best practices to continuously improve our backend systems.
• Drive the adoption of coding standards, design patterns, and engineering best practices.
• Collaborate with frontend engineers to ensure seamless integration between frontend and backend components.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
• Minimum of 4 years of professional experience in backend development.
• Strong proficiency in Python and backend frameworks like Django and Flask.
• In-depth knowledge of database systems, both relational (MySQL) and NoSQL (MongoDB, etc. ).
• Proven track record of designing and developing scalable and maintainable backend services.
• Experience with RESTful API design and best practices.
• Solid understanding of software architecture, design principles, and software development lifecycle.
• Previous experience leading or mentoring engineers is a strong plus.
• Strong problem-solving skills and a proactive attitude towards challenges.
• Excellent communication skills, both verbal and written.
• Familiarity with cloud platforms (e. g., AWS, Azure, GCP) and containerization (Docker) is a plus.

Required Skills:

• 3+ years of experience in the Development of JAVA technology.
• Strong Java Basics
• SpringBoot or Spring MVC
• Hands-on experience in Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Any Caching Mechanism
• Good at problem-solving

Good to Have Skills:

• 4+ years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem-solving skills.
• Ability to work in a fast-paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding AI/ML algorithms is a plus.

• Interaction with the Clients, understanding their requirements, collating required data for preparation and submission of the proposal to Banks/ FI's
• In-depth credit assessment involving Financial, Credit, Legal, Technical, Economic and risk analysis
• Structuring the proposal, preparing Information Memorandum, Teasers, Financial model, cash flow and CMA projections
• Ability to lead meetings and negotiations
• Solution-oriented attitude and resolving queries of all Banks and Clients
• Visiting clients office for understanding and collecting data

Should be highly Technical and hands-on experience in Artificial Intelligence and Machine learning and Python. Managing the successful delivery of projects by efficient planning and coordination.

KEY RESPONSIBILITIES OF THE POSITION :

• Create Technical Design for AI, Machine Learning, Deep Learning, NLP, NLU, NLG projects and implement the same in production.
• Solid understanding and experience of deep learning architectures and algorithms
• Working experience with AWS, most importantly AWS SageMaker, Aurora or MongoDB, Analytics and reporting.
• Experience solving problems in the industry using deep learning methods such as recurrent neural networks (RNN, LSTM), convolutional neural nets, auto-encoders, etc.
• Should have experience of 2-3 production implementations of machine learning projects.
• Knowledge of open-source libraries such as Keras, Tensor Flow, Pytorch
• Work with business analysts/consultants and other necessary teams to create a strong solution
• Should have in-depth understanding and experience of Data Science and Machine Learning projects using Python, R, etc. Skills in Java/C are a plus
• Should developing solutions using python in AI/ML projects
• Should be able to train and build a team of technical developers
• Desired to have experience as leads in designing and developing applications/tools using Microsoft technologies - ASP.Net, C#, HTML5, MVC
• Desired to have knowledge on any of the cloud solutions such as Azure or AWS
• Desired to have knowledge on any of container technology such as Docker
• Should be able to build strong relationships with project stakeholders

Keywords:

• Python
• Artificial Intelligence
• Machine Learning
• AWS
• Django
• NLP

• Install and configure software and hardware
• Manage network servers and technology tools
• Set up accounts and workstations
• Monitor performance and maintain systems according to requirements
• Troubleshoot issues and outages
• Ensure security through access controls, backups and firewalls
• Upgrade systems with new releases and models
• Develop expertise to train staff on new technologies
• Build an internal wiki with technical documentation, manuals and IT policies
• Maintain all local software and hardware licensing to ensure conformance.
• Support determination of local and customer needs for yearly budgeting process and request for proposal processes.

• Any B.Tech / BE graduate
• Minimum 3+ years of experience into IT system administration
• A working knowledge of IT operating systems, particularly Windows, IOS
• Hands on experience of installing IT hardware and software
• Strong communication skills

• Proven experience as a System Administrator, Network Administrator or similar role
• Experience with databases, networks (LAN, WAN) and patch management
• Experience with Firewall management
• Handling LAN / WAN networks an coordinating with ISPs
• Working with vendors for purchasing / renting laptops and desktops.
• Knowledge of system security (e.g. intrusion detection systems) and data backup/recovery
• Familiarity with various operating systems and platforms
• Resourcefulness and problem-solving aptitude

Chennai