Software Engineer

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.

Experience: 3-10 Years

Qualification- Graduation: Bachelor of Science (B.Sc) / Bachelor of Technology (B.Tech) / Bachelor of Computer Applications (BCA)

Post-Graduation: Master of Science (M.Sc) /Master of Technology (M.Tech) / Master of Computer Applications (MCA)

Roles and Responsibilities:

• Must have experience in Microservice architecture with the ability to collaborate effectively with team members and build positive working relationships.
• Design and build and deploy APIs to meet business requirements.
• High level of commitment to business satisfaction and agility.
• Strong work ethic and a passion for the role, with a positive attitude and a willingness to learn.
• Communicate effectively with the tech lead to thoroughly understand the requirements and highlight any blockers immediately.
• Handle programming and software development, including requirement gathering, bug fixing, testing, documenting, and implementation.
• Work in an agile environment to deliver high-quality solutions.
• Understand and implement Security, Logging, Auditing, Policy Management, and Performance Monitoring.
• Familiarity with relational databases (E.g.: Oracle), non-relational databases (E.g.: MongoDB), MSK Kafka, Docker, Kubernetes, and CICD Technologies (Jenkins, GitHub, Maven)

Need Immediate Joiners only (4-5 days)

Overall experience 6+ years and relevant at least 2+ years in Golang with Java

● Strong design and architectural experience in building various highly-scalable and

highly-available products

● Strong understanding of the SDLC Activities which include Analysis, Design, Development,

Testing, Deployment and Post-Production Support etc.

● Proficiency in at least one server side framework for languages preferably Go Lang

● Experience working on NoSQL & SQL Databases such as MySQL, PostgreSQL, MongoDB,

Redis etc

● Deep Dive, problem-solving, RCA and systematic thinking to reach the cause of issues

● Able to work independently and multi-task effectively

● Program at a system level and able to manage service stability

● Excellent experience maintaining, scalable, extensible code

● Methodical in maintaining up to date documentation

● Metric-driven mindset and obsessive about ensuring clean coding practices

● Preferred experience in product development

● Preferred working experience on microservices platforms

● Proficiency in at least one modern web front-end development framework such as React JS

will be a bonus

Good to Have Skills:

● Preferred experience in Elasticsearch and Kibana (ELK Stack)

● Preferred experience with messaging systems like RabbitMQ

• 5-8 years of experience as a Java/J2EE developer.
• 1-3 years of experience with Angular / React is desirable.
• 1-3 years of experience in using Spring and Spring Boot frameworks.
• Thorough knowledge of server-side development.
• Proven experience as a Full Stack Developer or similar role.
• Good understanding of web services (WSDL SOAP, RESTful).
• Hands-on experience in using Application Servers like WebSphere.
• Expertise in relational databases (Oracle, SQL Server).
• E-commerce domain knowledge is desirable.
• Prior experience in developing desktop and mobile applications.
• Familiarity with common stacks.
• Knowledge of multiple frontend languages and libraries, like HTML/ CSS, JavaScript, XML, jQuery.
• Experience in implementation of Microservices
• Experience with AWS (S3, SQS, SNS, ECS, EC2, ALB, API Gateway, Lambda, etc.) is highly desirable
• Good understanding of Docker & Kubernetes is highly desired.
• Familiarity with databases (MySQL, MongoDB, PostgresSQL), web servers (Apache), and UI/UX designs.

Job Description / Roles & Responsibilities (in Detail)Job Description

Work with Architect to define Application, Integration and Security Design for various components involved.

Design, development and build of java solution components/modules and integrations

Hands on knowledge in technology areas like Core Java, Java 8, Web services (SOAP and REST), Spring boot, Spring Frameworks, Spring Data JPA, REST/SOAP services, Spring cloud, Spring MVC, JSON & XML based processing. Strong command on Java/J2EE & OOPs concepts and current industry trends. Working knowledge of Java 8, 11 new features.

Working knowledge of cloud based server less application development on any of cloud platforms like AWS/Azure/GCP. Candidate with experience in Cloud native application development experience will be preferred.

Working knowledge in any of the databases like Mongo DB/Oracle/MySQL/SQL Server.

Working knowledge in any of messaging platforms like Apache Kafka/Rabbit MQ/JMS/AWS SQS/Azure Event Hub/Service Bus.

Production implementation experience for large enterprise applications using Java/J2EE will be preferred.

Experience in implementing Web services Security using WS-Security, SAML, OAUTH2, Kerberos and integrating with Identity providers, LDAP and ADFS. Experience working with credential vaults will be add-on.

Strong knowledge on design and integration patterns especially in applications involving Portals/SSO, legacy applications, B2B Applications, external partners using enterprise service bus.

Well versed with ensuring coding standards, DevOps CICD implementations, version management, branching strategy, security principles.

Ensure code quality and standards are followed. Experience in test automation is plus.

Up-to-date technical knowledge by attending educational workshops, reviewing publications

Must skills:

Hands- on in the following:

• Java 8/J2EE
• Spring boot
• Gradle/Maven
• REST API
• ORM- hibernate/ JPA
• Unit Testing and Integration Testing- Junit/ TestNG

Good to have:

Hands-on in the following:

• CI/CD pipeline deployment
• Messaging- ActiveMQ/RabbitMQ/MQ
• DB2
• Kafka
• NoSQL framework exposure