11+ HDFS Jobs in Pune | HDFS Job openings in Pune

Job Description:

We are looking for a Senior Java Developer with strong expertise in Apache Kafka and backend systems. The ideal candidate will have hands-on experience in Java (8/11+), Spring Boot, and building scalable, real-time data pipelines using Kafka.

Key Responsibilities:

• Develop and maintain backend services using Java and Spring Boot
• Design and implement Kafka-based messaging and streaming solutions
• Optimize Kafka performance (topics, partitions, consumers)
• Collaborate with cross-functional teams to deliver scalable microservices
• Ensure code quality and maintain best practices in a distributed environment

Required Skills:

• 6+ years in Java development
• 3+ years of hands-on Kafka experience (producers, consumers, streams)
• Strong knowledge of Spring Boot, REST APIs, and microservices
• Familiarity with Kafka Connect, Schema Registry, and stream processing
• Experience with containerization (Docker), CI/CD, and cloud platforms (AWS/GCP/Azure)

Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.

You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.

Required Experience:

• Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
• Have experience working and strong understanding of object-oriented programing and cloud technologies
• End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
• Strong experience with unit and integration testing of the Spring Boot APIs.
• Strong understanding and production experience of RESTful API's and microservice architecture.
• Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.

Nice to have's (but not required):

• Exposure to Kotlin or other JVM programming languages
• Strong understanding and production experience working with Docker container environments
• Strong understanding and production experience working with Kafka
• Cloud Environments: AWS, GCP or Azure

Requirements

• 3+ years of experience in the Development of JAVA technology.
• Strong Java Basics
• Linux
• SpringBoot or Spring MVC
• Hands-on experience in Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Java 8
• Any Caching Mechanism
• Good at problem-solving

Good to Have Skills:

• 3 years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem-solving skills.
• Ability to work in a fast-paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding AI/ML algorithms is a plus.

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development,  Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of  using Python/Perl/Shell

Please note - Hbase hive and spark are must.

• You will be responsible for design, development and testing of Products
• Contributing in all phases of the development lifecycle

• Writing well designed, testable, efficient code
• Ensure designs are in compliance with specifications

• Prepare and produce releases of software components

• Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

• Some of the technologies you will be working on: Core Java, Solr, Hadoop, Spark, Elastic search, Clustering, Text Mining, NLP, Mahout and Lucene etc.