11+ HDFS Jobs in Pune | HDFS Job openings in Pune

Job Description:

We are looking for a Senior Java Developer with strong expertise in Apache Kafka and backend systems. The ideal candidate will have hands-on experience in Java (8/11+), Spring Boot, and building scalable, real-time data pipelines using Kafka.

Key Responsibilities:

• Develop and maintain backend services using Java and Spring Boot
• Design and implement Kafka-based messaging and streaming solutions
• Optimize Kafka performance (topics, partitions, consumers)
• Collaborate with cross-functional teams to deliver scalable microservices
• Ensure code quality and maintain best practices in a distributed environment

Required Skills:

• 6+ years in Java development
• 3+ years of hands-on Kafka experience (producers, consumers, streams)
• Strong knowledge of Spring Boot, REST APIs, and microservices
• Familiarity with Kafka Connect, Schema Registry, and stream processing
• Experience with containerization (Docker), CI/CD, and cloud platforms (AWS/GCP/Azure)

Requirements

• Extensive and expert programming experience in at least one general programming language (e. g.

Java, C, C++) & tech stack to write maintainable, scalable, unit-tested code.

• Experience with multi-threading and concurrency programming.

• Extensive experience in object oriented design skills, knowledge of design patterns, and a huge passion

and ability to design intuitive modules and class-level interfaces.

• Excellent coding skills - should be able to convert design into code fluently.

• Knowledge of Test Driven Development.

• Good understanding of databases (e. g. MySQL) and NoSQL (e. g. HBase, Elasticsearch, Aerospike etc).

• Strong desire to solve complex and interesting real world problems.

• Experience with full life cycle development in any programming language on a Linux platform.

• Go-getter attitude that reflects in energy and intent behind assigned tasks.

• Worked in a startup-like environment with high levels of ownership and commitment.

• BTech, MTech or Ph. D. in Computer Science or related technical discipline (or equivalent).

• Experience in building highly scalable business applications, which involve implementing large complex

business flows and dealing with huge amounts of data.

• 3+ years of experience in the art of writing code and solving problems on a large scale.

• Open communicator who shares thoughts and opinions frequently, listens intently, and takes

constructive feedback.

Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.

You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.

Required Experience:

• Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
• Have experience working and strong understanding of object-oriented programing and cloud technologies
• End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
• Strong experience with unit and integration testing of the Spring Boot APIs.
• Strong understanding and production experience of RESTful API's and microservice architecture.
• Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.

Nice to have's (but not required):

• Exposure to Kotlin or other JVM programming languages
• Strong understanding and production experience working with Docker container environments
• Strong understanding and production experience working with Kafka
• Cloud Environments: AWS, GCP or Azure

Hi,

We are hiring for the position of Java Tech Lead. Please find below the details for the same.

A passionate developer who has a strong working knowledge of OOPS and functional programming

principles. Standard Definitions and abbreviations don't entice us that much.

Key skills:

• Strong Java and J2EE background with 5-7 years of experience.

• Strong working experience in Multi-Threading, Exception Management and the Use of Collections.

• Sound knowledge of working with application aspects i.e., Caching, Asynchronous APIs, Logging etc.

• Experience with web application frameworks like Spring Boot or Dropwizard.

• Unit Testing is an everyday affair and hence demands very good unit testing skills using tools like Junit & TestNG.

• Understanding of relational databases, RESTful services, and build tools like Maven & Gradle

• Knows what and when to mock and has used frameworks like Mockito/Power Mock.

• Understanding of message queues such as ActiveMQ, Kafka, and RabbitMQ.

•  Version Control is treated as important as programming skills. Fluent with version control tools like Git and Bitbucket.

• Exposure to Agile/Scrum, TDD not in theory but in practice.

•  Experience with Continuous Integration, Continuous Deployment, Static Code Analysis, Jenkins and SonarQube.

•  Willingness to take ownership of the technical solution and ensure technical expectations of deliverables are met.

• Strong communication skills along with the ability to articulate technical designs and concepts.

• Exposure to cloud and containerization would be a plus.

• Hands-on experience in application development in an enterprise setup.

• Have a good understanding of Distributed Application Architecture.

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development,  Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of  using Python/Perl/Shell

Please note - Hbase hive and spark are must.

Role: Java developer
Experience: 4+ years

Job description

○ Working experience on JAVA,Spring Boot. (on building web services?)

○ NOSQL DynamoDB knowledge is plus

○ Working experience in building micro services and distributed systems

○ Working experience on using messaging queues RabbitMQ/Kafka is plus

Desired Candidate Profile

• A team focus with strong collaboration and communication skills
• Exceptional ability to quickly grasp high-level business goals, derive requirements, and translate them into effective technical solutions
• Exceptional object-oriented thinking, design and programming skills (Java 8 or 11)
• Expertise with the following technologies : Data Structures, Design Patterns ,Code Versioning Tools(Github/bitbucket/..), XML, JSON, Spring Batch Restful, Spring Cloud, Grafana(Knowledge/Experience), Kafka, Spring Boot, Microservices, DB/NoSQL, Docker, Kubernetes, AWS/GCP, Architecture design (Patterns) Agile, JIRA.
• Penchant toward self-motivation and continuous improvement; these words should describe you: dedicated, energetic, curious, conscientious, and flexible.

•  2 - 6 years of software development experience
•  Good grasp on programming fundamentals including OOP, Design Patterns and Data Structures
•  Excellent analytical, logical and problem-solving skills
• Software Development Engineer
• Good understanding of complexities involved in designing/developing large scale systems
• Strong system design skills
•  Experience in technologies like Elasticsearch, Redis, Kafka etc
• Good knowledge of relational and NoSQL databases
• Familiarity with common machine learning algorithms. In-depth knowledge is a plus
• Experience of working with big data technologies like Hadoop, Spark, Hive is a big plus
• Ability to understand business requirements and take ownership of the work
• Exhibit passion and enthusiasm for building and maintaining large scale platforms