Hadoop Developer

Position : Software Engineer (Java Backend Engineer)

Experience : 4+ Years

📍 Location : Bangalore, India (Hybrid)

Mandatory Skills : Java 8+ (Advanced Features), Spring Boot, Apache Spark (Spark Streaming), SQL & Cosmos DB, Git, Maven, CI/CD (Jenkins, GitHub), Azure Cloud, Agile Scrum.

About the Role :

We are seeking a highly skilled Backend Engineer with expertise in Java, Spark, and microservices architecture to join our dynamic team. The ideal candidate will have a strong background in object-oriented programming, experience with Spark Streaming, and a deep understanding of distributed systems and cloud technologies.

Key Responsibilities :

• Design, develop, and maintain highly scalable microservices and optimized RESTful APIs using Spring Boot and Java 8+.
• Implement and optimize Spark Streaming applications for real-time data processing.
• Utilize advanced Java 8 features, including:
• Functional interfaces & Lambda expressions
• Streams and Parallel Streams
• Completable Futures & Concurrency API improvements
• Enhanced Collections APIs
• Work with relational (SQL) and NoSQL (Cosmos DB) databases, ensuring efficient data modeling and retrieval.
• Develop and manage CI/CD pipelines using Jenkins, GitHub, and related automation tools.
• Collaborate with cross-functional teams, including Product, Business, and Automation, to deliver end-to-end product features.
• Ensure adherence to Agile Scrum practices and participate in code reviews to maintain high-quality standards.
• Deploy and manage applications in Azure Cloud environments.

Minimum Qualifications:

• BS/MS in Computer Science or a related field.
• 4+ Years of experience developing backend applications with Spring Boot and Java 8+.
• 3+ Years of hands-on experience with Git for version control.
• Strong understanding of software design patterns and distributed computing principles.
• Experience with Maven for building and deploying artifacts.
• Proven ability to work in Agile Scrum environments with a collaborative team mindset.
• Prior experience with Azure Cloud Technologies.

Job Description

We are seeking a highly skilled and experienced Backend Engineer to join our dynamic and fast-paced development team in Bangalore. The ideal candidate will have expertise in Java development, particularly in Java 8 or above, and extensive hands-on experience with Apache Spark, Spark Streaming, and Spring Boot for developing scalable and high-performance microservices. The candidate must also have strong problem-solving skills, a deep understanding of distributed computing, and experience with cloud technologies (Azure).

Key Responsibilities

• Design, develop, and maintain highly scalable microservices and optimized RESTful APIs using Spring Boot in Java 8 or above.
• Write efficient and maintainable Spark and Spark Streaming code for processing large-scale data in real-time.
• Implement Java 8 advanced features such as Functional Interfaces, Lambda Expressions, Streams, Parallel Streams, Completable Futures, and Concurrency API improvements.
• Work with relational (SQL) and non-relational (Cosmos DB) databases for data modeling and optimization.
• Utilize Maven for building and deploying artifacts to the snapshot repository.
• Collaborate with cross-functional teams, including Product, Business, Automation, and other stakeholders, to define, design, and deliver new features.
• Follow Agile SCRUM methodologies for software development and actively participate in sprint planning and retrospective meetings.
• Maintain version control using Git and ensure best practices for code collaboration and peer code reviews.
• Implement CI/CD pipelines using tools such as Jenkins and GitHub Actions to automate build and deployment processes.
• Work with Azure Cloud Technologies to build and deploy cloud-based applications.
• Apply software design patterns and best practices in backend development to enhance system architecture and scalability.
• Troubleshoot and debug applications, ensuring high performance, security, and scalability.
• Keep up to date with the latest industry trends, tools, and technologies to continuously improve development processes.

Minimum Qualifications

• BS/MS in Computer Science or equivalent.
• 4+ years of industry experience in developing highly scalable microservices and optimized RESTful APIs using Spring Boot in Java 8 or above.
• 3+ years of experience in version control tools like Git.
• 3+ years of experience working in an Agile SCRUM environment.
• Strong understanding of software design patterns and distributed computing concepts.
• Solid experience in relational and non-relational databases (SQL and Cosmos DB).
• Experience with Maven for building and managing dependencies.
• Knowledge of CI/CD workflows and experience with Jenkins and GitHub Actions.
• Prior enterprise experience in working with Azure Cloud Technologies.
• Proven ability to work collaboratively with cross-functional teams to deliver high-quality product features.
• Strong problem-solving skills, debugging techniques, and ability to troubleshoot complex issues efficiently.

Preferred Qualifications

• Experience with Kafka or other messaging queues for real-time data processing.
• Exposure to Docker, Kubernetes, and container orchestration tools.
• Hands-on experience with NoSQL databases like MongoDB, Cassandra, or DynamoDB.
• Experience with performance optimization techniques for backend applications.
• Knowledge of test-driven development (TDD) and unit testing frameworks like JUnit.

Location: Pune

Required Skills : Scala, Python, Data Engineering, AWS, Cassandra/AstraDB, Athena, EMR, Spark/Snowflake

Roles and Responsibilities

Requirements

• Extensive and expert programming experience in at least one general programming language (e. g.

Java, C, C++) & tech stack to write maintainable, scalable, unit-tested code.

• Experience with multi-threading and concurrency programming.

• Extensive experience in object oriented design skills, knowledge of design patterns, and a huge passion

and ability to design intuitive modules and class-level interfaces.

• Excellent coding skills - should be able to convert design into code fluently.

• Knowledge of Test Driven Development.

• Good understanding of databases (e. g. MySQL) and NoSQL (e. g. HBase, Elasticsearch, Aerospike etc).

• Strong desire to solve complex and interesting real world problems.

• Experience with full life cycle development in any programming language on a Linux platform.

• Go-getter attitude that reflects in energy and intent behind assigned tasks.

• Worked in a startup-like environment with high levels of ownership and commitment.

• BTech, MTech or Ph. D. in Computer Science or related technical discipline (or equivalent).

• Experience in building highly scalable business applications, which involve implementing large complex

business flows and dealing with huge amounts of data.

• 3+ years of experience in the art of writing code and solving problems on a large scale.

• Open communicator who shares thoughts and opinions frequently, listens intently, and takes

constructive feedback.

Senior Software Engineer - 221254.

We (the Software Engineer team) are looking for a motivated, experienced person with a data driven approach to join our Distribution Team in Budapest or Szeged to help design, execute and improve our test sets and infrastructure for producing high-quality Hadoop software.

A Day in the life

You will be part of a team that makes sure our releases are predictable and deliver high value to the customer. This team is responsible for automating and maintaining our test harness, and making test results reliable and repeatable.

You will…

•work on making our distributed software stack more resilient to high-scale endurance runs and customer simulations

•provide valuable fixes to our product development teams to the issues you’ve found during exhaustive test runs

•work with product and field teams to make sure our customer simulations match the expectations and can provide valuable feedback to our customers

•work with amazing people - We are a fun & smart team, including many of the top luminaries in Hadoop and related open source communities. We frequently interact with the research community, collaborate with engineers at other top companies & host cutting edge researchers for tech talks.

•do innovative work - Cloudera pushes the frontier of big data & distributed computing, as our track record shows. We work on high-profile open source projects, interacting daily with engineers at other exciting companies, speaking at meet-ups, etc.

•be a part of a great culture - Transparent and open meritocracy. Everybody is always thinking of better ways to do things, and coming up with ideas that make a difference. We build our culture to be the best workplace in our careers.

You have...

•strong knowledge in at least 1 of the following languages: Java / Python / Scala / C++ / C#

•hands-on experience with at least 1 of the following configuration management tools: Ansible, Chef, Puppet, Salt

•confidence with Linux environments

•ability to identify critical weak spots in distributed software systems

•experience in developing automated test cases and test plans

•ability to deal with distributed systems

•solid interpersonal skills conducive to a distributed environment

•ability to work independently on multiple tasks

•self-driven & motivated, with a strong work ethic and a passion for problem solving

•innovate and automate and break the code

The right person in this role has an opportunity to make a huge impact at Cloudera and add value to our future decisions. If this position has piqued your interest and you have what we described - we invite you to apply! An adventure in data awaits.