Hadoop Developer

We are seeking a skilled Java Developer with hands-on experience in Java and Spark to build scalable data processing solutions. You'll contribute to high-performance data pipelines and analytics platforms in a dynamic Agile environment.

Key Responsibilities

• Design and develop Java applications integrated with Apache Spark for ETL processes, data transformations, and analytics.
• Build and optimize Spark jobs (Spark SQL, DataFrames, Streaming) for large-scale data processing.
• Collaborate with data engineers and analysts to implement robust data workflows.
• Write clean, maintainable Java code following best practices (Spring Boot, Microservices preferred).
• Perform code reviews, unit testing, and contribute to CI/CD pipelines.
• Troubleshoot and optimize Spark performance for production workloads.
• Document technical solutions and mentor junior developers.

Required Skills & Qualifications

• 4-7 years of hands-on Java development experience.
• Strong expertise in Apache Spark (Spark Core, Spark SQL, PySpark basics).
• Proficiency in Java 8/11+ with multithreading and collections frameworks.
• Experience with data processing (ETL, data pipelines, big data).
• Familiarity with build tools (Maven/Gradle) and version control (Git).
• Strong problem-solving skills and Bangalore location availability.
• Excellent communication skills for cross-team collaboration.

Good to Have

• Experience with Snowflake for cloud data warehousing.
• Knowledge of DBT (Data Build Tool) for analytics engineering.
• Python scripting for data manipulation and automation.
• Exposure to AWS/GCP/Azure cloud platforms.
• Familiarity with Kafka, Airflow, or containerization (Docker/Kubernetes).

Roles and Responsibilities

Experience:

The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database and distributed System is mandatory.

Required Skills:

Mandatory: -

1. Core Java or Scala
2. Experience in Big Data, Spark
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.
4. Should have the ability to analyze, design, develop and test complexity of spark job.
5. Working knowledge of Unix/Linux.
6. Hands on experience in Spark, creating RDD, applying operation - transformation-action

Good To have: -

1. Python
2. Spark streaming
3. Py Spark
4. Azure/AWS Cloud Knowledge of Data Storage and Compute side

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities. 

A Day in the Life

Over the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.

You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.

Opportunity:

Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world. 

https://hive.apache.org/" target="_blank">Apache Hive

Responsibilities:

• Build robust and scalable data infrastructure software

• Design and create services and system architecture for your projects 

• Improve code quality through writing unit tests, automation, and code reviews

• The candidate would write Java code and/or build several services in the Cloudera Data Warehouse. 

• Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

• The candidate has to understand the basics of Kubernetes.

• Build out the production and test infrastructure. 

• Develop automation frameworks to reproduce issues and prevent regressions.

• Work closely with other developers providing services to our system.

• Help to analyze and to understand how customers use the product and improve it where necessary.  

Qualifications:

• Deep familiarity with Java programming language.

• Hands-on experience with distributed systems. 

• Knowledge of database concepts, RDBMS internals.

• Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus.  

• Has experience working in a distributed team. 

• Has 3+ years of experience in software development.

About Vymo

Vymo is a Sanfrancisco-based next-generation Sales productivity SaaS company with offices in 7 locations. Vymo is funded by top tier VC firms like Emergence Capital and Sequoia Capital. Vymo is a category creator, an intelligent Personal Sales Assistant who captures sales activities automatically, learns from top performers, and predicts ‘next best actions’ contextually. Vymo has 100,000 users in 60+ large enterprises such as AXA, Allianz, Generali.Vymo has seen 3x annual growth over the last few years and aspires to do even better this year by building up the team globally.

What is the Personal Sales Assistant

A game-changer! We thrive in the CRM space where every company is struggling to deliver meaningful engagement to their Sales teams and IT systems. Vymo was engineered with a mobile-first philosophy. The platform through AI/ML detects, predicts, and learns how to make Sales Representatives more productive through nudges and suggestions on a mobile device. Explore Vymo https://getvymo.com/">https://getvymo.com/

What you will do at Vymo

From young open source enthusiasts to experienced Googlers, this team develops products like Lead Management System, Intelligent Allocations & Route mapping, Intelligent Interventions, that help improve the effectiveness of the sales teams manifold. These products power the "Personal Assistant" app that automates the sales force activities, leveraging our cutting edge location based technology and intelligent routing algorithms.

A Day in your Life 

• Design, develop and maintain robust data platforms on top of Kafka, Spark, ES etc.
• Provide leadership to a group of engineers in an innovative and fast-paced environment.
• Manage and drive complex technical projects from the planning stage through execution.
  
  

What you would have done  

• B.E (or equivalent) in Computer Sciences
• 6-9 years of experience building enterprise class products/platforms.
• Knowledge of Big data systems and/or Data pipeline building experience is preferred.
• 2-3 years of relevant work experience as technical lead or technical management experience.
• Excellent coding skills in one of Core Java or NodeJS
• Demonstrated problem solving skills in previous roles.
• Good communication skills.