Hadoop Developer

Persistent System Ltd

Hadoop Developer

Milestone Hr Consultancy

Company

Home

Hadoop Developer

at Persistent System Ltd

Agency job

via Milestone Hr Consultancy

4 - 6 yrs

₹6L - ₹22L / yr

Bengaluru (Bangalore), Pune, Hyderabad

Skills

Apache HBase

Apache Hive

Apache Spark

Go Programming (Golang)

Ruby on Rails (ROR)

Ruby

Python

Java

Hadoop

Spark

Urgently require Hadoop Developer in reputed MNC company

Location: Bangalore/Pune/Hyderabad/Nagpur

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development, Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of using Python/Perl/Shell

Please note - Hbase hive and spark are must.

Urgently require Hadoop Developer in reputed MNC company

Location: Bangalore/Pune/Hyderabad/Nagpur

Please note - Hbase hive and spark are must.

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

Java Developer (Java & Spark)

at Wissen Technology

4 recruiters

Posted by Bharanidharan K

Bengaluru (Bangalore)

4 - 7 yrs

Best in industry

Java

Spark

J2EE

Spring

Apache Spark

+5 more

We are seeking a skilled Java Developer with hands-on experience in Java and Spark to build scalable data processing solutions. You'll contribute to high-performance data pipelines and analytics platforms in a dynamic Agile environment.

Key Responsibilities

Design and develop Java applications integrated with Apache Spark for ETL processes, data transformations, and analytics.
Build and optimize Spark jobs (Spark SQL, DataFrames, Streaming) for large-scale data processing.
Collaborate with data engineers and analysts to implement robust data workflows.
Write clean, maintainable Java code following best practices (Spring Boot, Microservices preferred).
Perform code reviews, unit testing, and contribute to CI/CD pipelines.
Troubleshoot and optimize Spark performance for production workloads.
Document technical solutions and mentor junior developers.

Required Skills & Qualifications

4-7 years of hands-on Java development experience.
Strong expertise in Apache Spark (Spark Core, Spark SQL, PySpark basics).
Proficiency in Java 8/11+ with multithreading and collections frameworks.
Experience with data processing (ETL, data pipelines, big data).
Familiarity with build tools (Maven/Gradle) and version control (Git).
Strong problem-solving skills and Bangalore location availability.
Excellent communication skills for cross-team collaboration.

Good to Have

Experience with Snowflake for cloud data warehousing.
Knowledge of DBT (Data Build Tool) for analytics engineering.
Python scripting for data manipulation and automation.
Exposure to AWS/GCP/Azure cloud platforms.
Familiarity with Kafka, Airflow, or containerization (Docker/Kubernetes).

Key Responsibilities

Design and develop Java applications integrated with Apache Spark for ETL processes, data transformations, and analytics.
Build and optimize Spark jobs (Spark SQL, DataFrames, Streaming) for large-scale data processing.
Collaborate with data engineers and analysts to implement robust data workflows.
Write clean, maintainable Java code following best practices (Spring Boot, Microservices preferred).
Perform code reviews, unit testing, and contribute to CI/CD pipelines.
Troubleshoot and optimize Spark performance for production workloads.
Document technical solutions and mentor junior developers.

Required Skills & Qualifications

4-7 years of hands-on Java development experience.
Strong expertise in Apache Spark (Spark Core, Spark SQL, PySpark basics).
Proficiency in Java 8/11+ with multithreading and collections frameworks.
Experience with data processing (ETL, data pipelines, big data).
Familiarity with build tools (Maven/Gradle) and version control (Git).
Strong problem-solving skills and Bangalore location availability.
Excellent communication skills for cross-team collaboration.

Good to Have

Experience with Snowflake for cloud data warehousing.
Knowledge of DBT (Data Build Tool) for analytics engineering.
Python scripting for data manipulation and automation.
Exposure to AWS/GCP/Azure cloud platforms.
Familiarity with Kafka, Airflow, or containerization (Docker/Kubernetes).

SDE2 Backend Python

Into designing a generic ML platform team as a product

Agency job

via Qrata by Blessy Fernandes

Bengaluru (Bangalore)

3 - 6 yrs

₹20L - ₹25L / yr

Python

AWS Lambda

Spark

Requirements

3+ years work experience with production-grade python. Contribution to open source repos is preferred
Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
Experience with one relational & 1 non-relational DB is preferred
Prior work in the ML domain will be a big boost

What You’ll Do

Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
Write maintainable, scalable performant python code
Building gRPC, rest API servers
Working with Thrift, Protobufs, etc.

Requirements

3+ years work experience with production-grade python. Contribution to open source repos is preferred
Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
Experience with one relational & 1 non-relational DB is preferred
Prior work in the ML domain will be a big boost

What You’ll Do

Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
Write maintainable, scalable performant python code
Building gRPC, rest API servers
Working with Thrift, Protobufs, etc.

Sr. Tech Lead

at YuktaMedia

1 video

3 recruiters

Posted by Aditya Bhelande

Pune

8 - 10 yrs

₹17L - ₹20L / yr

Hibernate

Amazon RedShift

Java

MySQL

Amazon Web Services (AWS)

+5 more

Responsibilities: Responsible for all aspects of development and support for internally created or supported application software, including: the development methodologies, technologies (language, databases, support tools), development and testing hardware/software environments, and management of the application development staff and project workload for the agency. Your job is to manage a project and manage a set of engineers. You are responsible for making your team happy and productive, helping them manage their careers. You are responsible for delivering great product on time and with quality. ESSENTIAL DUTIES AND RESPONSIBILITIES • Supervise the projects and responsibilities of the Web and Software Developers. • Responsible for the prioritization of projects assigned to the Application Development team. • Responsible for the complete development lifecycle of the agency software systems; including gathering requirements, database management, software development, testing, implementation, user follow up, support and Project Management. • Responsible for the Integrity, Maintenance and changes to the Application Development Servers and Databases. (DBA) • Responsible for developing and implementing change control processes for the development team to follow. • Provides ad-hoc reporting and decision support required for management decision processes. • Makes technology decisions that effect Software Development. • Works on special I.T. projects as needed. Familiarity with Technologies: • Java, Spring, Hibernate, Laravel • MySQL, MongoDB, Amazon RedShift, Hadoop • Angular.js, Boostrap • AWS cloud infrastructure QUALIFICATIONS • Bachelor’s degree in Information Science or Computer Science required. • 8-10 years of Application Development Experience required. • Five plus years of Database Design and Analysis required. • Strong verbal communication skills required.

Backend SDE3/Lead Engineer

Games24x7/RummyCircle.com

Agency job

via zyoin by Suchoritha Zyoin

Bengaluru (Bangalore)

6 - 10 yrs

₹15L - ₹60L / yr

Java

J2EE

J2SE

Spring Boot

06692

+4 more

General Accountabilities/Job Responsibilities
• Participation in the requirements analysis, design, development and testing of applications.
• The candidate is expected to write code himself/herself.
• The candidate is expected to write high level code, code review, unit testing and deployment.
• Practical application of design principles with a focus on the user experience, usability, template
designs, cross browser issues and client server concepts.
• Contributes to the development of project estimates, scheduling, and deliverables.
• Works closely with QA team to determine testing requirements to ensure full coverage and best
quality of product.
• There is also the opportunity to mentor and guide junior team members in excelling their jobs.

Job Specifications
• BE/B. Tech. Computer Science or MCA from a reputed University.
• 6+ Years of experience in software development, with emphasis on JAVA/J2EE Server side
programming.
• Hands on experience in Core Java, Multithreading, RMI, Socket programing, JDBC, NIO,
webservices and Design patterns.
• Should have Knowledge of distributed system, distributed caching, messaging frameworks, ESB
etc.
• Knowledge of Linux operating system and PostgreSQL/MySQL/MongoDB/Cassandra database is
essential.
• Additionally, knowledge of HBase, Hadoop and Hive are desirable.
• Familiarity with message queue systems and AMQP and Kafka is desirable.
• Should have experience as a participant in Agile methodologies.
• Should have excellent written and verbal communication skills and presentation skills.
• This is not a Fullstack requirement, we are purely looking out for Backend resources

Senior Software Engineer (Java/Scala/SOLR/Data/Hadoop)

at CodeHall Technology Pvt Ltd

2 recruiters

Posted by Avneesh Jain

Bengaluru (Bangalore)

5 - 8 yrs

₹10L - ₹15L / yr

Spark

Hadoop

MongoDB

Java

Scala

+1 more

Interested in building high performance search systems to handle petabytes of retail data, while working in an agile, small company environment? At CodeHall Technologies, you will have the opportunity to work with the newest technology in Search and Browse. We are working on systems that powers and personalizes site search, considering the user intent for every query, providing a wholly unique search experience that is engaging - designed to display the most relevant results through Findability. Primary responsibilities: Building high performance Search systems for personalization, optimization, and targeting Building systems with Hadoop, Solr, Cassandra, Flink, Spark, Mongo DB Deep understanding of HTTP and REST principles Good diagnostic and troubleshooting skills… Unit testing with JUnit, Performance testing and tuning Working with rapid and innovative development methodologies like: Kanban, Continuous Integration and Daily deployments Highly proficient Software engineering skills in Java Coordination with internal and external teams Mentoring junior engineers Participate in Product design discussions and decisions Minimum requirements: BS/MS in CS, Electrical Engineering or foreign equivalent plus relevant software development experience At least 5-8 years of software development experience Expert in Java, Scala or any other object oriented language Proficient in SQL concepts (HiveQL or Postgres a plus) Additional language skills for scripting and rapid application development Desired skills and experience: Working with large data sets in the PBs Familiarity with UNIX (systems skills a plus) Working experience in Solr, Cassandra, Mongo DB, and Hadoop Working in a distributed environment and has dealt with challenges around scaling and performance Proven ability to project and meet scheduled deadlines Self-driven, quick learner with attention to detail and quality

Hadoop Developer

at Securonix

1 recruiter

Posted by Ramakrishna Murthy

Pune

3 - 7 yrs

₹10L - ₹15L / yr

HDFS

Apache Flume

Apache HBase

Hadoop

Impala

+3 more

Securonix is a Big Data Security Analytics product company. The only product which delivers real-time behavior analytics (UEBA) on Big Data.

Product Development and Solutions Architect

at Fintuple Technologies Private Ltd.

1 video

2 recruiters

Posted by Naveen Chandramohan

Chennai

5 - 8 yrs

₹10L - ₹16L / yr

Java

Product development

RESTful APIs

Spark

Database Design

+3 more

Fintuple Technologies is looking to hire a hands on Product Development Architect, a technology geek with experience working with a product startup ( preferably). The Interested candidate, will be responsible for guide lining the architecture of the platform and product development for our next stage of growth. · Should have strong experience in Java, Spark API microservice framework with a complete understanding of REST APIs · Strong proficiency with UI frameworks & languages such as Bootstrap, Angular, TypeScript, jQuery, etc. · Actively find ways (new technologies, tools, frameworks) to improve software solutions · Setup and maintain all environments such as build, staging, and production · Ability to handle multiple technologies, own the troubleshooting and debugging procedures · Experience in agile development methodologies and DevOps practices incl. continuous integration, static code analysis, etc. · Manage the existing team to maintain the product in a fully working condition and upgrade features as and when required · Experience in project management and related tools · Familiarity with various operating systems (e.g. Windows, Mac, Linux) and databases (e.g. MySQL) · Proficient understanding of code versioning tools like Git & SVN · Implementation of security and data protection · Integration of Data Storage Solutions

Technical Architect/CTO

at auzmor

5 recruiters

Posted by Loga B

Chennai

3 - 10 yrs

₹10L - ₹30L / yr

Java

React.js

AngularJS (1.x)

Selenium Web driver

Hadoop

+3 more

Description Auzmor is US HQ’ed, funded SaaS startup focussed on disrupting the HR space. We combine passion, domain expertise and build products with focus on great end user experiences We are looking for Technical Architect to envision, build, launch and scale multiple SaaS products What You Will Do: • Understand the broader strategy, business goals, and engineering priorities of the company and how to incorporate them into your designs of systems, components, or features • Designing applications and architectures for multi-tenant SaaS software • Responsible for the selection and use of frameworks, platforms and design patterns for Cloud based multi-tenant SaaS based application • Collaborate with engineers, QA, product managers, UX designers, partners/vendors, and other architects to build scalable systems, services, and products for our diverse ecosystem of users across apps What you will need • Minimum of 5+ years of Hands on engineering experience in SaaS, Cloud services environments with architecture design and definition experience using Java/JEE, Struts, Spring, JMS & ORM (Hibernate, JPA) or other Server side technologies, frameworks. • Strong understanding of architecture patterns such as multi-tenancy, scalability, and federation, microservices(design, decomposition, and maintenance ) to build cloud-ready systems • Experience with server-side technologies (preferably Java or Go),frontend technologies (HTML/CSS, Native JS, React, Angular, etc.) and testing frameworks and automation (PHPUnit, Codeception, Behat, Selenium, webdriver, etc.) • Passion for quality and engineering excellence at scale What we would love to see • Exposure to Big data -related technologies such as Hadoop, Spark, Cassandra, Mapreduce or NoSQL, and data management, data retrieval , data quality , ETL, data analysis. • Familiarity with containerized deployments and cloud computing platforms (AWS, Azure, GCP)

Elastic Search and NoSql Engineers

at Foster Entrepreneurship Ventures

1 recruiter

Posted by Debdas Sinha

Bengaluru (Bangalore)

1 - 2 yrs

₹6L - ₹18L / yr

Elastic Search

Apache Kafka

Solr

Apache HBase

www.aaknet.co.in/careers/careers-at-aaknet.html You are extra-ordinary, a rock-star, hardly found a place to leverage or challenge your potential, did not spot a sky rocketing opportunity yet? Come play with us – face the challenges we can throw at you, chances are you might be humiliated (positively); do not take it that seriously though! Please be informed, we rate CHARACTER, attitude high if not more than your great skills, experience and sharpness etc. :) Best wishes & regards, Team Aak!