Hadoop Developer

at Persistent System Ltd

icon
Bengaluru (Bangalore), Pune, Hyderabad
icon
4 - 6 yrs
icon
₹6L - ₹22L / yr
icon
Full time
Skills
Apache HBase
Apache Hive
Apache Spark
Java
Python
Ruby
Ruby on Rails (ROR)
Go Programming (Golang)
Hadoop
Spark
Urgently require Hadoop Developer in reputed MNC company

Location: Bangalore/Pune/Hyderabad/Nagpur

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development,  Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of  using Python/Perl/Shell

 

Please note - Hbase hive and spark are must.

Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Backend Developer

at CK-12 Foundation

Founded 2007  •  Product  •  20-100 employees  •  Raised funding
Python
Amazon Web Services (AWS)
MySQL
MongoDB
Relational Database (RDBMS)
Git
Grunt
Spark
RESTful APIs
icon
Bengaluru (Bangalore)
icon
2 - 4 yrs
icon
Best in industry

Position: Backend Engineer

 

Basic:

  • Design, maintain, and monitor infrastructure for data products
  • Design and develop RESTful APIs for the data infrastructure
  • Design, implement and drive adoption of new analytic technologies and solutions
  • Work closely with data scientists, front end engineers and peers to gather requirements and develop solutions
  • Handle and resolve issues escalated from the production operational environment.
  • Troubleshoot performance, reliability, and scalability issues. 
  • Excellent Problem solving skills
  • A Code Craftsman that follows best software development and coding practices delivering understandable and maintainable code with thorough unit tests coverage


Requirements:

  • 2-­4 years of development experience with Java, Scala, and/or Python
  • Experience with writing and executing queries on RDBMS and NoSQL databases. Working knowledge of MongoDB, MySQL. We are not looking for a DBA.
  • Familiar with standard development tools like version control systems (Subversion/Git), build tools like Grunt.
  • Experience in virtualization technologies and deployment frameworks (familiarity with working on UNIX shell, Jenkins.)
  • Bachelors or masters degree in computer science or equivalent


Desired:

  • Experience working with Pylons Web Framework.
  • Experience with the Berkeley Data Analytics Stack (Spark, SparkSQL, Spark Streaming)
  • Experience with Storm, Hadoop, Kafka
  • Experience with Cascading, Summingbird
  • Experience with AWS EC2, Redshift, RDS, S3, Elastic MapReduce
  • Experience with business intelligence (BI) platforms like Tableau, Pentaho, Looker

     


    About CK-12 Foundation

     

    CK-12’s mission​ is to provide free access to open-source content and technology tools that empower students as well as teachers to enhance and experiment with different learning styles, resources, levels of competence, and circumstances.

     

    To achieve this noble and ambitious vision, we at CK-12 are challenging traditional model of education to transform it dramatically. Technology has opened up lots of opportunities to revolutionize education for the benefit of students, teachers and parents.

     

    We have chosen to be non-profit so that we can effectively realize our mission and so that we can do the right thing! It also provides us the ability to experiment big and bold ideas. CK-12 is backed by Vinod Khosla, a renowned technology venture capitalist.

     

    At CK-12, you’ll experience the benefits of working in a dynamic, entrepreneurial, innovative and non bureaucratic environment where you will get a lot of cool things done than you ever imagined! We are a small group of passionate folks who are determined to disrupt the current form of education. We came together from companies such as Apple, eBay, Amazon, McGraw-Hill, and startups.

     

    Technology is key to scale education and we deeply believe in it. Come develop great solutions on our cloud based (AWS) AI-first platform delivering rich ​and interactive content.

     

    Does our mission, people ​and technologies excite you? If the answer is YES! and you are a great technologist who will challenge status-quo (no order takers please!) by innovating, please come join us! Together, we will change the world!

     

    Check out how CK-12 is making an impact in teaching and learning - https://www.ck12info.org/about/testimonials/

Job posted by
Amit Gupta

Backend Engineer

at Jar

Founded 2021  •  Product  •  0-20 employees  •  Raised funding
MongoDB
NodeJS (Node.js)
GraphQL
PostgreSQL
Hadoop
Apache Kafka
Amazon Web Services (AWS)
RESTful APIs
WebSocket
icon
Bengaluru (Bangalore)
icon
2 - 6 yrs
icon
₹20L - ₹40L / yr

Jar is a daily gold savings app that lets users save money by taking spare change from their online transactions and investing it in digital gold automatically. Jar is the first Made in India app to come up with an innovative solution to save money daily and invest automatically in digital gold for the best gold rate. We want to help millions of Indians rediscover the undeniable, cumulative advantages of saving every single day. To know more about the company: bit.ly/workatjar

 

💪🏼 Responsibilities

  • As a Backend Engineer, you will design and build server-side components that run seamlessly on Jar, design and implement infrastructure, and more.
  • You will partner with Fullstack engineers to build high-performance REST & WebSocket APIs to power our frontend experiences.
  • Perform data analysis and troubleshoot technical issues with platforms, performance, data discrepancies, production environment.
  • As an early engineer, work with the team to create and foster a culture of raising the bar with each new hire.

 

🎓 Qualifications

  • 2+ years of hands-on experience in writing secure, efficient, high-quality code and have a good understanding of CS fundamentals.
  • Experience with technologies like GraphQL, MongoDB, Postgres, Elasticsearch, Node.js, and other server-side technologies, etc.
  • Experience with Implementation of services in a micro-service architecture.
  • Familiarity with Big data technologies such as Hadoop, Spark, Kafka.
  • Demonstrated interest in open and community-driven platforms.

 

✨ Good to have

  • Experience with building fintech products
  • Experience building and scaling applications on public cloud infrastructure (Docker, AWS/GCP, Kubernetes, Mesos, etc.)
  • Experience in the development of large, distributed software systems
  • A Background in Computer Science

 

💥 You’ll be in a rewarding company

  • Work with cutting-edge technology and unchartered territory.
  • Competitive salary and compelling stock options offerings.
  • An international team of highly skilled and motivated colleagues, to help You succeed and push boundaries.
  • Flexible working hours, training resources, and a company culture that promotes open discussions, jokes, learning, and lots of fun along the way.
  • Opportunity to have a major impact on the future of the company.
Job posted by
Antriksh Jain

Software Engineer

at Dremio

Founded 2015  •  Product  •  100-500 employees  •  Raised funding
Java
C++
Microservices
Algorithms
Data Structures
Hadoop
SQL
Distributed Systems
Scalability
Architecture
Python
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Windows Azure
daas
icon
Remote, Bengaluru (Bangalore), Hyderabad
icon
3 - 10 yrs
icon
₹15L - ₹65L / yr

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

  • Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
  • Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
  • Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
  • Lead the team to solve complex and unknown problems 
  • Solve technical problems and customer issues with technical expertise
  • Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
  • Mentor other team members for high quality and design 
  • Collaborate with Product Management to deliver on customer requirements and innovation
  • Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

  • B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
  • Fluency in Java/C++ with 8+ years of experience developing production-level software
  • Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
  • 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
  • Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
  • Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
  • Passion for learning and delivering using latest technologies
  • Ability to solve ambiguous, unexplored, and cross-team problems effectively
  • Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
  • Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
  • Understanding of distributed file systems such as  S3, ADLS, or HDFS
  • Excellent communication skills and affinity for collaboration and teamwork
  • Ability to work individually and collaboratively with other team members
  • Ability to scope and plan solution for  big problems and mentors others on the same
  • Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
Job posted by
Maharaja Subramanian (CW)

Spark Scala Developer

at Accion Labs

Founded 2009  •  Products & Services  •  100-1000 employees  •  Profitable
Apache Spark
Scala
Apache Hive
Spark
Hadoop
icon
Bengaluru (Bangalore)
icon
4 - 7 yrs
icon
₹5L - ₹15L / yr

Spark / Scala experience should be more than 2 years.

Combination with Java & Scala is fine or we are even fine with Big Data Developer with strong Core Java Concepts. - Scala / Spark Developer.

Strong proficiency Scala on Spark (Hadoop) - Scala + Java is also preferred

Complete SDLC process and Agile Methodology (Scrum)

Version control / Git

Job posted by
Kripa Oza

Java Developer

at PODIUM SYSTEMS PRIVATE LIMITED

Founded 2016  •  Product  •  employees  •  Bootstrapped
Java
Elastic Search
Solr
Hadoop
Natural Language Processing (NLP)
icon
Pune
icon
1 - 4 yrs
icon
₹4L - ₹7L / yr
  • You will be responsible for design, development and testing of Products
  • Contributing in all phases of the development lifecycle

 

  • Writing well designed, testable, efficient code
  • Ensure designs are in compliance with specifications

  • Prepare and produce releases of software components

  • Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

  • Some of the technologies you will be working on: Core Java, Solr, Hadoop, Spark, Elastic search, Clustering, Text Mining, NLP, Mahout and Lucene etc.
Job posted by
Saujanya Sathe

Backend Engineer - Java/Scala/Distributed System/NoSQL

at Intellicar Telematics Pvt Ltd

Founded 2015  •  Products & Services  •  20-100 employees  •  Profitable
Java
Scala
Distributed Systems
NOSQL Databases
Multithreading
Spark
Hadoop
GPS
Telematics
Automotive engineering
Analytics
Automotive
Fleet management
Technology integration
SAS GIS
GPRS
Web
RFID
Hardware
Logistics
Manufacturing
Science
Programming
Apache Hadoop
Apache Spark
Apache Cassandra
Cassandra
Apache Kafka
HTTP
Microsoft Works
Network
icon
Bengaluru (Bangalore)
icon
3 - 7 yrs
icon
₹8L - ₹9L / yr
Systems EngineerAbout Intellicar Telematics Pvt LtdIntellicar Telematics Private Limited is a vehicular telematics organization founded in 2015 with the vision of connecting businesses and customers to their vehicles in a meaningful way. We provide vehicle owners with the ability to connect and diagnose vehicles remotely in real-time. Our team consists of individuals with an in-depth knowledge and understanding in automotive engineering, driver analytics and information technology. By leveraging our expertise in the automotive domain, we have created solutions to reduce operational and maintenance costs of large fleets, and ensure safety at all times.Solutions :- Enterprise Fleet Management, GPS Tracking- Remote engine diagnostics, Driver behavior & training- Technology Integration : GIS, GPS, GPRS, OBD, WEB, Accelerometer, RFID, On-board Storage.Intellicar's team of accomplished automotive Engineers, hardware manufacturers, Software Developers and Data Scientists have developed the best solutions to track vehicles and drivers, and ensure optimum performance, utilization and safety at all times.We cater to the needs of our clients across various industries such as: Self drive cars, Taxi cab rentals, Taxi cab aggregators, Logistics, Driver training, Bike Rentals, Construction, ecommerce, armored trucks, Manufacturing, dealership and more. Desired skills as a developer :- Education: BE/B.Tech in Computer Science or related field.- 4+ years of experience with scalable distributed systems applications and building scalable multi-threaded server applications.- Strong programming skills in Java or Scala on Linux or a Unix based OS.- Understanding of distributed systems like Hadoop, Spark, Cassandra, Kafka.- Good understanding of HTTP, SQL, Database internals.- Good understanding of Internet and how it works- Create new features from scratch, enhance existing features and optimize existing functionality, from conception and design through testing and deployment.- Work on projects that make our network more stable, faster, and secure.- Work with our development QA and system QA teams to come up with regression tests that cover new changes to our software
Job posted by
Lata Patil

Java Application Developer (4+ Yrs of Workex), Graph Based Product Dev

at Mezzure Software Technology Pvt Ltd

Founded 2014  •  Product  •  20-100 employees  •  Bootstrapped
Java
Hadoop
Spark
Machine Learning (ML)
Artificial Intelligence (AI)
icon
Pune
icon
4 - 9 yrs
icon
₹4L - ₹12L / yr
We are looking to hire passionate Java techies who will be comfortable learning and working on Java and any open source frameworks & technologies. She/he should be a 100% hands-on person on technology skills and interested in solving complex analytics use cases. We are working on a complete stack platform which has already been adopted by some very large Enterprises across the world. Candidates with prior experience of having worked in typical R&D environment and/or product based companies with dynamic work environment will be have an additional edge. We currently work on some of the latest technologies like Cassandra, Hadoop, Apache Solr, Spark and Lucene, and some core Machine Learning and AI technologies. Even though prior knowledge of these skills is not mandatory at all for selection, you would be expected to learn new skills on the job.
Job posted by
Neha Ambastha

Tech Lead

at Mintifi

Founded 2017  •  Products & Services  •  20-100 employees  •  Raised funding
Java
Javascript
MySQL
jQuery
DevOps
Hadoop
MongoDB
icon
Mumbai
icon
5 - 10 yrs
icon
₹8L - ₹20L / yr
Job Title: Technology Lead Responsibilities We are looking for a Technology Lead who can drive innovation and take ownership and deliver results. • Own one or more modules of the project under development • Conduct system wide requirement analysis. • Quality, on time delivery of agreed deliverables. • Mentor junior team members • Flexible in working under changing and different work settings. • Contribute to the company knowledge base and process improvements. • Participate in SDLC • Design and implement automated unit testing framework as required • Use best practices and coding standards. • Conduct peer reviews and lead reviews and provide feedback • Develop, maintain, troubleshoot, enhance and document components developed by self and others as per the requirements and detailed design Qualifications • Excellent programming experience of 5 to 10 years in Ruby and Ruby on Rails • Good understanding about Data Structures and Algorithms • Good understanding about relational and non-relational database concepts (MySQL, Hadoop, MongoDB) • Exposure to front-end technologies like HTML, CSS, Javascript as well as JS libraries/frameworks like JQuery, Angular, React etc. is a strong plus • Exposure to DevOps on AWS is a strong plus Compensation Best in the industry Job Location: Mumbai
Job posted by
Suchita Upadhyay

Technical Architect/CTO

at auzmor

Founded 2017  •  Product  •  20-100 employees  •  Raised funding
Java
React.js
AngularJS (1.x)
Selenium Web driver
Hadoop
Cassandra
phpunit
codeception
icon
Chennai
icon
3 - 10 yrs
icon
₹10L - ₹30L / yr
Description Auzmor is US HQ’ed, funded SaaS startup focussed on disrupting the HR space. We combine passion, domain expertise and build products with focus on great end user experiences We are looking for Technical Architect to envision, build, launch and scale multiple SaaS products What You Will Do: • Understand the broader strategy, business goals, and engineering priorities of the company and how to incorporate them into your designs of systems, components, or features • Designing applications and architectures for multi-tenant SaaS software • Responsible for the selection and use of frameworks, platforms and design patterns for Cloud based multi-tenant SaaS based application • Collaborate with engineers, QA, product managers, UX designers, partners/vendors, and other architects to build scalable systems, services, and products for our diverse ecosystem of users across apps What you will need • Minimum of 5+ years of Hands on engineering experience in SaaS, Cloud services environments with architecture design and definition experience using Java/JEE, Struts, Spring, JMS & ORM (Hibernate, JPA) or other Server side technologies, frameworks. • Strong understanding of architecture patterns such as multi-tenancy, scalability, and federation, microservices(design, decomposition, and maintenance ) to build cloud-ready systems • Experience with server-side technologies (preferably Java or Go),frontend technologies (HTML/CSS, Native JS, React, Angular, etc.) and testing frameworks and automation (PHPUnit, Codeception, Behat, Selenium, webdriver, etc.) • Passion for quality and engineering excellence at scale What we would love to see • Exposure to Big data -related technologies such as Hadoop, Spark, Cassandra, Mapreduce or NoSQL, and data management, data retrieval , data quality , ETL, data analysis. • Familiarity with containerized deployments and cloud computing platforms (AWS, Azure, GCP)
Job posted by
Loga B

Python Developer

at WNS Global Services

Founded 2015  •  Products & Services  •  100-1000 employees  •  Profitable
0360
Python
Apache Hive
Big Data
icon
Bengaluru (Bangalore)
icon
4 - 8 yrs
icon
₹12L - ₹25L / yr
• Good experience in Python and SQL • Plus will be experience in Hive / Presto • Strong skills in using Python / R for building data pipelines and analysis • Good programming background - o Writing efficient and re-usable code o Comfort with working on the CLI and with tools like GitHub etc. Other softer aspects that are important - • Fast learner - No matter how much programming a person has done in the past, willing to learn new tools is the key • An eye for standardization and scalability of processes - the person will not need to do this alone but it will help us for everyone on the team to have this orientation • A generalist mindset - Everyone on the team will need to also work on front-end tools (Tableau and Unidash) so openness to playing a little outside the comfort zone
Job posted by
Jiten Chanana
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at Persistent System Ltd?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort