MapReduce Jobs in Delhi, NCR and Gurgaon

Why are we building Urban Company?-Organized service commerce is a large yet young industry in India. While India is a very large market for a home and local services (~USD 50 Billion in retail spends) and expected to double in the next 5 years, there is no billion-dollar company in this segment today. The industry is bare ~20 years old, with a sub-optimal market architecture typical of an unorganized market - fragmented supply side operated by middlemen. As a result, experiences are broken for both customers and service professionals, each largely relying upon word of mouth to discover the other.    - The industry can easily be 1.5-2x larger than it is today if the frictions in user and professional's journeys are removed - and the experiences made more meaningful and joyful. Urban Company is a - services platform-, with the bold ambition to organize the key verticals within the service commerce industry, bringing in the benefits of scale - structured processes, systems, standardization, transparency, and trust.    - This platform will enable billions of dollars in commerce annually, and create jobs for 1 million+ service professionals. The key industries that we are going to organize over the next few years include - home improvement, home maintenance & repairs, appliance repairs, salon spa & makeup services, fitness & health at home, academic tuition, photography & events, packing & moving, etc .Job Responsibilities :- Over the last 5 years in the Urban Company journey, we have grown from a single monolith to 65 microservices. We deliver throughout around 100Mn/day. Our database has grown from a mere single Monolith cluster to 18 clusters in total with around 8TB of data. So overall engineering tech stack has grown tremendously in recent years. For the last 2 years, the platform team has been working on solving core engineering problems with focused effort.- Platform team is responsible for writing really high-quality code that is highly abstracted, pluggable, performant, extensible, and opens sourceable.As an SDE-2 in the data platform, you will be working on :- Platform first approach to an engineering problem.- Creating highly autonomous systems with minimal manual intervention.- Frameworks which can be extended to a larger audience through open source- Extending and modifying the open-source projects to adopt as per Urban Company use case.- Building platform to solve for Data Availability and Data consumption with ease- Scalable data pipeline and ingestion platformWho can apply?- Bachelors/master's in computer science from top tier Engineering School- 3-7 years prior engineering experience in building scalable systems- Experience with data pipeline and workflow management tools like Luigi, Airflow, etc- Proven ability to work on a fast-paced environment- History and Familiarity of server-side development of APIs, databases, dev-ops, and systems- Fanatic about building scalable, reliable data products- Experience with Big data tools: Hadoop, Kafka/Kinesis, Flume, etc is added advantage- Experience with Relational SQL and NO SQL databases like HBase, Cassandra, etc- Experience with stream processing engines like Spark, Link, Storm, etc is added advantageWhat can you expect?- Work closely with the founding and the leadership team on key projects- Execute highly scalable applications & implement best practices- A phenomenal work environment, with massive ownership and growth opportunities- Quick iterations and deployments - fail-fast attitude

We are looking at a Big Data Engineer with at least 3-5 years of experience as a Big Data Developer/EngineerExperience with Big Data technologies and tools like Hadoop, Hive, MapR, Kafka, Spark, etc.,Experience in Architecting data ingestion, storage, consumption model.Experience with NoSQL Databases like MongoDB, HBase, Cassandra, etc.,Knowledge of various ETL tools & techniques