The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Bengaluru (Bangalore)
5 - 10 yrs
₹10L - ₹20L / yr
Data Warehouse (DWH)
Apache Hive
ETL
DWH Cloud
Hadoop
+3 more
candidate will be responsible for all aspects of data acquisition, data transformation, and analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Expected deliverables will include the development of Big Data ELT jobs using a mix of technologies, stitching together complex and seemingly unrelated data sets for mass consumption, and automating and scaling analytics into the GRAND's Data Lake.
Key Responsibilities :
- Create a GRAND Data Lake and Warehouse which pools all the data from different regions and stores of GRAND in GCC
- Ensure Source Data Quality Measurement, enrichment and reporting of Data Quality
- Manage All ETL and Data Model Update Routines
- Integrate new data sources into DWH
- Manage DWH Cloud (AWS/AZURE/Google) and Infrastructure
Skills Needed :
- Very strong in SQL. Demonstrated experience with RDBMS, Unix Shell scripting preferred (e.g., SQL, Postgres, Mongo DB etc)
- Experience with UNIX and comfortable working with the shell (bash or KRON preferred)
- Good understanding of Data warehousing concepts.
Big data systems : Hadoop, NoSQL, HBase, HDFS, MapReduce
- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
- Working with data delivery teams to set up new Hadoop users. This job includes setting up Linux users, setting up and testing HDFS, Hive, Pig and MapReduce access for the new users.
- Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, and other tools.
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
- Screen Hadoop cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security
- File system management and monitoring.
- HDFS support and maintenance.
- Collaborating with application teams to install operating system and
- Hadoop updates, patches, version upgrades when required.
- Defines, develops, documents and maintains Hive based ETL mappings and scripts
Read more
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Juntrax Solutions is a young company with a collaborative work culture, on a mission to bring efficient solutions to SMEs. Joining us you will be part of a great team building an integrated platform for SMEs to help them manage their daily business globally.
Crystal Logistic Cool Chain Ltd is a complete logistics and supply chain service provider. Crystal is one of the largest and fastest growing service providers in the integrated cold chain logistics solution space. Crystal provides services such as refrigerated warehousing (cold storages), refrigerated transportation on a pan-India network. Always on the cusp of innovation, Crystal also provides solutions such as express refrigerated transportation for LTL (less than truck load) consignments and portable cold storages.
Crystal boasts to be the only company in the country to provide complete range of services with such wide gamut of solutions in the cold chain logistics industry.Crystal traces its origin back in 1962, promoted by Mr. Murari Lal Agarwal began operations under the name M/S Harayana Transport Company.
Techlyverse: Your Partner in Digital Product Innovation
At Techlyverse, we turn ambitious ideas into impactful digital products. We are a dynamic product studio dedicated to partnering with businesses to design, build, and scale custom technology solutions that are not only functional but also deeply human-centered.
Our expertise lies in crafting bespoke web and mobile applications, creating robust cloud infrastructures, and delivering strategic product roadmaps. We believe that great technology is a result of collaboration, clear communication, and a shared passion for solving real-world problems.
From the initial concept to post-launch support, Techlyverse is committed to providing a seamless and transparent journey, ensuring that every product we build is a true reflection of our partners' vision and a catalyst for their growth. We don't just build products; we build partnerships for success.
TheCodersHub is a startup that offers services in #androiddevelopment, #webdevelopment, #softwaredevelopment, #mobiledevelopment, and #iosdevelopment. While still in the early stages, we are focused on growth and innovation within the tech industry.
