Must be willing to relocate to Chandigarh/Mohali, in our state-of-the-art office in Quark City in Mohali. We're looking for a data engineer. Responsibilities include: building out infrastructure and implementing end-to-end data flows from ingest, to data transformation, machine learning for client-side applications.• Must have Java/J2EE, Spring, Micro services, Python (Hands On) • Must have integration expert Hadoop Eco Systems and ML Expert • Knowledge of Spark, Accumulo, HDFS, YARN, MapReduce, Kafka is necessary. As a data engineer, you may have experience spanning traditional DW and ETL architectures. But for this role it is important to have industry experience working with big data ecosystems like Spark/Hadoop and Redshift. You've probably been in the industry as an engineer for 2+ years and have developed a passion for the data that drives businesses. On your first day, we'll expect you to have: • Deep understanding of big data challenges and eco-system • Experience with solution building and architecting with public cloud offerings such as Amazon Web Services, Redshift, S3, EMR/Spark, Presto/Athena • Experience with Spark and Hive • Expertise in SQL, SQL tuning, schema design, Python and ETL processes • Expertise in data pipeline with such workflow tools as Airflow, Oozie or Luigi • Solid understanding experience in building RESTful APIs and microservices, e.g. with Flask • Experience in test automation and ensuring data quality across multiple datasets used for analytical purposes • Experience with Lambda Architecture or other Big Data architectural best practices • A graduate degree in Computer Science or similar discipline • Commit code to open source projects • Experience with test automation and continuous delivery It's great, but not required, if you have: • Experience with Tableau • Experience with Machine Learning • Have worked with Data Scientists
Design and development of the Supply chain applications for the retail customers, making use of the open source technologies. It can be taking our own product and customizing as per the customer requirements or developing applications from the scratch.