Data Engineer
Data & Cloud Technology serviced based company.
Data Engineer at Data & Cloud Technology serviced based company. · Chennai, Coimbatore, Madurai · 5 - 10 years · ₹12L - ₹19L / yr · Posted 12 Feb 2021

5 - 10 yrs
₹12L - ₹19L / yr
Chennai, Coimbatore, Madurai
Skills
Apache Spark
HiveQL
Data engineering
JSON
Apache Airflow
- Must have the experience of leading teams and drive customer interactions
- Must have multiple successful deployments user stories
- Extensive hands on experience in Apache Spark along with HiveQL
- Sound knowledge in Amazon Web Services or any other Cloud environment.
- Experienced in data flow orchestration using Apache Airflow
- JSON, XML, CSV, Parquet file formats with snappy compression.
- File movements between HDFS and AWS S3
- Experience in shell scripting and scripting to automate report generation and migration of reports to AWS S3
- Worked in building a data pipeline using Pandas and Flask FrameworkGood Familiarity with Anaconda and Jupyternotebook
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Companies hiring on Cutshort

Similar jobs (0)
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Companies hiring on Cutshort






