Data Engineer (PySpark)

MNC

Data Engineer (PySpark)

Fragma Data Systems

Data Engineer (PySpark) at MNC · Bengaluru (Bangalore) · 3 - 7 years · ₹8L - ₹16L / yr · Posted 9 Apr 2021

Data Engineer (PySpark)

at MNC

Agency job

via Fragma Data Systems

3 - 7 yrs

₹8L - ₹16L / yr

Bengaluru (Bangalore)

Skills

PySpark

Python

Spark

Roles and Responsibilities:

• Responsible for developing and maintaining applications with PySpark

• Contribute to the overall design and architecture of the application developed and deployed.

• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.

• Interact with business users to understand requirements and troubleshoot issues.

• Implement Projects based on functional specifications.

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ETL architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skills

Roles and Responsibilities:

• Responsible for developing and maintaining applications with PySpark

• Contribute to the overall design and architecture of the application developed and deployed.

• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.

• Interact with business users to understand requirements and troubleshoot issues.

• Implement Projects based on functional specifications.

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ETL architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skills

Read more

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

companies logos

Similar jobs (0)

Why apply to jobs via Cutshort

people_solving_puzzle

Personalized job matches

Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.

people_verifying_people

Verified hiring teams

See actual hiring teams, find common social connections or connect with them directly.

ai_chip

Move faster with AI

We use AI to get you faster responses, recommendations and unmatched user experience.

Did not find a job you were looking for?

Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.

Get to hear about interesting companies hiring right now

Follow Cutshort

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

companies logos