Data Engineer

at NeenOpal Intelligent Solutions Private Limited

Data Engineer

NeenOpal Intelligent Solutions Private Limited

Data Engineer at NeenOpal Intelligent Solutions Private Limited · Remote, Bengaluru (Bangalore) · 2 - 5 years · ₹6L - ₹12L / yr · Bootstrapped · Remote friendly · Posted 7 Dec 2020

Data Engineer

at NeenOpal Intelligent Solutions Private Limited

Posted by Pavel Gupta

2 - 5 yrs

₹6L - ₹12L / yr

Remote, Bengaluru (Bangalore)

Skills

ETL

Python

Amazon Web Services (AWS)

SQL

PostgreSQL

We are actively seeking a Senior Data Engineer experienced in building data pipelines and integrations from 3rd party data sources by writing custom automated ETL jobs using Python. The role will work in partnership with other members of the Business Analytics team to support the development and implementation of new and existing data warehouse solutions for our clients. This includes designing database import/export processes used to generate client data warehouse deliverables.

Requirements

2+ Years experience as an ETL developer with strong data architecture knowledge around data warehousing concepts, SQL development and optimization, and operational support models.
Experience using Python to automate ETL/Data Processes jobs.
Design and develop ETL and data processing solutions using data integration tools, python scripts, and AWS / Azure / On-Premise Environment.
Experience / Willingness to learn AWS Glue / AWS Data Pipeline / Azure Data Factory for Data Integration.
Develop and create transformation queries, views, and stored procedures for ETL processes, and process automation.
Document data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance.
Work with the data analytics team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake and then upon transformation, and transparently build lessons learned into future data quality assessments
Solid experience with data modeling, business logic, and RESTful APIs.
Solid experience in the Linux environment.
Experience with NoSQL / PostgreSQL preferred
Experience working with databases such as MySQL, NoSQL, and Postgres, and enterprise-level connectivity experience (such as connecting over TLS and through proxies).
Experience with NGINX and SSL.
Performance tune data processes and SQL queries, and recommend and implement data process optimization and query tuning techniques.

Requirements

2+ Years experience as an ETL developer with strong data architecture knowledge around data warehousing concepts, SQL development and optimization, and operational support models.
Experience using Python to automate ETL/Data Processes jobs.
Design and develop ETL and data processing solutions using data integration tools, python scripts, and AWS / Azure / On-Premise Environment.
Experience / Willingness to learn AWS Glue / AWS Data Pipeline / Azure Data Factory for Data Integration.
Develop and create transformation queries, views, and stored procedures for ETL processes, and process automation.
Document data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance.
Work with the data analytics team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake and then upon transformation, and transparently build lessons learned into future data quality assessments
Solid experience with data modeling, business logic, and RESTful APIs.
Solid experience in the Linux environment.
Experience with NoSQL / PostgreSQL preferred
Experience working with databases such as MySQL, NoSQL, and Postgres, and enterprise-level connectivity experience (such as connecting over TLS and through proxies).
Experience with NGINX and SSL.
Performance tune data processes and SQL queries, and recommend and implement data process optimization and query tuning techniques.

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

About NeenOpal Intelligent Solutions Private Limited

Founded :

2016

Type :

Services

Size :

100-1000

Stage :

Bootstrapped

About

NeenOpal is a global management consulting firm with a unique and specialized focus on Data Science. We provide services across the whole value chain of an organization - Digital Strategy, Sales & Marketing, Supply Chain & Logistics as well as Finance. Discover how NeenOpal can help you achieve operational efficiency using Data Science.