Azure Data Engineer

at Marktine

Azure Data Engineer

Marktine

Company

Home

Azure Data Engineer

at Marktine

Posted by Vishal Sharma

3 - 6 yrs

₹10L - ₹20L / yr

Remote, Bengaluru (Bangalore)

Skills

Big Data

Spark

PySpark

Data engineering

Data Warehouse (DWH)

Windows Azure

Python

SQL

Scala

Azure databricks

Azure – Data Engineer

At least 2 years hands on experience working with an Agile data engineering team working on big data pipelines using Azure in a commercial environment.
Dealing with senior stakeholders/leadership
Understanding of Azure data security and encryption best practices. [ADFS/ACLs]

Data Bricks –experience writing in and using data bricks Using Python to transform, manipulate data.

Data Factory – experience using data factory in an enterprise solution to build data pipelines. Experience calling rest APIs.

Synapse/data warehouse – experience using synapse/data warehouse to present data securely and to build & manage data models.

Microsoft SQL server – We’d expect the candidate to have come from a SQL/Data background and progressed into Azure

PowerBI – Experience with this is preferred

Additionally

Experience using GIT as a source control system
Understanding of DevOps concepts and application
Understanding of Azure Cloud costs/management and running platforms efficiently

Azure – Data Engineer

At least 2 years hands on experience working with an Agile data engineering team working on big data pipelines using Azure in a commercial environment.
Dealing with senior stakeholders/leadership
Understanding of Azure data security and encryption best practices. [ADFS/ACLs]

Data Bricks –experience writing in and using data bricks Using Python to transform, manipulate data.

Data Factory – experience using data factory in an enterprise solution to build data pipelines. Experience calling rest APIs.

Synapse/data warehouse – experience using synapse/data warehouse to present data securely and to build & manage data models.

Microsoft SQL server – We’d expect the candidate to have come from a SQL/Data background and progressed into Azure

PowerBI – Experience with this is preferred

Additionally

Experience using GIT as a source control system
Understanding of DevOps concepts and application
Understanding of Azure Cloud costs/management and running platforms efficiently

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Subodh Popalwar

Software Engineer, Memorres

For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.

Companies hiring on Cutshort

About Marktine

Founded :

2016

Type

Size :

100-1000

Stage :

Bootstrapped

About

We are a decision science organization assisting clients to leverage their under-utilized, unstructured, raw, and remote data. to perform business impactful applications using AI/ML technologies. We comprise of Data Enthusiasts (engineers, scientists visualizers), Business Consultants, and Sales Managers with a core focus to address your business growth via data.

Connect with the team

Vishal Sharma

Connect

Company social profiles

Similar jobs

Data Engineer

at TensorGo Software Private Limited

2 recruiters

Posted by Deepika Agarwal

Remote only

5 - 8 yrs

₹5L - ₹15L / yr

Python

PySpark

apache airflow

Spark

Hadoop

+4 more

Requirements:

● Understanding our data sets and how to bring them together.

● Working with our engineering team to support custom solutions offered to the product development.

● Filling the gap between development, engineering and data ops.

● Creating, maintaining and documenting scripts to support ongoing custom solutions.

● Excellent organizational skills, including attention to precise details

● Strong multitasking skills and ability to work in a fast-paced environment

● 5+ years experience with Python to develop scripts.

● Know your way around RESTFUL APIs.[Able to integrate not necessary to publish]

● You are familiar with pulling and pushing files from SFTP and AWS S3.

● Experience with any Cloud solutions including GCP / AWS / OCI / Azure.

● Familiarity with SQL programming to query and transform data from relational Databases.

● Familiarity to work with Linux (and Linux work environment).

● Excellent written and verbal communication skills

● Extracting, transforming, and loading data into internal databases and Hadoop

● Optimizing our new and existing data pipelines for speed and reliability

● Deploying product build and product improvements

● Documenting and managing multiple repositories of code

● Experience with SQL and NoSQL databases (Casendra, MySQL)

● Hands-on experience in data pipelining and ETL. (Any of these frameworks/tools: Hadoop, BigQuery,

RedShift, Athena)

● Hands-on experience in AirFlow

● Understanding of best practices, common coding patterns and good practices around

● storing, partitioning, warehousing and indexing of data

● Experience in reading the data from Kafka topic (both live stream and offline)

● Experience in PySpark and Data frames

Responsibilities:

You’ll

● Collaborating across an agile team to continuously design, iterate, and develop big data systems.

● Extracting, transforming, and loading data into internal databases.

● Optimizing our new and existing data pipelines for speed and reliability.

● Deploying new products and product improvements.

● Documenting and managing multiple repositories of code.

Requirements:

● Understanding our data sets and how to bring them together.

● Working with our engineering team to support custom solutions offered to the product development.

● Filling the gap between development, engineering and data ops.

● Creating, maintaining and documenting scripts to support ongoing custom solutions.

● Excellent organizational skills, including attention to precise details

● Strong multitasking skills and ability to work in a fast-paced environment

● 5+ years experience with Python to develop scripts.

● Know your way around RESTFUL APIs.[Able to integrate not necessary to publish]

● You are familiar with pulling and pushing files from SFTP and AWS S3.

● Experience with any Cloud solutions including GCP / AWS / OCI / Azure.

● Familiarity with SQL programming to query and transform data from relational Databases.

● Familiarity to work with Linux (and Linux work environment).

● Excellent written and verbal communication skills

● Extracting, transforming, and loading data into internal databases and Hadoop

● Optimizing our new and existing data pipelines for speed and reliability

● Deploying product build and product improvements

● Documenting and managing multiple repositories of code

● Experience with SQL and NoSQL databases (Casendra, MySQL)

● Hands-on experience in data pipelining and ETL. (Any of these frameworks/tools: Hadoop, BigQuery,

RedShift, Athena)

● Hands-on experience in AirFlow

● Understanding of best practices, common coding patterns and good practices around

● storing, partitioning, warehousing and indexing of data

● Experience in reading the data from Kafka topic (both live stream and offline)

● Experience in PySpark and Data frames

Responsibilities:

You’ll

● Collaborating across an agile team to continuously design, iterate, and develop big data systems.

● Extracting, transforming, and loading data into internal databases.

● Optimizing our new and existing data pipelines for speed and reliability.

● Deploying new products and product improvements.

● Documenting and managing multiple repositories of code.

BI Developer

at Agiletech Info Solutions pvt ltd

Posted by Kalaithendral Nagarajan

Chennai

4 - 9 yrs

₹4L - ₹12L / yr

Data Analytics

Data Visualization

PowerBI

Tableau

Qlikview

+5 more

4 - 8 overall experience.

1-2 years’ experience in Azure Data Factory - schedule Jobs in Flows and ADF Pipelines, Performance Tuning, Error logging etc..
1+ years of experience with Power BI - designing and developing reports, dashboards, metrics and visualizations in Powe BI.
(Required) Participate in video conferencing calls - daily stand-up meetings and all day working with team members on cloud migration planning, development, and support.
Proficiency in relational database concepts & design using star, Azure Datawarehouse, and data vault.
Requires 2-3 years of experience with SQL scripting (merge, joins, and stored procedures) and best practices.
Knowledge on deploying and run SSIS packages in Azure.
Knowledge of Azure Data Bricks.
Ability to write and execute complex SQL queries and stored procedures.

4 - 8 overall experience.

1-2 years’ experience in Azure Data Factory - schedule Jobs in Flows and ADF Pipelines, Performance Tuning, Error logging etc..
1+ years of experience with Power BI - designing and developing reports, dashboards, metrics and visualizations in Powe BI.
(Required) Participate in video conferencing calls - daily stand-up meetings and all day working with team members on cloud migration planning, development, and support.
Proficiency in relational database concepts & design using star, Azure Datawarehouse, and data vault.
Requires 2-3 years of experience with SQL scripting (merge, joins, and stored procedures) and best practices.
Knowledge on deploying and run SSIS packages in Azure.
Knowledge of Azure Data Bricks.
Ability to write and execute complex SQL queries and stored procedures.

Data Scientist

at leading pharmacy provider

Agency job

via Econolytics by Jyotsna Econolytics

Noida, NCR (Delhi | Gurgaon | Noida)

4 - 10 yrs

₹18L - ₹24L / yr

Data Science

R Programming

Python

Algorithms

Predictive modelling

Job Description:

• Help build a Data Science team which will be engaged in researching, designing,
implementing, and deploying full-stack scalable data analytics vision and machine learning
solutions to challenge various business issues.
• Modelling complex algorithms, discovering insights and identifying business
opportunities through the use of algorithmic, statistical, visualization, and mining techniques
• Translates business requirements into quick prototypes and enable the
development of big data capabilities driving business outcomes
• Responsible for data governance and defining data collection and collation
guidelines.
• Must be able to advice, guide and train other junior data engineers in their job.

Must Have:

• 4+ experience in a leadership role as a Data Scientist
• Preferably from retail, Manufacturing, Healthcare industry(not mandatory)
• Willing to work from scratch and build up a team of Data Scientists
• Open for taking up the challenges with end to end ownership
• Confident with excellent communication skills along with a good decision maker

Data Engineer- Pyspark+SQL (Onsite opportunity- UAE Abu Dhabi/Dubai)

at UAE Client

Agency job

via Fragma Data Systems by Evelyn Charles

Abu Dhabi, Dubai

6 - 12 yrs

₹18L - ₹25L / yr

PySpark

Big Data

Spark

Data Warehouse (DWH)

SQL

+2 more

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skill

Technology Skills (Good to Have):

Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
Designing and implementing data engineering, ingestion, and transformation functions
Azure Synapse or Azure SQL data warehouse
Spark on Azure is available in HD insights and data bricks

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skill

Technology Skills (Good to Have):

Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
Designing and implementing data engineering, ingestion, and transformation functions
Azure Synapse or Azure SQL data warehouse
Spark on Azure is available in HD insights and data bricks

SQL/Pyspark Developer

at MNC

Agency job

via Fragma Data Systems by Priyanka U

Remote, Bengaluru (Bangalore)

5 - 8 yrs

₹12L - ₹20L / yr

PySpark

SQL

Data Warehouse (DWH)

ETL

SQL Developer with Relevant experience of 7 Yrs with Strong Communication Skills.

Key responsibilities:

Creating, designing and developing data models
Prepare plans for all ETL (Extract/Transformation/Load) procedures and architectures
Validating results and creating business reports
Monitoring and tuning data loads and queries
Develop and prepare a schedule for a new data warehouse
Analyze large databases and recommend appropriate optimization for the same
Administer all requirements and design various functional specifications for data
Provide support to the Software Development Life cycle
Prepare various code designs and ensure efficient implementation of the same
Evaluate all codes and ensure the quality of all project deliverables
Monitor data warehouse work and provide subject matter expertise
Hands-on BI practices, data structures, data modeling, SQL skills
Minimum 1 year experience in Pyspark

SQL Developer with Relevant experience of 7 Yrs with Strong Communication Skills.

Key responsibilities:

Creating, designing and developing data models
Prepare plans for all ETL (Extract/Transformation/Load) procedures and architectures
Validating results and creating business reports
Monitoring and tuning data loads and queries
Develop and prepare a schedule for a new data warehouse
Analyze large databases and recommend appropriate optimization for the same
Administer all requirements and design various functional specifications for data
Provide support to the Software Development Life cycle
Prepare various code designs and ensure efficient implementation of the same
Evaluate all codes and ensure the quality of all project deliverables
Monitor data warehouse work and provide subject matter expertise
Hands-on BI practices, data structures, data modeling, SQL skills
Minimum 1 year experience in Pyspark

Sr. Data Scientist

at Our Client company is into Computer Software. (EC1)

Agency job

via Multi Recruit by Manjunath Multirecruit

Bengaluru (Bangalore)

5 - 7 yrs

₹14.5L - ₹16.5L / yr

Data Science

Data scientist

Data Analytics

Machine Learning (ML)

Python

+2 more

Actively engage with internal business teams to understand their challenges and deliver robust, data-driven solutions.
Work alongside global counterparts to solve data-intensive problems using standard analytical frameworks and tools.
Be encouraged and expected to innovate and be creative in your data analysis, problem-solving, and presentation of solutions.
Network and collaborate with a broad range of internal business units to define and deliver joint solutions.
Work alongside customers to leverage cutting-edge technology (machine learning, streaming analytics, and ‘real’ big data) to creatively solve problems and disrupt existing business models.

In this role, we are looking for:

A problem-solving mindset with the ability to understand business challenges and how to apply your analytics expertise to solve them.
The unique person who can present complex mathematical solutions in a simple manner that most will understand, including customers.
An individual excited by innovation and new technology and eager to finds ways to employ these innovations in practice.
A team mentality, empowered by the ability to work with a diverse set of individuals.

Basic Qualifications

A Bachelor’s degree in Data Science, Math, Statistics, Computer Science or related field with an emphasis on analytics.
5+ Years professional experience in a data scientist/analyst role or similar.
Proficiency in your statistics/analytics/visualization tool of choice, but preferably in the Microsoft Azure Suite, including Azure ML Studio and PowerBI as well as R, Python, SQL.

Preferred Qualifications

Excellent communication, organizational transformation, and leadership skills
Demonstrated excellence in Data Science, Business Analytics and Engineering

Actively engage with internal business teams to understand their challenges and deliver robust, data-driven solutions.
Work alongside global counterparts to solve data-intensive problems using standard analytical frameworks and tools.
Be encouraged and expected to innovate and be creative in your data analysis, problem-solving, and presentation of solutions.
Network and collaborate with a broad range of internal business units to define and deliver joint solutions.
Work alongside customers to leverage cutting-edge technology (machine learning, streaming analytics, and ‘real’ big data) to creatively solve problems and disrupt existing business models.

In this role, we are looking for:

A problem-solving mindset with the ability to understand business challenges and how to apply your analytics expertise to solve them.
The unique person who can present complex mathematical solutions in a simple manner that most will understand, including customers.
An individual excited by innovation and new technology and eager to finds ways to employ these innovations in practice.
A team mentality, empowered by the ability to work with a diverse set of individuals.

Basic Qualifications

A Bachelor’s degree in Data Science, Math, Statistics, Computer Science or related field with an emphasis on analytics.
5+ Years professional experience in a data scientist/analyst role or similar.
Proficiency in your statistics/analytics/visualization tool of choice, but preferably in the Microsoft Azure Suite, including Azure ML Studio and PowerBI as well as R, Python, SQL.

Preferred Qualifications

Excellent communication, organizational transformation, and leadership skills
Demonstrated excellence in Data Science, Business Analytics and Engineering

Internship- JAVA / Python / AI / ML

at Wise Source

1 recruiter

Posted by Wise HR

Remote, Guindy

0 - 2 yrs

₹1L - ₹1.5L / yr

Artificial Intelligence (AI)

Machine Learning (ML)

Internship

Java

Python

Looking out for Internship Candidates . Designation:- Intern/ Trainee Technology : .NET/JAVA/ Python/ AI/ ML Duration : 2-3 Months Job Location :Online Internship Joining :Immediately Job Type :Internship Job Description - MCA/M.Tech/ B.Tech/ BE who need 2-6 months internship project to be done. - Should be available to join us immediately. - Should be flexible to work on any Skills/ Technologies. - Ready to work in long working hours. - Must possess excellent analytical and logical skills. - Internship experience is provided from experts - Internship Certificate will be provided at the end of training. - The requirement is strictly for internship and not a permanent job - Stipend will be provided only based on the performance.

ETL developer

at fintech

Agency job

via Talentojcom by Raksha Pant

Remote only

2 - 6 yrs

₹9L - ₹30L / yr

ETL

Druid Database

Java

Scala

SQL

+2 more

● Education in a science, technology, engineering, or mathematics discipline, preferably a
bachelor’s degree or equivalent experience
● Knowledge of database fundamentals and fluency in advanced SQL, including concepts
such as windowing functions
● Knowledge of popular scripting languages for data processing such as Python, as well as
familiarity with common frameworks such as Pandas
● Experience building streaming ETL pipelines with tools such as Apache Flink, Apache
Beam, Google Cloud Dataflow, DBT and equivalents
● Experience building batch ETL pipelines with tools such as Apache Airflow, Spark, DBT, or
custom scripts
● Experience working with messaging systems such as Apache Kafka (and hosted
equivalents such as Amazon MSK), Apache Pulsar
● Familiarity with BI applications such as Tableau, Looker, or Superset
● Hands on coding experience in Java or Scala

Data Scientist

at Saama Technologies

6 recruiters

Posted by Sandeep Chaudhary

Pune

4 - 8 yrs

₹1L - ₹16L / yr

Data Science

Python

Machine Learning (ML)

Natural Language Processing (NLP)

Big Data

+2 more

Description Must have Direct Hands- on, 4 years of experience, building complex Data Science solutions Must have fundamental knowledge of Inferential Statistics Should have worked on Predictive Modelling, using Python / R Experience should include the following, File I/ O, Data Harmonization, Data Exploration Machine Learning Techniques (Supervised, Unsupervised) Multi- Dimensional Array Processing Deep Learning NLP, Image Processing Prior experience in Healthcare Domain, is a plus Experience using Big Data, is a plus Should have Excellent Analytical, Problem Solving ability. Should be able to grasp new concepts quickly Should be well familiar with Agile Project Management Methodology Should have excellent written and verbal communication skills Should be a team player with open mind

Data Scientist

at Indix

1 recruiter

Posted by Sri Devi

Chennai, Hyderabad

3 - 7 yrs

₹15L - ₹45L / yr

Data Science

Python

Algorithms

Data Structures

Scikit-Learn

+3 more

Software Engineer – ML at Indix provides an opportunity to design and build systems that crunch large amounts of data everyday What We’re Looking For- 3+ years of experience Ability to propose hypothesis and design experiments in the context of specific problems. Should come from a strong engineering background Good overlap with Indix Data tech stack such as Hadoop, MapReduce, HDFS, Spark, Scalding, Scala/Python/C++ Dedication and diligence in understanding the application domain, collecting/cleaning data and conducting experiments. Creativity in model and algorithm development. An obsession to develop algorithms/models that directly impact business. Master’s/Phd. in Computer Science/Statistics is a plus Job Expectations Experience working in text mining and python libraries like scikit-learn, numpy, etc Collect relevant data from production systems/Use crawling and parsing infrastructure to put together data sets. Survey academic literature and identify potential approaches for exploration. Craft, conduct and analyze experiments to evaluate models/algorithms. Communicate findings and take algorithms/models to production with end to end ownership.

Why apply to jobs via Cutshort