11+ Pipeline management Jobs in Mumbai | Pipeline management Job openings in Mumbai

Roles and Responsibilities

• Managing available resources such as hardware, data, and personnel so that deadlines are met.
• Analyzing the ML and Deep Learning algorithms that could be used to solve a given problem and ranking them by their success probabilities
• Exploring data to gain an understanding of it, then identifying differences in data distribution that could affect performance when deploying the model in the real world
• Defining validation framework and establish a process to ensure acceptable data quality criteria are met
• Supervising the data acquisition and partnership roadmaps to create stronger product for our customers.
• Defining feature engineering process to ensure usage of meaningful features given the business constraints which may vary by market
• Device self-learning strategies through analysis of errors from the models
• Understand business issues and context, devise a framework for solving unstructured problems and articulate clear and actionable solutions underpinned by analytics.
• Manage multiple projects simultaneously while demonstrating business leadership to collaborate & coordinate with different functions to deliver the solutions in a timely, efficient and effective manner.
• Manage project resources optimally to deliver projects on time; drive innovation using residual resources to create strong solution pipeline; provide direction, coaching & training, feedbacks to project team members to enhance performance, support development and encourage value aligned behaviour of the project team members; Provide inputs for periodic performance appraisal of project team members.

Preferred Technical & Professional expertise

• Undergraduate Degree in Computer Science / Engineering / Mathematics / Statistics / economics or other quantitative fields
• At least 2+ years of experience of managing Data Science projects with specializations in Machine Learning
• In-depth knowledge of cloud analytics tools.
• Able to drive Python Code optimization; ability review codes and provide inputs to improve the quality of codes
• Ability to evaluate hardware selection for running ML models for optimal performance
• Up to date with Python libraries and versions for machine learning; Extensive hands-on experience with Regressors; Experience working with data pipelines.
• Deep knowledge of math, probability, statistics and algorithms; Working knowledge of Supervised Learning, Adversarial Learning and Unsupervised learning
• Deep analytical thinking with excellent problem-solving abilities
• Strong verbal and written communication skills with a proven ability to work with all levels of management; effective interpersonal and influencing skills.
• Ability to manage a project team through effectively allocation of tasks, anticipating risks and setting realistic timelines for managing the expectations of key stakeholders
• Strong organizational skills and an ability to balance and handle multiple concurrent tasks and/or issues simultaneously.
• Ensure that the project team understand and abide by compliance framework for policies, data, systems etc. as per group, region and local standards

Senior Director – Strategy (Data & Analytics)

The client is a leading media agency who drive more strategic, creative and integrated media approach established to drive better business results. Their team is made up of best in class digital, offline, and integrated media experts who work together to enhance media's contribution to their client's business.

Responsibilities of the role:

We are looking for a talented Director to join our leadership team and manage the delivery of data engineering projects . In this role, you will be responsible to manage a team of highly skilled engineers, scientists and analysts to deliver data-driven solutions to exceed client goals. 

 As the Director, Data and Analytics, you will work with the agency and client to enable the data and tech solutions that lay the foundation for executing brand & performance marketing. 

• Set the vision, strategy, and roadmap to deliver cutting edge data, technology and analytics solutions across a portfolio of clients .
• Become a trusted advisor to clients and consult on growth opportunities and identify new way to use data to solve business challenges and support growth, 
• Support development and deployment of products and services across multiple cloud environments 
• Collaborate with a cross-functional team of client leads, application developers, operations engineers, and architects to translate complex product requirements into technical specs and design requirements 
• Act as a consultant and subject matter expert for internal stakeholders in GroupM Data & Analytics, GroupM Engineering and agency data science and tech leads 
• Build & manage a team of experts in Data Strategy, Measurement/Business Analysts, Advanced Analytics, and Marketing Technology specialists to deliver best in class audience, measurement strategy in collaboration with Client, Strategy, and Investment teams. 

What you will need:

·      7+ years of experience in data analytics / quantitative research

• Proven thought-leadership, and a deep understanding of the data and technology issues facing the marketing industry
• Experience building, managing and inspiring large and diverse teams of data and technology specialists
• A proven track record in working with a diverse array of clients to solve complex problems and delivering demonstrable business success. Including (but not limited to) the development of compelling and sophisticated data strategies and AdTech / martech strategies to enable marketing objectives.

·      Master’s or Bachelor’s in Statistics, Mathematics or related quantitative field

About UpSolve

We built and deliver complex AI solutions which help drive business decisions faster and more accurately. We are a typical AI company and have a range of solutions developed on Video, Image and Text.

What you will do

• Stay informed on new technologies and implement cautiously
• Maintain necessary documentation for the project
• Fix the issues reported by application users
• Plan, build, and design solutions with a mental note of future requirements
• Coordinate with the development team to manage fixes, code changes, and merging

Location: Mumbai

Working Mode: Remote

What are we looking for

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• Minimum 2 years of professional experience in software development, with a focus on machine learning and full stack development.
• Strong proficiency in Python programming language and its machine learning libraries such as TensorFlow, PyTorch, or scikit-learn.
• Experience in developing and deploying machine learning models in production environments.
• Proficiency in web development technologies including HTML, CSS, JavaScript, and front-end frameworks such as React, Angular, or Vue.js.
• Experience in designing and developing RESTful APIs and backend services using frameworks like Flask or Django.
• Knowledge of databases and SQL for data storage and retrieval.
• Familiarity with version control systems such as Git.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.
• Ability to work effectively in a fast-paced and dynamic team environment.
• Good to have Cloud Exposure

Our client is the world’s largest media investment company and are a part of WPP. In fact, they are responsible for one in every three ads you see globally. We are currently looking for a Senior Software Engineer to join us. In this role, you will be responsible for coding/implementing of custom marketing applications that Tech COE builds for its customer and managing a small team of developers.

What your day job looks like:

• Serve as a Subject Matter Expert on data usage – extraction, manipulation, and inputs for analytics
• Develop data extraction and manipulation code based on business rules
• Develop automated and manual test cases for the code written
• Design and construct data store and procedures for their maintenance
• Perform data extract, transform, and load activities from several data sources.
• Develop and maintain strong relationships with stakeholders
• Write high quality code as per prescribed standards.
• Participate in internal projects as required

 
Minimum qualifications:

• B. Tech./MCA or equivalent preferred
• Excellent 3 years Hand on experience on Big data, ETL Development, Data Processing.

    What you’ll bring:

• Strong experience in working with Snowflake, SQL, PHP/Python.
• Strong Experience in writing complex SQLs
• Good Communication skills
• Good experience of working with any BI tool like Tableau, Power BI.
• Sqoop, Spark, EMR, Hadoop/Hive are good to have.

ABOUT EPISOURCE:

Episource has devoted more than a decade in building solutions for risk adjustment to measure healthcare outcomes. As one of the leading companies in healthcare, we have helped numerous clients optimize their medical records, data, analytics to enable better documentation of care for patients with chronic diseases.

The backbone of our consistent success has been our obsession with data and technology. At Episource, all of our strategic initiatives start with the question - how can data be “deployed”? Our analytics platforms and datalakes ingest huge quantities of data daily, to help our clients deliver services. We have also built our own machine learning and NLP platform to infuse added productivity and efficiency into our workflow. Combined, these build a foundation of tools and practices used by quantitative staff across the company.

What’s our poison you ask? We work with most of the popular frameworks and technologies like Spark, Airflow, Ansible, Terraform, Docker, ELK. For machine learning and NLP, we are big fans of keras, spacy, scikit-learn, pandas and numpy. AWS and serverless platforms help us stitch these together to stay ahead of the curve.

ABOUT THE ROLE:

We’re looking to hire someone to help scale Machine Learning and NLP efforts at Episource. You’ll work with the team that develops the models powering Episource’s product focused on NLP driven medical coding. Some of the problems include improving our ICD code recommendations, clinical named entity recognition, improving patient health, clinical suspecting and information extraction from clinical notes.

This is a role for highly technical data engineers who combine outstanding oral and written communication skills, and the ability to code up prototypes and productionalize using a large range of tools, algorithms, and languages. Most importantly they need to have the ability to autonomously plan and organize their work assignments based on high-level team goals.

You will be responsible for setting an agenda to develop and ship data-driven architectures that positively impact the business, working with partners across the company including operations and engineering. You will use research results to shape strategy for the company and help build a foundation of tools and practices used by quantitative staff across the company.

During the course of a typical day with our team, expect to work on one or more projects around the following;

1. Create and maintain optimal data pipeline architectures for ML

2. Develop a strong API ecosystem for ML pipelines

3. Building CI/CD pipelines for ML deployments using Github Actions, Travis, Terraform and Ansible

4. Responsible to design and develop distributed, high volume, high-velocity multi-threaded event processing systems

5. Knowledge of software engineering best practices across the development lifecycle, coding standards, code reviews, source management, build processes, testing, and operations  

6. Deploying data pipelines in production using Infrastructure-as-a-Code platforms

7. Designing scalable implementations of the models developed by our Data Science teams  

8. Big data and distributed ML with PySpark on AWS EMR, and more!

BASIC REQUIREMENTS 

1.  Bachelor’s degree or greater in Computer Science, IT or related fields
   
   

2.  Minimum of 5 years of experience in cloud, DevOps, MLOps & data projects
   
   

3. Strong experience with bash scripting, unix environments and building scalable/distributed systems
   
   

4. Experience with automation/configuration management using Ansible, Terraform, or equivalent
   
   

5. Very strong experience with AWS and Python
   
   

6. Experience building CI/CD systems
   
   

7. Experience with containerization technologies like Docker, Kubernetes, ECS, EKS or equivalent

8. Ability to build and manage application and performance monitoring processes

Roles and

Responsibilities

Seeking AWS Cloud Engineer /Data Warehouse Developer for our Data CoE team to

help us in configure and develop new AWS environments for our Enterprise Data Lake,

migrate the on-premise traditional workloads to cloud. Must have a sound

understanding of BI best practices, relational structures, dimensional data modelling,

structured query language (SQL) skills, data warehouse and reporting techniques.

 Extensive experience in providing AWS Cloud solutions to various business

use cases.

 Creating star schema data models, performing ETLs and validating results with

business representatives

 Supporting implemented BI solutions by: monitoring and tuning queries and

data loads, addressing user questions concerning data integrity, monitoring

performance and communicating functional and technical issues.

Job Description: -

This position is responsible for the successful delivery of business intelligence

information to the entire organization and is experienced in BI development and

implementations, data architecture and data warehousing.

Requisite Qualification

Essential

-

AWS Certified Database Specialty or -

AWS Certified Data Analytics

Preferred

Any other Data Engineer Certification

Requisite Experience

Essential 4 -7 yrs of experience

Preferred 2+ yrs of experience in ETL & data pipelines

Skills Required

Special Skills Required

 AWS: S3, DMS, Redshift, EC2, VPC, Lambda, Delta Lake, CloudWatch etc.

 Bigdata: Databricks, Spark, Glue and Athena

 Expertise in Lake Formation, Python programming, Spark, Shell scripting

 Minimum Bachelor’s degree with 5+ years of experience in designing, building,

and maintaining AWS data components

 3+ years of experience in data component configuration, related roles and

access setup

 Expertise in Python programming

 Knowledge in all aspects of DevOps (source control, continuous integration,

deployments, etc.)

 Comfortable working with DevOps: Jenkins, Bitbucket, CI/CD

 Hands on ETL development experience, preferably using or SSIS

 SQL Server experience required

 Strong analytical skills to solve and model complex business requirements

 Sound understanding of BI Best Practices/Methodologies, relational structures,

dimensional data modelling, structured query language (SQL) skills, data

warehouse and reporting techniques

Preferred Skills

Required

 Experience working in the SCRUM Environment.

 Experience in Administration (Windows/Unix/Network/Database/Hadoop) is a

plus.

 Experience in SQL Server, SSIS, SSAS, SSRS

 Comfortable with creating data models and visualization using Power BI

 Hands on experience in relational and multi-dimensional data modelling,

including multiple source systems from databases and flat files, and the use of

standard data modelling tools

 Ability to collaborate on a team with infrastructure, BI report development and

business analyst resources, and clearly communicate solutions to both

technical and non-technical team members

• Key responsibility is to design, develop & maintain efficient Data models for the organization maintained to ensure optimal query performance by the consumption layer.
• Developing, Deploying & maintaining a repository of UDXs written in Java / Python.
• Develop optimal Data Model design, analyzing complex distributed data deployments, and making recommendations to optimize performance basis data consumption patterns, performance expectations, the query is executed on the tables/databases, etc.
• Periodic Database health check and maintenance
• Designing collections in a no-SQL Database for efficient performance
• Document & maintain data dictionary from various sources to enable data governance
• Coordination with Business teams, IT, and other stakeholders to provide best-in-class data pipeline solutions, exposing data via APIs, loading in down streams, No-SQL Databases, etc
• Data Governance Process Implementation and ensuring data security

Requirements

• Extensive working experience in Designing & Implementing Data models in OLAP Data Warehousing solutions (Redshift, Synapse, Snowflake, Teradata, Vertica, etc).
• Programming experience using Python / Java.
• Working knowledge in developing & deploying User-defined Functions (UDXs) using Java / Python.
• Strong understanding & extensive working experience in OLAP Data Warehousing (Redshift, Synapse, Snowflake, Teradata, Vertica, etc) architecture and cloud-native Data Lake (S3, ADLS, BigQuery, etc) Architecture.
• Strong knowledge in Design, Development & Performance tuning of 3NF/Flat/Hybrid Data Model.
• Extensive technical experience in SQL including code optimization techniques.
• Strung knowledge of database performance and tuning, troubleshooting, and tuning.
• Knowledge of collection design in any No-SQL DB (DynamoDB, MongoDB, CosmosDB, etc), along with implementation of best practices.
• Ability to understand business functionality, processes, and flows.
• Good combination of technical and interpersonal skills with strong written and verbal communication; detail-oriented with the ability to work independently.
• Any OLAP DWH DBA Experience and User Management will be added advantage.
• Knowledge in financial industry-specific Data models such as FSLDM, IBM Financial Data Model, etc will be added advantage.
• Experience in Snowflake will be added advantage.
• Working experience in BFSI/NBFC & data understanding of Loan/Mortgage data will be added advantage.

Functional knowledge

• Data Governance & Quality Assurance
• Modern OLAP Database Architecture & Design
• Linux
• Data structures, algorithm & data modeling techniques
• No-SQL database architecture
• Data Security

Specialism- Advance Analytics, Data Science, regression, forecasting, analytics, SQL, R, python, decision tree, random forest, SAS, clustering classification

Senior Analytics Consultant- Responsibilities

• Understand business problem and requirements by building domain knowledge and translate to data science problem
• Conceptualize and design cutting edge data science solution to solve the data science problem, apply design thinking concepts
• Identify the right algorithms , tech stack , sample outputs required to efficiently adder the end need
• Prototype and experiment the solution to successfully demonstrate the value
  Independently or with support from team execute the conceptualized solution as per plan by following project management guidelines
• Present the results to internal and client stakeholder in an easy to understand manner with great story telling, story boarding, insights and visualization
• Help build overall data science capability for eClerx through support in pilots, pre sales pitches, product development , practice development initiatives

Nactus is at forefront of education reinvention, helping educators and learner’s community at large through innovative solutions in digital era. We are looking for an experienced AI specialist to join our revolution using the deep learning, artificial intelligence.  This is an excellent opportunity to take advantage of emerging trends and technologies to a real-world difference.

Role and Responsibilities

• Manage and direct research and development (R&D) and processes to meet the needs of our AI strategy.
• Understand company and client challenges and how integrating AI capabilities can help create educational solutions.
• Analyse and explain AI and machine learning (ML) solutions while setting and maintaining high ethical standards.

Skills Required

• Knowledge of algorithms, object-oriented and functional design principles
• Demonstrated artificial intelligence, machine learning, mathematical and statistical modelling knowledge and skills.
• Well-developed programming skills – specifically in SAS or SQL and other packages with statistical and machine learning application, e.g. R, Python
• Experience with machine learning fundamentals, parallel computing and distributed systems fundamentals, or data structure fundamentals
• Experience with C, C++, or Python programming
• Experience with debugging and building AI applications.
• Robustness and productivity analyse conclusions.
• Develop a human-machine speech interface.
• Verify, evaluate, and demonstrate implemented work.
• Proven experience with ML, deep learning, Tensorflow, Python