11+ Pipeline management Jobs in Mumbai | Pipeline management Job openings in Mumbai

Roles and Responsibilities

• Managing available resources such as hardware, data, and personnel so that deadlines are met.
• Analyzing the ML and Deep Learning algorithms that could be used to solve a given problem and ranking them by their success probabilities
• Exploring data to gain an understanding of it, then identifying differences in data distribution that could affect performance when deploying the model in the real world
• Defining validation framework and establish a process to ensure acceptable data quality criteria are met
• Supervising the data acquisition and partnership roadmaps to create stronger product for our customers.
• Defining feature engineering process to ensure usage of meaningful features given the business constraints which may vary by market
• Device self-learning strategies through analysis of errors from the models
• Understand business issues and context, devise a framework for solving unstructured problems and articulate clear and actionable solutions underpinned by analytics.
• Manage multiple projects simultaneously while demonstrating business leadership to collaborate & coordinate with different functions to deliver the solutions in a timely, efficient and effective manner.
• Manage project resources optimally to deliver projects on time; drive innovation using residual resources to create strong solution pipeline; provide direction, coaching & training, feedbacks to project team members to enhance performance, support development and encourage value aligned behaviour of the project team members; Provide inputs for periodic performance appraisal of project team members.

Preferred Technical & Professional expertise

• Undergraduate Degree in Computer Science / Engineering / Mathematics / Statistics / economics or other quantitative fields
• At least 2+ years of experience of managing Data Science projects with specializations in Machine Learning
• In-depth knowledge of cloud analytics tools.
• Able to drive Python Code optimization; ability review codes and provide inputs to improve the quality of codes
• Ability to evaluate hardware selection for running ML models for optimal performance
• Up to date with Python libraries and versions for machine learning; Extensive hands-on experience with Regressors; Experience working with data pipelines.
• Deep knowledge of math, probability, statistics and algorithms; Working knowledge of Supervised Learning, Adversarial Learning and Unsupervised learning
• Deep analytical thinking with excellent problem-solving abilities
• Strong verbal and written communication skills with a proven ability to work with all levels of management; effective interpersonal and influencing skills.
• Ability to manage a project team through effectively allocation of tasks, anticipating risks and setting realistic timelines for managing the expectations of key stakeholders
• Strong organizational skills and an ability to balance and handle multiple concurrent tasks and/or issues simultaneously.
• Ensure that the project team understand and abide by compliance framework for policies, data, systems etc. as per group, region and local standards

Responsibilities:

• Data science model review, run the code refactoring and optimization, containerization, deployment, versioning, and monitoring of its quality.
• Design and implement cloud solutions, build MLOps on the cloud (preferably AWS)
• Work with workflow orchestration tools like Kubeflow, Airflow, Argo, or similar tools
• Data science models testing, validation, and test automation.
• Communicate with a team of data scientists, data engineers, and architects, and document the processes.

Eligibility:

• Rich hands-on experience in writing object-oriented code using python
• Min 3 years of MLOps experience (Including model versioning, model and data lineage, monitoring, model hosting and deployment, scalability, orchestration, continuous learning, and Automated pipelines)
• Understanding of Data Structures, Data Systems, and software architecture
• Experience in using MLOps frameworks like Kubeflow, MLFlow, and Airflow Pipelines for building, deploying, and managing multi-step ML workflows based on Docker containers and Kubernetes.
• Exposure to deep learning approaches and modeling frameworks (PyTorch, Tensorflow, Keras, etc. )

Our client is the world’s largest media investment company and are a part of WPP. In fact, they are responsible for one in every three ads you see globally. We are currently looking for a Senior Software Engineer to join us. In this role, you will be responsible for coding/implementing of custom marketing applications that Tech COE builds for its customer and managing a small team of developers.

What your day job looks like:

• Serve as a Subject Matter Expert on data usage – extraction, manipulation, and inputs for analytics
• Develop data extraction and manipulation code based on business rules
• Develop automated and manual test cases for the code written
• Design and construct data store and procedures for their maintenance
• Perform data extract, transform, and load activities from several data sources.
• Develop and maintain strong relationships with stakeholders
• Write high quality code as per prescribed standards.
• Participate in internal projects as required

 
Minimum qualifications:

• B. Tech./MCA or equivalent preferred
• Excellent 3 years Hand on experience on Big data, ETL Development, Data Processing.

    What you’ll bring:

• Strong experience in working with Snowflake, SQL, PHP/Python.
• Strong Experience in writing complex SQLs
• Good Communication skills
• Good experience of working with any BI tool like Tableau, Power BI.
• Sqoop, Spark, EMR, Hadoop/Hive are good to have.

DATA ENGINEER

Overview

They started with a singular belief - what is beautiful cannot and should not be defined in marketing meetings. It's defined by the regular people like us, our sisters, our next-door neighbours, and the friends we make on the playground and in lecture halls. That's why we stand for people-proving everything we do. From the inception of a product idea to testing the final formulations before launch, our consumers are a part of each and every process. They guide and inspire us by sharing their stories with us. They tell us not only about the product they need and the skincare issues they face but also the tales of their struggles, dreams and triumphs. Skincare goes deeper than skin. It's a form of self-care for many. Wherever someone is on this journey, we want to cheer them on through the products we make, the content we create and the conversations we have. What we wish to build is more than a brand. We want to build a community that grows and glows together - cheering each other on, sharing knowledge, and ensuring people always have access to skincare that really works.

Job Description:

We are seeking a skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that enable efficient data collection, storage, processing, and analysis. You will collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to implement data pipelines and ensure the availability, reliability, and scalability of our data platform.

Responsibilities:

Design and implement scalable and robust data pipelines to collect, process, and store data from various sources.

Develop and maintain data warehouse and ETL (Extract, Transform, Load) processes for data integration and transformation.

Optimize and tune the performance of data systems to ensure efficient data processing and analysis.

Collaborate with data scientists and analysts to understand data requirements and implement solutions for data modeling and analysis.

Identify and resolve data quality issues, ensuring data accuracy, consistency, and completeness.

Implement and maintain data governance and security measures to protect sensitive data.

Monitor and troubleshoot data infrastructure, perform root cause analysis, and implement necessary fixes.

Stay up-to-date with emerging technologies and industry trends in data engineering and recommend their adoption when appropriate.

Qualifications:

Bachelor’s or higher degree in Computer Science, Information Systems, or a related field.

Proven experience as a Data Engineer or similar role, working with large-scale data processing and storage systems.

Strong programming skills in languages such as Python, Java, or Scala.

Experience with big data technologies and frameworks like Hadoop, Spark, or Kafka.

Proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, or Oracle).

Familiarity with cloud platforms like AWS, Azure, or GCP, and their data services (e.g., S3, Redshift, BigQuery).

Solid understanding of data modeling, data warehousing, and ETL principles.

Knowledge of data integration techniques and tools (e.g., Apache Nifi, Talend, or Informatica).

Strong problem-solving and analytical skills, with the ability to handle complex data challenges.

Excellent communication and collaboration skills to work effectively in a team environment.

Preferred Qualifications:

Advanced knowledge of distributed computing and parallel processing.

Experience with real-time data processing and streaming technologies (e.g., Apache Kafka, Apache Flink).

Familiarity with machine learning concepts and frameworks (e.g., TensorFlow, PyTorch).

Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).

Experience with data visualization and reporting tools (e.g., Tableau, Power BI).

Certification in relevant technologies or data engineering disciplines.

We are looking for a Data Analyst that oversees organisational data analytics. This will require you to design and help implement the data analytics platform that will keep the organisation running. The team will be the go-to for all data needs for the app and we are looking for a self-starter who is hands on and yet able to abstract problems and anticipate data requirements.
This person should be very strong technical data analyst who can design and implement data systems on his own. Along with him, he also needs to be proficient in business reporting and should have keen interest in provided data needed for business.

Tools familiarity:  SQL, Python, Mix panel, Metabase, Google Analytics,  Clever Tap, App Analytics

Responsibilities

• Processes and frameworks for metrics, analytics, experimentation and user insights, lead the data analytics team
• Metrics alignment across teams to make them actionable and promote accountability
• Data based frameworks for assessing and strengthening Product Market Fit
• Identify viable growth strategies through data and experimentation
• Experimentation for product optimisation and understanding user behaviour
• Structured approach towards deriving user insights, answer questions using data
• This person needs to closely work with Technical and Business teams to get this implemented.

Skills

• 4 to 6 years at a relevant role in data analytics in a Product Oriented company
• Highly organised, technically sound & good at communication
• Ability to handle & build for cross functional data requirements / interactions with teams
• Great with Python, SQL
• Can build, mentor a team
• Knowledge of key business metrics like cohort, engagement cohort, LTV, ROAS, ROE

Eligibility

BTech or MTech in Computer Science/Engineering from a Tier1, Tier2 colleges

Good knowledge on Data Analytics, Data Visualization tools. A formal certification would be added advantage.

We are more interested in what you CAN DO than your location, education, or experience levels.

Send us your code samples / GitHub profile / published articles if applicable.

Responsibilities :

• Involve in planning, design, development and maintenance of large-scale data repositories, pipelines, analytical solutions and knowledge management strategy
• Build and maintain optimal data pipeline architecture to ensure scalability, connect operational systems data for analytics and business intelligence (BI) systems
• Build data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
• Reporting and obtaining insights from large data chunks on import/export and communicating relevant pointers for helping in decision-making
• Preparation, analysis, and presentation of reports to the management for further developmental activities
• Anticipate, identify and solve issues concerning data management to improve data quality

Requirements :

• Ability to build and maintain ETL pipelines 
• Technical Business Analysis experience and hands-on experience developing functional spec
• Good understanding of Data Engineering principles including data modeling methodologies
• Sound understanding of PostgreSQL
• Strong analytical and interpersonal skills as well as reporting capabilities

Who Are We

A research-oriented company with expertise in computer vision and artificial intelligence, at its core, Orbo is a comprehensive platform of AI-based visual enhancement stack. This way, companies can find a suitable product as per their need where deep learning powered technology can automatically improve their Imagery.

ORBO's solutions are helping BFSI, beauty and personal care digital transformation and Ecommerce image retouching industries in multiple ways.

WHY US

• Join top AI company
• Grow with your best companions
• Continuous pursuit of excellence, equality, respect
• Competitive compensation and benefits

You'll be a part of the core team and will be working directly with the founders in building and iterating upon the core products that make cameras intelligent and images more informative.

To learn more about how we work, please check out

https://www.orbo.ai/.

Description:

We are looking for a computer vision engineer to lead our team in developing a factory floor analytics SaaS product. This would be a fast-paced role and the person will get an opportunity to develop an industrial grade solution from concept to deployment.

Responsibilities:

• Research and develop computer vision solutions for industries (BFSI, Beauty and personal care, E-commerce, Defence etc.)
• Lead a team of ML engineers in developing an industrial AI product from scratch
• Setup end-end Deep Learning pipeline for data ingestion, preparation, model training, validation and deployment
• Tune the models to achieve high accuracy rates and minimum latency
• Deploying developed computer vision models on edge devices after optimization to meet customer requirements

Requirements:

• Bachelor’s degree
• Understanding about depth and breadth of computer vision and deep learning algorithms.
• Experience in taking an AI product from scratch to commercial deployment.
• Experience in Image enhancement, object detection, image segmentation, image classification algorithms
• Experience in deployment with OpenVINO, ONNXruntime and TensorRT
• Experience in deploying computer vision solutions on edge devices such as Intel Movidius and Nvidia Jetson
• Experience with any machine/deep learning frameworks like Tensorflow, and PyTorch.
• Proficient understanding of code versioning tools, such as Git

Our perfect candidate is someone that:

• is proactive and an independent problem solver
• is a constant learner. We are a fast growing start-up. We want you to grow with us!
• is a team player and good communicator

What We Offer:

• You will have fun working with a fast-paced team on a product that can impact the business model of E-commerce and BFSI industries. As the team is small, you will easily be able to see a direct impact of what you build on our customers (Trust us - it is extremely fulfilling!)
• You will be in charge of what you build and be an integral part of the product development process
• Technical and financial growth!

We are establishing infrastructure for internal and external reporting using Tableau and are looking for someone with experience building visualizations and dashboards in Tableau and using Tableau Server to deliver them to internal and external users. 

Required Experience 

• Implementation of interactive visualizations using Tableau Desktop  
• Integration with Tableau Server and support of production dashboards and embedded reports with it 

• Writing and optimization of SQL queries  
• Proficient in Python including the use of Pandas and numpy libraries to perform data exploration and analysis 
• 3  years of experience working as a Software Engineer / Senior Software Engineer 
• Bachelors in Engineering – can be Electronic and comm , Computer , IT  
• Well versed with Basic Data Structures Algorithms and system design 

• Should be capable of working well in a team – and should possess very good communication skills 
• Self-motivated and fun to work with and organized 
• Productive and efficient working remotely 
• Test driven mindset with a knack for finding issues and problems at earlier stages of development 
• Interest in learning and picking up a wide range of cutting edge technologies 

• Should be curious and interested in learning some Data science related concepts and domain knowledge 
• Work alongside other engineers on the team to elevate technology and consistently apply best practices 

Highly Desirable 

• Data Analytics 

• Experience in AWS cloud or any cloud technologies 
• Experience in BigData technologies and streaming like – pyspark, kafka is a big plus 
• Shell scripting  
• Preferred tech stack – Python, Rest API, Microservices, Flask/Fast API, pandas, numpy, linux, shell scripting, Airflow, pyspark 
• Has a strong backend experience – and worked with Microservices and Rest API’s - Flask, FastAPI, Databases Relational and Non-relational