Data Engineer

• 6+ years of data science experience.

• Demonstrated experience in leading programs.

• Prior experience in customer data platforms/finance domain is a plus.

• Demonstrated ability in developing and deploying data-driven products.

• Experience of working with large datasets and developing scalable algorithms.

• Hands-on experience of working with tech, product, and operation teams.

Technical Skills:

• Deep understanding and hands-on experience of Machine learning and Deep

learning algorithms. Good understanding of NLP and LLM concepts and fair

experience in developing NLU and NLG solutions.

• Experience with Keras/TensorFlow/PyTorch deep learning frameworks.

• Proficient in scripting languages (Python/Shell), SQL.

• Good knowledge of Statistics.

• Experience with big data, cloud, and MLOps.

Soft Skills:

• Strong analytical and problem-solving skills.

• Excellent presentation and communication skills.

• Ability to work independently and deal with ambiguity.

Continuous Learning:

• Stay up to date with emerging technologies.

Qualification.

A degree in Computer Science, Statistics, Applied Mathematics, Machine Learning, or any related field / B. Tech.

Role & Responsibilities:

• Ability to architect Azure cloud-based application modernization, Azure infrastructure setup, configuration and management
• Ability to create / recreate / rewrite or refactor applications based for cloud resource optimization.
• Make use of Azure Integration Services: Logic Apps, Service Bus, API Management and Event Grid.
• Assure that data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements.
• Solution design using Microsoft Azure services and tools including Data Factory, Data Lake, Synapse etc.
• Extracting data, troubleshooting and maintaining the data warehouse.
• Experience of SQL and Dataverse databases is mandatory.
• The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.).
• Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications.
• Build data pipelines to collectively bring together data.
• Utilize Microsoft Azure PaaS and SaaS solution development technologies including Azure Functions, Azure Notifications Hub, Azure App Service and Key Vault
• Setup Fresh / Modify existing CI/CD pipelines development (YAML or Classic).
• Hands-on experience with automation tools, cloud computing platforms, and scripting languages
• Ability to learn and implement automation tools and technologies, such as Azure DevOps, Docker, and Terraform on the Azure platform.
• Knowledge of containerization and container orchestration, such as Kubernetes
• Experience with Azure monitoring and error logging tools, debugging skills, problem solving ability.

Data Scientist – Program Embedded 

Job Description:   

We are seeking a highly skilled and motivated senior data scientist to support a big data program. The successful candidate will play a pivotal role in supporting multiple projects in this program covering traditional tasks from revenue management, demand forecasting, improving customer experience to testing/using new tools/platforms such as Copilot Fabric for different purpose. The expected candidate would have deep expertise in machine learning methodology and applications. And he/she should have completed multiple large scale data science projects (full cycle from ideation to BAU). Beyond technical expertise, problem solving in complex set-up will be key to the success for this role. This is a data science role directly embedded into the program/projects, stake holder management and collaborations with patterner are crucial to the success on this role (on top of the deep expertise). 

What we are looking for: 

1. Highly efficient in Python/Pyspark/R. 
2. Understand MLOps concepts, working experience in product industrialization (from Data Science point of view). Experience in building product for live deployment, and continuous development and continuous integration. 
3. Familiar with cloud platforms such as Azure, GCP, and the data management systems on such platform. Familiar with Databricks and product deployment on Databricks. 
4. Experience in ML projects involving techniques: Regression, Time Series, Clustering, Classification, Dimension Reduction, Anomaly detection with traditional ML approaches and DL approaches. 
5. Solid background in statistics, probability distributions, A/B testing validation, univariate/multivariate analysis, hypothesis test for different purpose, data augmentation etc. 
6. Familiar with designing testing framework for different modelling practice/projects based on business needs. 
7. Exposure to Gen AI tools and enthusiastic about experimenting and have new ideas on what can be done. 
8. If they have improved an internal company process using an AI tool, that would be great (e.g. process simplification, manual task automation, auto emails) 
9. Ideally, 10+ years of experience, and have been on independent business facing roles. 
10. CPG or retail as a data scientist would be nice, but not number one priority, especially for those who have navigated through multiple industries. 
11. Being proactive and collaborative would be essential. 

Some projects examples within the program: 

1. Test new tools/platforms such as Copilo, Fabric for commercial reporting. Testing, validation and build trust. 
2. Building algorithms for predicting trend in category, consumptions to support dashboards. 
3. Revenue Growth Management, create/understand the algorithms behind the tools (can be built by 3rd parties) we need to maintain or choose to improve. Able to prioritize and build product roadmap. Able to design new solutions and articulate/quantify the limitation of the solutions. 
4. Demand forecasting, create localized forecasts to improve in store availability. Proper model monitoring for early detection of potential issues in the forecast focusing particularly on improving the end user experience. 

Job Title: SQL Query Writer - Analytics Automation

Location: Thane (West), Mumbai

Experience: 4-5 years

Responsibilities:

• Develop and optimize SQL queries for efficient data retrieval and analysis.
• Automate analytics processes using platforms like SQL, Python, ACL, Alteryx, Analyzer, Excel Macros, and Access Query.
• Collaborate with cross-functional teams to understand analytical requirements and provide effective solutions.
• Ensure data accuracy, integrity, and security in automated processes.
• Troubleshoot and resolve issues related to analytics automation.

Qualifications:

• Minimum 3 years of experience in SQL query writing and analytics automation.
• Proficiency in SQL, Python, ACL, Alteryx, Analyzer, Excel Macros, and Access Query.
• Strong analytical skills and attention to detail.

Deep-Rooted.Co is on a mission to get Fresh, Clean, Community (Local farmer) produce from harvest to reach your home with a promise of quality first! Our values are rooted in trust, convenience, and dependability, with a bunch of learning & fun thrown in.

Founded out of Bangalore by Arvind, Avinash, Guru and Santosh, with the support of our Investors Accel, Omnivore & Mayfield, we raised $7.5 million in Seed, Series A and Debt funding till date from investors include ACCEL, Omnivore, Mayfield among others. Our brand Deep-Rooted.Co which was launched in August 2020 was the first of its kind as India’s Fruits & Vegetables (F&V) which is present in Bangalore & Hyderabad and on a journey of expansion to newer cities which will be managed seamlessly through Tech platform that has been designed and built to transform the Agri-Tech sector.

Deep-Rooted.Co is committed to building a diverse and inclusive workplace and is an equal-opportunity employer.  

How is this possible? It’s because we work with smart people. We are looking for Engineers in Bangalore to work with thehttps://www.linkedin.com/in/gururajsrao/"> Product Leader (Founder) andhttps://www.linkedin.com/in/sriki77/"> CTO and this is a meaningful project for us and we are sure you will love the project as it touches everyday life and is fun. This will be a virtual consultation.

We want to start the conversation about the project we have for you, but before that, we want to connect with you to know what’s on your mind. Do drop a note sharing your mobile number and letting us know when we can catch up.

Purpose of the role:

* As a startup we have data distributed all across various sources like Excel, Google Sheets, Databases etc. We need swift decision making based a on a lot of data that exists as we grow. You help us bring together all this data and put it in a data model that can be used in business decision making.
* Handle nuances of Excel and Google Sheets API.
* Pull data in and manage it growth, freshness and correctness.
* Transform data in a format that aids easy decision-making for Product, Marketing and Business Heads.
* Understand the business problem, solve the same using the technology and take it to production - no hand offs - full path to production is yours.

Technical expertise:

* Good Knowledge And Experience with Programming languages - Java, SQL,Python.
* Good Knowledge of Data Warehousing, Data Architecture.
* Experience with Data Transformations and ETL; 
* Experience with API tools and more closed systems like Excel, Google Sheets etc.
* Experience AWS Cloud Platform and Lambda
* Experience with distributed data processing tools.
* Experiences with container-based deployments on cloud.

 Skills:

Java, SQL, Python, Data Build Tool, Lambda, HTTP, Rest API, Extract Transform Load.

Job Description

We are looking for an experienced engineer with superb technical skills. Primarily be responsible for architecting and building large scale data pipelines that delivers AI and Analytical solutions to our customers. The right candidate will enthusiastically take ownership in developing and managing a continuously improving, robust, scalable software solutions.

Although your primary responsibilities will be around back-end work, we prize individuals who are willing to step in and contribute to other areas including automation, tooling, and management applications. Experience with or desire to learn Machine Learning a plus.

Skills

• Bachelors/Masters/Phd in CS or equivalent industry experience
• Demonstrated expertise of building and shipping cloud native applications
• 5+ years of industry experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka Streams, Py Spark, and streaming databases like druid or equivalent like Hive
• Strong industry expertise with containerization technologies including kubernetes (EKS/AKS), Kubeflow
• Experience with cloud platform services such as AWS, Azure or GCP especially with EKS, Managed Kafka
• 5+ Industry experience in python
• Experience with popular modern web frameworks such as Spring boot, Play framework, or Django
• Experience with scripting languages. Python experience highly desirable. Experience in API development using Swagger
• Implementing automated testing platforms and unit tests
• Proficient understanding of code versioning tools, such as Git
• Familiarity with continuous integration, Jenkins

Responsibilities

• Architect, Design and Implement Large scale data processing pipelines using Kafka Streams, PySpark, Fluentd and Druid
• Create custom Operators for Kubernetes, Kubeflow
• Develop data ingestion processes and ETLs
• Assist in dev ops operations
• Design and Implement APIs
• Identify performance bottlenecks and bugs, and devise solutions to these problems
• Help maintain code quality, organization, and documentation
• Communicate with stakeholders regarding various aspects of solution.
• Mentor team members on best practices

Role Summary

We Are looking for an analytically inclined, Insights Driven Product Analyst to make our organisation more data driven. In this role you will be responsible for creating dashboards to drive insights for product and business teams. Be it Day to Day decisions as well as long term impact assessment, Measuring the Efficacy of different products or certain teams, You'll be Empowering each of them. The growing nature of the team will require you to be in touch with all of the teams at upgrad. Are you the "Go-To" person everyone looks at for getting Data, Then this role is for you.

Roles & Responsibilities

• Lead and own the analysis of highly complex data sources, identifying trends and patterns in data and provide insights/recommendations based on analysis results
• Build, maintain, own and communicate detailed reports to assist Marketing, Growth/Learning Experience and Other Business/Executive Teams
• Own the design, development, and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions.
• Analyze data and generate insights in the form of user analysis, user segmentation, performance reports, etc.
• Facilitate review sessions with management, business users and other team members
• Design and create visualizations to present actionable insights related to data sets and business questions at hand
• Develop intelligent models around channel performance, user profiling, and personalization

Skills Required

• Having 4-6 yrs hands-on experience with Product related analytics and reporting
• Experience with building dashboards in Tableau or other data visualization tools such as D3
• Strong data, statistics, and analytical skills with a good grasp of SQL.
• Programming experience in Python is must
• Comfortable managing large data sets
• Good Excel/data management skills

• 1-5 years of experience in building and maintaining robust data pipelines, enriching data, low-latency/highly-performance data analytics applications.
• Experience handling complex, high volume, multi-dimensional data and architecting data products in streaming, serverless, and microservices-based Architecture and platform.
• Experience in Data warehousing, Data modeling, and Data architecture.
• Expert level proficiency with the relational and NoSQL databases.
• Expert level proficiency in Python, and PySpark.
• Familiarity with Big Data technologies and utilities (Spark, Hive, Kafka, Airflow).
• Familiarity with cloud services (preferable AWS)
• Familiarity with MLOps processes such as data labeling, model deployment, data-model feedback loop, data drift.

Key Roles/Responsibilities:

• Act as a technical leader for resolving problems, with both technical and non-technical audiences.
• Identifying and solving issues with data pipelines regarding consistency, integrity, and completeness.
• Lead data initiatives, architecture design discussions, and implementation of next-generation BI solutions.
• Partner with data scientists, tech architects to build advanced, scalable, efficient self-service BI infrastructure.
• Provide thought leadership and mentor data engineers in information presentation and delivery.

• Desire to explore new technology and break new ground.
• Are passionate about Open Source technology, continuous learning, and innovation.
• Have the problem-solving skills, grit, and commitment to complete challenging work assignments and meet deadlines.

Qualifications

• Engineer enterprise-class, large-scale deployments, and deliver Cloud-based Serverless solutions to our customers.
• You will work in a fast-paced environment with leading microservice and cloud technologies, and continue to develop your all-around technical skills.
• Participate in code reviews and provide meaningful feedback to other team members.
• Create technical documentation.
• Develop thorough Unit Tests to ensure code quality.

Skills and Experience

• Advanced skills in troubleshooting and tuning AWS Lambda functions developed with Java and/or Python.
• Experience with event-driven architecture design patterns and practices
• Experience in database design and architecture principles and strong SQL abilities
• Message brokers like Kafka and Kinesis
• Experience with Hadoop, Hive, and Spark (either PySpark or Scala)
• Demonstrated experience owning enterprise-class applications and delivering highly available distributed, fault-tolerant, globally accessible services at scale.
• Good understanding of distributed systems.
• Candidates will be self-motivated and display initiative, ownership, and flexibility.

Preferred Qualifications

• AWS Lambda function development experience with Java and/or Python.
• Lambda triggers such as SNS, SES, or cron.
• Databricks
• Cloud development experience with AWS services, including:
• IAM
• S3
• EC2
• AWS CLI
• API Gateway
• ECR
• CloudWatch
• Glue
• Kinesis
• DynamoDB
• Java 8 or higher
• ETL data pipeline building
• Data Lake Experience
• Python
• Docker
• MongoDB or similar NoSQL DB.
• Relational Databases (e.g., MySQL, PostgreSQL, Oracle, etc.).
• Gradle and/or Maven.
• JUnit
• Git
• Scrum
• Experience with Unix and/or macOS.
• Immediate Joiners

Nice to have:

• AWS / GCP / Azure Certification.
• Cloud development experience with Google Cloud or Azure