Data Engineer

• A Data and MLOps Engineering lead that has a good understanding of modern Data engineering frameworks with a focus on Microsoft Azure and Azure Machine Learning and its development lifecycle and DevOps.
• Aims to solve the problems encountered when turning Data into meaningful solutions using transformations and data science code into production Machine Learning systems. Some of these challenges include:
  • ML orchestration - how can I automate my ML workflows across multiple environments
  • Scalability - how can I take advantage of the huge computational power available in the cloud?
  • Serving - how can I make my ML models available to make predictions reliably when needed?
  • Monitoring - how can I effectively monitor my ML system in production to ensure reliability? Not just system metrics, but also get insight into how my models are performing over time
  • Reuse – how can I profess reuse of artefacts built and establish templates and patterns?

The MLOps team works closely with ML Engineering and DevOps teams. Rather than focus just on individual use cases, the focus would be to specialise in building the platforms and tools that can help adoption of MLOps across the organisation and develop best practices and ways of working to develop a state of the art MLOps capability.

A good understanding of AI/Machine Learning and software engineering best practices such as Cloud Engineering, Infrastructure-as-Code, and CI/CD.

Have excellent communication and consulting skills, while delivering innovative AI solutions on Azure.

Responsibilities will include:

• Building state-of-the-art MLOps platforms and tooling to help adoption of MLOps across organization
• Designing cloud ML architectures and provide a roadmap for flexible patterns
• Optimizing solutions for performance and scalability
• Leading and driving the evolving best practices for MLOps
• Helping to showcase expertise and leadership in this field

Tech stack

These are some of the tools and technologies that we use day to day. Key to success will be attitude and aptitude with a vision to build the next big thing in AI/ML field.

• Python - including poetry for dependency management, pytest for automated testing and fastapi for building APIs
• Microsoft Azure Platform - primarily focused on Databricks, Azure ML
• Containers
• CI/CD – Azure DevOps
• Strong programming skills in Python
• Solid understanding of cloud concepts
• Demonstrable interest in Machine Learning
• Understanding of IaC and CI/CD concepts
• Strong communication and presentation skills.

Remuneration: Best in the industry

Connect: https://www.linkedin.com/in/shweta-gupta-a361511

From building entire infrastructures or platforms to solving complex IT challenges, Cambridge Technology helps businesses accelerate their digital transformation and become AI-first businesses. With over 20 years of expertise as a technology services company, we enable our customers to stay ahead of the curve by helping them figure out the perfect approach, solutions, and ecosystem for their business. Our experts help customers leverage the right AI, big data, cloud solutions, and intelligent platforms that will help them become and stay relevant in a rapidly changing world.

No Of Positions: 1

Skills required: 

• The ideal candidate will have a bachelor’s degree in data science, statistics, or a related discipline with 4-6 years of experience, or a master’s degree with 4-6 years of experience. A strong candidate will also possess many of the following characteristics:
• Strong problem-solving skills with an emphasis on achieving proof-of-concept
• Knowledge of statistical techniques and concepts (regression, statistical tests, etc.)
• Knowledge of machine learning and deep learning fundamentals
• Experience with Python implementations to build ML and deep learning algorithms (e.g., pandas, numpy, sci-kit-learn, Stats Models, Keras, PyTorch, etc.)
• Experience writing and debugging code in an IDE
• Experience using managed web services (e.g., AWS, GCP, etc.)
• Strong analytical and communication skills
• Curiosity, flexibility, creativity, and a strong tolerance for ambiguity
• Ability to learn new tools from documentation and internet resources.

Roles and responsibilities :

• You will work on a small, core team alongside other engineers and business leaders throughout Cambridge with the following responsibilities:
• Collaborate with client-facing teams to design and build operational AI solutions for client engagements.
• Identify relevant data sources for data wrangling and EDA
• Identify model architectures to use for client business needs.
• Build full-stack data science solutions up to MVP that can be deployed into existing client business processes or scaled up based on clear documentation.
• Present findings to teammates and key stakeholders in a clear and repeatable manner.

Experience :

2 - 14 Yrs

Required Experience

· 3+ years of relevant technical experience as a data analyst role

· Intermediate / expert skills with SQL and basic statistics

· Experience in Advance SQL

· Python programming- Added advantage

· Strong problem solving and structuring skills

· Automation in connecting various sources to the data and representing it through various dashboards

· Excellent with Numbers and communicate data points through various reports/templates

· Ability to communicate effectively internally and outside Data Analytics team

· Proactively take up work responsibilities and take adhocs as and when needed

· Ability and desire to take ownership of and initiative for analysis; from requirements clarification to deliverable

· Strong technical communication skills; both written and verbal

· Ability to understand and articulate the "big picture" and simplify complex ideas

· Ability to identify and learn applicable new techniques independently as needed

· Must have worked with various Databases (Relational and Non-Relational) and ETL processes

· Must have experience in handling large volume and data and adhere to optimization and performance standards

· Should have the ability to analyse and provide relationship views of the data from different angles

· Must have excellent Communication skills (written and oral).

· Knowing Data Science is an added advantage

Required Skills

MYSQL, Advanced Excel, Tableau, Reporting and dashboards, MS office, VBA, Analytical skills

Preferred Experience

· Strong understanding of relational database MY SQL etc.

· Prior experience working remotely full-time

· Prior Experience working in Advance SQL

· Experience with one or more BI tools, such as Superset, Tableau etc.

· High level of logical and mathematical ability in Problem Solving

Introduction

http://www.synapsica.com/">Synapsica is a https://yourstory.com/2021/06/funding-alert-synapsica-healthcare-ivycap-ventures-endiya-partners/">series-A funded HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don't have to rely on cryptic 2 liners given to them as a diagnosis. 

Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyse medical images and create v2.0 of advanced radiology reporting.  We are backed by IvyCap, Endia Partners, YCombinator and other investors from India, US, and Japan. We are proud to have GE and The Spinal Kinetics as our partners. Here’s a small sample of what we’re building: https://www.youtube.com/watch?v=FR6a94Tqqls">https://www.youtube.com/watch?v=FR6a94Tqqls 

Your Roles and Responsibilities

We are looking for an experienced MLOps Engineer to join our engineering team and help us create dynamic software applications for our clients. In this role, you will be a key member of a team in decision making, implementations, development and advancement of ML operations of the core AI platform.

• Work closely with a cross functional team to serve business goals and objectives.
• Develop, Implement and Manage MLOps in cloud infrastructure for data preparation,deployment, monitoring and retraining models
• Design and build application containerisation and orchestrate with Docker and Kubernetes in AWS platform. 
• Build and maintain code, tools, packages in cloud

• At Least 2+ years of experience in Data engineering 
• At Least 3+ yr experience in Python with familiarity in popular ML libraries.
• At Least 2+ years experience in model serving and pipelines
• Working knowledge of containers like kubernetes , dockers, in AWS
• Design distributed systems deployment at scale
• Hands-on experience in coding and scripting
• Ability to write effective scalable and modular code.
• Familiarity with Git workflows, CI CD and NoSQL Mongodb
• Familiarity with Airflow, DVC and MLflow is a plus

The Data Engineer would be responsible for selecting and integrating Big Data tools and frameworks required. Would implement Data Ingestion & ETL/ELT processes

Required Experience, Skills and Qualifications:

• Hands on experience on Big Data tools/technologies like Spark,  Databricks, Map Reduce, Hive, HDFS.
• Expertise and excellent understanding of big data toolset such as Sqoop, Spark-streaming, Kafka, NiFi
• Proficiency in any of the programming language: Python/ Scala/  Java with 4+ years’ experience
• Experience in Cloud infrastructures like MS Azure, Data lake etc
• Good working knowledge in NoSQL DB (Mongo, HBase, Casandra)

High Level Scope of Work :

• Work with AI / Analytics team to priorities MACHINE LEARNING Identified USE CASES for Development and Rollout
• Meet and understand current retail / Marketing Requirements and how AI/ML solution will address and automate the decision process.
• Develop AI/ML Programs using DATAIKU Solution & Python or open source tech with focus to deliver high Quality and accurate ML prediction Model
• Gather additional and external data sources to support the AI/ML Model as desired .
• Support the ML Model and FINE TUNEit to ensure high accuracy all the time.
• Example of use cases (Customer Segmentation , Product Recommendation, Price Optimization, Retail Customer Personalization Offers, Next Best Location for Business Est, CCTV Computer Vision, NLP and Voice Recognition Solutions)

Required technology expertise :

• Deep Knowledge & Understanding on MACHINE LEARNING ALGORITHMS (Supervised / Unsupervised Learning / Deep Learning Models)
• Hands on EXP for at least 5+ years with PYTHON and R STATISTICS PROGRAMMING Languages
• Strong Database Development knowledge using SQL and PL/SQL
• Must have EXP using Commercial Data Science Solution particularly DATAIKU and (Altryx, SAS, Azure ML, Google ML, Oracle ML is a plus)
• Strong hands on EXP with BIG DATA Solution Architecture and Optimization for AI/ML Workload.
• Data Analytics and BI Tools Hand on EXP particularly (Oracle OBIEE and Power BI)
• Have implemented and Developed at least 3 successful AI/ML Projects with tangible Business Outcomes In retail Focused Industry
• Have at least 5+ Years EXP in Retail Industry and Customer Focus Business.
• Ability to communicate with Business Owner & stakeholders to understand their current issues and provide MACHINE LEARNING Solution accordingly.

Qualifications

• Bachelor Degree or Master Degree in Data Science, Artificial Intelligent, Computer Science
• Certified as DATA SCIENTIST or MACHINE LEARNING Expert.

Responsibilities

• Installing and configuring Informatica components, including high availability; managing server activations and de-activations for all environments; ensuring that all systems and procedures adhere to organizational best practices
• Day to day administration of the Informatica Suite of services (PowerCenter, IDS, Metadata, Glossary and Analyst).
• Informatica capacity planning and on-going monitoring (e.g. CPU, Memory, etc.) to proactively increase capacity as needed.
• Manage backup and security of Data Integration Infrastructure.
• Design, develop, and maintain all data warehouse, data marts, and ETL functions for the organization as a part of an infrastructure team.
• Consult with users, management, vendors, and technicians to assess computing needs and system requirements.
• Develop and interpret organizational goals, policies, and procedures.
• Evaluate the organization's technology use and needs and recommend improvements, such as software upgrades.
• Prepare and review operational reports or project progress reports.
• Assist in the daily operations of the Architecture Team , analyzing workflow, establishing priorities, developing standards, and setting deadlines.
• Work with vendors to manage support SLA’s and influence vendor product roadmap
• Provide leadership and guidance in technical meetings, define standards and assist/provide status updates
• Work with cross functional operations teams such as systems, storage and network to design technology stacks.

Preferred Qualifications

• Minimum 6+ years’ experience as Informatica Engineer and Developer role
• Minimum of 5+ years’ experience in an ETL environment as a developer.
• Minimum of 5+ years of experience in SQL coding and understanding of databases
• Proficiency in Python
• Proficiency in command line troubleshooting
• Proficiency in writing code in Perl/Shell scripting languages
• Understanding of Java and concepts of Object-oriented programming
• Good understanding of systems, networking, and storage
• Strong knowledge of scalability and high availability