Data Analyst

We are looking for an exceptionally talented Lead data engineer who has exposure in implementing AWS services to build data pipelines, api integration and designing data warehouse. Candidate with both hands-on and leadership capabilities will be ideal for this position.

Qualification: At least a bachelor’s degree in Science, Engineering, Applied Mathematics. Preferred Masters degree

Job Responsibilities:

• Total 6+ years of experience as a Data Engineer and 2+ years of experience in managing a team

• Have minimum 3 years of AWS Cloud experience.

• Well versed in languages such as Python, PySpark, SQL, NodeJS etc

• Has extensive experience in Spark ecosystem and has worked on both real time and batch processing

• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.

• Experience with modern Database systems such as Redshift, Presto, Hive etc.

• Worked on building data lakes in the past on S3 or Apache Hudi

• Solid understanding of Data Warehousing Concepts

• Good to have experience on tools such as Kafka or Kinesis

• Good to have AWS Developer Associate or Solutions Architect Associate Certification

• Have experience in managing a team

We are #hiring for AWS Data Engineer expert to join our team

Job Title: AWS Data Engineer

Experience: 5 Yrs to 10Yrs

Location: Remote

Notice: Immediate or Max 20 Days

Role: Permanent Role

Skillset: AWS, ETL, SQL, Python, Pyspark, Postgres DB, Dremio.

Job Description:

 Able to develop ETL jobs.

Able to help with data curation/cleanup, data transformation, and building ETL pipelines.

Strong Postgres DB exp and knowledge of Dremio data visualization/semantic layer between DB and the application is a plus.

Sql, Python, and Pyspark is a must.

Communication should be good

• A Data and MLOps Engineering lead that has a good understanding of modern Data engineering frameworks with a focus on Microsoft Azure and Azure Machine Learning and its development lifecycle and DevOps.
• Aims to solve the problems encountered when turning Data into meaningful solutions using transformations and data science code into production Machine Learning systems. Some of these challenges include:
  • ML orchestration - how can I automate my ML workflows across multiple environments
  • Scalability - how can I take advantage of the huge computational power available in the cloud?
  • Serving - how can I make my ML models available to make predictions reliably when needed?
  • Monitoring - how can I effectively monitor my ML system in production to ensure reliability? Not just system metrics, but also get insight into how my models are performing over time
  • Reuse – how can I profess reuse of artefacts built and establish templates and patterns?

The MLOps team works closely with ML Engineering and DevOps teams. Rather than focus just on individual use cases, the focus would be to specialise in building the platforms and tools that can help adoption of MLOps across the organisation and develop best practices and ways of working to develop a state of the art MLOps capability.

A good understanding of AI/Machine Learning and software engineering best practices such as Cloud Engineering, Infrastructure-as-Code, and CI/CD.

Have excellent communication and consulting skills, while delivering innovative AI solutions on Azure.

Responsibilities will include:

• Building state-of-the-art MLOps platforms and tooling to help adoption of MLOps across organization
• Designing cloud ML architectures and provide a roadmap for flexible patterns
• Optimizing solutions for performance and scalability
• Leading and driving the evolving best practices for MLOps
• Helping to showcase expertise and leadership in this field

Tech stack

These are some of the tools and technologies that we use day to day. Key to success will be attitude and aptitude with a vision to build the next big thing in AI/ML field.

• Python - including poetry for dependency management, pytest for automated testing and fastapi for building APIs
• Microsoft Azure Platform - primarily focused on Databricks, Azure ML
• Containers
• CI/CD – Azure DevOps
• Strong programming skills in Python
• Solid understanding of cloud concepts
• Demonstrable interest in Machine Learning
• Understanding of IaC and CI/CD concepts
• Strong communication and presentation skills.

Remuneration: Best in the industry

Connect: https://www.linkedin.com/in/shweta-gupta-a361511

This profile will include the following responsibilities:

- Develop Parsers for XML and JSON Data sources/feeds

- Write Automation Scripts for product development

- Build API Integrations for 3^rd Party product integration

- Perform Data Analysis

- Research on Machine learning algorithms

- Understand AWS cloud architecture and work with 3 party vendors for deployments

We are Still Hiring!!!

Dear Candidate,

This email is regarding open positions for Data Engineer Professionals with our organisation CRMNext.

In case, you find the company profile and JD matching your aspirations and your profile matches the required Skill and qualifications criteria, please share your updated resume with response to questions.

We shall reach you back for scheduling the interviews post this.

About Company:

Driven by a Passion for Excellence

Acidaes Solutions Pvt. Ltd. is a fast growing specialist Customer Relationship Management (CRM) product IT company providing ultra-scalable CRM solutions. It offers CRMNEXT, our flagship and award winning CRM platform to leading enterprises both on cloud as well as on-premise models. We consistently focus on using the state of art technology solutions to provide leading product capabilities to our customers.

CRMNEXT is a global cloud CRM solution provider credited with the world's largest installation ever. From Fortune 500 to start-ups, businesses across nine verticals have built profitable customer relationships via CRMNEXT. A pioneer of Digital CRM for some of the largest enterprises across Asia-Pacific, CRMNEXT's customers include global brands like Pfizer, HDFC Bank, ICICI Bank, Axis Bank, Tata AIA, Reliance, National Bank of Oman, Pavers England etc. It was recently lauded in the Gartner Magic Quadrant 2015 for Lead management, Sales Force Automation and Customer Engagement. For more information, visit us at www.crmnext.com

Educational Qualification:

B.E./B.Tech /M.E./ M.Tech/ MCA with (Bsc.IT/Bsc. Comp/BCA is mandatory)

60% in Xth, XIIth /diploma, B.E./B.Tech/M.E/M.Tech/ MCA with (Bsc.IT/Bsc. Comp/BCA is mandatory)

All education should be regular (Please Note - Degrees through Distance learning/correspondence will not consider)

Exp level- 2 to 5 yrs

Location-Andheri (Mumbai)

Technical expertise required:

1)Analytics experience in the BFSI domain is must

2) Hands on technical experience in python, big data and AI

3) Understanding of datamodels and analytical concepts

4) Client engagement :

Should have run in past client engagements for Big data/ AI projects starting from requirement gathering, to planning development sprints, and delivery

Should have experience in deploying big data and AI projects

First hand experience on data governance, data quality, customer data models, industry data models

Aware of SDLC.

Regards,
Deepak Sharma
HR Team