Cymetrix Software

Remote working 

Must have skills:

1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java

2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges

3. Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP

4. Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At Least 2 databases)

5. Data Warehouse concepts - Beginner to Intermediate level

Role & Responsibilities:

● Work with business users and other stakeholders to understand business processes.

● Ability to design and implement Dimensional and Fact tables

● Identify and implement data transformation/cleansing requirements

● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data

from various systems to the Enterprise Data Warehouse

● Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical

data definitions

● Design, develop and maintain ETL workflows and mappings using the appropriate data load technique

● Provide research, high-level design, and estimates for data transformation and data integration from source

applications to end-user BI solutions.

● Provide production support of ETL processes to ensure timely completion and availability of data in the data

warehouse for reporting use.

● Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate,

design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and

data quality.

● Work collaboratively with key stakeholders to translate business information needs into well-defined data

requirements to implement the BI solutions.

● Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into

reporting & analytics.

● Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.

● Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers,

quality issues, and continuously validate reports, dashboards and suggest improvements.

● Train business end-users, IT analysts, and developers.

WS data engineer role; hence candidates should have a minimum 3yr in AWS and in Redshift, lambda, glue, S3, EMR, Athena.

Programming skills :Python, Pyspark, Scala, ETL pipeline exp ( 2+ years in Python and Pyspark)

  Design and develop data lakes, manage data flows that integrate information from various

sources into a common data lake platform through an ETL Tool

 Code and manage delta lake implementations on S3 using technologies like Databricks or

Apache Hoodie

 Triage, debug and fix technical issues related to Data Lakes

 Design and Develop Data warehouses for Scale

Must have skills:

1. Cognos to Tableau Migration

2. Create Tableau Reports

3. Dashboard CreationQuery Optimization

4. any BI to Tableau Migration

Must Have: BiTesting, Report Testing, SQL Script Writing, Automation Testing

Good to have: ETL Testing

Experience in onshore/remote model with strong QA methodology and good communication.

Proven knowledge and adherence to Quality Assurance best practices.

Experience in Power BI and any reporting tools

Experience in Automation (design and developing scripts) along with strong Testing skills

Proven understanding of database testing with excellent SQL skills

Positive attitude and team player

High level of integrity and strict adherence to protecting confidential information

Have a minimum of 4+ years of experience in Quality Assurance and SDLC

Responsibilities

Design and execute test plans, Validate data models, Collaborate with data engineers to resolve issues, Create a robust reporting testing structure, and Create automated frameworks against visualization and data virtualization layers.

Skills 

• Strong SQL skills for querying databases
• Knowledge of database design and management principles
• Proficiency in BI tools such as Microsoft Power BI, Tableau, or QlikSense
• Good written and verbal communication skills
• Collaboration skills

Location - HYBRID - 3 days from office , 2 days WFH

Experience – 3 – 8  years

Key Skills - Azure , Azure Databricks , Azure Synapse Analytics, Azure SQL Datawarehouse, and Azure Data Lake Storage , SQL , ETL, Microsoft Azure SQL Data Warehouse

Lead Time - Immediate Joiners

Roles & RESPONSIBILITIES 

As an Azure Data Engineer, you will be responsible for designing, building, and maintaining data pipelines to support business and analytics needs. You will work closely with data analysts and business stakeholders to understand their needs and develop solutions to meet those needs.

• 6+ Years of Experience in Azure with Data Engineering.
• 4+ Hands on experience in Azure technologies such as Azure Data Factory, Azure Databricks and Azure Synapse Analytics, Azure Data Lake
• Design, develop, manage data flows that integrate information from various sources into a common data lake using Microsoft Azure data Factory.
• Extract, transform and load data from a variety of sources, including on-premises databases, cloud-based data stores and API calls.
• 6+ years of working with SQL, implementing data processing and transformation logic using SQL, handling complex windowing functions and joins.
• Optimize and tune data pipelines for performance, scalability, and cost-efficiency, leveraging best practices and automation tools.
• Ensure data quality, integrity, and security throughout the data lifecycle, implementing data governance policies and compliance standards.
•  Collaborate with data analysts and business stakeholders to understand their data needs and develop data models and solutions to meet those needs.

Monitor and troubleshoot data pipelines, identifying and resolving issues in a timely manner to minimize impact on business operations.