2+ Datawarehousing Jobs in Ahmedabad | Datawarehousing Job openings in Ahmedabad

Job Description: Data Engineer

Location: Ahmedabad

Experience: 7+ years

Employment Type: Full-Time

We are looking for a highly motivated and experienced Data Engineer to join our  team. As a Data Engineer, you will play a critical role in designing, building, and optimizing data pipelines that ensure the availability, reliability, and performance of our data infrastructure. You will collaborate closely with data scientists, analysts, and cross-functional teams to provide timely and efficient data solutions.

Responsibilities

● Design and optimize data pipelines for various data sources

● Design and implement efficient data storage and retrieval mechanisms

● Develop data modelling solutions and data validation mechanisms

● Troubleshoot data-related issues and recommend process improvements

● Collaborate with data scientists and stakeholders to provide data-driven insights and solutions

● Coach and mentor junior data engineers in the team

Skills Required: 

● Minimum 5 years of experience in data engineering or related field

● Proficient in designing and optimizing data pipelines and data modeling

● Strong programming expertise in Python

● Hands-on experience with big data technologies such as Hadoop, Spark, and Hive

● Extensive experience with cloud data services such as AWS, Azure, and GCP

● Advanced knowledge of database technologies like SQL, NoSQL, and data warehousing

● Knowledge of distributed computing and storage systems

● Familiarity with DevOps practices and power automate and Microsoft Fabric will be an added advantage

● Strong analytical and problem-solving skills with outstanding communication and collaboration abilities

Qualifications

● Bachelor's degree in Computer Science, Data Science, or a Computer related field

Data Analytics Lead

Responsibilities:

·        Oversee the design, development, and implementation of data analysis solutions to meet business needs.

·        Work closely with business stakeholders and the Aviation SME to define data requirements, project scope, and deliverables.

·        Drive the design and development of analytics data models and data warehouse designs.

·        Develop and maintain data quality standards and procedures.

·        Manage and prioritize data analysis projects, ensuring timely completion.

·        Identify opportunities to improve data analysis processes and tools.

·        Collaborate with Data Engineers and Data Architects to ensure data solutions align with the overall data platform architecture.

·        Evaluate and recommend new data analysis tools and technologies.

·        Contribute to the development of best practices for data analysis.

·        Participate in project meetings and provide input on data-related issues, risks and requirements.

Qualifications

·        8+ years of experience as a Data Analytics Lead, with experience leading or mentoring a team.

·        Extensive experience with cloud-based data modelling and data warehousing solutions, using Azure Data Bricks.

·        Proven experience in data technologies and platforms, ETL processes and tools, preferably using Azure Data Factory, Azure Databricks (Spark), Delta Lake.

·        Advanced proficiency in data visualization tools such as Power BI.

Data Analysis and Visualization:

• Experience in data analysis, statistical modelling, and machine learning techniques.
• Proficiency in analytical tools like Python, R, and libraries such as Pandas, NumPy for data analysis and modelling.
• Strong expertise in Power BI, Superset, Tablue for data visualization, data modelling, and DAX queries, with knowledge of best practices.
• Experience in implementing Row-Level Security in Power BI.
• Ability to work with medium-complex data models and quickly understand application data design and processes.
• Familiar with industry best practices for Power BI and experienced in performance optimization of existing implementations.
• Understanding of machine learning algorithms, including supervised, unsupervised, and deep learning techniques.

Data Handling and Processing:

• Proficient in SQL Server and query optimization.
• Expertise in application data design and process management.
• Extensive knowledge of data modelling.
• Hands-on experience with Azure Data Factory,Azure Databricks.
• Expertise in data warehouse development, including experience with SSIS (SQL Server Integration Services) and SSAS (SQL Server Analysis Services).
• Proficiency in ETL processes (data extraction, transformation, and loading), including data cleaning and normalization.
• Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) for large-scale data processing.

Understanding of data governance, compliance, and security measures within Azure environments.