10+ ADF Jobs in Bangalore (Bengaluru) | ADF Job openings in Bangalore (Bengaluru)

Data Engineer

Brief Posting Description:

This person will work independently or with a team of data engineers on cloud technology products, projects, and initiatives. Work with all customers, both internal and external, to make sure all data related features are implemented in each solution. Will collaborate with business partners and other technical teams across the organization as required to deliver proposed solutions.

Detailed Description:

·        Works with Scrum masters, product owners, and others to identify new features for digital products.

·        Works with IT leadership and business partners to design features for the cloud data platform.

·        Troubleshoots production issues of all levels and severities, and tracks progress from identification through resolution.

·        Maintains culture of open communication, collaboration, mutual respect and productive behaviors; participates in the hiring, training, and retention of top tier talent and mentors team members to new and fulfilling career experiences.

·        Identifies risks, barriers, efficiencies and opportunities when thinking through development approach; presents possible platform-wide architectural solutions based on facts, data, and best practices.

·        Explores all technical options when considering solution, including homegrown coding, third-party sub-systems, enterprise platforms, and existing technology components.

·        Actively participates in collaborative effort through all phases of software development life cycle (SDLC), including requirements analysis, technical design, coding, testing, release, and customer technical support.

·        Develops technical documentation, such as system context diagrams, design documents, release procedures, and other pertinent artifacts.

·        Understands lifecycle of various technology sub-systems that comprise the enterprise data platform (i.e., version, release, roadmap), including current capabilities, compatibilities, limitations, and dependencies; understands and advises of optimal upgrade paths.

·        Establishes relationships with key IT, QA, and other corporate partners, and regularly communicates and collaborates accordingly while working on cross-functional projects or production issues.

Job Requirements:

EXPERIENCE:

2 years required; 3 - 5 years preferred experience in a data engineering role.

2 years required, 3 - 5 years preferred experience in Azure data services (Data Factory, Databricks, ADLS, Synapse, SQL DB, etc.)

EDUCATION:

Bachelor’s degree information technology, computer science, or data related field preferred

SKILLS/REQUIREMENTS:

Expertise working with databases and SQL.

Strong working knowledge of Azure Data Factory and Databricks

Strong working knowledge of code management and continuous integrations systems (Azure DevOps or Github preferred)

Strong working knowledge of cloud relational databases (Azure Synapse and Azure SQL preferred)

Familiarity with Agile delivery methodologies

Familiarity with NoSQL databases (such as CosmosDB) preferred.

Any experience with Python, DAX, Azure Logic Apps, Azure Functions, IoT technologies, PowerBI, Power Apps, SSIS, Informatica, Teradata, Oracle DB, and Snowflake preferred but not required.

Ability to multi-task and reprioritize in a dynamic environment.

Outstanding written and verbal communication skills

Working Environment:

General Office – Work is generally performed within an office environment, with standard office equipment. Lighting and temperature are adequate and there are no hazardous or unpleasant conditions caused by noise, dust, etc. 

physical requirements:                     

Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. 

Mental requirements:

Employee required to organize and coordinate schedules.

Employee required to analyze and interpret complex data.

Employee required to problem-solve. 

Employee required to communicate with the public.

 Hiring for Azure Data Engineers.

Location: Bangalore

Employment type: Full-time, permanent

website: www.amazech.com

Qualifications: 

B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Electrical or Electronic with good academic background.

Experience and Required Skill Sets:

•       Minimum 5 years of hands-on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse, Azure Blob, Azure Storage Explorer

•       Experience in Data warehouse/analytical systems using Azure Synapse.

Proficient in creating Azure Data Factory pipelines for ETL processing; copy activity, custom Azure development, Synapse, etc.

•       Knowledge of Azure Data Catalog, Event Grid, Service Bus, SQL, and Purview.

•       Good technical knowledge in Microsoft SQL Server BI Suite (ETL, Reporting, Analytics, Dashboards) using SSIS, SSAS, SSRS, Power BI

•       Design and develop batch and real-time streaming of data loads to data warehouse systems

 Other Requirements:

A Bachelor's or Master's degree (Engineering or computer-related degree preferred)

Strong understanding of Software Development Life Cycles including Agile/Scrum

Responsibilities: 

•       Ability to create complex, enterprise-transforming applications that meet and exceed client expectations. 

•       Responsible for the bottom line. Strong project management abilities. Ability to encourage the team to stick to timelines.

• Azure Data Factory, Azure Data Bricks, Talend, BODS, Jenkins
• Microsoft Office (mandatory)
• Strong knowledge on Databases, Azure Synapse, data management, SQL
• Knowledge on any cloud platforms (Azure, AWS etc.,)

• Azure Data Factory, Azure Data Bricks, Talend, BODS, Jenkins
• Microsoft Office (mandatory)
• Strong knowledge on Databases, Azure Synapse, data management, SQL
• Knowledge on any cloud platforms (Azure, AWS etc.,)

Power BI Developer

Senior visualization engineer with 5 years’ experience in Power BI to develop and deliver solutions that enable delivery of information to audiences in support of key business processes. In addition, Hands-on experience on Azure data services like ADF and databricks is a must.

Ensure code and design quality through execution of test plans and assist in development of standards & guidelines working closely with internal and external design, business, and technical counterparts.

Candidates should have worked in agile development environments.

Desired Competencies:

• Should have minimum of 3 years project experience using Power BI on Azure stack.
• Should have good understanding and working knowledge of Data Warehouse and Data Modelling.
• Good hands-on experience of Power BI
• Hands-on experience T-SQL/ DAX/ MDX/ SSIS
• Data Warehousing on SQL Server (preferably 2016)
• Experience in Azure Data Services – ADF, DataBricks & PySpark
• Manage own workload with minimum supervision.
• Take responsibility of projects or issues assigned to them
• Be personable, flexible and a team player
• Good written and verbal communications
• Have a strong personality who will be able to operate directly with users

• Establish and maintain a trusted advisor relationship within the company’s IT, Commercial Digital Solutions, Functions, and Businesses you interact with
• Establish and maintain close working relationships with teams responsible for delivering solutions to the company’s businesses and functions
• Perform key management and thought leadership in the areas of advanced data techniques, including data modeling, data access, data integration, data visualization, big data solutions, text mining, data discovery, statistical methods, and database design
• Work with business partners to define ways to leverage data to develop platforms and solutions to drive business growth
• Engage collaboratively with project teams to support project objectives through the application of sound data architectural principles; support a project with knowledge of existing data assets and provide guidance on reusable data structures
• Share knowledge of external and internal data capabilities and trends, provide leadership, and facilitate the evaluation of vendors and products
• Utilize advanced data analysis, including statistical analysis and data mining techniques
• Collaborate with others to set an enterprise data vision with solid recommendations, and work to gain business and IT consensus

Basic Qualifications

• Overall 10+ years of IT Environment Experience.
• 3+ years of experience partnering with business managers to develop technical strategies and architectures to support their objectives
• 3+ years in Azure Data Factory.
• 2 +azure data bricks, azure cosmos DB, multi-factor authentication, event hub, azure active directory, logic apps.
• 2+ years of hands-on experience with analytics deployment in the cloud (prefer Azure)
• 5+ years of delivering analytics in modern data architecture (Hadoop, Massively Parallel Processing Database Platforms, and Semantic Modeling)
• Demonstrable knowledge of ETL and ELT patterns and when to use either one; experience selecting among different tools that could be leveraged to accomplish this (Talend, Informatica, Azure Data Factory, SSIS, SAP Data Services)
• Demonstrable knowledge of and experience with different scripting languages (python, JavaScript, PIG, or object-oriented programming like Java or . NET)

Preferred Qualifications

• Bachelor’s degree in Computer Science, MIS, related field, or equivalent experience
• Experience working with solutions delivery teams using Agile/Scrum or similar methodologies
• 2+ years of experience designing solutions leveraging Microsoft Cortana Intelligence Suite of Products [Azure SQL, Azure SQL DW, Cosmos DB, HDInsight, DataBricks]
• Experience with enterprise systems, like CRM, ERP, Field Services Management, Supply Chain solutions, HR systems
• Ability to work independently, establishing strategic objectives, project plans, and milestones
• Exceptional written, verbal & presentation skills

• Working knowledge of setting up and running HD insight applications
• Hands on experience in Spark, Scala & Hive
• Hands on experience in ADF – Azure Data Factory
• Hands on experience in Big Data & Hadoop ECO Systems
•  Exposure to Azure Service categories like PaaS components and IaaS subscriptions
• Ability to Design, Develop ingestion & processing frame work for ETL applications
• Hands on experience in powershell scripting, deployment on Azure
• Experience in performance tuning and memory configuration
• Should be adaptable to learn & work on new technologies
• Should have Communication Good written and spoken

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Author data services using a variety of programming languages
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centres and Azure regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Work in an Agile environment with Scrum teams.
• Ensure data quality and help in achieving data governance.

• 2+ years of experience in a Data Engineer role
• Undergraduate degree required (Graduate degree preferred) in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
• Experience using the following software/tools:
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases
• Experience with data pipeline and workflow management tools
• Experience with Azure cloud services: ADLS, ADF, ADLA, AAS
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Understanding of ELT and ETL patterns and when to use each. Understanding of data models and transforming data into the models
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets
• Strong analytic skills related to working with unstructured datasets
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Experience supporting and working with cross-functional teams in a dynamic environment