Senior Data Engineer

at OSBIndia Private Limited

Posted by Ashwini Mamidi

5 - 12 yrs

₹10L - ₹18L / yr

Bengaluru (Bangalore), Hyderabad

Skills

ETL

Informatica

Data Warehouse (DWH)

SQL

Stored Procedures

databricks

Microsoft Windows Azure

Change Management

1. Core Responsibilities

· Leading solutions for data engineering

· Maintain the integrity of both the design and the data that is held within the architecture

· Champion and educate people in the development and use of data engineering best practises

· Support the Head of Data Engineering and lead by example

· Contribute to the development of database management services and associated processes relating to the delivery of data solutions

· Provide requirements analysis, documentation, development, delivery and maintenance of data platforms.

· Develop database requirements in a structured and logical manner ensuring delivery is aligned with business prioritisation and best practise

· Design and deliver performance enhancements, application migration processes and version upgrades across a pipeline of BI environments.

· Provide support for the scoping and delivery of BI capability to internal users.

· Identify risks and issues and escalate to Line / Project manager.

· Work with clients, existing asset owners & their service providers and non BI development staff to clarify and deliver work stream objectives in timescales that deliver to the overall project expectations.

· Develop and maintain documentation in support of all BI processes.

· Proactively identify cost-justifiable improvements to data manipulation processes.

· Research and promote relevant BI tools and processes that contribute to increased efficiency and capability in support of corporate objectives.

· Promote a culture that embraces change, continuous improvement and a ‘can do’ attitude.

· Demonstrate enthusiasm and self-motivation at all times.

· Establish effective working relationships with other internal teams to drive improved efficiency and effective processes.

· Be a champion for high quality data and use of strategic data repositories, associated relational model, and Data Warehouse for optimising the delivery of accurate, consistent and reliable business intelligence

· Ensure that you fully understand and comply with the organisation’s Risk Management Policies as they relate to your area of responsibility and demonstrate in your day to day work that you put customers at the heart of everything you do.

· Ensure that you fully understand and comply with the organisation’s Data Governance Policies as they relate to your area of responsibility and demonstrate in your day to day work that you treat data as an important corporate asset which must be protected and managed.

· Maintain the company’s compliance standards and ensure timely completion of all mandatory on-line training modules and attestations.

2. Experience Requirements

· 5 years Data Engineering / ETL development experience is essential

· 5 years data design experience in an MI / BI / Analytics environment (Kimball, lake house, data lake) is essential

· 5 years experience of working in a structured Change Management project lifecycle is essential

· Experience of working in a financial services environment is desirable

· Experience of dealing with senior management within a large organisation is desirable

· 5 years experience of developing in conjunction with large complex projects and programmes is desirable

· Experience mentoring other members of the team on best practise and internal standards is essential

· Experience with cloud data platforms desirable (Microsoft Azure) is desirable

3. Knowledge Requirements

· A strong knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential

· Strong demonstrable knowledge of data warehouse methodologies

· Robust understanding of high level business processes is essential

· Understanding of data migration, including reconciliation, data cleanse and cutover is desirable