Bits In Glass

Responsibilities

• Act as a liaison between business and technical teams to bridge gaps and support successful project delivery.
• Maintain high-quality metadata and data artifacts that are accurate, complete, consistent, unambiguous, reliable, accessible, traceable, and valid.
• Create and deliver high-quality data models while adhering to defined data governance practices and standards.
• Translate high-level functional or business data requirements into technical solutions, including database design and data mapping.
• Participate in requirement-gathering activities, elicitation, gap analysis, data analysis, effort estimation, and review processes.

Qualifications

• 6–12 years of strong data analysis and/or data modeling experience.
• Strong individual contributor with solid understanding of SDLC and Agile methodologies.
• Comprehensive expertise in conceptual, logical, and physical data modeling.

Skills

• Strong financial domain knowledge and data analysis capabilities.
• Excellent communication and stakeholder management skills.
• Ability to work effectively in a fast-paced and continuously evolving environment.
• Problem-solving mindset with a solution-oriented approach.
• Team player with a self-starter attitude and strong sense of ownership.
• Proficiency in SQL, MS Office tools, GCP BigQuery, Erwin, and Visual Paradigm (preferred).

We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our data engineering team. The team is responsible for ingesting data from multiple sources, making it accessible to internal stakeholders, and enabling seamless data exchange across internal and external systems.

You will play a key role in enhancing and scaling our Enterprise Data Platform (EDP) hosted on Azure and built using modern technologies such as Databricks, Synapse, Azure Data Factory (ADF), ADLS Gen2, Azure DevOps, and CI/CD pipelines.

Responsibilities

• Design, develop, optimize, and maintain scalable data architectures and pipelines aligned with ETL principles and business goals.
• Collaborate across teams to build simple, functional, and scalable data solutions.
• Troubleshoot and resolve complex data issues to support business insights and organizational objectives.
• Build and maintain data products to support company-wide usage.
• Advise, mentor, and coach data and analytics professionals on standards and best practices.
• Promote reusability, scalability, operational efficiency, and knowledge-sharing within the team.
• Develop comprehensive documentation for data engineering standards, processes, and capabilities.
• Participate in design and code reviews.
• Partner with business analysts and solution architects on enterprise-level technical architectures.
• Write high-quality, efficient, and maintainable code.

Technical Qualifications

• 5–8 years of progressive data engineering experience.
• Strong expertise in Databricks, Python, Scala, and Microsoft Azure services including Synapse & Azure Data Factory (ADF).
• Hands-on experience with data pipelines across multiple source & target systems (Databricks, Synapse, SQL Server, Data Lake, SQL/NoSQL sources, and file-based systems).
• Experience with design patterns, code refactoring, CI/CD, and building scalable data applications.
• Experience developing batch ETL pipelines; real-time streaming experience is a plus.
• Solid understanding of data warehousing, ETL, dimensional modeling, data governance, and handling both structured and unstructured data.
• Deep understanding of Synapse and SQL Server, including T-SQL and stored procedures.
• Proven experience working effectively with cross-functional teams in dynamic environments.
• Experience extracting, processing, and analyzing large / complex datasets.
• Strong background in root cause analysis for data and process issues.
• Advanced SQL proficiency and working knowledge of a variety of database technologies.
• Knowledge of Boomi is an added advantage.

Core Skills & Competencies

• Excellent analytical and problem-solving abilities.
• Strong communication and cross-team collaboration skills.
• Self-driven with the ability to make decisions independently.
• Innovative mindset and passion for building quality data solutions.
• Ability to understand operational systems, identify gaps, and propose improvements.
• Experience with large-scale data ingestion and engineering.
• Knowledge of CI/CD pipelines (preferred).
• Understanding of Python and parallel processing frameworks (MapReduce, Spark, Scala).
• Familiarity with Agile development methodologies.

Education

• Bachelor’s degree in Computer Science, Information Technology, MIS, or an equivalent field.