SSIS Developer

Position: Lead Software Engineer 

Job Overview:

Lead ETL Engineer with SSIS (SQL Server Integration Services) knowledge is primarily responsible for designing, developing, and maintaining ETL (Extract, Transform, Load) workflows and data integration processes to support enterprise data solutions. 

Key Responsibilities and Duties  

Lead the software development team: 

• Lead a team of software engineers in designing, developing, and maintaining ETL Framework. 
• Set and communicate clear expectations for the clients regarding project timelines, quality standards, and deliverables. 
• Experience with Microsoft SQL Server Database, 
• Hands-on experience in writing, optimizing and maintaining complex SQL queries, stored procedures and functions. 
• Design and develop robust, scalable, and efficient database structures based on the organization's requirements. 

SSIS: 

• Design, develop, test, deploy, and maintain SSIS packages for data migration, ETL processes, reporting and to integrate data between various systems. 
• Develop complex SQL queries to extract data from various sources such as Oracle or SQL databases. 
• Troubleshoot issues related to package execution failures and optimize performance of existing packages. 
• Collaborate with stakeholders to understand business requirements and design solutions using SQL Server Integration Services (SSIS). 
• Work closely with the team to ensure timely delivery of projects. 
• Optimize existing integrations for improved performance and scalability. 
• Design and implement complex SSIS packages for extracting, transforming, and loading data from various sources such as relational databases (SQL Server, Oracle, DB2), flat files, and XML files. 
• Develop ETL best practices, including error handling, logging, checkpoints, and data quality assurance. 
• Write efficient SQL queries, stored procedures, functions, and triggers to support ETL processes. 
• Optimize SSIS packages and SQL queries for maximum performance using techniques such as parallelization, lookup caching, and bulk loading. 
• Create and maintain design documentation such as data models, mapping documents, data flow diagrams, and architecture diagrams. 
• Collaborate with business analysts, BI teams, and other stakeholders to understand requirements and deliver data solutions for reporting and analytics. 
• Schedule and monitor SSIS workflows using SQL Server Agent or other scheduling tools, ensuring timely and error-free data loads. 
• Troubleshoot, debug, and test SSIS packages and backend database processes to ensure data accuracy and system reliability. 
• Participate in resource planning, task estimation, and code review processes. 

Collaborate with cross-functional teams: 

• Work with other teams such as product management, quality assurance, and user experience to ensure that software applications meet business requirements and user needs. 
• Communicate effectively with team members and stakeholders. 

Stay up to date with emerging trends and technologies: 

• Keep up to date with emerging trends and technologies in the software development industry. 
• Make recommendations for improvements to existing software applications and processes. 

Mandatory skills 

SSIS, understanding of ETL Framework, able to design and implement SSIS 

Qualifications 

• Bachelor’s degree in computer science or related field. 
• 6-9 years of experience in software development. 
• Proven leadership experience in leading ETL teams. 
• Knowledge of software development methodologies such as Agile or Scrum. 
• Ability to mentor and train junior team members. 

• Manage different versions of complicate code and distribute them to different teams in the organization utilizing TFS.
• Develop an ASP.Net application to input and manage a production schedule, production statistical analysis and trend reporting.
• Create routines for importing data utilizing XML, CSV and comma delimitate files.
• Filter and cleanse OLTP data with complex store procedures and SSIS packages in the staging area.
• Develop a dimensional database and OLAP cube using SSAS for analysis, maintenance and good customer service.
• Involve in development and implementation of SSIS, SSRS and SSAS application solutions for various business units across the organization.
• Extract the data from XML and load it to dimensional model.
• Maintain SQL scripts, indexes, complex queries for data analysis and extraction.
• Create advanced reports like dashboard and scoreboard using SharePoint and power pivot for better presentation of data.
• Create cubes in SSAS reports which require complex calculations such as calculation of the premium for a particular policy.
• Create SharePoint sub sites, lists, libraries, folders and apply site permissions according to the given requirement.
• Work with business analysts, subject matter experts, and other team members to determine data extraction and transformation requirements.
• Develop T-SQL functions and store procedures to support complex business requirements.
• Create and configure an OLTP replication database for disaster recovery purpose.
• Designed/Implemented/Maintain OLAP servers and processes to replicate production data to the server.

• Experience in either of these Relational DB’s MS SQL Server / PostgreSQL / AWS Aurora DB / MySQL / Oracle / NOSQL DBs (MongoDB / DynamoDB / DocumentDB) in an application development environment and eagerness to switch DB.
• Design database tables, views, indexes
• Write functions and procedures for Middle Tier Development Team
• Work with any front-end developers in completing the database modules end to end (hands-on experience in parsing of JSON & XML in Stored Procedures would be an added advantage).
• Query Optimization for performance improvement
• Design & develop SSIS Packages or any other Transformation tools for ETL

• Banking / Insurance / Retail domain would be a plus.
• Interaction with a client a plus

• Knowledge in a Cloud Platform (AWS / Azure)
• Knowledge on version control system (SVN / Git)
• Exposure to Quality and Process Management
• Knowledge in Agile Methodology

• Team building (attitude to train, work along, mentor juniors)
• Communication skills (all kinds)
• Quality consciousness
• Analytical acumen to all business requirement
• Think out-of-box for business solution