Agile Programme Manager

Job Description:

Position: Senior Data Engineer

Location: Chennai / Pune / Bangalore / Hyderabad

Working Type: WFO

Shift: UK Shift (2:00 – 11:00 PM)

Experience : 7+ years overall

Interviews: Assessment || 2 Interview rounds.

Notice Period: Immediate Joiner

Key Responsibilities

Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.

Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)

Manage large-volume ingestion and backfill operations

Implement Bronze to Silver transformation pipelines

Develop incremental load and CDC logic

Optimize Lakehouse performance and storage patterns

Implement monitoring (record counts, load duration, failure tracking)

Support Dev/Test/Prod promotion processes

Required Qualifications

7+ years of data engineering experience

Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory

Strong experience with Fivetran or similar ELT tools

Experience handling high-volume datasets (hundreds of millions of records)

Proficiency in SQL, Python, and data modeling concepts

Strong understanding of Medallion architecture.

• facilitate and maintain relationships between  organization and vendors/partners
• negotiating contracts, creating standards for the vendors, and finding the best available vendors
• Good stakeholder management and 3-4 years of experience working in a similar set up where they have handled the Contract hiring piece
• Prior experience in MIS, tracking of profiles, sourcing candidates, scheduling
• Exp in Vendor management, assessing vendor performance, clearing PO’s, empanelment of vendors and creating SOP’s.
• Establishing the process (create a flow chart on process and circulate to all businesses)
• Maintaining vendor database and keeping resumes ready skill wise.

• Strong Snowflake Cloud database experience Database developer.
• Knowledge of Spark and Databricks is desirable.
• Strong technical background in data modelling, database design and optimization for data warehouses, specifically on column oriented MPP architecture 
• Familiar with technologies relevant to data lakes such as Snowflake
• Candidate should have strong ETL & database design/modelling skills. 
• Experience creating data pipelines
• Strong SQL skills and debugging knowledge and Performance Tuning exp.
• Experience with Databricks / Azure is add on /good to have . 
• Experience working with global teams and global application environments
• Strong understanding of SDLC methodologies with track record of high quality deliverables and data quality, including detailed technical design documentation desired

Requirements:

• Bachelor’s degree in computer science, computer engineering, or related field.
• Experience working with ruby on rails as well as libraries like Resque and RSpec.
• Ability to write clean ruby code.
• Proficiency with code versioning tools including Git, Github, SVN, and Mercurial.
• Familiarity with MVC, Mocking, RESTful, and ORM.
• Good understanding of front-end technologies including HTML5, JavaScript, and CSS3.
• Knowledge of server-side templating languages including Slim and Liquid.
• Familiarity with testing tools.

• To design UI that carries wow effect
• Designing clean, professional looking UI to high standards, in a timely way
• Follow industry best practices when designing UI
• Design UI for Website, fluid/responsive mobile friendly designs.

• At least 2 years of experience
• In-depth knowledge of React, Redux
• In-depth knowledge of HTML, CSS, JavaScript, jQuery, Bootstrap, JavaScript frameworks
• Experience of React Native is added advantage
• Git/ version control
• Testing/ debugging
• Creative and efficient problem solver
• Good communication skills in English, ability to listen to customer, understand their requirements and respond back meaningfully. Ability to work in a small team or individually and share different tasks which are pertinent to the organization.

Key Responsibilities:

• Partnering with clients and internal business owners (product, marketing, edit, etc.) to understand needs and develop models and products for Kaleidofin business line.
• Good understanding of the underlying business and workings of cross functional teams for successful execution
• Design and develop analyses based on business requirement needs and challenges.
• Leveraging statistical analysis on consumer research and data mining projects, including segmentation, clustering, factor analysis, multivariate regression, predictive modeling, hyperparameter tuning, ensembling etc.
• Providing statistical analysis on custom research projects and consult on A/B testing and other statistical analysis as needed. Other reports and custom analysis as required.
• Identify and use appropriate investigative and analytical technologies to interpret and verify results.
• Apply and learn a wide variety of tools and languages to achieve results
• Use best practices to develop statistical and/ or machine learning techniques to build models that address business needs.
• Collaborate with the team to improve the effectiveness of business decisions using data and machine learning/predictive modeling.
• Innovate on projects by using new modeling techniques or tools.
• Utilize effective project planning techniques to break down complex projects into tasks and ensure deadlines are kept.
• Communicate findings to team and leadership to ensure models are well understood and incorporated into business processes.

Skills:

• 2+ year experience in advanced analytics, model building, statistical modeling, optimization, and machine learning algorithms.
• Machine Learning Algorithms: Crystal clear understanding, coding, implementation, error analysis, model tuning knowledge on Linear Regression, Logistic Regression, SVM, shallow Neural Networks, clustering, Decision Trees, Random forest, Boosting trees, Recommender Systems, ARIMA and Anomaly Detection. Feature selection, hyper parameters tuning, model selection and error analysis, ensemble methods.
• Strong with programming languages like Python and data processing using SQL or equivalent and ability to experiment with newer open source tools
• Experience in normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis.
• Experience designing, developing, implementing and maintaining a database and programs to manage data analysis efforts.
• Experience with big data and cloud computing viz. Spark, Hadoop (MapReduce, PIG, HIVE)
• Experience in risk and credit scoring domains preferred