Affine

• Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
• Design and build ETL pipelines using ADF
• Build and maintain a Lakehouse architecture in ADLS / Databricks.
• Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
• Work with DevOps team to deploy solutions in production environments.
• Control data processes and take corrective action when errors are identified. Corrective action may include executing a work around process and then identifying the cause and solution for data errors.
• Participate as a full member of the global Analytics team, providing solutions for and insights into data related items.
• Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions and to propagate best practices.
• You will lead projects that include other team members and participate in projects led by other team members.
• Apply change management tools including training, communication and documentation to manage upgrades, changes and data migrations.

Job Responsibility:

• Design, develop, and deploy Power BI reports and dashboards that provide key insights into business performance.
• Create and maintain complex Power BI data models, integrating data from multiple sources.
• Write and optimize SQL queries to extract, manipulate, and analyze data from various databases.
• Collaborate with cross-functional teams to understand business requirements and translate them into effective BI solutions.
• Perform data analysis using Excel, Power Query, and other tools to support reporting and analytics needs.
• Monitor and troubleshoot Power BI reports and data refresh schedules to ensure consistent performance.
• Implement security measures and ensure data is presented to the appropriate audience through role-based access.
• Continuously improve the usability, interactivity, and performance of reports.
• Provide training and support to end-users on Power BI usage.

Work Mode: 

• 2 to 3 days a month will be work from client office in Gurugram/Hyderabad
• Preferred Location - Gurugram/Hyderabad. 
• For other locations, candidate should be willing to travel to Gurugram/Hyderabad for a few days every month.

External Skills And Expertise

Must Have Skills:

• Excel
• SQL
• Power BI Dax
• Power Query
• Power BI Online Services

Job Responsibilities:

• Code emails in Emarsys ESP environment using HTML and Emarsys tags.
• Integrate models from DS team using Emarsys and Snowflake data connections.
• Use JIRA to manage email development tickets.
• Dedicated PM to manage partnership between developers and BN email team, providing status updates of all projects. This person is the POC for all project discussions and help.
• Development needs - average of 9 emails/per week over the year.
• Ability to pick up and edit pre-built legacy emails and build email from scratch using creative Figma files.
• QA media prior to sharing to reduce errors in layouts, copy and links

External Skills And Expertise

Mandate Skills:

• Emarsys 
• Digital Marketing

Optional Skills:

• SQL
• Excel

Role Objective:

Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities:

• Sound knowledge in Spark architecture and distributed computing and Spark streaming.
• Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
• Good understanding in object-oriented concepts and hands on experience on Kotlin/Scala/Java with excellent programming logic and technique.
• Good in functional programming and OOPS concept on Kotlin/Scala/Java
• Good experience in SQL – should be able to write complex queries.
• Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
• Able to mentor new members for onboarding to the project.
• Understand the client requirement and able to design, develop from scratch and deliver.
• AWS cloud experience would be preferable.
• Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on cloud (AWS preferred)
• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
• Managing project timing, client expectations and meeting deadlines.
• Should have played project and team management roles.
• Facilitate meetings within the team on regular basis.
• Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
• Optimization, maintenance, and support of pipelines.
• Strong analytical and logical skills.
• Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

• Kotlin/Scala/Java
• Spark
• SQL (Intermediate to advanced level)
• Spark Streaming
• Any cloud(AWS preferable)
• Kafka /Kinesis/Any streaming services
• Object-Oriented Programming
• Hive, ETL/ELT design experience
• CICD experience (ETL pipeline deployment)

Good to Have Skills:

• AWS Certification
• Git/similar version control tool
• Knowledge in CI/CD, Microservices

Key Responsibilities:

• Create and maintain test cases to validate data extraction, transformation, and loading processes within Snowflake.
• Conduct end-to-end testing of ETL workflows to ensure data integrity and accuracy throughout the entire pipeline.
• Collaborate closely with data engineers, developers, and stakeholders to understand data requirements and business logic.
• Identify, document, and report defects or discrepancies in data transformations or loading processes.
• Develop and maintain automated test scripts and frameworks for ETL testing in Snowflake.
• Perform performance testing to evaluate the efficiency and scalability of Snowflake data pipelines.
• Troubleshoot issues and work with cross-functional teams to resolve data-related problems.
• Ensure compliance with data governance, security, and regulatory standards during testing processes.
• Document test results, findings, and recommendations for improvements in testing procedures.
• Strong Hands on, experience in SQL.
• Good to have testing experience ETL build using DBT, Pyspark, Glue, Lambda.

Primary Skillsets:

• ETL Testing
• Python Scripting
• SQL
• Snowflake
• Performance Testing

Good to Have:

• DBT
• Pyspark
• Glue
• Lambda

We are looking for a detail-oriented Business Analyst with expertise in Tableau, statistics, SQL, and Excel. The role involves data analysis, creating interactive dashboards, and providing actionable insights to support business decisions and improve operations.

Key Responsibilities:

• Data Analysis & Visualization: Use Tableau for dashboards and conduct statistical analysis.
• SQL & Data Management: Write and optimize SQL queries, ensure data accuracy.
• Reporting: Develop Excel spreadsheets, analyze business processes, and provide reports.
• Collaboration: Work with cross-functional teams to gather requirements and deliver insights.
• Project Management: Manage multiple projects, deliver timely reports, and support teams with data insights.

Role Objective:

Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities:

• Sound knowledge in Spark architecture and distributed computing and Spark streaming.
• Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
• SFDC(Data modelling experience) would be given preference
• Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
• Good in functional programming and OOPS concept on Scala
• Good experience in SQL – should be able to write complex queries.
• Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
• Able to mentor new members for onboarding to the project.
• Understand the client requirement and able to design, develop from scratch and deliver.
• AWS cloud experience would be preferable.
• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
• Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
• Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
• Managing project timing, client expectations and meeting deadlines.
• Should have played project and team management roles.
• Facilitate meetings within the team on regular basis.
• Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
• Optimization, maintenance, and support of pipelines.
• Strong analytical and logical skills.
• Ability to comfortably tackling new challenges and learn

Role Objective:

Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities:

• Sound knowledge in Spark architecture and distributed computing and Spark streaming.
• Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
• Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
• Good in functional programming and OOPS concept on Scala
• Good experience in SQL – should be able to write complex queries.
• Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
• Able to mentor new members for onboarding to the project.
• Understand the client requirement and able to design, develop from scratch and deliver.
• AWS cloud experience would be preferable.
• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
• Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
• Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
• Managing project timing, client expectations and meeting deadlines.
• Should have played project and team management roles.
• Facilitate meetings within the team on regular basis.
• Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
• Optimization, maintenance, and support of pipelines.
• Strong analytical and logical skills.
• Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

• Scala
• Spark
• SQL (Intermediate to advanced level)
• Spark Streaming
• AWS preferable/Any cloud
• Kafka /Kinesis/Any streaming services
• Object-Oriented Programming
• Hive, ETL/ELT design experience
• CICD experience (ETL pipeline deployment)

Good to Have Skills:

• AWS Certification
• Git/similar version control tool
• Knowledge in CI/CD, Microservices