Senior BI & ETL Developer

Designing, building, and automating ETL processes using AWS services like Apache Sqoop, AWS S3, AWS CLI, Amazon 

EMR, Amazon MSK, Amazon Sagemaker. 

∙Developing and maintaining data pipelines to move and transform data from diverse sources into data warehouses or 

data lakes. 

∙Ensuring data quality and integrity through validation, cleansing, and monitoring ETL processes. 

∙Optimizing ETL workflows for performance, scalability, and cost efficiency within the AWS environment. 

∙Troubleshooting and resolving issues related to data processing and ETL workflows. 

∙Implementing and maintaining security measures and compliance standards for data pipelines and infrastructure. 

∙Documenting ETL processes, data mappings, and system architecture. 

• Bachelor's degree required, or higher education level, or foreign equivalent, preferably in area wit
• At least 5 years experience in Duck Creek Data Insights as Technical Architect/Senior Developer.
• Strong Technical knowledge on SQL databases, MSBI.
• Should have strong hands-on knowledge on Duck Creek Insight product, SQL Server/DB level configuration, T-SQL, XSL/XSLT, MSBI etc
• Well versed with Duck Creek Extract Mapper Architecture
• Strong understanding of Data Modelling, Data Warehousing, Data Marts, Business Intelligence with ability to solve business problems
• Strong understanding of ETL and EDW toolsets on the Duck Creek Data Insights
• Strong knowledge on Duck Creek Insight product overall architecture flow, Data hub, Extract mapper etc
• Understanding of data related to business application areas policy, billing, and claims business solutions
• Minimum 4 to 7 year working experience on Duck Creek Insights product
• Strong Technical knowledge on SQL databases, MSBI
• Preferable having experience in Insurance domain
• Preferable experience in Duck Creek Data Insights
• Experience specific to Duck Creek would be an added advantage
• Strong knowledge of database structure systems and data mining
• Excellent organisational and analytical abilities
• Outstanding problem solver

Key skills : Python, Numpy, Panda, SQL, ETL 

Roles and Responsibilities:

- The work will involve the development of workflows triggered by events from other systems

- Design, develop, test, and deliver software solutions in the FX Derivatives group

- Analyse requirements for the solutions they deliver, to ensure that they provide the right solution

- Develop easy to use documentation for the frameworks and tools developed for adaption by other teams

Familiarity with event-driven programming in Python

- Must have unit testing and debugging skills

- Good problem solving and analytical skills

- Python packages such as NumPy, Scikit learn

- Testing and debugging applications.

- Developing back-end components.

CTC Budget: 35-50LPA

Location: Hyderabad/Bangalore

Experience: 8+ Years

Company Overview:

An 8-year-old IT Services and consulting company based in Hyderabad providing services in maximizing product value while delivering rapid incremental innovation, possessing extensive SaaS company M&A experience including 20+ closed transactions on both the buy and sell sides. They have over 100 employees and looking to grow the team.

Work with, learn from, and contribute to a diverse, collaborative

development team

● Use plenty of PHP, Go, JavaScript, MySQL, PostgreSQL, ElasticSearch,

Redshift, AWS Services and other technologies

● Build efficient and reusable abstractions and systems

● Create robust cloud-based systems used by students globally at scale

● Experiment with cutting edge technologies and contribute to the

company’s product roadmap

● Deliver data at scale to bring value to clients Requirements

You will need:

● Experience working with a server side language in a full-stack environment

● Experience with various database technologies (relational, nosql,

document-oriented, etc) and query concepts in high performance

environments

● Experience in one of these areas: React, Backbone

● Understanding of ETL concepts and processes

● Great knowledge of design patterns and back end architecture best

practices

● Sound knowledge of Front End basics like JavaScript, HTML, CSS

● Experience with TDD, automated testing

● 12+ years’ experience as a developer

● Experience with Git or Mercurial

● Fluent written & spoken English

It would be great if you have:

● B.Sc or M.Sc degree in Software Engineering, Computer Science or similar

● Experience and/or interest in API Design

● Experience with Symfony and/or Doctrine

● Experience with Go and Microservices

● Experience with message queues e.g. SQS, Kafka, Kinesis, RabbitMQ

● Experience working with a modern Big Data stack

● Contributed to open source projects

● Experience working in an Agile environment

Responsibilities and Duties

Develop high-quality software design and architecture.

Achieve the timeline with quality delivery of assigned tasks.

Able to do technical analysis and code review.

Able to troubleshoot internal & production bugs.

Coordinate and support to project co-ordinator/project manager.

Development coding standards are achieved.

Work with internal teams to understand and analyse their needs and to ensure that proposed solution caters to same.

Adopt new technology in quick time.

Implement Unit tests and Functional tests to ascertain highest quality of deliverables.

Identify, prioritize and execute tasks in the software development life cycle.

Understand business needs and know how to implement needs in system to meet business needs.

Able to create the technical documents.

Able to leading team members and planning of team’s task.

Design, develop, modify, implement, and support software components anywhere in the software stack.

Work in close partnership with cross-functional teams and management.

Requirements

Having knowledge of ASP .Net / .net core, Web API, Micro Services, JavaScript, jQuery, Bootstrap, Flutter.

Having good Release management, Cloud Management & Data base management knowledge

Having fluency in Agile methodology

Having knowledge of Power BI / Tablue will be added advantage

Soft skills – Manager level skill

Critical thinker and creative mindset and the ability to approach a problem creatively.

Ability to provide in-depth evaluation and analysis of unique complex technological issues.

Skill for BI Backend developer -

-SQL development (Snowflake preferred but any other version of SQL would work)

- ETL

- Stored Procedures

- Creating jobs and work flows in SQL

- some business knowledge

About Us

Welthungerhilfe (WHH) is an international aid agency headquartered in Germany with its vision for “Zero Hunger by 2030”, the second sustainable development goal set by the UN. It has thousands of programs fighting hunger in more than 30 countries. (https://www.welthungerhilfe.org/">https://www.welthungerhilfe.org)  (https://www.childgrowthmonitor.org/">https://www.childgrowthmonitor.org).

Child Growth Monitor (CGM) is Welthungerhilfe’s digital innovation project leveraging AI to fight child malnutrition. Around 200 million children around the world are suffering from malnutrition. Malnutrition contributes to one-third of deaths of children under the age of five. In the fight against malnutrition, detection is the first important step, but this is not an easy task: Measuring children with traditional methods is still a complex, slow, and expensive task, frequently resulting in poor data and wrong assessments of the child’s health. Early detection of malnutrition becomes the key to initiating treatment, minimizing the risk of complications,

and saving lives by reducing the chances of death to a great extent.

Our solution to measure children replaces hardware (bulky measuring boards and physical scales) with off-the-shelf cell phones and AI. CGM uses augmented reality-enabled smartphones to record 3D scans of children. Artificial Intelligence is used to predict their height, weight, and middle upper-arm circumference needed to know the nutritional status of the children.

What you would do to help us save millions of children's lives

We are looking for you as an experienced Sr Software Engineer who works collaboratively with the dedicated team of tech specialists (AI, ML & Data Scientists) distributed globally have a shared responsibility for ensuring high quality and

Scalable health care product in an agile approach.

This posting concerns a full-time assignment working for Welthungerhilfe’s CGM in a freelance capacity but Full-time employment (payroll) is scheduled for the end of 2022 latest. We are in the process of setting up CGM as a registered social business from mostly January 2023 and moving all the consultants on CGM payrolls.

Responsibilities

• Designing, developing features, refinement/improving and implementing the CGM product in a secure, well-tested, and performant way.
• De-bugging of the current issues
• Collaborate with Product Management and other stakeholders within Engineering (Frontend, UX, etc.) to maintain a high bar for quality in a fast-paced, iterative environment.
• Advocate for improvements to product quality, security, and performance.
• Solve technical problems of moderate scope and complexity.
• Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale Mobile app environment. Maintain and advocate for these standards through code review.
• Provide mentorship for Junior and Intermediate Engineers on your team to help them grow in their technical responsibilities and remove blockers to their autonomy.

 Requirements and skills

• Comfort working in a highly agile, intensely iterative software development process.
• Demonstrated capacity to clearly and concisely communicate about complex technical, architectural, and/or organizational problems and propose thorough iterative solutions.
• Experience with performance and optimization problems and a demonstrated ability to both diagnose and prevent these problems.
• Extensive experience in core Python (3-7yrs)
• Should have worked on Azure or any Cloud and Azure data factory or any similar data platforms
• Experience using Flask/Flutter framework
• Experience working on mobile applications/Web applications (writing flask framework)
• Knowledge of DevOps Pipeline
• Good experience in SQL database
• Working knowledge in Data engineering (ETL pipelines Result Generation Module)
• Basic understanding of front-end technologies such as Vue JS
• Working knowledge in creating predictive models for AI and ML-based features
• Tech /BE in Computer Science with a total of 7 years of software development/Programming experience.

Desired skills

• Good to have an experience in Kubernetes (opensource system)
• Good to have experience working on healthcare mobile apps (predictive analytics and image diagnostics)
• Experience owning a project from concept to production, including proposal, discussion, and execution.
• Proficient understanding of code versioning tools

Soft/Human Skills

• Positive and solution-oriented mindset.
• Excellent communication & interpersonal skills
• Self-motivated and self-managing, with excellent organizational skills.
• Ability to thrive in a fully remote organization

We are urgently looking Azure Data Factory Engineers with 3 to 7 years of overall experience, having good experience on Azure Data Factory and SSIS.

Requirements:

• Qualification: Engineering Graduate.
• Years of Experience: 2+ yrs of relevant experience on Azure Data Factory & SSIS.
• Strong understanding of ETL/ELT concepts.
• Hands on experience on Azure Data Factory.
• Exposure of Cloud technologies, standards, and platforms.
• Sound knowledge of ADF pipeline, configuration, parameters, variables, Integration services runtime (part of Data Factory).
• Strong Experience on SSIS.
• Sound knowledge of implementing slowly changing dimensions and transactional, fact less, snapshot fact tables.
• Azure Data Warehouse.
• Knowledge on Azure components especially file storage and Azure Sql, Blob storage and Data Lake Gen2 storage (just used as a file system on the blob).
• Azure Data Migration tool.
• Well versed with RDBMS systems like Sql server, DDL, DML scripts.
• Sound knowledge of T-SQL and stored procedures.
• Strong Query writing skills, Scheduling tools.
• Ensure quality deliverable and ability to extend work hours if required.
• Azure Certification: Preferred.
• Ability to understand Customer requirements and convert the requirements into technical specifications.
• Ability to understand the overall solution and design components to fit the overall solution.
• Ability to take technical decisions and support the decisions with justifications.
• Ability to work in Agile manner.
• Ability to work independently without much guidance.
• Self-Motivated, team player, results oriented, strong Time Management skills.
• Excellent written and verbal communication skills.
• Willing to travel to outside India (Short term as well as long term)