Sr. Data Engineer

4 - 8 overall experience.

• 1-2 years’ experience in Azure Data Factory - schedule Jobs in Flows and ADF Pipelines, Performance Tuning, Error logging etc..
• 1+ years of experience with Power BI - designing and developing reports, dashboards, metrics and visualizations in Powe BI.
• (Required) Participate in video conferencing calls - daily stand-up meetings and all day working with team members on cloud migration planning, development, and support.
• Proficiency in relational database concepts & design using star, Azure Datawarehouse, and data vault.
• Requires 2-3 years of experience with SQL scripting (merge, joins, and stored procedures) and best practices.
• Knowledge on deploying and run SSIS packages in Azure.
• Knowledge of Azure Data Bricks.
• Ability to write and execute complex SQL queries and stored procedures.

1. Create and maintain optimal data pipeline architecture
2. Assemble large, complex data sets that meet business requirements
3. Identifying, designing, and implementing internal process improvements including redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes
4. Work with Data, Analytics & Tech team to extract, arrange and analyze data
5. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
6. Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
7. Works closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.
8. Working with stakeholders including data, design, product, and executive teams, and assisting them with data-related technical issues
9. Working with stakeholders including the Executive, Product, Data, and Design teams to support their data infrastructure needs while assisting with data-related technical issues.

1. SQL
2. Ruby or Python(Ruby preferred)
3. Apache-Hadoop based analytics
4. Data warehousing
5. Data architecture
6. Schema design
7. ML

1.  Prior experience of 2 to 5 years as a Data Engineer.
2. Ability in managing and communicating data warehouse plans to internal teams.
3. Experience designing, building, and maintaining data processing systems.
4. Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions.
5. Excellent analytic skills associated with working on unstructured datasets.
6. Ability to build processes that support data transformation, workload management, data structures, dependency, and metadata.

• Play a critical role as a member of the leadership team in shaping and supporting our overall company vision, day-to-day operations, and culture.
• Set the technical vision and build the technical product roadmap from launch to scale; including defining long-term goals and strategies
• Define best practices around coding methodologies, software development, and quality assurance
• Define innovative technical requirements and systems while balancing time, feasibility, cost and customer experience
• Build and support production products
• Ensure our internal processes and services comply with privacy and security regulations
• Establish a high performing, inclusive engineering culture focused on innovation, execution, growth and development
• Set a high bar for our overall engineering practices in support of our mission and goals
• Develop goals, roadmaps and delivery dates to help us scale quickly and sustainably
• Collaborate closely with Product, Business, Marketing and Data Science
• Experience with financial and transactional systems
• Experience engineering for large volumes of data at scale
• Experience with financial audit and compliance is a plus
• Experience building a successful consumer facing web and mobile apps at scale

Job Description - Data Engineer

About us
Propellor is aimed at bringing Marketing Analytics and other Business Workflows to the Cloud ecosystem. We work with International Clients to make their Analytics ambitions come true, by deploying the latest tech stack and data science and engineering methods, making their business data insightful and actionable. 

What is the role?
This team is responsible for building a Data Platform for many different units. This platform will be built on Cloud and therefore in this role, the individual will be organizing and orchestrating different data sources, and
giving recommendations on the services that fulfil goals based on the type of data

Qualifications:
• Experience with Python, SQL, Spark
• Knowledge/notions of JavaScript
• Knowledge of data processing, data modeling, and algorithms
• Strong in data, software, and system design patterns and architecture
• API building and maintaining
• Strong soft skills, communication
Nice to have:
• Experience with cloud: Google Cloud Platform, AWS, Azure
• Knowledge of Google Analytics 360 and/or GA4.
Key Responsibilities
• Work on the core backend and ensure it meets the performance benchmarks.
• Designing and developing APIs for the front end to consume.
• Constantly improve the architecture of the application by clearing the technical backlog.
• Meeting both technical and consumer needs.
• Staying abreast of developments in web applications and programming languages.

Key Responsibilities
• Design and develop platform based on microservices architecture.
• Work on the core backend and ensure it meets the performance benchmarks.
• Work on the front end with ReactJS.
• Designing and developing APIs for the front end to consume.
• Constantly improve the architecture of the application by clearing the technical backlog.
• Meeting both technical and consumer needs.
• Staying abreast of developments in web applications and programming languages.

What are we looking for?
An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.
• Education - BE/MCA or equivalent.
• Agnostic/Polyglot with multiple tech stacks.
• Worked on open-source technologies – NodeJS, ReactJS, MySQL, NoSQL, MongoDB, DynamoDB.
• Good experience with Front-end technologies like ReactJS.
• Backend exposure – good knowledge of building API.
• Worked on serverless technologies.
• Efficient in building microservices in combining server & front-end.
• Knowledge of cloud architecture.
• Should have sound working experience with relational and columnar DB.
• Should be innovative and communicative in approach.
• Will be responsible for the functional/technical track of a project.

Whom will you work with?
You will closely work with the engineering team and support the Product Team.

Hiring Process includes : 

a. Written Test on Python and SQL

b. 2 - 3 rounds of Interviews

Immediate Joiners will be preferred

This is the first senior person we are bringing for this role. This person will start with the training program but will go on to build a team and eventually also be responsible for the entire training program + Bootcamp.

We are looking for someone fairly senior and has experience in data + tech. At some level, we have all the technical expertise to teach you the data stack as needed. So it's not super important you know all the tools. However, having basic knowledge of the stack requirement. The training program covers 2 parts - Technology (our stack) and Process (How we work with clients). Both of which are super important.

• Full-time flexible working schedule and own end-to-end training
• Self-starter - who can communicate effectively and proactively
• Function effectively with minimal supervision.
• You can train and mentor potential 5x engineers on Data Engineering skillsets
• You can spend time on self-learning and teaching for new technology when needed
• You are an extremely proactive communicator, who understands the challenges of remote/virtual classroom training and the need to over-communicate to offset those challenges.
  
  

Requirements

• Proven experience as a corporate trainer or have passion for Teaching/ Providing Training
• Expertise in Data Engineering Space and have good experience in Data Collection, Data
• Ingestion, Data Modeling, Data Transformation, and Data Visualization technologies and techniques
• Experience Training working professionals on in-demand skills like Snowflake, debt, Fivetran, google data studio, etc.
• Training/Implementation Experience using Fivetran, DBT Cloud, Heap, Segment, Airflow, Snowflake is a big plus

• Extract and present valuable information from data
• Understand business requirements and generate insights
• Build mathematical models, validate and work with them
• Explain complex topics tailored to the audience
• Validate and follow up on results
• Work with large and complex data sets
• Establish priorities with clear goals and responsibilities to achieve a high level of performance.
• Work in an agile and iterative manner on solving problems
• Evaluate different options proactively and the ability to solve problems in an innovative way. Develop new solutions or combine existing methods to create new approaches.
• Good understanding of Digital & analytics
• Strong communication skills, orally and in writing

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Author data services using a variety of programming languages
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centres and Azure regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Work in an Agile environment with Scrum teams.
• Ensure data quality and help in achieving data governance.

• 2+ years of experience in a Data Engineer role
• Undergraduate degree required (Graduate degree preferred) in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
• Experience using the following software/tools:
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases
• Experience with data pipeline and workflow management tools
• Experience with Azure cloud services: ADLS, ADF, ADLA, AAS
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Understanding of ELT and ETL patterns and when to use each. Understanding of data models and transforming data into the models
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets
• Strong analytic skills related to working with unstructured datasets
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Experience supporting and working with cross-functional teams in a dynamic environment

Job Title: Power BI Developer(Onsite)

Location: Park Centra, Sec 30, Gurgaon

CTC:        8 LPA

Time:       1:00 PM - 10:00 PM

Must Have Skills: 

• Power BI Desktop Software
• Dax Queries
• Data modeling
• Row-level security
• Visualizations
• Data Transformations and filtering
• SSAS and SQL

Job description:

We are looking for a PBI Analytics Lead responsible for efficient Data Visualization/ DAX Queries and Data Modeling. The candidate will work on creating complex Power BI reports. He will be involved in creating complex M, Dax Queries and working on data modeling, Row-level security, Visualizations, Data Transformations, and filtering. He will be closely working with the client team to provide solutions and suggestions on Power BI.

Roles and Responsibilities:

• Accurate, intuitive, and aesthetic Visual Display of Quantitative Information: We generate data, information, and insights through our business, product, brand, research, and talent teams. You would assist in transforming this data into visualizations that represent easy-to-consume visual summaries, dashboards and storyboards. Every graph tells a story.
• Understanding Data: You would be performing and documenting data analysis, data validation, and data mapping/design. You would be mining large datasets to determine its characteristics and select appropriate visualizations.
• Project Owner: You would develop, maintain, and manage advanced reporting, analytics, dashboards and other BI solutions, and would be continuously reviewing and improving existing systems and collaborating with teams to integrate new systems. You would also contribute to the overall data analytics strategy by knowledge sharing and mentoring end users.
• Perform ongoing maintenance & production of Management dashboards, data flows, and automated reporting.
• Manage upstream and downstream impact of all changes on automated reporting/dashboards
• Independently apply problem-solving ability to identify meaningful insights to business
• Identify automation opportunities and work with a wide range of stakeholders to implement the same.
• The ability and self-confidence to work independently and increase the scope of the service line

Requirements: 

• 3+ years of work experience as an Analytics Lead / Senior Analyst / Sr. PBI Developer.
• Sound understanding and knowledge of PBI Visualization and Data Modeling with DAX queries
• Experience in leading and mentoring a small team.