Azure Data Engineer

We are looking for an exceptionally talented Lead data engineer who has exposure in implementing AWS services to build data pipelines, api integration and designing data warehouse. Candidate with both hands-on and leadership capabilities will be ideal for this position.

Qualification: At least a bachelor’s degree in Science, Engineering, Applied Mathematics. Preferred Masters degree

Job Responsibilities:

• Total 6+ years of experience as a Data Engineer and 2+ years of experience in managing a team

• Have minimum 3 years of AWS Cloud experience.

• Well versed in languages such as Python, PySpark, SQL, NodeJS etc

• Has extensive experience in the real-timeSpark ecosystem and has worked on both real time and batch processing

• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.

• Experience with modern Database systems such as Redshift, Presto, Hive etc.

• Worked on building data lakes in the past on S3 or Apache Hudi

• Solid understanding of Data Warehousing Concepts

• Good to have experience on tools such as Kafka or Kinesis

• Good to have AWS Developer Associate or Solutions Architect Associate Certification

• Have experience in managing a team

JOB DESCRIPTION

Product Analyst

About Us:-

"Slack for Construction"

Early stage startup cofounded by IIT - Roorkee alumnis. A Mobile-based operating system to manage construction & architectural projects. Material, all the info is shared over whatsapp, mobile app to manage all this in one single place - almost like a slack tool for construction.Mobile app + SAAS platform - administration and management of the process, 150000 users, subscription based pricing.It helps construction project owners and contractors track on-site progress in real-time to finish projects on time and in budget. We aim to bring the speed of software development to infrastructure development.Founded by IIT Roorkee alumni and backed by industry experts, we are on a mission to help the second largest industry in India-Construction make a transition from pen and paper to digital.

As a productivity app startup, we value productivity and ownership most. That helps raise our own bar and the bar of people we hire.We follow agile and scrum approaches for product development and use best of class tools and practices. Measuring our progress on a weekly basis and iterating fast enables us to build breakthrough modules and features rapidly.If you join us, You will be constantly thrown into challenging situations. Decisions that you take, will directly impact our clients and sales. That's how we learn.

• Prior experience in any data driven decision making field.
• Working knowledge of querying data using SQL.
• Familiarity with customer and business data analytic tools like Segment, Mix-panel, Google Analytics, SmartLook etc.
• Data visualisation tools like Tableau, Power BI, etc.
•  

Responsibility -

"All things data"

• Ability to synthesize complex data into actionable goals.
• Critical thinking skills to recommend original and productive ideas
• Ability to visualise user stories and create user funnels
• Perform user test sessions and market surveys to inform product development teams
• Excellent writing skills to prepare detailed product specification and analytic reports
• Help define Product strategy / Roadmaps with scalable architecture
• Interpersonal skills to work collaboratively with various stakeholders who may have competing interests

Responsibilities 

• Identify, analyze, and interpret trends or patterns in complex data sets to develop a thorough understanding of users, and acquisition channels.
• Run exploratory analysis uncover new areas of opportunity, generate hypotheses, and quickly assess the potential upside of a given opportunity.
• Help execute projects to drive insights that lead to growth.
• Work closely with marketing, design, product, support, and engineering to anticipate analytics needs and to quantify the impact of existing features, future product changes, and marketing campaigns.
• Work with data engineering to develop and implement new analytical tools and improve our underlying data infrastructure. Build tracking plans for new and existing products and work with engineering to ensure proper
• Analyze, forecast, and build custom reports to make key performance indicators and insights available to the entire company.
• Monitor, optimize, and report on marketing and growth metrics and split-test results. Make recommendations based on analytics and test findings.
• Drive optimization and data minded culture inside the company.
• Develop frameworks, models, tools, and processes to ensure that analytical insights can be incorporated into all key decision making.
• Effectively present and communicate analysis to the company to drive business decisions.
• Create a management dashboard including all important KPIs to be tracked on a company and department level

• Establish end to end campaign ROI tracking mechanism to attribute sales to specific google and Facebook campaigns

Skills and Experience

• Minimum 1-2 years of proven work experience in a data analyst role.
• Excellent analytical skills and problem-solving ability; the ability to answer unstructured business questions and work independently to drive projects to conclusion.
• Strong analytical skills with the capacity to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Experience extracting insights using advanced SQL or similar tool to work efficiently at scale. Advanced expertise with commonly used analytics tools including Google Analytics, studio and Excel.
• Strong knowledge of statistics, this includes experimental design for optimization, statistical significance, confidence intervals and predictive analytics techniques.
• Must be self-directed, organized and detail oriented as well as have the ability to multitask and work effectively in a fast-paced environment.
• Active team player, excellent communication skills, positive attitude and good work ethic.

We are looking for a Senior Data Engineer to join the Customer Innovation team, who will be responsible for acquiring, transforming, and integrating customer data onto our Data Activation Platform from customers’ clinical, claims, and other data sources. You will work closely with customers to build data and analytics solutions to support their business needs, and be the engine that powers the partnership that we build with them by delivering high-fidelity data assets.

In this role, you will work closely with our Product Managers, Data Scientists, and Software Engineers to build the solution architecture that will support customer objectives. You'll work with some of the brightest minds in the industry, work with one of the richest healthcare data sets in the world, use cutting-edge technology, and see your efforts affect products and people on a regular basis. The ideal candidate is someone that

• Has healthcare experience and is passionate about helping heal people,
• Loves working with data,
• Has an obsessive focus on data quality,
• Is comfortable with ambiguity and making decisions based on available data and reasonable assumptions,
• Has strong data interrogation and analysis skills,
• Defaults to written communication and delivers clean documentation, and,
• Enjoys working with customers and problem solving for them.

A day in the life at Innovaccer:

• Define the end-to-end solution architecture for projects by mapping customers’ business and technical requirements against the suite of Innovaccer products and Solutions.
• Measure and communicate impact to our customers.
• Enabling customers on how to activate data themselves using SQL, BI tools, or APIs to solve questions they have at speed.

What You Need:

• 4+ years of experience in a Data Engineering role, a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
• 4+ years of experience working with relational databases like Snowflake, Redshift, or Postgres.
• Intermediate to advanced level SQL programming skills.
• Data Analytics and Visualization (using tools like PowerBI)
• The ability to engage with both the business and technical teams of a client - to document and explain technical problems or concepts in a clear and concise way.
• Ability to work in a fast-paced and agile environment.
• Easily adapt and learn new things whether it’s a new library, framework, process, or visual design concept.

What we offer:

• Industry certifications: We want you to be a subject matter expert in what you do. So, whether it’s our product or our domain, we’ll help you dive in and get certified.
• Quarterly rewards and recognition programs: We foster learning and encourage people to take risks. We recognize and reward your hard work.
• Health benefits: We cover health insurance for you and your loved ones.
• Sabbatical policy: We encourage people to take time off and rejuvenate, learn new skills, and pursue their interests so they can generate new ideas with Innovaccer.
• Pet-friendly office and open floor plan: No boring cubicles.

 Strong experience on SQL and relational databases

• Good programming exp on Scala & Spark
• Good exp on ETL batch data pipelines development and migration/upgrading
• Python – Good to have.
• AWS – Good to have
• Knowledgeable in the areas of Big data/Hadoop/S3/HIVE. Nice to have exp on ETL frameworks (ex: Airflow, Flume, Oozie etc.)
• Ability to work independently, take ownership and strong troubleshooting/debugging skills
• Good communication and collaboration skills

• Gathering project requirements from customers and supporting their requests.
• Creating project estimates and scoping the solution based on clients’ requirements.
• Delivery on key project milestones in line with project Plan/ Budget.
• Establishing individual project plans and working with the team in prioritizing production schedules.
• Communication of milestones with the team and to clients via scheduled work-in-progress meetings
• Designing and documenting product requirements.
• Possess good analytical skills - detail-orientemd
• Be familiar with Microsoft applications and working knowledge of MS Excel
• Knowledge of MIS Reports & Dashboards
• Maintaining strong customer relationships with a positive, can-do attitude

• Expertise in designing and implementing enterprise scale database (OLTP) and Data warehouse solutions.
• Hands on experience in implementing Azure SQL Database, Azure SQL Date warehouse (Azure Synapse Analytics) and big data processing using Azure Databricks and Azure HD Insight.
• Expert in writing T-SQL programming for complex stored procedures, functions, views and query optimization.
• Should be aware of Database development for both on-premise and SAAS Applications using SQL Server and PostgreSQL.
• Experience in ETL and ELT implementations using Azure Data Factory V2 and SSIS.
• Experience and expertise in building machine learning models using Logistic and linear regression, Decision tree  and Random forest Algorithms.
• PolyBase queries for exporting and importing data into Azure Data Lake.
• Building data models both tabular and multidimensional using SQL Server data tools.
• Writing data preparation, cleaning and processing steps using Python, SCALA, and R.
• Programming experience using python libraries NumPy, Pandas and Matplotlib.
• Implementing NOSQL databases and writing queries using cypher.
• Designing end user visualizations using Power BI, QlikView and Tableau.
• Experience working with all versions of SQL Server 2005/2008/2008R2/2012/2014/2016/2017/2019
• Experience using the expression languages MDX and DAX.
• Experience in migrating on-premise SQL server database to Microsoft Azure.
• Hands on experience in using Azure blob storage, Azure Data Lake Storage Gen1 and Azure Data Lake Storage Gen2.
• Performance tuning complex SQL queries, hands on experience using SQL Extended events.
• Data modeling using Power BI for Adhoc reporting.
• Raw data load automation using T-SQL and SSIS
• Expert in migrating existing on-premise database to SQL Azure.
• Experience in using U-SQL for Azure Data Lake Analytics.
• Hands on experience in generating SSRS reports using MDX.
• Experience in designing predictive models using Python and SQL Server.
• Developing machine learning models using Azure Databricks and SQL Server