Data Engineer

Power BI Developer(Azure Developer )

Job Description:

Senior visualization engineer with understanding in Azure Data Factory & Databricks to develop and deliver solutions that enable delivery of information to audiences in support of key business processes.

Ensure code and design quality through execution of test plans and assist in development of standards & guidelines working closely with internal and external design, business and technical counterparts.

Desired Competencies:

• Strong designing concepts of data visualization centered on business user and a knack of communicating insights visually.
• Ability to produce any of the charting methods available with drill down options and action-based reporting. This includes use of right graphs for the underlying data with company themes and objects.
• Publishing reports & dashboards on reporting server and providing role-based access to users.
• Ability to create wireframes on any tool for communicating the reporting design.
• Creation of ad-hoc reports & dashboards to visually communicate data hub metrics (metadata information) for top management understanding.
• Should be able to handle huge volume of data from databases such as SQL Server, Synapse, Delta Lake or flat files and create high performance dashboards.
• Should be good in Power BI development
• Expertise in 2 or more BI (Visualization) tools in building reports and dashboards.
• Understanding of Azure components like Azure Data Factory, Data lake Store, SQL Database, Azure Databricks
• Strong knowledge in SQL queries
• Must have worked in full life-cycle development from functional design to deployment
• Intermediate understanding to format, process and transform data
• Should have working knowledge of GIT, SVN
• Good experience in establishing connection with heterogeneous sources like Hadoop, Hive, Amazon, Azure, Salesforce, SAP, HANA, API’s, various Databases etc.
• Basic understanding of data modelling and ability to combine data from multiple sources to create integrated reports

Preferred Qualifications:

• Bachelor's degree in Computer Science or Technology
• Proven success in contributing to a team-oriented environment

About Us:

6sense is a Predictive Intelligence Engine that is reimagining how B2B companies do

sales and marketing. It works with big data at scale, advanced machine learning and

predictive modelling to find buyers and predict what they will purchase, when and

how much.

6sense helps B2B marketing and sales organizations fully understand the complex ABM

buyer journey. By combining intent signals from every channel with the industry’s most

advanced AI predictive capabilities, it is finally possible to predict account demand and

optimize demand generation in an ABM world. Equipped with the power of AI and the

6sense Demand PlatformTM, marketing and sales professionals can uncover, prioritize,

and engage buyers to drive more revenue.

6sense is seeking a Staff Software Engineer and data to become part of a team

designing, developing, and deploying its customer-centric applications.

We’ve more than doubled our revenue in the past five years and completed our Series

E funding of $200M last year, giving us a stable foundation for growth.

Responsibilities:

1. Own critical datasets and data pipelines for product & business, and work

towards direct business goals of increased data coverage, data match rates, data

quality, data freshness

2. Create more value from various datasets with creative solutions, and unlocking

more value from existing data, and help build data moat for the company3. Design, develop, test, deploy and maintain optimal data pipelines, and assemble

large, complex data sets that meet functional and non-functional business

requirements

4. Improving our current data pipelines i.e. improve their performance, SLAs,

remove redundancies, and figure out a way to test before v/s after roll out

5. Identify, design, and implement process improvements in data flow across

multiple stages and via collaboration with multiple cross functional teams eg.

automating manual processes, optimising data delivery, hand-off processes etc.

6. Work with cross function stakeholders including the Product, Data Analytics ,

Customer Support teams for their enablement for data access and related goals

7. Build for security, privacy, scalability, reliability and compliance

8. Mentor and coach other team members on scalable and extensible solutions

design, and best coding standards

9. Help build a team and cultivate innovation by driving cross-collaboration and

execution of projects across multiple teams

Requirements:

 8-10+ years of overall work experience as a Data Engineer

 Excellent analytical and problem-solving skills

 Strong experience with Big Data technologies like Apache Spark. Experience with

Hadoop, Hive, Presto would-be a plus

 Strong experience in writing complex, optimized SQL queries across large data

sets. Experience with optimizing queries and underlying storage

 Experience with Python/ Scala

 Experience with Apache Airflow or other orchestration tools

 Experience with writing Hive / Presto UDFs in Java

 Experience working on AWS cloud platform and services.

 Experience with Key Value stores or NoSQL databases would be a plus.

 Comfortable with Unix / Linux command line

Interpersonal Skills:

 You can work independently as well as part of a team.

 You take ownership of projects and drive them to conclusion.

 You’re a good communicator and are capable of not just doing the work, but also

teaching others and explaining the “why” behind complicated technical

decisions.

 You aren’t afraid to roll up your sleeves: This role will evolve over time, and we’ll

want you to evolve with it

1. Strong communication skills are essential, as the selected candidate will be responsible for leading a team of two in the future.
2. Proficiency in SQL.
3. Expertise in Data Modelling.
4. Experience with Azure Data Factory (ADF).
5. Competence in Power BI.
6. SQL – Should be strong in Data Modeling , Tables Design and SQL Queries.
7. ADF – Must have hands-on experience in ADF pipelines and its set-up from End-to-End in Azure including subscriptions, IR and Resource Group creations.
8. Power BI – Hands-on knowledge in Power BI reports including documentation and follow existing standards.

Responsibilities

> Selecting features, building and optimizing classifiers using machine

> learning techniques

> Data mining using state-of-the-art methods

> Extending company’s data with third party sources of information when

> needed

> Enhancing data collection procedures to include information that is

> relevant for building analytic systems

> Processing, cleansing, and verifying the integrity of data used for

> analysis

> Doing ad-hoc analysis and presenting results in a clear manner

> Creating automated anomaly detection systems and constant tracking of

> its performance

Key Skills

> Hands-on experience of analysis tools like R, Advance Python

> Must Have Knowledge of statistical techniques and machine learning

> algorithms

> Artificial Intelligence

> Understanding of Text analysis- Natural Language processing (NLP)

> Knowledge on Google Cloud Platform

> Advanced Excel, PowerPoint skills

> Advanced communication (written and oral) and strong interpersonal

> skills

> Ability to work cross-culturally

> Good to have Deep Learning

> VBA and visualization tools like Tableau, PowerBI, Qliksense, Qlikview

> will be an added advantage

Roles and Responsibilities:

• Create logical and physical data models using best practices to ensure high data quality and reduced redundancy.

• Create or manage ETL batches and jobs.

• Understand and translate business needs into data models supporting long-term solutions.

• Analyze data-related system integration challenges and propose appropriate solutions.

• Enhance data collection procedures to include information that is relevant for building analytic systems.

Skills Required:

• 6+ years of industry experience with 3+ years in the role of BI Developer

Desired Technical Skills:

• In-depth understanding of database management systems, online analytical processing (OLAP), and ETL (Extract, transform, load) framework.

• Understanding of data modeling, processing, warehousing techniques, and related tools (Erwin or ER Studio or others) required.

• Ability to create KPIs, visualizations, reports and dashboards based on business requirement.

• Knowledge and experience in prototyping, designing, and requirement analysis.

• Experience of Pentaho Business Analytics Platform

• Analytical thinking for translating data into informative reports and visuals.

• Solid experience in writing SQL, stored procedures, proficient in SQL query performance tuning.

• Developing visual reports, KPI scorecards, and dashboards using any one of the following tools like Pentaho BI solutions/Business Object, OBIEE or Micro Strategy.

• Knowledge of Relational Database Management Systems (RDBMS) like Oracle, MySQL, or MSSQL.

• Strong PL/SQL knowledge is an advantage.

• Good communication, comprehension, and analytical skills.

Desired Business Skills:

• Property and Casualty Insurance experience is strongly preferred.

• Well-versed in software processes and methodologies

• Excellent verbal, written, and presentation skills.

• Excellent interpersonal skills.

• A quick learner with a strong analytical mindset.

• Excellent organizational and follow-up skills and the ability to meet time sensitive deadlines.

Primary Skills:

PL/SQL, Pentaho Business Analytics Platform, OLAP, ETL Framework, Stored Procedures, SQL Query Performance Tuning

Responsibilities 

• Identify, analyze, and interpret trends or patterns in complex data sets to develop a thorough understanding of users, and acquisition channels.
• Run exploratory analysis uncover new areas of opportunity, generate hypotheses, and quickly assess the potential upside of a given opportunity.
• Help execute projects to drive insights that lead to growth.
• Work closely with marketing, design, product, support, and engineering to anticipate analytics needs and to quantify the impact of existing features, future product changes, and marketing campaigns.
• Work with data engineering to develop and implement new analytical tools and improve our underlying data infrastructure. Build tracking plans for new and existing products and work with engineering to ensure proper
• Analyze, forecast, and build custom reports to make key performance indicators and insights available to the entire company.
• Monitor, optimize, and report on marketing and growth metrics and split-test results. Make recommendations based on analytics and test findings.
• Drive optimization and data minded culture inside the company.
• Develop frameworks, models, tools, and processes to ensure that analytical insights can be incorporated into all key decision making.
• Effectively present and communicate analysis to the company to drive business decisions.
• Create a management dashboard including all important KPIs to be tracked on a company and department level

• Establish end to end campaign ROI tracking mechanism to attribute sales to specific google and Facebook campaigns

Skills and Experience

• Minimum 1-2 years of proven work experience in a data analyst role.
• Excellent analytical skills and problem-solving ability; the ability to answer unstructured business questions and work independently to drive projects to conclusion.
• Strong analytical skills with the capacity to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Experience extracting insights using advanced SQL or similar tool to work efficiently at scale. Advanced expertise with commonly used analytics tools including Google Analytics, studio and Excel.
• Strong knowledge of statistics, this includes experimental design for optimization, statistical significance, confidence intervals and predictive analytics techniques.
• Must be self-directed, organized and detail oriented as well as have the ability to multitask and work effectively in a fast-paced environment.
• Active team player, excellent communication skills, positive attitude and good work ethic.

We are looking for an outstanding ML Architect (Deployments) with expertise in deploying Machine Learning solutions/models into production and scaling them to serve millions of customers. A candidate with an adaptable and productive working style which fits in a fast-moving environment.

Skills:

- 5+ years deploying Machine Learning pipelines in large enterprise production systems.

- Experience developing end to end ML solutions from business hypothesis to deployment / understanding the entirety of the ML development life cycle.
- Expert in modern software development practices; solid experience using source control management (CI/CD).
- Proficient in designing relevant architecture / microservices to fulfil application integration, model monitoring, training / re-training, model management, model deployment, model experimentation/development, alert mechanisms.
- Experience with public cloud platforms (Azure, AWS, GCP).
- Serverless services like lambda, azure functions, and/or cloud functions.
- Orchestration services like data factory, data pipeline, and/or data flow.
- Data science workbench/managed services like azure machine learning, sagemaker, and/or AI platform.
- Data warehouse services like snowflake, redshift, bigquery, azure sql dw, AWS Redshift.
- Distributed computing services like Pyspark, EMR, Databricks.
- Data storage services like cloud storage, S3, blob, S3 Glacier.
- Data visualization tools like Power BI, Tableau, Quicksight, and/or Qlik.
- Proven experience serving up predictive algorithms and analytics through batch and real-time APIs.
- Solid working experience with software engineers, data scientists, product owners, business analysts, project managers, and business stakeholders to design the holistic solution.
- Strong technical acumen around automated testing.
- Extensive background in statistical analysis and modeling (distributions, hypothesis testing, probability theory, etc.)
- Strong hands-on experience with statistical packages and ML libraries (e.g., Python scikit learn, Spark MLlib, etc.)
- Experience in effective data exploration and visualization (e.g., Excel, Power BI, Tableau, Qlik, etc.)
- Experience in developing and debugging in one or more of the languages Java, Python.
- Ability to work in cross functional teams.
- Apply Machine Learning techniques in production including, but not limited to, neuralnets, regression, decision trees, random forests, ensembles, SVM, Bayesian models, K-Means, etc.

Roles and Responsibilities:

Deploying ML models into production, and scaling them to serve millions of customers.

Technical solutioning skills with deep understanding of technical API integrations, AI / Data Science, BigData and public cloud architectures / deployments in a SaaS environment.

Strong stakeholder relationship management skills - able to influence and manage the expectations of senior executives.
Strong networking skills with the ability to build and maintain strong relationships with both business, operations and technology teams internally and externally.

Provide software design and programming support to projects.

 Qualifications & Experience:

Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Machine Learning Architect (Deployments) or a similar role for 5-7 years.

Datametica is looking for talented SQL engineers who would get training & the opportunity to work on Cloud and Big Data Analytics.

Mandatory Skills:

• Strong in SQL development
• Hands-on at least one scripting language - preferably shell scripting
• Development experience in Data warehouse projects

Opportunities:

• Selected candidates will be provided training opportunities on one or more of the following: Google Cloud, AWS, DevOps Tools, Big Data technologies like Hadoop, Pig, Hive, Spark, Sqoop, Flume, and KafkaWould get a chance to be part of the enterprise-grade implementation of Cloud and Big Data systems
• Will play an active role in setting up the Modern data platform based on Cloud and Big Data
• Would be part of teams with rich experience in various aspects of distributed systems and computing

• Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
• Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. 
• Designing and implementing data engineering, ingestion, and transformation functions

• Experience with Azure Analysis Services
• Experience in Power BI
• Experience with third-party solutions like Attunity/Stream sets, Informatica
• Experience with PreSales activities (Responding to RFPs, Executing Quick POCs)
• Capacity Planning and Performance Tuning on Azure Stack and Spark.