Ab>initio, Big Data, Informatica, Tableau, Data Architect, Cognos, Microstrategy, Healther Business Analysts, Cloud etc.

• Working knowledge of setting up and running HD insight applications
• Hands on experience in Spark, Scala & Hive
• Hands on experience in ADF – Azure Data Factory
• Hands on experience in Big Data & Hadoop ECO Systems
•  Exposure to Azure Service categories like PaaS components and IaaS subscriptions
• Ability to Design, Develop ingestion & processing frame work for ETL applications
• Hands on experience in powershell scripting, deployment on Azure
• Experience in performance tuning and memory configuration
• Should be adaptable to learn & work on new technologies
• Should have Communication Good written and spoken

Qualifications

● Bachelor's degree in Mathematics, Statistics, a relevant technical field, or equivalent practical

experience (or) degree in an analytical field (e.g. Computer Science, Engineering, Mathematics,

Statistics, Operations Research, Management Science)

● 3+ years experience with data analysis and metrics development

● 3+ years experience analyzing and interpreting data, drawing conclusions, defining

recommended actions, and reporting results across stakeholders

● 2+ years experience writing SQL queries

● 2+ years experience scripting in Python

● Demonstrated curiosity in and excitement for Web3/blockchain technologies

● Interested in learning new technologies to solve customer needs with lots of creative freedom

● Strong communication skills and business acumen

● Self-starter, motivated by an interest for developing the best possible solutions to problems

● Experience with Google Cloud - Bigquery, DataBricks stack, DBT, Tableu, Jupyter is a plus

About Company

Our client is the worlds largest media investment company and a global digital transformation agency with 1200 employees across 21 nations. They support clients in programmatic, social, paid search, analytics, technology, organic search, affiliate marketing, e-commerce and across traditional channels

About The Role

· Provide support on Campaign Measurement, Brand Lift studies, Reporting and other data needs (ingestion, cleaning, delivery etc.)

· Code in SQL, Python to create reports and build dashboards.

· Use Bigquery, Python, Datalab (GCP) and automate recurring workloads to improve efficiency

· Maintain underlying data infrastructure and troubleshoot data issues

· Generate meaningful insights from data using advanced analytics/statistical techniques and create dashboards and presentations for wider teams.

· Liaise closely with clients (internally and externally) on projects and work with key stakeholders to assess project needs and ensure best-in-class work is being delivered.

A bit about yourself

· 0-2 years of experience required

· Programming skills in SQL, Python/R

· Logical thinking and problem solving skills

· Strong communication skills (verbal & written)

· Adherence to quality & ability to plan & prioritize the work

· Passionate about data analysis, ability to troubleshoot data anomalies, pulling data from several sources, integrating it to create data layers

· Experience in applying big data, statistics, analytical techniques and technology to solve client problems will be plus

· Experience in creating dashboards, reports, presentations and finding insights, and strong business acumen to provide actionable strategic recommendations will be plus.

Data Engineer JD:

• Designing, developing, constructing, installing, testing and maintaining the complete data management & processing systems.
• Building highly scalable, robust, fault-tolerant, & secure user data platform adhering to data protection laws.
• Taking care of the complete ETL (Extract, Transform & Load) process.
• Ensuring architecture is planned in such a way that it meets all the business requirements.
• Exploring new ways of using existing data, to provide more insights out of it.
• Proposing ways to improve data quality, reliability & efficiency of the whole system.
• Creating data models to reduce system complexity and hence increase efficiency & reduce cost.
• Introducing new data management tools & technologies into the existing system to make it more efficient.
• Setting up monitoring and alarming on data pipeline jobs to detect failures and anomalies

What do we expect from you?

• BS/MS in Computer Science or equivalent experience
• 5 years of recent experience in Big Data Engineering.
• Good experience in working with Hadoop and Big Data technologies like HDFS, Pig, Hive, Zookeeper, Storm, Spark, Airflow and NoSQL systems
• Excellent programming and debugging skills in Java or Python.
• Apache spark, python, hands on experience in deploying ML models
• Has worked on streaming and realtime pipelines
• Experience with Apache Kafka or has worked with any of Spark Streaming, Flume or Storm

Focus Area:

Requirements:

• Retrieve Data from Databases

SSRS developers optimize SQL server queries to retrieve data efficiently and quickly. As

teams submit requests for different ways of doing things, SSRS developers work with them to find solutions that meet their needs.

• Design Data Solutions

To create and design best-practice data warehouse solutions that support business reporting tasks. This is achieved using different programs and software, such as Microsoft Excel, MS SQL Server, and Tableau.

• Create and Maintain Reporting Processes

To maintain a record of the different reporting processes in place. Evolve ways & means for a more effective data management.

• Resolve IT and Data Issues
• Provide Delivery Plans and Estimates for Projects

• Must Have 3-4 Experience in SSIS, Mysql
• Good Experience in Tableau
• Experience in SQL Server.
• 1+ year of Experience in Tableau
• Knowledge of ETL Tool
• Knowledge of Dataware Housing

1. Proven experience with deploying and tuning Open Source components into enterprise ready production tooling Experience with datacentre (Metal as a Service – MAAS) and cloud deployment technologies (AWS or GCP Architect certificates required)
2. Deep understanding of Linux from kernel mechanisms through user space management
3. Experience on CI/CD (Continuous Integrations and Deployment) system solutions (Jenkins).
4. Using Monitoring tools (local and on public cloud platforms) Nagios, Prometheus, Sensu, ELK, Cloud Watch, Splunk, New Relic etc. to trigger instant alerts, reports and dashboards.  Work closely with the development and infrastructure teams to analyze and design solutions with four nines (99.99%) up-time, globally distributed, clustered, production and non-production virtualized infrastructure. 
5. Wide understanding of IP networking as well as data centre infrastructure

1. Expert with software development tools and sourcecode management, understanding, managing issues, code changes and grouping them into deployment releases in a stable and measurable way to maximize production Must be expert at developing and using ansible roles and configuring deployment templates with jinja2.
2. Solid understanding of data collection tools like Flume, Filebeat, Metricbeat, JMX Exporter agents.
3. Extensive experience operating and tuning the kafka streaming data platform, specifically as a message queue for big data processing
4. Strong understanding and must have experience:
5. Apache spark framework, specifically spark core and spark streaming, 
6. Orchestration platforms, mesos and kubernetes, 
7. Data storage platforms, elasticstack, carbon, clickhouse, cassandra, ceph, hdfs
8. Core presentation technologies kibana, and grafana.
9. Excellent scripting and programming skills (bash, python, java, go, rust). Must have previous experience with “rust” in order to support, improve in house developed products

Red Hat Certified Architect certificate or equivalent required CCNA certificate required 3-5 years of experience running open source big data platforms