Sr. Data Engineer DataBricks

Looking for freelance?

We are seeking a freelance Data Engineer with 7+ years of experience

Skills Required: Deep knowledge in any cloud (AWS, Azure , Google cloud), Data bricks, Data lakes, Data Ware housing Python/Scala , SQL, BI, and other analytics systems

What we are looking for

We are seeking an experienced Senior Data Engineer with experience in architecture, design, and development of highly scalable data integration and data engineering processes

• The Senior Consultant must have a strong understanding and experience with data & analytics solution architecture, including data warehousing, data lakes, ETL/ELT workload patterns, and related BI & analytics systems
• Strong in scripting languages like Python, Scala
• 5+ years of hands-on experience with one or more of these data integration/ETL tools.
• Experience building on-prem data warehousing solutions.
• Experience with designing and developing ETLs, Data Marts, Star Schema
• Designing a data warehouse solution using Synapse or Azure SQL DB
• Experience building pipelines using Synapse or Azure Data Factory to ingest data from various sources
• Understanding of integration run times available in Azure.
• Advanced working SQL knowledge and experience working with relational databases, and queries. authoring (SQL) as well as working familiarity with a variety of database

Data Analyst

Job Description

Are you passionate about handling large & complex data problems, want to make an impact and have the desire to work on ground-breaking big data technologies? Then we are looking for you.

At Amagi, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Amagi’s Data Engineering and Business Intelligence team is looking for passionate, detail-oriented, technical savvy, energetic team members who like to think outside the box.

Amagi’s Data warehouse team deals with petabytes of data catering to a wide variety of real-time, near real-time and batch analytical solutions. These solutions are an integral part of business functions such as Sales/Revenue, Operations, Finance, Marketing and Engineering, enabling critical business decisions. Designing, developing, scaling and running these big data technologies using native technologies of AWS and GCP are a core part of our daily job.

• Experience in building highly cost optimised data analytics solutions
• Experience in designing and building dimensional data models to improve accessibility, efficiency and quality of data
• Experience (hands on) in building high quality ETL applications, data pipelines and analytics solutions ensuring data privacy and regulatory compliance.
• Experience in working with AWS or GCP
• Experience with relational and NoSQL databases
• Experience to full stack web development (Preferably Python)
• Expertise with data visualisation systems such as Tableau and Quick Sight
• Proficiency in writing advanced SQL queries with expertise in performance tuning handling large data volumes
• Familiarity with ML/AÍ technologies is a plus
• Demonstrate strong understanding of development processes and agile methodologies
• Strong analytical and communication skills. Should be self-driven, highly motivated and ability to learn quickly

Data Analytics is at the core of our work, and you will have the opportunity to:

• Design Data-warehousing solutions on Amazon S3 with Athena, Redshift, GCP Bigtable etc
• Lead quick prototypes by integrating data from multiple sources
• Do advanced Business Analytics through ad-hoc SQL queries
• Work on Sales Finance reporting solutions using tableau, HTML5, React applications

We build amazing experiences and create depth in knowledge for our internal teams and our leadership. Our team is a friendly bunch of people that help each other grow and have a passion for technology, R&D, modern tools and data science.

Our work relies on deep understanding of the company needs and an ability to go through vast amounts of internal data such as sales, KPIs, forecasts, Inventory etc. One of the key expectations of this role would be to do data analytics, building data lakes, end to end reporting solutions etc. If you have a passion for cost optimised analytics and data engineering and are eager to learn advanced data analytics at a large scale, this might just be the job for you..

A bachelor’s/master’s degree in Computer Science with 5 to 7 years of experience and previous experience in data engineering is a plus.

Senior Data Scientist-Job Description

The Senior Data Scientist role is a creative problem solver who utilizes statistical/mathematical principles and modelling skills to uncover new insights that will significantly and meaningfully impact business decisions and actions.  She/he applies their data science expertise in identifying, defining, and executing state-of-art techniques for academic opportunities and business objectives in collaboration with other Analytics team members. The Senior Data Scientist will execute analyses & outputs spanning test design and measurement, predictive analytics, multivariate analysis, data/text mining, pattern recognition, artificial intelligence, and machine learning.

Key Responsibilities:

• Perform the full range of data science activities including test design and measurement, predictive/advanced analytics, and data mining, and analytic dashboards.
• Extract, manipulate, analyse & interpret data from various corporate data sources developing advanced analytic solutions, deriving key observations, findings, insights, and formulating actionable recommendations.
• Generate clearly understood and intuitive data science / advanced analytics outputs.
• Provide thought leadership and recommendations on business process improvement, analytic solutions to complex problems.
• Participate in best practice sharing and communication platform for advancement of the data science discipline.
• Coach and collaborate with other data scientists and data analysts.
• Present impact, insights, outcomes & recommendations to key business partners and stakeholders.
• Comply with established Service Level Agreements to ensure timely, high quality deliverables with value-add recommendations, clearly articulated key findings and observations.

Qualification:

• Bachelor's Degree (B.A./B.S.) or Master’s Degree (M.A./M.S.) in Computer Science, Statistics, Mathematics, Machine Learning, Physics, or similar degree
• 5+ years of experience in data science in a digitally advanced industry focusing on strategic initiatives, marketing and/or operations.
• Advanced knowledge of best-in-class analytic software tools and languages: Python, SQL, R, SAS, Tableau, Excel, PowerPoint.
• Expertise in statistical methods, statistical analysis, data visualization, and data mining techniques.
• Experience in Test design, Design of Experiments, A/B Testing, Measurement Science Strong influencing skills to drive a robust testing agenda and data driven decision making for process improvements
• Strong Critical thinking skills to track down complex data and engineering issues, evaluate different algorithmic approaches, and analyse data to solve problems.
• Experience in partnering with IT, marketing operations & business operations to deploy predictive analytic solutions.
• Ability to translate/communicate complex analytical/statistical/mathematical concepts with non-technical audience.
• Strong written and verbal communications skills, as well as presentation skills.

We are looking for a data scientist that will help us to discover the information hidden in vast amounts of data, and help us make smarter decisions to deliver even better products. Your primary focus will be in applying data mining techniques, doing statistical analysis, and building high quality prediction systems integrated with our products. 

• Selecting features, building and optimizing classifiers using machine learning techniques
• Data mining using state-of-the-art methods
• Extending company’s data with third party sources of information when needed
• Enhancing data collection procedures to include information that is relevant for building analytic systems
• Processing, cleansing, and verifying the integrity of data used for analysis
• Doing ad-hoc analysis and presenting results in a clear manner
• Creating automated anomaly detection systems and constant tracking of its performance

• Excellent understanding of machine learning techniques and algorithms, such as Linear regression, SVM, Decision Forests, LSTM, CNN etc.
• Experience with Deep Learning preferred.
• Experience with common data science toolkits, such as R, NumPy, MatLab, etc. Excellence in at least one of these is highly desirable
• Great communication skills
• Proficiency in using query languages such as SQL, Hive, Pig 
• Good applied statistics skills, such as statistical testing, regression, etc.
• Good scripting and programming skills 
• Data-oriented personality