
Data Engineer- Pyspark+SQL (Onsite opportunity- UAE Abu Dhabi/Dubai)
at UAE Client
- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
- Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
- Designing and implementing data engineering, ingestion, and transformation functions
-
Azure Synapse or Azure SQL data warehouse
-
Spark on Azure is available in HD insights and data bricks

Similar jobs
Innovate and develop interactive ways to enhance English learning through real-world activities. This role is ideal for those passionate about language education and creative teaching methods.
Benefits:
● Experience in language learning methodologies
● Opportunity to develop experiential learning programs
● Hands-on teaching experience
Key Responsibilities:
✔ Design real-world activities to enhance English learning
✔ Conduct interactive and engaging sessions
✔ Work with students to improve communication skills
Requirements:
● Strong command of English language and communication skills
● Creativity in designing experiential learning methods




Roles and Responsibilities
1) Understand client requirements and functionalities.
2) Write well-designed, testable, efficient code.
3) Responsible for solving complex technical issues.
4) Ensure quality projects are delivered within defined timelines.
5) Active involvement in client communication to understand functional requirements.
6) Maintain high standards of quality for code, documentation and other deliverables.
Required Skills
1) Good experience in React
2) Hand on Node.JS./Express JS
3) Database : MYSQL/MongoDB
4) Experience in Java Script, Typescript.
5)Good experience in HTML5, CSS3, JavaScript, Jquery
6) Experience working in an Agile environment.
7) Good communication skills.



• Strong proficiency with Java programming & DevOps
• -Must have experience on Micro-Services using Spring boot/Jersy/Swagger.
• Must havegood knowledge on Dockers.
• Must have at least 1to 2 years’ experience of Web application
• Knowledge of OOP concepts, industry best practices and design
• Well versed Back-end build pipelines and tools-Professional, precise communication
skills
• Work experience writing Unit Tests
• Work experience on applying the best practices ofWeb Applicationdevelopment
• Working experience in an Agile team especially with SCRUM
• Good understandingof DevOps, CI/CD principles and practices
toimprove Software Quality & Efficienc
• Good understanding of web technology/enterprise level applications
• Good to have experience in in JavaScript frameworks
• Good to have experience in Agile Methodology
• Good to have previously worked on distributed systems
• Good to have working knowledge on Kafka and Redis
• Good to have exposure to stream processing and functional
programming
CANDIDATES MUST HAVE
• JAVA 8 or above
• DevOps
• 1+years of Web Development experience
• Javascript Framework
• Hibernate &Mircroservices
Who are we?
We are a venture capital-backed software development company headquartered in Canada. We develop in-house products to disrupt one industry at a time and partner as a technology service provider to selected startups.
Who are you?
Experience in writing applications using Nodejs including Express or similar.
Must be good in MySQL or one of the databases such as Mongo.
Proficient in Javascript and good experience and knowledge of open source tools, frameworks, broader cutting-edge technologies around server-side development.
Excellent data structure, algorithm, and problem-solving skills.
Created and consumed various APIs in the past.
Should be an active contributor to developer communities like Stack Overflow, GitHub, Google Developer Groups (GDGs).
Customer-focused, react well to changes, work with teams, and able to multi-task.
Must be a proven performer and team player that enjoys challenging assignments in a high-energy, fast-growing, and start-up workplace.
Must be a self-starter who can work well with minimal guidance and in a fluid environment.
Some of the technologies we use are:
NodeJS
ExpressJS
Angular 9
AWS
Github
PSQL, MongoDB
Selenium
- Looking for a highly capable Node.js developer to optimize our web-based application performance.
- Developing and maintaining all server-side network components.
- Ensuring optimal performance of the central database and responsiveness to front-end requests.
- Designing customer-facing UI and back-end services for various business processes.
- Qualification: Bachelor's degree in computer science, information science, or similar.
- Should have 4 years' experience as a node js developer.
- Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
- Knowledge of front-end technologies such as HTML5 and CSS3.
- Superb interpersonal, communication, and collaboration skills.
- Exceptional analytical and problem-solving aptitude.
- Great organizational and time management skills.
- Salary is negotiable for right fit.
Job brief
We are looking for a Full Stack Developer to produce scalable software solutions. Youll be part of a cross-functional team thats responsible for the full software development life cycle, from conception to deployment.
As a Full Stack Developer, you should be comfortable around both front-end and back-end coding languages, development frameworks and third-party libraries. You should also be a team player with a knack for visual design and utility.
Responsibilities
- Work with development team and product managers to ideate software solutions.
- Design client-side and server-side architecture.
- Build the front-end of applications through appealing visual design.
- Develop and manage well-functioning databases and applications.
- Write effective APIs.
- Test software to ensure responsiveness and efficiency.
- Troubleshoot, debug and upgrade software.
- Create security and data protection settings.
- Build features and applications with a mobile responsive design in mind.
- Write technical documentation.
Requirements
- B.E./B.Tech. in Computer Science or a degree in Computer Science background.
- Experience as a Full Stack Developer or similar role (1-2 years)
- Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript, jQuery)
- Knowledge of back-end languages and JavaScript frameworks (e.g. React and Node.js)
- Familiarity with MongoDB, web servers, and UI/UX design.
- Excellent communication and teamwork skills.
- Great attention to detail.
- Organizational skills.
- An analytical mind.
- Knowledge of Cloud Platforms like AWS or GCP.



About us
DataWeave provides Retailers and Brands with “Competitive Intelligence as a Service” that enables them to take key decisions that impact their revenue. Powered by AI, we provide easily consumable and actionable competitive intelligence by aggregating and analyzing billions of publicly available data points on the Web to help businesses develop data-driven strategies and make smarter decisions.
Data Science@DataWeave
We the Data Science team at DataWeave (called Semantics internally) build the core machine learning backend and structured domain knowledge needed to deliver insights through our data products. Our underpinnings are: innovation, business awareness, long term thinking, and pushing the envelope. We are a fast paced labs within the org applying the latest research in Computer Vision, Natural Language Processing, and Deep Learning to hard problems in different domains.
How we work?
It's hard to tell what we love more, problems or solutions! Every day, we choose to address some of the hardest data problems that there are. We are in the business of making sense of messy public data on the web. At serious scale!
What do we offer?
● Some of the most challenging research problems in NLP and Computer Vision. Huge text and image
datasets that you can play with!
● Ability to see the impact of your work and the value you're adding to our customers almost immediately.
● Opportunity to work on different problems and explore a wide variety of tools to figure out what really
excites you.
● A culture of openness. Fun work environment. A flat hierarchy. Organization wide visibility. Flexible
working hours.
● Learning opportunities with courses and tech conferences. Mentorship from seniors in the team.
● Last but not the least, competitive salary packages and fast paced growth opportunities.
Who are we looking for?
The ideal candidate is a strong software developer or a researcher with experience building and shipping production grade data science applications at scale. Such a candidate has keen interest in liaising with the business and product teams to understand a business problem, and translate that into a data science problem.
You are also expected to develop capabilities that open up new business productization opportunities.
We are looking for someone with a Master's degree and 1+ years of experience working on problems in NLP or Computer Vision.
If you have 4+ years of relevant experience with a Master's degree (PhD preferred), you will be considered for a senior role.
Key problem areas
● Preprocessing and feature extraction noisy and unstructured data -- both text as well as images.
● Keyphrase extraction, sequence labeling, entity relationship mining from texts in different domains.
● Document clustering, attribute tagging, data normalization, classification, summarization, sentiment
analysis.
● Image based clustering and classification, segmentation, object detection, extracting text from images,
generative models, recommender systems.
● Ensemble approaches for all the above problems using multiple text and image based techniques.
Relevant set of skills
● Have a strong grasp of concepts in computer science, probability and statistics, linear algebra, calculus,
optimization, algorithms and complexity.
● Background in one or more of information retrieval, data mining, statistical techniques, natural language
processing, and computer vision.
● Excellent coding skills on multiple programming languages with experience building production grade
systems. Prior experience with Python is a bonus.
● Experience building and shipping machine learning models that solve real world engineering problems.
Prior experience with deep learning is a bonus.
● Experience building robust clustering and classification models on unstructured data (text, images, etc).
Experience working with Retail domain data is a bonus.
● Ability to process noisy and unstructured data to enrich it and extract meaningful relationships.
● Experience working with a variety of tools and libraries for machine learning and visualization, including
numpy, matplotlib, scikit-learn, Keras, PyTorch, Tensorflow.
● Use the command line like a pro. Be proficient in Git and other essential software development tools.
● Working knowledge of large-scale computational models such as MapReduce and Spark is a bonus.
● Be a self-starter—someone who thrives in fast paced environments with minimal ‘management’.
● It's a huge bonus if you have some personal projects (including open source contributions) that you work
on during your spare time. Show off some of your projects you have hosted on GitHub.
Role and responsibilities
● Understand the business problems we are solving. Build data science capability that align with our product strategy.
● Conduct research. Do experiments. Quickly build throw away prototypes to solve problems pertaining to the Retail domain.
● Build robust clustering and classification models in an iterative manner that can be used in production.
● Constantly think scale, think automation. Measure everything. Optimize proactively.
● Take end to end ownership of the projects you are working on. Work with minimal supervision.
● Help scale our delivery, customer success, and data quality teams with constant algorithmic improvements and automation.
● Take initiatives to build new capabilities. Develop business awareness. Explore productization opportunities.
● Be a tech thought leader. Add passion and vibrance to the team. Push the envelope. Be a mentor to junior members of the team.
● Stay on top of latest research in deep learning, NLP, Computer Vision, and other relevant areas.

