
Data Engineer- Pyspark+SQL (Onsite opportunity- UAE Abu Dhabi/Dubai)
at UAE Client
- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
- Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
- Designing and implementing data engineering, ingestion, and transformation functions
-
Azure Synapse or Azure SQL data warehouse
-
Spark on Azure is available in HD insights and data bricks

Similar jobs


A bit about us
WeatherBug, a division of GroundTruth, empowers people to plan their day thanks to hyperlocal weather forecasts. With 10+ million monthly users, our app and website are favorites on the App Store and Google Play Store. We use a vast network of weather observations and innovative technology to give you real-time forecasts, alerts, and insights. Our team is passionate about enhancing user experiences and always looks for new ways to use weather data to make a difference. Join us at WeatherBug and help people stay informed and prepared for whatever the weather brings. Let's make it happen together!
Learn more: www.weatherbug.com
At GroundTruth, we believe that innovative technology starts with the best talent and we have been ranked one of Ad Age’s Best Places to Work for three years in a row (2021, 2022 & 2023). Learn more about the perks of joining our team here.
Role : Senior Software Engineer (iOS/React Native)
Location : Remote, India
*This role requires Core Work Hours from 8:30 pm to 12:30 am IST (will change as per daylight saving in US). The remaining hours are completed at individual discretion.*
Role Characteristics:
Recognized subject matter expert who knows how to apply theory and put it into practice with in-depth understanding of the professional field with limited oversight from managers. Independently performs the full range of responsibilities within the function; requires deep job knowledge of areas typically obtained through higher education combined with experience. Manages large projects or processes and problems faced are difficult and often complex; analyzes problems/issues of diverse scope and determines solutions. May manage programs that include formulating strategies and administering policies, processes, and resources; functions with a high degree of autonomy. Influences others regarding policies, practices and procedures.
You Will:
- Design, architect, and document the entire system, down to the details, to meet team needs.
- Code robust iOS solutions to solve current problems, identifying and fixing issues within your areas of expertise.
- Act as a CodeOwner and stakeholder in code reviews within your area of expertise.
- Automate unit, integration, and end-to-end testing solutions, working closely with the QA team to ensure seamless integration.
- Deploy and run your code in pre-production to ensure quality before release.
- Develop and maintain debugging tools to enhance team efficiency.
- Collaborate with vendors to ensure third-party SDKs are properly integrated and functional.
- Perform and monitor mobile releases for iOS, ensuring smooth rollouts and updates.
- Retire outdated solutions and resources when no longer needed, ensuring the system remains efficient and streamlined.
- Provide operational support for your deployed code and all code within your domain of expertise.
- Identify and address team-wide issues, preventing problems from occurring.
- Coordinate across all business teams to resolve technical issues, mitigate risks, and provide actionable solutions.
- Perform other job-related duties as assigned
You Have:
- 4-year degree in Computer Science or a related field OR 9+ years of experience in software development.
- 7+ years of experience in software engineering.
- 5+ years of experience with iOS development tools (Swift, SwiftUI, Objective-C, Xcode, Core Data, Combine, Foundation, UIKit).
- 2+ years of experience with SwiftUI or declarative UI frameworks.
- 3+ years of experience on an Agile team.
- Proficiency in Concurrency, Multithreading, and Swift Combine or other asynchronous programming patterns.
- Knowledge of object-oriented design principles, patterns, best practices, performance optimizations, and memory management on iOS.
- Ability to effectively communicate across teams to provide and implement solutions.
- Proven ability to troubleshoot complex issues and execute solutions.
- A strong sense of self-drive and technical expertise to work independently and within a team.
- Mentorship skills to guide junior and mid-level engineers.
- Excellent communication and documentation skills to articulate ideas clearly.
- Strong problem-solving and critical-thinking abilities to handle edge cases and unexpected issues.
- Experience collaborating with cross-functional teams (designers, product managers, QA).
Great if You Have:
- Experience using React Native (Function Components, Hooks, Redux, JavaScript/TypeScript).
- Familiarity with ingesting and exposing large datasets in the weather industry.
- Experience in the advertising industry.
- Proficiency with tools like GitHub, Jenkins, Spinnaker, Artifactory.
What we offer
At WeatherBug, we want our employees to be comfortable with their benefits so they can focus on doing the work they love.
- Parental leave- Maternity and Paternity
- Flexible Time Offs (Earned Leaves, Sick Leaves, Birthday leave, Bereavement leave & Company Holidays)
- In Office Daily Catered Lunch
- Fully stocked snacks/beverages
- Health cover for any hospitalization. Covers both nuclear family and parents
- Tele-med for free doctor consultation, discounts on health checkups and medicines
- Wellness/Gym Reimbursement
- Pet Expense Reimbursement
- Childcare Expenses and reimbursements
- Employee assistance program
- Employee referral program
- Education reimbursement program
- Skill development program
- Cell phone reimbursement (Mobile Subsidy program)
- Internet reimbursement
- Birthday treat reimbursement
- Employee Provident Fund Scheme offering different tax saving options such as VPF and employee and employer contribution up to 12% Basic
- Creche reimbursement
- Co-working space reimbursement
- NPS employer match
- Meal card for tax benefit
- Special benefits on salary account
We are an equal opportunity employer and value diversity, inclusion and equity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.


LogiNext is looking for a technically savvy and passionate Software Engineer - Data Science to analyze large amounts of raw information to find patterns that will help improve our company. We will rely on you to build data products to extract valuable business insights.
In this role, you should be highly analytical with a knack for analysis, math and statistics. Critical thinking and problem-solving skills are essential for interpreting data. We also want to see a passion for machine-learning and research.
Your goal will be to help our company analyze trends to make better decisions. Without knowledge of how the software works, data scientists might have difficulty in work. Apart from experience in developing R and Python, they must know modern approaches to software development and their impact. DevOps continuous integration and deployment, experience in cloud computing are everyday skills to manage and process data.
Responsibilities:
Identify valuable data sources and automate collection processes Undertake preprocessing of structured and unstructured data Analyze large amounts of information to discover trends and patterns Build predictive models and machine-learning algorithms Combine models through ensemble modeling Present information using data visualization techniques Propose solutions and strategies to business challenges Collaborate with engineering and product development teams
Requirements:
Bachelors degree or higher in Computer Science, Information Technology, Information Systems, Statistics, Mathematics, Commerce, Engineering, Business Management, Marketing or related field from top-tier school 2 to 3 year experince in in data mining, data modeling, and reporting. Understading of SaaS based products and services. Understanding of machine-learning and operations research Experience of R, SQL and Python; familiarity with Scala, Java or C++ is an asset Experience using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop) Analytical mind and business acumen and problem-solving aptitude Excellent communication and presentation skills Proficiency in Excel for data management and manipulation Experience in statistical modeling techniques and data wrangling Able to work independently and set goals keeping business objectives in mind
- Should have strong experience in CRM platform either Functional / Technical with strong exposure to Salesforce Lightning components.
- Must be familiar with like Sales Cloud, Service Cloud, Lightning Platform.
- Strong knowledge and development experience in Lightning development, Aura framework, Apex, Visualforce, JavaScript, jQuery, Angular Js.
- Expert knowledge of Salesforce.coms Web services, SOAP, REST.
- Must have experience in developing custom integration processes using Salesforce.coms Web Services API, SOAP, REST etc.
- Worked on latest web standards (OAuth, SAML, OpenID Connect, RESTful web services, JSON & others).
- Experienced with ETL tools like Starfish ETL, Talend Open Studio, Apex Data Loader, Pervasive, etc
- Familiarity and work experience with integrated development environments such as Eclipse.
- Good oral and written communication skill, Customer interaction skill and collaborative team working.
We are looking for a Business Development Associate who will be responsible for building strategies to enhance the company's sales and overall organizational growth.
Job Responsibilities:
· Identifying and developing new business opportunities
· Developing and executing strategic sales plans
· Meeting the business goals and objectives
· Conducting market research and analyzing competitor activities
· Identifying and contacting potential clients
· Obtain contact information of potential customers through cold calling, internet research, and emailing.
· Building and maintaining long-lasting business relationships with clients
· Identify and qualify new customers based on the company’s business model and guidelines.
· Initiate and build relationships with customers through phone, marketing mailer campaigns, in-person contacts, and presentations.
· Coordinate appointments, meetings, and calls between customers and senior management for business expansions and new opportunities.
· Manage customer meetings with internal teams for project development and delivery activities.
· Updating client and lead information in the respective databases
· Developing and implementing business growth strategies
· Preparing and presenting client retention plans
· Monitoring and analyzing sales data
· Coordinating with customers about quotations & product feedback
· Creating accurate and detailed sales reports
· Maintain a database of potential customers’ details like numbers, emails, and company information.
· Work closely with the internal team to deliver business services with a high level of customer satisfaction.
· Assist in achieving targeted revenues from current and new customers.
Skills Required:
· Strong analytical skills and attention to detail.
· Committed to the team and the project.
· Good convincing skills
· Good communication skills
Experience: 0-2 years of experience in pre-sales/ telesales/ ad sales/ digital media. (FMCG sector will be preferred)
Qualification: Minimum qualification: Graduation
Languages: Must be fluent in English and Hindi
Job Type: Full-time
Schedule:
- Morning shift
Ability to commute/relocate:
- Vishakhapatnam, Vishakhapatnam - 530007, Andhra Pradesh: Reliably commute or planning to relocate before starting work (Required)
Education:
- Bachelor's (Preferred)


Requirements:
- Knowledge of REACT tools including React.js, Webpack, Redux.
- Experience with user interface design.
- Excellent troubleshooting skills.
- Good project management skills.
- In-depth knowledge of JavaScript, CSS, HTML, and front-end languages.
Skills Required:
- React (Must), Preferably mobx experience
- Modern CSS layouts like Flex, Grid
- Strong fundamentals in OOP design patterns
- Basic understanding of REST API's
Responsibilities
- Developing new user-facing features using React.js
- Building reusable components and front-end libraries for future use
- Translating designs and wireframes into high-quality code
- Optimizing components for maximum performance across a vast array of web-capable devices and browsers


We’re Looking for Someone With:
Experience working with startups.
Experience working with ORMs like SQLAlchemy or Django
Experience with SQL and databases (Postgres preferred)
Experience in developing large server side applications and microservices
Ability to create high quality code
Experience with python testing tools (pytest) and test automation
Familiarity with code versioning tools like GIT
Strong sense of ownership and leadership quality
Experienced in the tools of our web stack
o Python
o Celery
o Postgres
o Redis
o RabbitMQ
Nice to Haves:
Prior experience at a growth stage Internet/Software company
Experience with ReactJS, Google Cloud, Heroku
Cloud deployment and scaling experience
We are looking for an experienced and knowledgeable SEO (Search Engine Optimization) Manager to join our Marketing team! As a SEO Manager you will be responsible for planning, implementing and managing our SEO strategy. As our online presence is extremely important for the success of business, your position will play a huge role in driving our business' growth and success.
- Develop and provide reporting daily/weekly/monthly reporting on the health of SEO.
- Plan, develop and implement our SEO strategy
- Work towards organic search optimization and ROI maximization
- Regularly perform thorough keywords research
- Identify key SEO KPIs
- Prepare and present reports regularly
- Identify problems and deficiency and implement solutions in a timely manner
- Suggest improvements in process and productivity optimization
- Collaborate with web developers and marketing team
- Stay up to date with the latest SEO and digital marketing latest trends and best practices
Requirements & Qualifications:
- 3 years of experience as SEO Manager or similar role, , ideally in an enterprise level capacity
- 3 years of experience in planning and implementing a successful SEO strategy, , ideally in an enterprise level capacity
- Proven success in SEO
- Familarity with Google Console and other such tools
- 5 years of experience web analytics, marketing, and business development
- Familiarity with HTML, CSS, JavaScript
- In- depth knowledge of research principles and methods and experience in analyzing data
- Sense of ownership and pride in your performance and its impact on company’s success
- Critical thinker and problem-solving skills
- Team Player
- Good time-management skills
- Great interpersonal and communication skills
Position Summary
DevOps is a Department of Horizontal Digital, within which we have 3 different practices.
- Cloud Engineering
- Build and Release
- Managed Services
This opportunity is for Cloud Engineering role who also have some experience with Infrastructure migrations, this will be a complete hands-on job, with focus on migrating clients workloads to the cloud, reporting to the Solution Architect/Team Lead and along with that you are also expected to work on different projects for building out the Sitecore Infrastructure from scratch.
We are Sitecore Platinum Partner and majority of the Infrastructure work that we are doing is for Sitecore.
Sitecore is a .Net Based Enterprise level Web CMS, which can be deployed on On-Prem, IaaS, PaaS and Containers.
So, most of our DevOps work is currently planning, architecting and deploying infrastructure for Sitecore.
Key Responsibilities:
- This role includes ownership of technical, commercial and service elements related to cloud migration and Infrastructure deployments.
- Person who will be selected for this position will ensure high customer satisfaction delivering Infra and migration projects.
- Candidate must expect to work in parallel across multiple projects, along with that candidate must also have a fully flexible approach to working hours.
- Candidate should keep him/herself updated with the rapid technological advancements and developments that are taking place in the industry.
- Along with that candidate should also have a know-how on Infrastructure as a code, Kubernetes, AKS/EKS, Terraform, Azure DevOps, CI/CD Pipelines.
Requirements:
- Bachelor’s degree in computer science or equivalent qualification.
- Total work experience of 6 to 8 Years.
- Total migration experience of 4 to 6 Years.
- Multiple Cloud Background (Azure/AWS/GCP)
- Implementation knowledge of VMs, Vnet,
- Know-how of Cloud Readiness and Assessment
- Good Understanding of 6 R's of Migration.
- Detailed understanding of the cloud offerings
- Ability to Assess and perform discovery independently for any cloud migration.
- Working Exp. on Containers and Kubernetes.
- Good Knowledge of Azure Site Recovery/Azure Migrate/Cloud Endure
- Understanding on vSphere and Hyper-V Virtualization.
- Working experience with Active Directory.
- Working experience with AWS Cloud formation/Terraform templates.
- Working Experience of VPN/Express route/peering/Network Security Groups/Route Table/NAT Gateway, etc.
- Experience of working with CI/CD tools like Octopus, Teamcity, Code Build, Code Deploy, Azure DevOps, GitHub action.
- High Availability and Disaster Recovery Implementations, taking into the consideration of RTO and RPO aspects.
- Candidates with AWS/Azure/GCP Certifications will be preferred.
JD for IOT DE:
The role requires experience in Azure core technologies – IoT Hub/ Event Hub, Stream Analytics, IoT Central, Azure Data Lake Storage, Azure Cosmos, Azure Data Factory, Azure SQL Database, Azure HDInsight / Databricks, SQL data warehouse.
You Have:
- Minimum 2 years of software development experience
- Minimum 2 years of experience in IoT/streaming data pipelines solution development
- Bachelor's and/or Master’s degree in computer science
- Strong Consulting skills in data management including data governance, data quality, security, data integration, processing, and provisioning
- Delivered data management projects with real-time/near real-time data insights delivery on Azure Cloud
- Translated complex analytical requirements into the technical design including data models, ETLs, and Dashboards / Reports
- Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases
- Experience with different computing paradigms in databases such as In-Memory, Distributed, Massively Parallel Processing
- Successfully delivered large scale IOT data management initiatives covering Plan, Design, Build and Deploy phases leveraging different delivery methodologies including Agile
- Experience in handling telemetry data with Spark Streaming, Kafka, Flink, Scala, Pyspark, Spark SQL.
- Hands-on experience on containers and Dockers
- Exposure to streaming protocols like MQTT and AMQP
- Knowledge of OT network protocols like OPC UA, CAN Bus, and similar protocols
- Strong knowledge of continuous integration, static code analysis, and test-driven development
- Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore
- Must have excellent analytical and problem-solving skills
- Delivered change management initiatives focused on driving data platforms adoption across the enterprise
- Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations
Roles & Responsibilities
You Will:
- Translate functional requirements into technical design
- Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core Azure services needed to fulfill the technical design
- Design, Develop and Deliver data integration interfaces in ADF and Azure Databricks
- Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs
- Deliver data models on Azure platform, it could be on Azure Cosmos, SQL DW / Synapse, or SQL
- Advise clients on ML Engineering and deploying ML Ops at Scale on AKS
- Automate core activities to minimize the delivery lead times and improve the overall quality
- Optimize platform cost by selecting the right platform services and architecting the solution in a cost-effective manner
- Deploy Azure DevOps and CI CD processes
- Deploy logging and monitoring across the different integration points for critical alerts


