

Koantek
http://www.koantek.comAbout
Jobs at Koantek

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

The Sr AWS/Azure/GCP Databricks Data Engineer at Koantek will use comprehensive
modern data engineering techniques and methods with Advanced Analytics to support
business decisions for our clients. Your goal is to support the use of data-driven insights
to help our clients achieve business outcomes and objectives. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and
patterns, insights, and trends to decision-makers. You will help design and build data
pipelines, data streams, reporting tools, information dashboards, data service APIs, data
generators, and other end-user information portals and insight tools. You will be a critical
part of the data supply chain, ensuring that stakeholders can access and manipulate data
for routine and ad hoc analysis to drive business outcomes using Advanced Analytics. You are expected to function as a productive member of a team, working and
communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. Requirements:
Strong experience as an AWS/Azure/GCP Data Engineer and must have
AWS/Azure/GCP Databricks experience. Expert proficiency in Spark Scala, Python, and spark
Must have data migration experience from on-prem to cloud
Hands-on experience in Kinesis to process & analyze Stream Data, Event/IoT Hubs, and Cosmos
In depth understanding of Azure/AWS/GCP cloud and Data lake and Analytics
solutions on Azure. Expert level hands-on development Design and Develop applications on Databricks. Extensive hands-on experience implementing data migration and data processing
using AWS/Azure/GCP services
In depth understanding of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib
Hands-on experience with the Technology stack available in the industry for data
management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc
Hands-on knowledge of data frameworks, data lakes and open-source projects such
asApache Spark, MLflow, and Delta Lake
Good working knowledge of code versioning tools [such as Git, Bitbucket or SVN]
Hands-on experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair
Experience preparing data for Data Science and Machine Learning with exposure to- model selection, model lifecycle, hyperparameter tuning, model serving, deep
learning, etc
Demonstrated experience preparing data, automating and building data pipelines for
AI Use Cases (text, voice, image, IoT data etc. ). Good to have programming language experience with. NET or Spark/Scala
Experience in creating tables, partitioning, bucketing, loading and aggregating data
using Spark Scala, Spark SQL/PySpark
Knowledge of AWS/Azure/GCP DevOps processes like CI/CD as well as Agile tools
and processes including Git, Jenkins, Jira, and Confluence
Working experience with Visual Studio, PowerShell Scripting, and ARM templates. Able to build ingestion to ADLS and enable BI layer for Analytics
Strong understanding of Data Modeling and defining conceptual logical and physical
data models. Big Data/analytics/information analysis/database management in the cloud
IoT/event-driven/microservices in the cloud- Experience with private and public cloud
architectures, pros/cons, and migration considerations. Ability to remain up to date with industry standards and technological advancements
that will enhance data quality and reliability to advance strategic initiatives
Working knowledge of RESTful APIs, OAuth2 authorization framework and security
best practices for API Gateways
Guide customers in transforming big data projects, including development and
deployment of big data and AI applications
Guide customers on Data engineering best practices, provide proof of concept, architect solutions and collaborate when needed
2+ years of hands-on experience designing and implementing multi-tenant solutions
using AWS/Azure/GCP Databricks for data governance, data pipelines for near real-
time data warehouse, and machine learning solutions. Over all 5+ years' experience in a software development, data engineering, or data
analytics field using Python, PySpark, Scala, Spark, Java, or equivalent technologies. hands-on expertise in Apache SparkTM (Scala or Python)
3+ years of experience working in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions. Bachelor's or Master's degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience
Ability to manage competing priorities in a fast-paced environment
Ability to resolve issues
Basic experience with or knowledge of agile methodologies
AWS Certified: Solutions Architect Professional
Databricks Certified Associate Developer for Apache Spark
Microsoft Certified: Azure Data Engineer Associate
GCP Certified: Professional Google Cloud Certified

Similar companies
About the company
As a prominent web development company in India, our core expertise lies in custom software development for web and mobile app development according to client’s need and business workflow. we assist our clients through every step of the way; from consultation, design, development to maintenance. Leave it all in the hands of our expert web developers and we will build you secure, innovative and responsive web applications.
Jobs
6
About the company
At Deqode, our purpose is to help businesses solve complex problems using new-age technologies. We provide enterprise blockchain solutions to businesses.
Jobs
93
About the company
TIGI HR Solution Pvt. Ltd. is recognized as a market leader in the field of technology-based staffing. TIGI HR is widely considered as India's most trusted and sought-after recruitment brand, making it an ideal choice for businesses interested in outsourcing personnel. The company operates with the goal and vision of fostering the creation of as many leaders and employment around the globe as is reasonably feasible. TIGI HR has, in a very short amount of time, developed a large-scale firm that is sustainable over the long term. The company places a high priority on speed, scalability, and predictability in its operations, which helps it to establish and maintain long-term trust relationships with both prospective clients and existing ones.
As it keeps an eye on the newest trends and technology that are available to HR professionals, TIGI HR is constantly one step ahead of the competition. In a very short amount of time, TIGI HR utilizes AI-based Recruit Robots and TMS technology to attract a potential talent pool.
Jobs
150
About the company
We Enable and empower our partners to engage their clients through smart technology. Use of technology innovations designed to squeeze out savings and efficiency from the current insurance industry model.The belief driving us is that the insurance industry is ripe for innovation and disruption. We offer ultra-customized tools and using new streams of data from internet-enabled devices to dynamically price premiums according to observed behavior.
Jobs
11
About the company
Jobs
10
About the company
Jobs
2
About the company
Jobs
5
About the company
Jobs
27
About the company
Sun King is a leading global provider of off-grid solar energy solutions, designed to serve the 1.8 billion people who lack reliable or affordable access to traditional electrical grids. With a mission to power brighter lives, the company focuses on underserved markets across Africa and Asia. Sun King's product range includes solar lanterns, solar home systems, and solar inverters, tailored to meet a variety of energy needs—from portable lighting to powering entire homes.
The company's innovative solutions, such as the recently launched PowerHub 3300 and expandable solar home systems, reflect their commitment to evolving customer demands. With operations in over 40 countries and millions of products sold, Sun King makes solar energy accessible through pay-as-you-go financing options. The company’s network of field agents plays a key role in selling, installing, and servicing products, driving local economic development. Rooted in sustainability, Sun King also implements a Sustainable Financing Framework and ensures customer satisfaction through extensive service centers and after-sales support.
Jobs
1
About the company
Jobs
160