

Koantek
http://www.koantek.comAbout
Jobs at Koantek

The Sr AWS/Azure/GCP Databricks Data Engineer at Koantek will use comprehensive
modern data engineering techniques and methods with Advanced Analytics to support
business decisions for our clients. Your goal is to support the use of data-driven insights
to help our clients achieve business outcomes and objectives. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and
patterns, insights, and trends to decision-makers. You will help design and build data
pipelines, data streams, reporting tools, information dashboards, data service APIs, data
generators, and other end-user information portals and insight tools. You will be a critical
part of the data supply chain, ensuring that stakeholders can access and manipulate data
for routine and ad hoc analysis to drive business outcomes using Advanced Analytics. You are expected to function as a productive member of a team, working and
communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. Requirements:
Strong experience as an AWS/Azure/GCP Data Engineer and must have
AWS/Azure/GCP Databricks experience. Expert proficiency in Spark Scala, Python, and spark
Must have data migration experience from on-prem to cloud
Hands-on experience in Kinesis to process & analyze Stream Data, Event/IoT Hubs, and Cosmos
In depth understanding of Azure/AWS/GCP cloud and Data lake and Analytics
solutions on Azure. Expert level hands-on development Design and Develop applications on Databricks. Extensive hands-on experience implementing data migration and data processing
using AWS/Azure/GCP services
In depth understanding of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib
Hands-on experience with the Technology stack available in the industry for data
management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc
Hands-on knowledge of data frameworks, data lakes and open-source projects such
asApache Spark, MLflow, and Delta Lake
Good working knowledge of code versioning tools [such as Git, Bitbucket or SVN]
Hands-on experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair
Experience preparing data for Data Science and Machine Learning with exposure to- model selection, model lifecycle, hyperparameter tuning, model serving, deep
learning, etc
Demonstrated experience preparing data, automating and building data pipelines for
AI Use Cases (text, voice, image, IoT data etc. ). Good to have programming language experience with. NET or Spark/Scala
Experience in creating tables, partitioning, bucketing, loading and aggregating data
using Spark Scala, Spark SQL/PySpark
Knowledge of AWS/Azure/GCP DevOps processes like CI/CD as well as Agile tools
and processes including Git, Jenkins, Jira, and Confluence
Working experience with Visual Studio, PowerShell Scripting, and ARM templates. Able to build ingestion to ADLS and enable BI layer for Analytics
Strong understanding of Data Modeling and defining conceptual logical and physical
data models. Big Data/analytics/information analysis/database management in the cloud
IoT/event-driven/microservices in the cloud- Experience with private and public cloud
architectures, pros/cons, and migration considerations. Ability to remain up to date with industry standards and technological advancements
that will enhance data quality and reliability to advance strategic initiatives
Working knowledge of RESTful APIs, OAuth2 authorization framework and security
best practices for API Gateways
Guide customers in transforming big data projects, including development and
deployment of big data and AI applications
Guide customers on Data engineering best practices, provide proof of concept, architect solutions and collaborate when needed
2+ years of hands-on experience designing and implementing multi-tenant solutions
using AWS/Azure/GCP Databricks for data governance, data pipelines for near real-
time data warehouse, and machine learning solutions. Over all 5+ years' experience in a software development, data engineering, or data
analytics field using Python, PySpark, Scala, Spark, Java, or equivalent technologies. hands-on expertise in Apache SparkTM (Scala or Python)
3+ years of experience working in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions. Bachelor's or Master's degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience
Ability to manage competing priorities in a fast-paced environment
Ability to resolve issues
Basic experience with or knowledge of agile methodologies
AWS Certified: Solutions Architect Professional
Databricks Certified Associate Developer for Apache Spark
Microsoft Certified: Azure Data Engineer Associate
GCP Certified: Professional Google Cloud Certified

Similar companies
About the company
IndiWork is a full service provider for web design, custom development and online marketing to help grown your brand. GET Your Project RIGHT the FIRST Time.
Jobs
4
About the company
MyOperator is India's leading cloud communications provider, empowering over 10,000 businesses across industries with cutting-edge SaaS solutions. Our offerings include Cloud Call Center, IVR, Toll-free Numbers, Enterprise Mobility, WhatsApp Business Solutions, and Heyo Phone. We are committed to delivering innovation and exceptional customer service that drives business success.
Jobs
22
About the company
Jobs
24
About the company
Immigration Consultancies is an Auckland-based immigration consultancy firm that handles the planning and submission process of all kinds of Study, Resident and Work visas for New Zealand, Australia and Canada.
For over 20 years, ICL has dealt with thousands of applications. Will yours be the next application we secure?
Jobs
11
About the company
Jobs
0
About the company
Transforming Finance with Innovation: FinSurge
From Murex Consultancy to Industry Leader in Software Development.
Over the past 25 years, FinSurge has evolved from a Murex consultancy into a transformative force in software development. We are not just another Murex SI firm but pioneers in software development, venturing where no other Murex SI partner dares to go.
Creating Trends, Not Following Them
At FinSurge, we innovate. Our advanced software solutions are designed to revolutionize capital markets and investment banking. Utilizing cutting-edge technologies like Open APIs, Microservices, and AI/ML, we deliver innovations that shape the future of finance. Our tools meet client needs and empower them to excel and lead in a dynamic market.
Unmatched Excellence and Innovation
What sets us apart is our unwavering commitment to excellence. We are a unique blend of forward-thinking software developers and seasoned consultants, leveraging automation and advanced development capabilities like no Murex partner. Every project is meticulously crafted with precision, quality, and efficiency, ensuring maximum value through tailored software innovations.
Shaping Tomorrow's Financial Landscapes
At FinSurge, we believe in the power of transformation. Our passion is solving today's challenges and shaping tomorrow's financial landscapes. We empower our clients with solutions that inspire progress.
Join Us in Revolutionizing Finance
Explore how we are reshaping the future of Murex services and driving innovation in software development.
Visit our website at https://finsurge.tech and join us in our mission to revolutionize the world of finance.
Jobs
1
About the company
Jobs
15
About the company
Asha Health is a Y Combinator backed AI healthcare startup. We help medical practices spin up their own AI clinic. We've raised an oversubscribed seed round backed by top Silicon Valley investors, and are growing rapidly. Our team consists of AI product experts from companies like Google, as well as senior physician executives from major health systems.
Jobs
8
About the company
KrispCall is experiencing rapid growth, and we're looking for talented individuals to join us on this exciting journey. We offer a dynamic and rewarding work environment where you can learn, grow, and contribute to a product that's transforming the way businesses communicate. We value our employees and provide opportunities for professional development and advancement. Explore our open positions and discover your potential at KrispCall!
Jobs
3
About the company
India hosts 25M+ events every year, but ordering food is still a nightmare—unreliable vendors, inconsistent pricing, and no seamless way to book catering. We’re fixing this."
Craft My Plate is a vertically integrated food marketplace where customers can instantly customize menus, place orders, and get it delivered conveniently —without dealing with vendors.
Jobs
5