

Koantek
http://www.koantek.comAbout
Jobs at Koantek

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

The Sr AWS/Azure/GCP Databricks Data Engineer at Koantek will use comprehensive
modern data engineering techniques and methods with Advanced Analytics to support
business decisions for our clients. Your goal is to support the use of data-driven insights
to help our clients achieve business outcomes and objectives. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and
patterns, insights, and trends to decision-makers. You will help design and build data
pipelines, data streams, reporting tools, information dashboards, data service APIs, data
generators, and other end-user information portals and insight tools. You will be a critical
part of the data supply chain, ensuring that stakeholders can access and manipulate data
for routine and ad hoc analysis to drive business outcomes using Advanced Analytics. You are expected to function as a productive member of a team, working and
communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. Requirements:
Strong experience as an AWS/Azure/GCP Data Engineer and must have
AWS/Azure/GCP Databricks experience. Expert proficiency in Spark Scala, Python, and spark
Must have data migration experience from on-prem to cloud
Hands-on experience in Kinesis to process & analyze Stream Data, Event/IoT Hubs, and Cosmos
In depth understanding of Azure/AWS/GCP cloud and Data lake and Analytics
solutions on Azure. Expert level hands-on development Design and Develop applications on Databricks. Extensive hands-on experience implementing data migration and data processing
using AWS/Azure/GCP services
In depth understanding of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib
Hands-on experience with the Technology stack available in the industry for data
management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc
Hands-on knowledge of data frameworks, data lakes and open-source projects such
asApache Spark, MLflow, and Delta Lake
Good working knowledge of code versioning tools [such as Git, Bitbucket or SVN]
Hands-on experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair
Experience preparing data for Data Science and Machine Learning with exposure to- model selection, model lifecycle, hyperparameter tuning, model serving, deep
learning, etc
Demonstrated experience preparing data, automating and building data pipelines for
AI Use Cases (text, voice, image, IoT data etc. ). Good to have programming language experience with. NET or Spark/Scala
Experience in creating tables, partitioning, bucketing, loading and aggregating data
using Spark Scala, Spark SQL/PySpark
Knowledge of AWS/Azure/GCP DevOps processes like CI/CD as well as Agile tools
and processes including Git, Jenkins, Jira, and Confluence
Working experience with Visual Studio, PowerShell Scripting, and ARM templates. Able to build ingestion to ADLS and enable BI layer for Analytics
Strong understanding of Data Modeling and defining conceptual logical and physical
data models. Big Data/analytics/information analysis/database management in the cloud
IoT/event-driven/microservices in the cloud- Experience with private and public cloud
architectures, pros/cons, and migration considerations. Ability to remain up to date with industry standards and technological advancements
that will enhance data quality and reliability to advance strategic initiatives
Working knowledge of RESTful APIs, OAuth2 authorization framework and security
best practices for API Gateways
Guide customers in transforming big data projects, including development and
deployment of big data and AI applications
Guide customers on Data engineering best practices, provide proof of concept, architect solutions and collaborate when needed
2+ years of hands-on experience designing and implementing multi-tenant solutions
using AWS/Azure/GCP Databricks for data governance, data pipelines for near real-
time data warehouse, and machine learning solutions. Over all 5+ years' experience in a software development, data engineering, or data
analytics field using Python, PySpark, Scala, Spark, Java, or equivalent technologies. hands-on expertise in Apache SparkTM (Scala or Python)
3+ years of experience working in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions. Bachelor's or Master's degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience
Ability to manage competing priorities in a fast-paced environment
Ability to resolve issues
Basic experience with or knowledge of agile methodologies
AWS Certified: Solutions Architect Professional
Databricks Certified Associate Developer for Apache Spark
Microsoft Certified: Azure Data Engineer Associate
GCP Certified: Professional Google Cloud Certified

Similar companies
About the company
The Story
Founded in 2011, Poshmark started with a simple yet powerful idea in Manish Chandra's garage. Along with co-founders Tracy Sun, Gautam Golwala, and Chetan Pungaliya, Chandra envisioned a platform that would revolutionize how people buy and sell fashion. The inspiration came from seeing the potential of the iPhone 4 to create meaningful connections in the shopping experience.
What They Do
Poshmark is not just another e-commerce platform – it's a social marketplace that brings together shopping and community. Think of it as a place where social media meets shopping, allowing users to buy, sell, and discover fashion, home goods, and accessories. With over 80 million users , the platform has become a go-to destination for both casual sellers and entrepreneurial individuals looking to build their own digital boutiques.
Growth & Achievements
- Started as a fashion-only platform and successfully expanded into home goods and electronics
- Raised over $160 million in venture funding
- Achieved a successful IPO in January 2021
- Recently launched innovative features like AI-powered visual search and livestream shopping
- Built a vibrant community of millions of buyers and sellers across the country
Today, under CEO Manish Chandra's leadership, Poshmark continues to innovate in the social commerce space, blending technology with community to create a unique shopping experience. The platform's success story is a testament to how combining social connections with commerce can create a powerful marketplace that resonates with modern consumers.
Jobs
1
About the company
Jobs
7
About the company
Jobs
5
About the company
Jobs
29
About the company
Immigration Consultancies is an Auckland-based immigration consultancy firm that handles the planning and submission process of all kinds of Study, Resident and Work visas for New Zealand, Australia and Canada.
For over 20 years, ICL has dealt with thousands of applications. Will yours be the next application we secure?
Jobs
3
About the company
Welcome to Fundly! - http://fundly.ai
We're on a mission to empower millions of small retailers and distributors across India, making them future-ready. Fundly.ai is a pioneering fintech platform nestled within the healthcare sector, providing innovative financing and allied solutions to the pharma distribution tail, specialty players, and brands.
Since our inception in early 2021, we've made significant strides. We've empowered over 2800 retailers and 40 distributors across 590+ PIN codes, disbursing funds worth more than INR 286+ Cr. We're honored to play a vital role in the pharma retail ecosystem, supporting small business owners and their communities with short-term credit.
Founded by experienced industry professionals with a cumulative experience of 30+ years, Fundly has rapidly expanded. In less than 2 years, we've grown to a team of over 50 passionate individuals spread across 12 cities. With an AUM of INR 100+ crores and USD 3M raised in venture capital, we're poised for even greater success.
Join us at Fundly and be part of a dynamic team that's reshaping the future of healthcare financing. Together, we're creating opportunities, driving innovation, and making a lasting impact. Your journey to success starts here.
Welcome to Fundly – where possibilities are endless!
Industry:- Financial Services
Jobs
5
About the company
StepSecurity is dedicated to enhancing CI/CD security by providing solutions to prevent pipeline attacks. Founded by seasoned security professionals with experience at Microsoft, Uber, and Plaid, StepSecurity addresses the security gaps highlighted by major breaches like SolarWinds and Codecov.
Founders:
- Varun Sharma: CEO & Co-Founder, formerly at Microsoft.
- Ashish Kurmi: CTO & Co-Founder, with experience at Plaid, Uber, and Microsoft.
Advisors:
- Sekhar Sarrukai, David Cross, Gagan Gulati, Jordan Harband, Ram Shankar Siva Kumar.
Investors:
StepSecurity is backed by leading VCs and notable angel investors, including Anmol Malhotra (Coinbase), Ash Devata (GreyNoise), and David Cross (Rain Capital).
Funding raised: $3M - Seed Funding
For more detailed information, visit - https://www.stepsecurity.io/team
Jobs
1
About the company
SponsorCloud is the leading investment syndication and fund management platform, serving thousands of deal sponsors worldwide. Founded in 2016 by Jacob Blackett and Ameet Mehta, the company transforms how investment syndications are managed through its comprehensive suite of products. Their all-in-one platform includes tools for investor management, legal documentation, networking, and administrative support. Built by sponsors for sponsors, SponsorCloud combines industry expertise with cutting-edge technology to deliver user-friendly solutions that streamline every aspect of investment syndication projects, from start to finish.
Jobs
1
About the company
KrispCall is experiencing rapid growth, and we're looking for talented individuals to join us on this exciting journey. We offer a dynamic and rewarding work environment where you can learn, grow, and contribute to a product that's transforming the way businesses communicate. We value our employees and provide opportunities for professional development and advancement. Explore our open positions and discover your potential at KrispCall!
Jobs
2
About the company
Jobs
18