5+ Apache Kafka Jobs in Ahmedabad | Apache Kafka Job openings in Ahmedabad

Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.

You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.

Required Experience:

• Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
• Have experience working and strong understanding of object-oriented programing and cloud technologies
• End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
• Strong experience with unit and integration testing of the Spring Boot APIs.
• Strong understanding and production experience of RESTful API's and microservice architecture.
• Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.

Nice to have's (but not required):

• Exposure to Kotlin or other JVM programming languages
• Strong understanding and production experience working with Docker container environments
• Strong understanding and production experience working with Kafka
• Cloud Environments: AWS, GCP or Azure

About Klevu:

Klevu is a discovery experience suite that revolutionises online shopping. It provides a range of SaaS based solutions, that are deep rooted in AI-ML technology and delivered via cloud for online retailers. Klevu is a global Finnish company that prides in diversity, great team, excellent partner network and global customer footprint. Learn more from www.klevu.com

Experience: 5+ years

Location: Ahmedabad, Gujarat

Responsibilities:

• Build, scale and maintain various services on the Klevu platform
• Design and develop solutions for business needs on the Klevu platform

Must have skills:

• 4+ years on experience with Java
• Experience in Web application development on Spring framework
• Experience working with database technologies – RDBMS or NoSQL
• Ability to communicate effectively within and outside the engineering team
• Familiar with agile software development process

Nice to haves:

• Experience in Hibernate, MySql, Redis, ActiveMQ or Kafka
• Experience in UI Frameworks like Jquery, React, Angular or equivalent
• Experience in REST API development
• Experience in debugging issues and checking production logs
• Experience working in eCommerce and/or SAAS startups
• Experience working with microservices architecture

What we offer:

• Being part of one of the most exciting search technology company from Nordics with global footprints
• Work with a team in 3 continents (North America, Europe, Asia)
• Excellent work culture, hands-on, result oriented
• Good salary and flexible hours

Job Description

Mandatory Requirements 

• Experience in AWS Glue

• Experience in Apache Parquet 

• Proficient in AWS S3 and data lake 

• Knowledge of Snowflake

• Understanding of file-based ingestion best practices.

• Scripting language - Python & pyspark

CORE RESPONSIBILITIES

• Create and manage cloud resources in AWS 

• Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

• Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

• Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

• Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

• Define process improvement opportunities to optimize data collection, insights and displays.

• Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

• Identify and interpret trends and patterns from complex data sets 

• Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

• Key participant in regular Scrum ceremonies with the agile teams  

• Proficient at developing queries, writing reports and presenting findings 

• Mentor junior members and bring best industry practices.

QUALIFICATIONS

• 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

• Strong background in math, statistics, computer science, data science or related discipline

• Advanced knowledge one of language: Java, Scala, Python, C# 

• Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

• Proficient with

• Data mining/programming tools (e.g. SAS, SQL, R, Python)

• Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

• Data visualization (e.g. Tableau, Looker, MicroStrategy)

• Comfortable learning about and deploying new technologies and tools. 

• Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

• Good written and oral communication skills and ability to present results to non-technical audiences 

• Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

• AWS certification

• Spark Streaming 

• Kafka Streaming / Kafka Connect 

• ELK Stack 

• Cassandra / MongoDB 

• CI/CD: Jenkins, GitLab, Jira, Confluence other related tools