Apache Kafka Jobs in Mumbai

Desired Candidate Profile

• A team focus with strong collaboration and communication skills
• Exceptional ability to quickly grasp high-level business goals, derive requirements, and translate them into effective technical solutions
• Exceptional object-oriented thinking, design and programming skills (Java 8 or 11)
• Expertise with the following technologies : Data Structures, Design Patterns ,Code Versioning Tools(Github/bitbucket/..), XML, JSON, Spring Batch Restful, Spring Cloud, Grafana(Knowledge/Experience), Kafka, Spring Boot, Microservices, DB/NoSQL, Docker, Kubernetes, AWS/GCP, Architecture design (Patterns) Agile, JIRA.
• Penchant toward self-motivation and continuous improvement; these words should describe you: dedicated, energetic, curious, conscientious, and flexible.

Roles and Responsibilities

• We are looking for a savvy Data Engineering professional to join the newly formed Data Engineering team

• We are looking for Big Data specialists who have proven skills on working large-scale data systems

• The hire will be responsible for building and optimizing data pipeline architectures, as well as optimizing data flow and collection for multiple source systems

• The ideal candidate should be an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up

• Have got the strong ability to build robust and resilient data pipelines which are fault-tolerant and reliable in terms of data movement

• Should have experience in batch and stream data processing

• Create end-to-end data products and productionise them in cloud/in-house servers

Technical Skills

• Minimum 3-8 years of progressive experience building solutions in Big Data environments

• Should have solid hands-on experience with Big Data technologies like Hadoop, HBase, Hive, Pig, Oozie, MapReduce, Yarn, HDFS, Zookeeper, and Apache Kafka.

• Hands-on experience on Apache Spark, with Java/Scala for batch and stream processing, will be highly preferred

• Minimum 6 months of hands-on experience in Apache Kafka.

• Hands-on solid capabilities in SQL and NoSQL technologies

• Should be able to build performant, fault-tolerant, scalable solutions

• Excellent written and verbal communication skills

• 3-8+ years of experience programming in a backend language (Java / Python), with a good understanding of troubleshooting errors. 
• 5+ years of experience in Confluent Kafka / 3+ years of experience in Confluent Kafka 

• Cloud Kafka, Control Central, Rest Proxy, HA Proxy, Confluent Kafka Connect, Confluent Kafka Security features 

Only apply on this link - https://loginext.hire.trakstar.com/jobs/fk025uh?source=

LogiNext is looking for a technically savvy and passionate Associate Vice President - Product Engineering - DevOps or Senior Database Administrator to cater to the development and operations efforts in product. You will choose and deploy tools and technologies to build and support a robust infrastructure.

You have hands-on experience in building secure, high-performing and scalable infrastructure. You have experience to automate and streamline the development operations and processes. You are a master in troubleshooting and resolving issues in dev, staging and production environments.

Responsibilities:

• Design and implement scalable infrastructure for delivering and running web, mobile and big data applications on cloud
• Scale and optimise a variety of SQL and NoSQL databases (especially MongoDB), web servers, application frameworks, caches, and distributed messaging systems
• Automate the deployment and configuration of the virtualized infrastructure and the entire software stack
• Plan, implement and maintain robust backup and restoration policies ensuring low RTO and RPO
• Support several Linux servers running our SaaS platform stack on AWS, Azure, IBM Cloud, Ali Cloud
• Define and build processes to identify performance bottlenecks and scaling pitfalls
• Manage robust monitoring and alerting infrastructure 
• Explore new tools to improve development operations to automate daily tasks
• Ensure High Availability and Auto-failover with minimum or no manual interventions

Requirements:

• Bachelor’s degree in Computer Science, Information Technology or a related field
• 11 to 14 years of experience in designing and maintaining high volume and scalable micro-services architecture on cloud infrastructure
• Strong background in Linux/Unix Administration and Python/Shell Scripting
• Extensive experience working with cloud platforms like AWS (EC2, ELB, S3, Auto-scaling, VPC, Lambda), GCP, Azure
• Experience in deployment automation, Continuous Integration and Continuous Deployment (Jenkins, Maven, Puppet, Chef, GitLab) and monitoring tools like Zabbix, Cloud Watch Monitoring, Nagios
• Knowledge of Java Virtual Machines, Apache Tomcat, Nginx, Apache Kafka, Microservices architecture, Caching mechanisms
• Experience in query analysis, peformance tuning, database redesigning, 
• Experience in enterprise application development, maintenance and operations
• Knowledge of best practices and IT operations in an always-up, always-available service
• Excellent written and oral communication skills, judgment and decision-making skills.
• Excellent leadership skill.

Expi with Node.js, Express, Feather JS
3rd party API integration knowledge
Database- MySql or NoSql

Kafka Client Integration with Nodejs

Redis integration using Nodejs

Location: Bengaluru/Mumbai

About the Role:

Freight Tiger is growing exponentially, and technology is at the centre of it. Our Engineers love solving complex industry problems by building modular and scalable solutions using cutting-edge technology. Your peers will be an exceptional group of Software Engineers, Quality Assurance Engineers, DevOps Engineers, and Infrastructure and Solution Architects.

This role is responsible for developing data pipelines and data engineering components to support strategic initiatives and ongoing business processes. This role works with leads, analysts, and data scientists to understand requirements, develop technical solutions, and ensure the reliability and performance of the data engineering solutions.

This role provides an opportunity to directly impact business outcomes for sales, underwriting, claims and operations functions across multiple use cases by providing them data for their analytical modelling needs.

Key Responsibilities

• Create and maintain a data pipeline.
• Build and deploy ETL infrastructure for optimal data delivery.
• Work with various product, design and executive teams to troubleshoot data-related issues.
• Create tools for data analysts and scientists to help them build and optimise the product.
• Implement systems and processes for data access controls and guarantees.
• Distil the knowledge from experts in the field outside the org and optimise internal data systems.

Preferred Qualifications/Skills

• Should have 5+ years of relevant experience.
• Strong analytical skills.
• Degree in Computer Science, Statistics, Informatics, Information Systems.
• Strong project management and organisational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• SQL guru with hands-on experience on various databases.
• NoSQL databases like Cassandra, and MongoDB.
• Experience with Snowflake, Redshift.
• Experience with tools like Airflow, and Hevo.
• Experience with Hadoop, Spark, Kafka, and Flink.
• Programming experience in Python, Java, and Scala.

An opportunity to revolutionize the restaurant industry

Here, at Rebel Foods, we are using technology and automation to disrupt the traditional food industry. We are focused on building an operating system for Cloud Kitchens - using the most innovative technologies - to provide the best food experiences for our customers. 

You will enjoy working with us, if:

• You are passionate about using technology to solve customer problems
• You are a software craftsman or craftswoman who is obsessed with high quality software
• You have a flair for good design and architecture
• You are unafraid of rearchitecting or refactoring code to improve it
• You are willing to dive deep to solve complex software issues
• You are a teacher and mentor

Our technology ecosystem:

• Languages: Java, Typescript, Javascript, Ruby
• Frameworks, environments: Spring Boot, NodeJS, ExpressJS
• Databases: AWS Aurora MySQL, MongoDB
• Cloud: AWS
• Microservices, Service Oriented Architecture, REST APIs, Caching, Messaging, Logging, Monitoring and Alerting
• CI/CD and DevOps
• Bitbucket, Jira

You will mostly spend time on the following:

• Leading the design and implementation of software systems
• Driving engineering initiatives across teams with a focus on quality, maintainability, availability, scalability, security, performance and stability
• Writing efficient, maintainable, scalable, high quality code
• Reviewing code and tests
• Refactoring and improving code
• Teaching and mentoring team members

We’re excited about you if you have:

• At least 8 years of experience in software development, including experience building microservices and distributed systems
• Excellent programming skills in one or more languages: Java, C#, C++, Typescript, Javascript, Python or Ruby
• Experience working in Cloud environments: AWS, Azure, GCP
• Experience building secure, configurable, observable services
• Excellent troubleshooting and problem-solving skills
• The ability to work in an Agile environment
• The ability to collaborate effectively within and across engineering, product and business teams

We value engineers who are:

• Crazy about customer experience
• Willing to challenge the status quo and innovate
• Obsessed with quality, performance and frugality
• Willing to take complete responsibility and ownership of results
• Team players, teachers, mentors

What you need to succeed in this job ?

• MS or BS/B.Tech in computer science or equivalent experience from top college.
• Minimum 2+ Experience in Java 8, Spring Boot, Spring Cloud, Spring Cloud Gateway etc
• Good understanding of Design Patterns usage and implementations.
• REST Services and understanding and implementation of Microservices Architecture.
• Unit testing tools – Junit & Mockito.
• Experience is PostgreSQL database is must, 
• Excellent data structure & algorithm and problem solving skills.
• Should be an active contributor to developer communities like Stackoverflow is added advantage.
• Experience and knowledge of open source tools & frameworks, broader cutting edge technologies around server side development (Prometheus, Elasticsearch, Kafka).
• Must be a proven performer and team player that enjoy challenging assignments in a high- energy, fast growing and start-up workplace.
• Must be a self-starter who can work well with minimal guidance and in fluid environment.

• Build campaign generation services which can send app notifications at a speed of 10 million a minute
• Dashboards to show Real time key performance indicators to clients
• Develop complex user segmentation engines which creates segments on Terabytes of data within few seconds
• Building highly available & horizontally scalable platform services for ever growing data
• Use cloud based services like AWS Lambda for blazing fast throughput & auto scalability
• Work on complex analytics on terabytes of data like building Cohorts, Funnels, User path analysis, Recency Frequency & Monetary analysis at blazing speed
• You will build backend services and APIs to create scalable engineering systems.
• As an individual contributor, you will tackle some of our broadest technical challenges that requires deep technical knowledge, hands-on software development and seamless collaboration with all functions.
• You will envision and develop features that are highly reliable and fault tolerant to deliver a superior customer experience.
• Collaborating various highly-functional teams in the company to meet deliverables throughout the software development lifecycle.
• Identify and improvise areas of improvement through data insights and research.

• 2-5 years of experience in backend development and must have worked on Java/shell/Perl/python scripting.
• Solid understanding of engineering best practices, continuous integration, and incremental delivery.
• Strong analytical skills, debugging and troubleshooting skills, product line analysis.
• Follower of agile methodology (Sprint planning, working on JIRA, retrospective etc).
• Proficiency in usage of tools like Docker, Maven, Jenkins and knowledge on frameworks in Java like spring, spring boot, hibernate, JPA.
• Ability to design application modules using various concepts like object oriented, multi-threading, synchronization, caching, fault tolerance, sockets, various IPCs, database interfaces etc.
• Hands on experience on Redis, MySQL and streaming technologies like Kafka producer consumers and NoSQL databases like mongo dB/Cassandra.
• Knowledge about versioning like Git and deployment processes like CICD.

• Minimum 1 years of relevant experience, in PySpark (mandatory)
• Hands on experience in development, test, deploy, maintain and improving data integration pipeline in AWS cloud environment is added plus 
• Ability to play lead role and independently manage 3-5 member of Pyspark development team 
• EMR ,Python and PYspark mandate.
• Knowledge and awareness working with AWS Cloud technologies like Apache Spark, , Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS

•  2 - 6 years of software development experience
•  Good grasp on programming fundamentals including OOP, Design Patterns and Data Structures
•  Excellent analytical, logical and problem-solving skills
• Software Development Engineer
• Good understanding of complexities involved in designing/developing large scale systems
• Strong system design skills
•  Experience in technologies like Elasticsearch, Redis, Kafka etc
• Good knowledge of relational and NoSQL databases
• Familiarity with common machine learning algorithms. In-depth knowledge is a plus
• Experience of working with big data technologies like Hadoop, Spark, Hive is a big plus
• Ability to understand business requirements and take ownership of the work
• Exhibit passion and enthusiasm for building and maintaining large scale platforms

Software Development Engineer:

Major Responsibilities:

• Translation of complex functional requirements into technical requirements, implementing and maintaining a coherent and progressive development strategy for our product line
• Design, develop and maintain complex systems using best of the breed development practices and technology.
• Responsible for the over-all software development life cycle.
• Delivery of High Quality, Scalable and Extensible systems and applications on-time and on-budget.
• Adoption and Evolution of the software engineering practices and tools within the organization
• Keep in sync with the latest technology developments and open source offerings. Evaluate and adopt them for solving business problem of organization.
• Collaborate with other technology and business teams within the organization to provide efficient robust solutions to the problems.
• Drive and manage the bug triage process
• Report on status of product delivery and quality to management, customer support and product teams.

Desired Skills

• Strong programming, debugging, and problem-solving skills
• Strong understanding of data structures and algorithms
• Sound understanding of object-oriented programming and excellent software design skills.
• Good experience of SOA/Microservices/Restful services and development of N-tier J2EE / JavaSpringboot applications (API’s).
• Strong understanding of database design and SQL (mySql/mariaDB) development
• Good to have knowledge of NoSQL technologies like MongoDB, Solr, Redis, Cassandra or any other NoSQL database
• Knowledge of design patterns and good to have experience of large-scale applications
• Should have experience in Apache Kafka, RabbitMQ or other Queueing systems.

Ideal Experience

• 3 to 8 years of industry experience.
• Bachelors or Master’s Degree in Computer Science/ IT
• Drive discussions to create/improve product, process and technology
• Provide end to end solution and design details
• Lead development of formalized solution methodologies
• Passion to work in startup like environment

Personal Characteristics

• Passion and commitment
• Strong and excellent software design intellect
• High integrity
• Self-starter

The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the Data related products and platforms which scale for any amount of data, users, and processing. The team also interacts with our customers to work out solutions, create technical architectures and deliver the products and solutions.

If you are someone who is always pondering how to make things better, how technologies can interact, how various tools, technologies, and concepts can help a customer or how a customer can use our products, then Lumiq is the place of opportunities.

Who are you?

• Enthusiast is your middle name. You know what’s new in Big Data technologies and how things are moving
• Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions
• You use cloud for more than just provisioning a Virtual Machine
• Vim is friendly to you and you know how to exit Nano
• You check logs before screaming about an error
• You are a solid engineer who writes modular code and commits in GIT
• You are a doer who doesn’t say “no” without first understanding
• You understand the value of documentation of your work
• You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines

Experience

• At least 2 years of Data Engineering Experience
• Have interacted with Customers

Must Have Skills

• Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES
• Apache Spark
• Python
• Scala
• PostgreSQL
• Git
• Linux

Good to have Skills

• Apache NiFi
• Apache Kafka
• Apache Hive
• Docker
• Amazon Certification