Apache Kafka Jobs in Mumbai

The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the Data related products and platforms which scale for any amount of data, users, and processing. The team also interacts with our customers to work out solutions, create technical architectures and deliver the products and solutions. If you are someone who is always pondering how to make things better, how technologies can interact, how various tools, technologies, and concepts can help a customer or how a customer can use our products, then Lumiq is the place of opportunities.   Who are you? Enthusiast is your middle name. You know what’s new in Big Data technologies and how things are moving Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions You use cloud for more than just provisioning a Virtual Machine Vim is friendly to you and you know how to exit Nano You check logs before screaming about an error You are a solid engineer who writes modular code and commits in GIT You are a doer who doesn’t say “no” without first understanding You understand the value of documentation of your work You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines   Eligibility Experience At least 2 years of Data Engineering Experience Have interacted with Customers Must Have Skills Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES Apache Spark Python Scala PostgreSQL Git Linux Good to have Skills Apache NiFi Apache Kafka Apache Hive Docker Amazon Certification

About Us upGrad is an online education platform building the careers of tomorrow by offering the most industry-relevant programs in an immersive learning experience. Our mission is to create a new digital-first learning experience to deliver tangible career impact to individuals at scale. upGrad currently offers programs in Data Science, Machine Learning, Product Management, Digital Marketing, and Entrepreneurship, etc.  upGrad is looking for people passionate about management and education to help design learning programs for working professionals to stay sharp and stay relevant and help build the careers of tomorrow. upGrad was awarded the Best Tech for Education by IAMAI for 2018-19 upGrad was also ranked as one of the LinkedIn Top Startups 2018: The 25 most sought-after startups in India  upGrad was earlier selected as one of the top ten most innovative companies in India by FastCompany. We were also covered by the Financial Times along with other disruptors in Ed-Tech upGrad is the official education partner for Government of India - Startup India program  Our program with IIIT B has been ranked #1 program in the country in the domain of Artificial Intelligence and Machine Learning    About the Role A highly motivated and passionate individual who has experience in executing end to end web based application projects and bringing them to production quickly and with high quality. Passionate about building flexible and scalable solutions with an eye for detail and can weigh pros and cons to find best possible solutions.  Role and Responsibilities Collaborate with Product Manager and Engineering Manager to plan, implement and deliver tasks and modules on a timely basis with best practices and adherence to SOPs. Understand the product specification and be able to ask questions and gather information and feedback to build a well rounded solution.  Deliver end to end applications starting from front end web development, back end development, middleware integration and persisting data in no SQL or RDBMS databases. Should be able to use existing front-end components to build web based UI interfaces. Strong technical design approach to problem solving for backend services. Should be able to communicate and defend the tech design choices taken for long term scalability and maintainability. Play the role of an unblocker in a tight scrum environment. Should be able to help other developers with challenges and help achieve milestones as per plan. Prioritize to manage ad-hoc requests in parallel with ongoing projects. Document API specification, technical design and other key information for all projects/modules/services owned. Skills/Experience A highly talented developer with 8+ years of hands-on experience in building secure and scalable web based applications using Java in backend and JS based frontend frameworks. Strong knowledge of Java 8+, databases (SQL and NoSQL) , MySql, Mongo,  Experience working with Cassandra, Spring Boot, Apache Spark, Kafka, RabbitMQ is highly desirable Working knowledge of any one or more of AngularJS/ReactJS/VueJS and CSS3, HTML5. Strong experience in data modelling for data storage tools in SQL; experience with noSQL is highly desirable.  Experience building scalable solutions for 2x, 5x and 10x growth with high quality and flexibility. Practitioner of test driven development practices. Experience in creating and adhering to best practices for development. Experience working with container technologies like Docker and knowledge of CI/CD processes for automated integration and deployment. Basic knowledge of AWS preferred. Strong experience in Microservices (SRP) paradigm. Willing to learn new technologies (Golang) Qualification – B.Tech/M.Tech/MCA(IT/Computer Science) Years of Exp – 8+ years

Position – Engineering Manager Location – Bangalore/Mumbai/Remote   About Us upGrad is an online education platform building the careers of tomorrow by offering the most industry-relevant programs in an immersive learning experience. Our mission is to create a new digital-first learning experience to deliver tangible career impact to individuals at scale. upGrad currently offers programs in Data Science, Machine Learning, Product Management, Digital Marketing, and Entrepreneurship, etc.   upGrad is looking for people passionate about management and education to help design learning programs for working professionals to stay sharp and stay relevant and help build the careers of tomorrow.   upGrad was awarded the Best Tech for Education by IAMAI for 2018-19 upGrad was also ranked as one of the LinkedIn Top Startups 2018: The 25 most sought-after startups in India upGrad was earlier selected as one of the top ten most innovativecompanies in India by FastCompany. We were also coveredby the Financial Times along with other disruptors in Ed-Tech upGrad is the official education partnerfor Government of India - Startup India program  Our program with IIIT B has been ranked #1 programin the country in the domain of Artificial Intelligence and Machine Learning    About the Role A highly motivated and passionate individual who has experience in executing end to end web based products and applications; bringing them to production quickly and with high quality. Passionate about building flexible and scalable solutions with an eye for detail and can weigh pros and cons to find best possible solutions.   Role and Responsibilities   Collaborate with Product Managers to plan, implement and deliver tasks and modules on a timely basis with best practices and adherence to SOPs. Understand the product requirements, ask questions, and gather information and feedback to design and deliver scalable and flexible systems. Deliver end to end applications from front end web development, back end development, middleware integration and persisting data in no SQL or RDBMS databases. Play the role of an unblocker in a tight scrum environment. Should be able to help other developers with challenges, problem solving, and help achieve milestones as per plan. Build a highly skilled and efficient team by hiring, keeping the team motivated, and managing performance. Build a culture of agile development, continuous improvement, and a strong sense of product ownership Drive a culture of high quality at all stages by leveraging CI/CD and automation. Identify architectural issues and plans to resolve them. Proactively identify risks and define mitigations plans. Prioritize to manage ad-hoc requests in parallel with ongoing projects. Hands on with programming with 25%+ of bandwidth going into coding activities owned.     Skills/Experience A highly talented developer with 8+ years of hands-on experience in building secure and scalable web based applications using Java in backend and JS based frontend frameworks. Demonstrated experience managing teams of 5-10 or more engineers in product or online teams. Strong knowledge of Java 8+, databases (SQL and NoSQL) , MySql, Mongo, Experience working with Cassandra, Spring Boot, Apache Spark, Kafka, RabbitMQ is highly desirable Working knowledge of any one or more of AngularJS/ReactJS/VueJS and CSS3, HTML5. Strong experience in data modelling for data storage tools in SQL; experience with noSQL is highly desirable. Experience building scalable solutions for 2x, 5x and 10x growth with high quality and flexibility. Practitioner of test driven development practices. Experience in creating and adhering to best practices for development. Experience working with container technologies like Docker and knowledge of CI/CD processes for automated integration and deployment. Basic knowledge of AWS preferred. Strong experience in Microservices (SRP) paradigm. Willing to learn new technologies (Golang)       Qualification – B.Tech/M.Tech/MCA(IT/Computer Science) Years of Exp – 8+

JOB DESCRIPTION: We are looking for a Data Engineer with a solid background in scalable systems to work with our engineering team to improve and optimize our platform. You will have significant input into the team’s architectural approach and execution. We are looking for a hands-on programmer who enjoys designing and optimizing data pipelines for large-scale data. This is NOT a "data scientist" role, so please don't apply if you're looking for that. RESPONSIBILITIES: 1. Build, maintain and test, performant, scalable data pipelines 2. Work with data scientists and application developers to implement scalable pipelines for data ingest, processing, machine learning and visualization 3. Building interfaces for ingest across various data stores MUST-HAVE: 1. A track record of building and deploying data pipelines as a part of work or side projects 2. Ability to work with RDBMS, MySQL or Postgres 3. Ability to deploy over cloud infrastructure, at least AWS 4. Demonstrated ability and hunger to learn GOOD-TO-HAVE: 1. Computer Science degree 2. Expertise in at least one of: Python, Java, Scala 3. Expertise and experience in deploying solutions based on Spark and Kafka 4. Knowledge of container systems like Docker or Kubernetes 5. Experience with NoSQL / graph databases: 6. Knowledge of Machine Learning Kindly apply only if you are skilled in building data pipelines.