Apache Kafka Jobs

Job Summary We are a fully remote company with 16 team members in 4 countries (USA, Germany, Uruguay, India). We are looking for very special software developers that want to work full-time remotely within a growing Silicon Valley SaaS Startup. You will work across the full stack for a number of internal web services on our backend microservices architecture. We are looking for someone that really understands coding & OO programming concepts. The 3-stage interviews will consist of code review and heavy discussion on code modules and methods in JavaScript. We are looking for someone that is highly skilled in making scalable applications that can connect various web services to work in conjunction with our augmented team. Technologies we use JavaScript, Node.js, React, Koa, GraphQL, Node.js, TypeScript, MongoDB, Postgre Principles we follow: Clean Code and Clean Architecture Our TeamWe are committed to fostering a culture of empathy, inclusivity, and acceptance — regardless of gender, sexual orientation, ethnicity, race, education, age, or other personal characteristics. Our mission is to transform the freight shipping industry and we achieve that through a culture of empathy, being diligent, harboring innate curiosity and desire to learn, quick validations, and feedback-driven process.You'd like here because we Create solutions for real-world problems Continuously contribute to the tech and web community Have an independent environment in which to grow your creativity and potential A collaborative team of strong developers that like to solve challenging and technical problems in a simple manner Qualifications and SkillsKey Qualifications Mastery of dev/build tools: git, NodeJS, npm, grunt, gulp, babel, webpack Mastery of Javascript and other back-end languages like PHP. Experience with databases such as MongoDB and Postgre Knowledge of REST API design and development. Experience creating web applications using JavaScript frameworks Excellent written and verbal interpersonal skills Ability to manage multiple tasks and prioritize work accordingly 3-6+ years of professional software development Proven full-stack web development Passionate about engineering perfection, performance, and quality Understanding and ability to orchestrate core computer science concepts You thrive in a collaborative environment, operating comfortably in a fast-paced and dynamic team setting Job Type: Full-time

Role :   - Design and architecture of highly scalable web services applications.- Make technology stack choices based on careful objective evaluation and build cutting edge applications and innovative workflows. Work with third-party services to review and approve technical solutions.- Architect Content Management Solution and scalable API platform to power one of the most popular content apps in India.- Partner with third party technology services and contribute to making strategic inputs for defining relationships with third party services.- Write good quality code, unit tests, automation and perform code reviews.- Create workflows and solutions involving search, recommendations, rights management, monetization, identity management, authorization and authentication to name a few. Technical ownership of several of these platforms.- Collaborate with product, design and another engineering team to drive execution across all platforms while balancing short-term requirements with long term objectives. Participate in brainstorming sessions and contribute ideas to our technology, algorithms and products.   Skills :   - Master's or Bachelor's degree in Computer Science, Computer Engineering or related technical discipline- Extensive experience on Node.js and AWS- Should have experience in building and maintaining large-scale distributed systems and web services handling web-scale traffic.- Should have excellent coding skills and good understanding algorithms and data structures.- Expertise in distributed systems, SQL and NoSQL databases (MongoDB, Redis, MySQL), scalability, AWS services such as EC2, ELB, AWS Lambda, API Gateway- Experience in troubleshooting infrastructure failures, infrastructure management frameworks (Mesos, Kubernetes), REST API development- Excellent knowledge of hosting web services like AWS, Google Compute, Azure, etc.- Hands-on experience in building Java/Scala based Hadoop/Spark applications- Knowledge and/or experience in building OTT/IPTV/online video service would be a bonus- Familiarity with front-end web technologies such as HTML, JavaScript, AngularJS, etc.- Understanding & experience in building efficient search & recommendation platforms; experience in Machine/ Deep Learning would be beneficial.

Java/ Fullstack Architect will be responsible for Technical ownership of an entire product design development from scratch, which extends to: Mandatory: 8+yrs Java Architect profile with minimum 4+yrs exp as Architect along with hands-on coding exp. Involvement in the full software development life cycle with stringent needs on (i) time to market, & (ii) quality of product - functional and non-functional aspect. Ownership of complex software architectures, operational metrics. Designing and defining the interaction between the different components and teams. Work closely with peers and product managers to develop great technical design and approach for new product development. Definition of, and compliance with, a world-class build/release and configuration management process. Handle a team of 6-10 full stack developers. This position will report in to Director of Engineering & the roles & responsibilities are as below:  Identify the technologies that would be used for the product. Recommend the development methodology and framework for the project. Provide the overall design and structure to the application. Ensure that the product is adequately defined & documented. Establish design/coding guidelines and best practices, and drive usage of design patterns. Enforce compliance with coding guidelines using code reviews etc. Build solution which is easily configurable, deploy-able and secure in SaaS environment. Responsible for planning product iterations & releasing iterations on schedule. REQUIREMENT: The Applicant with a total experience of 11-18 years, should have hands-on development experience in Core Java and J2EE with proven expertise in writing application architecture and core design ground up with sound algorithmic thought process enabling bullet-proof application performance in terms of key drivers like security, load, scalability, etc.   Skills and Technologies: Versatile experience with delivering highly available services on multiple technology stacks in traditional data centers, public clouds, and private clouds. Java, Spring, Hibernate, JMS/Rabbit MQ/Kafka, Web-Services, Oracle, MSSQL, JSP-Servlets, , Design Patterns. Nice to have: New cutting edge technology (Java, Microservices, Angular, react.js or node,js fullstack exposure or Nosql db, mongodb, cassandra, Neo4j, dynamodb or Apache, Kafka, RabbitMQ, ELK stack (elastic search, logstash, kibana), redis, solr, etc.)   Team mentoring: Mentor developers for difficult tasks & provide technical advice and guidance to the Tech Leads. Guide the team is doing POCs and early risk assessments. should have direct reportees. · Leadership Abilities: Optimize & effectively manage resources and time of the team members. Identify, track and mitigate risks to the product Should not hesitate to carry out healthy and constructive confrontation with team members, peers and managers for the benefit of Product. should have handled a team of 10 developers

What we are looking for: We are looking for an experienced Data Engineer for product and business analytics who will design and build mission critical data pipelines in SQL environment.   As a Senior Data Engineer, you will: Engineer data pipelines ( batch and real-time ) that aids in creation of data-driven products for our platform Design, develop and maintain a robust and scalable data-warehouse Work closely alongside Product managers and data-scientists to bring the various datasets together and cater to our business intelligence and analytics use-cases Design and develop solutions using data science techniques ranging from statistics, algorithms to machine learning -Perform hands-on devops work to keep the Data platform secure and reliable   Basic Qualifications Bachelor's degree in Computer Science, Information Systems, or related engineering discipline 3 + years’ experience with ETL, Data Mining, Data Modeling, and working with large-scale datasets 1+ years’ experience with an object-oriented programming language such as Python, C++, Java, etc. Extremely proficient in writing performant SQL working with large data volumes Experience with map-reduce, Spark, Kafka, Presto, and the ecosystem.  Experience in building automated analytical systems utilizing large data sets. Familiarity with AWS technologies preferred

Requires a bachelor's degree in area of specialty and experience in the field or in a related area. Familiar with standard concepts, practices, and procedures within a particular field. Relies on experience and judgment to plan and accomplish goals. Performs a variety of tasks. A degree of creativity and latitude is required. Typically reports to a supervisor or manager. Designs, develops, and implements web-based Java applications to support business requirements. Follows approved life cycle methodologies, creates design documents, and performs program coding and testing. Resolves technical issues through debugging, research, and investigation.   Additional Job Details: Strong in Java, Spring, Spring Boot, REST and developing MicroServices. Knowledge or experience , Cassandra preferred Knowledge or experience on Kafka Good to have but not must   Good to know: Reporting tools like Splunk/Grafana Protobuf Python/Ruby

Primary Skills required: Java, J2ee, JSP, Servlets, JDBC, Tomcat, Hadoop (hdfs, map reduce, hive, hbase, spark, impala) Secondary Skills: Streaming, Archiving , AWS / AZURE / CLOUD Role:·         Should have strong programming and support experience in Java, J2EE technologies ·         Should have good experience in Core Java, JSP, Sevlets, JDBC·         Good exposure in Hadoop development ( HDFS, Map Reduce, Hive, HBase, Spark)·         Should have 2+ years of Java experience and 1+ years of experience in Hadoop ·         Should possess good communication skills ·         Web Services or Elastic \ Map Reduce  ·         Familiarity with data-loading tools such as Sqoop ·         Good to know: Spark, Storm, Apache HBase

Responsibilities Ensure timely and top-quality product delivery Ensure that the end product is fully and correctly defined and documented Ensure implementation/continuous improvement of formal processes to support product development activities Drive the architecture/design decisions needed to achieve cost-effective and high-performance results Conduct feasibility analysis, produce functional and design specifications of proposed new features. · Provide helpful and productive code reviews for peers and junior members of the team. Troubleshoot complex issues discovered in-house as well as in customer environments. Qualifications · Strong computer science fundamentals in algorithms, data structures, databases, operating systems, etc. · Expertise in Java, Object Oriented Programming, Design Patterns · Experience in coding and implementing scalable solutions in a large-scale distributed environment · Working experience in a Linux/UNIX environment is good to have · Experience with relational databases and database concepts, preferably MySQL · Experience with SQL and Java optimization for real-time systems · Familiarity with version control systems Git and build tools like Maven · Excellent interpersonal, written, and verbal communication skills · BE/B.Tech./M.Sc./MCS/MCA in Computers or equivalent

Primary responsibility is to take up product development as a full stack developer and ability to work with the larger product team, arrive at best architectural approach, choose most appropriate frameworks, code and deliver Shown success as an individual contributor. Should have consistently demonstrated ability and commitment to deliver major initiatives in a timely manner Embrace good development practices including design specification, coding standards, unit testing and code reviews A self­starter, who loves to take on hard problems, loves solving service scalability problems, enjoys breaking things and enthusiastic to learn new technologies and working in startup environments

3. Key Result Areas   ·         Create and maintain optimal data pipeline, ·         Assemble large, complex data sets that meet functional / non-functional business requirements. ·         Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. ·         Keep our data separated and secure ·         Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. ·         Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics. ·         Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. ·         Work with data and analytics experts to strive for greater functionality in our data systems   4. Knowledge, Skills and Experience   Core Skills: We are looking for a candidate with 7+ years of experience in a Data Engineer role. They should also have experience using the following software/tools: ·         Experience in developing Big Data applications using Spark, Hive, Sqoop, Kafka, and Map Reduce ·         Experience with stream-processing systems: Spark-Streaming, Strom etc. ·         Experience with object-oriented/object function scripting languages: Python, Scala etc ·         Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data ·         Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus ·         Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. ·         Experience with Azure cloud services is a plus ·         Financial Services Knowledge is a plus

What is the Job like? You will be working closely with Java backend Team Breaking down complex requirements into simpler stories. Working with various stakeholders and helping convert requirements to code. Managing, mentoring and reviewing engineers for their technical contribution. Participating actively in hiring and nurturing of talent.  Your focus will be on delivering products in a timely manner with high quality. Familiarity with multiple software development practices and tools, and the proven ability to adapt os expected as well.    Required expectations for the Job Role: 5+ years of experience building scalable systems including at least 2 years of direct people management experience. Worked on large scale Java, Spring, Hibernate applications with a good understanding of web stack. Good understanding of nuances of micro-services systems and REST APIs. Good understanding of relational databases preferably - MySQL. Worked with Message Brokers like Rabbit MQ, Apache Kafka and Application Containers like Docker. Analyze, design and architect, develop and maintain software solutions across multiple projects.  You’re should be able to communicate effectively among and between stakeholder groups You will be working closely with Java backend Team