Summary
Our Kafka developer has a combination of technical skills, communication skills and business knowledge. The developer should be able to work on multiple medium to large projects. The successful candidate will have excellent technical skills of Apache/Confluent Kafka, Enterprise Data WareHouse preferable GCP BigQuery or any equivalent Cloud EDW and also will be able to take oral and written business requirements and develop efficient code to meet set deliverables.
Must Have Skills
- Participate in the development, enhancement and maintenance of data applications both as an individual contributor and as a lead.
- Leading in the identification, isolation, resolution and communication of problems within the production environment.
- Leading developer and applying technical skills Apache/Confluent Kafka (Preferred) AWS Kinesis (Optional), Cloud Enterprise Data Warehouse Google BigQuery (Preferred) or AWS RedShift or SnowFlakes (Optional)
- Design recommending best approach suited for data movement from different sources to Cloud EDW using Apache/Confluent Kafka
- Performs independent functional and technical analysis for major projects supporting several corporate initiatives.
- Communicate and Work with IT partners and user community with various levels from Sr Management to detailed developer to business SME for project definition .
- Works on multiple platforms and multiple projects concurrently.
- Performs code and unit testing for complex scope modules, and projects
- Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume environment (~900 Million messages)
- Provide expertise in Kafka brokers, zookeepers, KSQL, KStream and Kafka Control center.
- Provide expertise and hands on experience working on AvroConverters, JsonConverters, and StringConverters.
- Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.
- Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API.
- Working knowledge on Kafka Rest proxy.
- Ensure optimum performance, high availability and stability of solutions.
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices.
- Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. Leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver our solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.
- Use automation tools like provisioning using Jenkins, Udeploy or relevant technologies
- Ability to perform data related benchmarking, performance analysis and tuning.
- Strong skills in In-memory applications, Database Design, Data Integration.
About DataMetica
Similar jobs
Backend Developer
Technical Overview
* You will be expected to develop and maintain large-scale complex backend web applications.
* You will be expected to rapidly learn and apply relevant new technologies.
* You will be having a high level of interaction with business and product stakeholders.
* You will be working on the entire web application stack, which includes:
- Web server hosting
- RESTful / RPC communication
- Message brokering
- Backend application layer, which includes the service and domain layers
- Data layer for persistence or caching
* You will be participating in an agile software development cycle, which includes:
- Design
- Development
- Code Review
- Unit and Integration Testing
- Deployment
* You will be exposed to the following technologies:
- Web application frameworks: Ruby on Rails, Node.js, Java Play, Vert.x, AIOHTTP, AWS Lambda
- Languages: Ruby, Java, Kotlin, Javascript, Python
- Datastores: PostgreSQL, Aerospike, Redis, Amazon Redshift
- Communication: HTTP, Amazon SQS, Sidekiq, Amazon SNS
- Server Management: Amazon ECS, Docker
Product Overview
* You will be contributing to products concerning both customers and partner drivers.
* Product sectors include:
- Growth: You’ll build tools to help boost user growth on the platform including our industry best driver on-boarding, training and certification system, referral system, and lead management models.
- Lifecycle Management: Build tools to help users engage with the platform better, which includes rewards and recognition module, subscription service, account management tools, partner and customer wallets and payout modules, and churn detection systems among others.
- Transaction Experience: You’ll help deliver the most delightful booking experience to our customers and drivers. As part of this team, you’ll be responsible for our core booking system, pricing and payment systems, location tracking and filtering services, fraud prevention systems, and in-app ticketing and support among others.
- Fulfilment: As part of the fulfilment team, you’ll work on systems which ensure high degree of ride fulfilment on the platform. Tools including allocation methodologies and system, dynamic pricing, dynamic partner routing, and partner re-activation tools among others.
- Enterprise Solutions: You’ll help Porter’s enterprise customers achieve delivery excellence. You’ll build tools for contract management, fleet management, fleet and route optimization tools, alerting and monitoring tools, and analytics suite among others.
Qualification Prerequisites
- Colleges: All NITs, IIITs and IITs, BITS, PEC, VIT, PESIT, DTU and Indraprastha University
- CGPA: >= 7.5
Responsibilities:
- Collaborate with cross-functional teams to define, design, and ship new features.
- Develop and maintain web applications using Angular and C# .NET.
- Design, build, and maintain efficient, reusable, and reliable code.
- Ensure the best possible performance, quality, and responsiveness of the application.
- Identify and correct bottlenecks and fix bugs.
- Work with external data sources and APIs.
- Unit-test code for robustness, including edge cases, usability, and general reliability.
- Collaborate with other developers and stakeholders to ensure successful project completion.
Requirements:
- Bachelor's degree in Computer Science, Software Engineering, or related field.
- 2+ years of experience in web application development using Angular and C# .NET.
- Strong knowledge of Angular 2+ and TypeScript.
- Experience with Angular Material and Bootstrap.
- Experience with C# .NET and .NET framework.
- Knowledge of relational database design and development using SQL Server.
- Familiarity with agile development methodologies.
- Strong analytical and problem-solving skills.
- Excellent written and verbal communication skills.
- Ability to work independently and as part of a team.
Preferred Qualifications:
- Experience with ASP.NET Core.
- Experience with Entity Framework Core.
- Experience with Azure Cloud Services.
- Familiarity with unit testing frameworks such as NUnit and xUnit.
- Experience with source control management tools such as Git.
- Knowledge of CI/CD pipelines using Azure DevOps or similar tools.
- 4 to 7 years of experience (or equivalent understanding of software engineering)
- Strong in Javascript & Typescript + frameworks like React, Next.js, Angular, etc.
- Strong experience in architecting complex, distributed systems in public or private cloud
- Willingness and interest in learning new tech/processes (Python, Airflow, Postgres, etc.)
- Willingness to travel to offices in New York City, San Francisco, and Hyderabad
DUTIES / ACCOUNTABILITIES
Responsibilities include, but may not be restricted to:
- Analyze an organization and understand its processes and systems, to define the current state of the process (as is process map) and documenting relevant information needed to determine automation potential. The examples are as below :
- Process steps, number of applications involved, and process steps per application
- Process volumes, including any seasonal variations.
- FTE needed to execute the process
- Average handling time
- Process interdependencies
- Target SLA , Financial or regulatory points associated with the process.
- Process error rate, error volumes, and exception handling steps
- % of process steps including paper, voice, digital etc.
- Define the future state and/or business solution to automate the defined processes by designing the to-be process maps that includes some of the following information:
- Identifying & documenting clearly
- The steps in the process suited for automation
- The source systems, work queues, the flow of the steps, the decision points, the exception paths, and the business rules
- Outputs and exceptional handling scenarios
- Scenarios and test data
- Reduction in Average handling, and FTE takeout as a result of automation
- Recommendations to alter or reengineer process to improve automation potential
- Processes that are not suitable, or would not lend any return on investment
- Ensures the designs are documented within the defined project timelines, and with quality.
- Performs Quality Control via reviews of the design created by other business analysts.
- Responsible for receiving the sign-off on the design from the customer, and place the design under configuration control.
- Serves as the functional expert for the development and test teams.
- Resolve queries/issues from the development and test teams.
KEY SKILLS
- 6 - 10 years of experience in requirements gathering, requirement management, gap analysis and SDLC.
- Working experience as a process architect/business analyst
- Experienced in writing Use Cases and High Level Functional cum Technical analysis deliverables
- Experience in working with key business representatives, data owners, end users, application designers and data architects to model current & to be processes.
- Eye for detail and good documentation skills are needed
- Fluency in English, both written and verbal essential
- Strong ability to understand the steps of a process that lend itself to automation. Knowledge of key features of the automation product is needed.
- Advanced problem solving and analytical skills.
- Ability to multi task in a fast-paced environment.
Below is a list of several skills required to deliver on responsibilities for this role:
- Minimum 2+ years of experience in React Native/ React development
- Familiarity with AWS solutions like Amplify , Cognito, DynamoDB will be a bonus
- Should be able to write reusable, testable, and efficient code. Should be able to design and implement low-latency, high-availability, and high-performance applications.
- Architect & design technically robust, flexible, and scalable solutions
- You must have experience in deploying Android/iOS apps previously on playstore/Appstore.
- You should be able to build pixel-perfect, amazingly smooth UIs across both mobile platforms.
- Diagnose and fix bugs and performance bottlenecks for performance that feels native
- .
- Firm grasp of the JavaScript language and its nuances, including ES6+ syntax.
If you always thought of yourself as entrepreneurial, customer-obsessed, results-oriented, strategic yet execution focused, hungry and passionate about technology, we have a dream opportunity to back yourself up.
Compensation: Cash and stocks for U.S company (to be discussed on a case to case basis)
An Engineer’s Life @ SequoiaAT
As an Engineer, SequoiaAT will be a dream job for you. You will have an opportunity to work on technologies and product before they hit the market and get popular. If working on a gadget you may get to own one of them as an early tester. Working with us we have a be your own boss culture so you will have plenty of opportunities to interact directly with our customers and their customer. Our goals just do not end there, we want to work with you on your personal development goals and ensure that you meet them. We work on projects involving hardware integration, Wireless Including (BLE, LoRa, WiFi etc.) , Data Analytics, Digital Transformation etc. We are all engineers and we do not want you to have a feeling that you got stuck on one project and could not grow your career. We expect you to contribute to a variety of projects during a given period of time. We keep you well informed about new technology trends through our tech chat sessions and secondary skill development process.
Is it right job the right one for you?
If you are passionate and through about what you have been doing and willing to learn daily, then you will fit in very well. You should also have the ability to freely and clearly communicate your ideas or thoughts to succeed at SequoiaAT.
What Technology Skills required for this?
Primary Skills: Node.js What’s expected from your experience in primary skills area?
Strong proficiency in Node.js, frameworks (e.g. Express), and JavaScript Development of server-side logic, including APIs and views.
Deep knowledge of server-side templating languages, front-end technologies, fundamental design principles, HTML5, and CSS.
Integration of third party APIs Deployment of autoscaling strategies Write reusable, testable, and efficient code.
Proficient understanding of code versioning tools such as Git Understanding of the Agile Development Process (i.e. Scrum)
Knowledge in React is a plus Secondary Skills
- Writing clean and efficient code for Android applications.
- Atleast published 1-2 apps on play store.
- Identifying and resolving bottlenecks, rectifying bugs and enhancing application performance.
- Collaborating with cross-functional teams to define and design new features.
- Staying up to date with new mobile technology trends, applications, and protocols.
- You have prior exposure to Kotlin, Android SDK.
- Understanding of design patterns and mobile architecture using frameworks such as MVVM / MVC / MVP.
- Familiarity with RESTful APIs to effectively integrate Android applications.
- Understanding of code versioning tools such as Git.
- You are a problem solver with good analytical skills.
- Prior experience in accessibility applications or voice-based applications will be a plus not a necessity
- Passion to work in dynamic, start-up environment
Job Description for Java Developer (Hinjewadi, Pune)
About the Position:- We at nCircle Tech aspire to be an organization that provides exciting and challenging work to build next-generation software built using the latest technologies. We are looking for techno enthusiast software developers with a very good understanding & experience of web & cloud-based software development for providing value to our customers.
This position requires you to work on cutting edge, mission critical Java / J2EE based enterprise software applications with opportunity to work on the latest cloud computing and collaborative technologies.
Your key responsibilities would include:
Responsibilities:
● Develop different modules, features of a given application as per the requirements.
● Write scalable code as per standard coding practices
● Ensure effective use of proper tools & adherence to the software development process.
● Involve in troubleshooting, Unit Testing, peer review as required
● Actively participate in daily standups, client meetings & demo as required
● Assist in effort estimations, technical documentation, interview process as required.
This is You:
● Have 2+ years proven experience in core Java, J2EE and have excellent codecraft
● Have hands-on experience in application development using Spring, JBoss.
● Knowledge of Hibernate & Web Services (Rest/SOAP) would be added advantage
● Have strong fundamental background on OOPs concepts
● Excellent communication and teamwork skills
● Great attention to detail and meeting sprint and project deadlines
● Someone who takes ownership of assigned tasks proactively
Preferred Qualification: ● B.Tech, B.E, M.Tech, MCA, MSc.Computers
BENEFITS :
● Hybrid working in-line with Govt / SEZ norms
● 5 day working week with flexible working times
● Standard healthcare benefits with family floater ( self + spouse + upto 2 kids)
● Flexible salary structure ( NPS / LTA / Meal Card ) benefits
● Frequent training, online library and subscriptions
● Attractive Referral Bonus if you bring other talented people like you
● Attractive rewards & recognition scheme