Hadoop Developer

Experience in Core Java and Spring Boot.

 • Extensive experience in developing enterprise-scale applications and systems. Should possess good architectural knowledge and be aware of enterprise application design patterns. 

• Should have the ability to analyze, design, develop and test complex, low-latency clientfacing applications. 

• Good development experience with RDBMS.

 • Good knowledge of multi-threading and high-performance server-side development. • Basic working knowledge of Unix/Linux. 

• Excellent problem solving and coding skills. 

• Strong interpersonal, communication and analytical skills. 

• Should have the ability to express their design ideas and thoughts

Job Title: Python Developer - Django (Full Time)

Location: Gurgaon, Onsite

Interview: Virtual Interview

Experience Required: 3+ Years

About the Role

We are looking for a skilled Python Developer with hands-on experience in building scalable backend systems. The ideal candidate should have strong expertise in Python, Django, distributed task queues using Celery, Redis, RabbitMQ, and experience working with event streaming platforms like Kafka.

Key Responsibilities

• Design, develop, and maintain backend services using Python and Django.
• Implement and optimize task queues using Celery with Redis/RabbitMQ as brokers.
• Develop and integrate event-driven systems using Apache Kafka.
• Write clean, reusable, and efficient code following best practices.
• Build RESTful APIs and integrate with external services.
• Ensure performance, scalability, and security of applications.
• Collaborate with frontend developers, DevOps, and product teams to deliver high-quality solutions.
• Troubleshoot and debug issues in production and staging environments.

Required Skills & Experience

• 2+ years of professional experience in Python backend development.
• Strong knowledge of Django Framework.
• Hands-on experience with Celery, Redis, RabbitMQ, and Kafka.
• Good understanding of REST API design principles.
• Experience with relational databases (PostgreSQL/MySQL).
• Familiarity with version control (Git) and Agile development.
• Strong problem-solving skills and ability to work in a fast-paced environment.

Job Role: We are seeking a skilled Java Developer to contribute to the development and enhancement renowned banking application, which supports automatic reconciliation and unified data reporting for their clients. This role involves working on high-impact enhancements, data pipeline integration, and platform modernization. The ideal candidate will be a quick learner, self-motivated, and able to ramp up quickly in a fast-paced environment. 

Key Responsibilities:

 Design, develop, and maintain Java-based applications using Java 17 and Spring Boot.

 Implement and manage message routing using Apache Camel.

 Develop and monitor data pipelines using Kafka.

 Support and enhance existing cloud-native applications.

 Work with OpenShift Container Platform (OCP 4) for container orchestration and deployments.

 Utilize Jenkins for CI/CD pipeline automation and management.

 Collaborate with cross-functional teams to integrate multiple data sources into a unified reporting platform.

 Participate in code reviews, unit testing, and performance tuning.

 Troubleshoot and resolve production issues in collaboration with operations teams.

 Document development processes and system configurations.

Required Skills:

 Strong proficiency in Java 17 and Spring Boot frameworks.

 Hands-on experience with Apache Camel for message routing and transformation.

 Solid experience in Kafka development and monitoring tools.

 Good understanding of cloud pipeline architectures and deployment strategies.

 Experience working with OpenShift (OCP 4).

 Familiarity with Jenkins for CI/CD and automated deployments.

 Understanding of cloud deployment platforms (AWS, Azure, or GCP preferred).

 Strong analytical and debugging skills.

 Ability to learn quickly and adapt to evolving project requirements.

Nice to Have:

 Experience in financial services or transaction reporting platforms.

 Familiarity with microservices architecture and containerization best practices.

 Knowledge of monitoring tools (e.g., Prometheus, Grafana).

Experience:

Should have a minimum of 10-12 years of Experience.

Should have experience on Product Development/Maintenance/Production Support experience in a support organization

Should have a good understanding of services business for fortune 1000 from the operations point of view

Ability to read, understand and communicate complex technical information

Ability to express ideas in an organized, articulate and concise manner

Ability to face stressful situation with positive attitude

Any certification in regards to support services will be an added advantage

Education: BE, B- Tech (CS), MCA

Location: India

Primary Skills:

Hands on experience with OpenStack framework. Ability to set up private cloud using OpenStack environment. Awareness to various OpenStack services and modules

Strong experience with OpenStack services like Neutron, Cinder, Keystone, etc.

Proficiency in programming languages such as Python, Ruby, or Go.

Strong knowledge of Linux systems administration and networking.

Familiarity with virtualization technologies like KVM or VMware.

Experience with configuration management and IaC tools like Ansible, Terraform.

Subject matter expertise in OpenStack security

Solid experience with Linux and shell scripting

Sound knowledge of cloud computing concepts & technologies, such as docker, Kubernetes, AWS, GCP, Azure etc.

Ability to configure OpenStack environment for optimum resources

Good knowledge of security, operations in open stack environment

Strong knowledge of Linux internals, networking, storage, security

Strong knowledge of VMware Enterprise products (ESX, vCenter)

Hands on experience with HEAT orchestration

Experience with CI/CD, monitoring, operational aspects

Strong experience working with Rest API's, JSON

Exposure to Big data technologies ( Messaging queues, Hadoop/MPP, NoSQL databases)

Hands on experience with open source monitoring tools like Grafana/Prometheus/Nagios/Ganglia/Zabbix etc.

Strong verbal and written communication skills are mandatory

Excellent analytical and problem solving skills are mandatory

Role & Responsibilities

Advise customers and colleagues on cloud and virtualization topics

Work with the architecture team on cloud design projects using openstack

Collaborate with product, customer success, and presales on customer projects

Participate in onsite assessments and workshops when requested 

Provide subject matter expertise and mentor colleagues

Set up open stack environments for projects

Design, deploy, and maintain OpenStack infrastructure.

Collaborate with cross-functional chapters to integrate OpenStack with other services (k8s, DBaaS)

Develop automation scripts and tools to streamline OpenStack operations.

Troubleshoot and resolve issues related to OpenStack services.

Monitor and optimize the performance and scalability of OpenStack components.

Stay updated with the latest OpenStack releases and contribute to the OpenStack community.

Work closely with Architects and Product Management to understand requirement

should be capable of working independently & responsible for end-to-end implementation

Should work with complete ownership and handle all issues without missing SLA's

Work closely with engineering team and support team

Should be able to debug the issues and report appropriately in the ticketing system

Contribute to improve the efficiency of the assignment by quality improvements & innovative suggestions

Should be able to debug/create scripts for automation

Should be able to configure monitoring utilities & set up alerts

Should be hands on in setting up OS, applications, databases and have passion to learn new technologies

Should be able to scan logs, errors, exception and get to the root cause of the issue

Contribute in developing a knowledge base on collaboration with other team members

Maintain customer loyalty through Integrity and accountability

Groom and mentor team members on project technologies and work

Job Description:

Responsibilities:

·      Participate in the entire application lifecycle, focusing on coding and debugging

·      Ability to design and document the product features, codes.

·      Self-driven and ability to take up ownership of things

·      Write clean code to develop functional applications, automation scripts, test cases

·      Troubleshoot and debug applications

·      Collaborate with developers, cross-functional teams to identify issue, new features and come up with solutions

·      Gather and address technical and design requirements

·      Provide training and support to internal teams

·      Build reusable code and libraries for future use

·      Ability to sync with other developers, designers to identify issues, new features and improvements

Requirements and skills:

·      Solid understanding of linux development environment and systems

·      Expert level knowledge of Python along with frameworks like Django, flask

·      Proficient in writing unit test cases using Pytest framework.

·      Expert level knowledge of SQL databases like MySQL and PostgreSQL

·      Good knowledge of design principles and databases

·      Knowledge of front technologies like Typescript, ReactJs

·      Knowledge of Caching techniques using Memcached and Redis

·      Experience of using queueing service line Kafka

·      Solid understanding of microservices architecture

·      Knowledge of AWS cloud services

·      Expert in serverless technologies like lambda along with API gateway

·      Knowledge of Git, Jira, CI/CD pipelines and containerization like docker

·      Knowledge of logging and monitoring tools like Grafana or Newrelic

Required Skills:

• 3+ years of experience in the Development of JAVA technology.
• Strong Java Basics
• SpringBoot or Spring MVC
• Hands-on experience in Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Any Caching Mechanism
• Good at problem-solving

Good to Have Skills:

• 4+ years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem-solving skills.
• Ability to work in a fast-paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding AI/ML algorithms is a plus.

• 3-8+ years of experience programming in a backend language (Java / Python), with a good understanding of troubleshooting errors. 
• 5+ years of experience in Confluent Kafka / 3+ years of experience in Confluent Kafka 

• Cloud Kafka, Control Central, Rest Proxy, HA Proxy, Confluent Kafka Connect, Confluent Kafka Security features 

• Someone’s traveling to airport/office/home - can we suggest them public transport routes with first mile & last mile and accurate tracking of the individual leg of the journey
• Someone’s new in the city - can we help them travel from A to B in the most efficient way
• Someone’s planning to not use their private vehicle for the commute - can we design an efficient and reliable system to plan their commute with accurate information of public and private transport
• Transition people from private to hybrid multimodal commute
• Someone's traveling home late at night - can we give their friends, family peace of mind?
• Build a single mobile ticket for the entire journey

What you’ll do

• Build the backend and deploy systems powering the app
• Improve routing across 10+ cities for everything from walking to trains to electric scooters to metro to bus to auto to bike
• Integrate new private transport companies and new ways of getting about our cities
• Develop smarter ways of integrating the payment systems with the app
• Extract, process and crunch together departure times, travel habits, and pricing information and suggest reliable results to users
• Create experiences that delight your friends, family, and millions of new commuters when they come and visit your city
• Design and build systems that scale on demand and are secure
• Deploy and support your code on AWS
• Best practices: code reviews, tests, CI
• Teach us how to be better our Stack (Required) Java (Spring Boot), Postgres, MongoDB, ReactJs, Golang Microservice Nginx, API Gateway, Load Balancer, Kafka, Redis, Websockets, Docker, Kubernetes, Git, AWS - EC2, RDS, s3, lambda Optional Nodejs(Express)

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team