Hadoop Developer

Job Title: Python Developer - Django (Full Time)

Location: Gurgaon, Onsite

Interview: Virtual Interview

Experience Required: 3+ Years

About the Role

We are looking for a skilled Python Developer with hands-on experience in building scalable backend systems. The ideal candidate should have strong expertise in Python, Django, distributed task queues using Celery, Redis, RabbitMQ, and experience working with event streaming platforms like Kafka.

Key Responsibilities

• Design, develop, and maintain backend services using Python and Django.
• Implement and optimize task queues using Celery with Redis/RabbitMQ as brokers.
• Develop and integrate event-driven systems using Apache Kafka.
• Write clean, reusable, and efficient code following best practices.
• Build RESTful APIs and integrate with external services.
• Ensure performance, scalability, and security of applications.
• Collaborate with frontend developers, DevOps, and product teams to deliver high-quality solutions.
• Troubleshoot and debug issues in production and staging environments.

Required Skills & Experience

• 2+ years of professional experience in Python backend development.
• Strong knowledge of Django Framework.
• Hands-on experience with Celery, Redis, RabbitMQ, and Kafka.
• Good understanding of REST API design principles.
• Experience with relational databases (PostgreSQL/MySQL).
• Familiarity with version control (Git) and Agile development.
• Strong problem-solving skills and ability to work in a fast-paced environment.

Job Description:

Responsibilities:

·      Participate in the entire application lifecycle, focusing on coding and debugging

·      Ability to design and document the product features, codes.

·      Self-driven and ability to take up ownership of things

·      Write clean code to develop functional applications, automation scripts, test cases

·      Troubleshoot and debug applications

·      Collaborate with developers, cross-functional teams to identify issue, new features and come up with solutions

·      Gather and address technical and design requirements

·      Provide training and support to internal teams

·      Build reusable code and libraries for future use

·      Ability to sync with other developers, designers to identify issues, new features and improvements

Requirements and skills:

·      Solid understanding of linux development environment and systems

·      Expert level knowledge of Python along with frameworks like Django, flask

·      Proficient in writing unit test cases using Pytest framework.

·      Expert level knowledge of SQL databases like MySQL and PostgreSQL

·      Good knowledge of design principles and databases

·      Knowledge of front technologies like Typescript, ReactJs

·      Knowledge of Caching techniques using Memcached and Redis

·      Experience of using queueing service line Kafka

·      Solid understanding of microservices architecture

·      Knowledge of AWS cloud services

·      Expert in serverless technologies like lambda along with API gateway

·      Knowledge of Git, Jira, CI/CD pipelines and containerization like docker

·      Knowledge of logging and monitoring tools like Grafana or Newrelic

Job Location: Pune 

Experience: 4- 5 years

Functional Area - IT Software - Application Programming , Maintenance

Role Category : Programming & Design

Requirement / Job Description:

 Core Skills:

 Strong experience of Core Java (1.7 or higher), OOPS concepts and Spring framework (Core,     AOP, Batch, JMS)

 Demonstrated design using Web Services (SOAP and REST)

 Demonstrated Microservices APIs design experience using Spring, Springboot

 Demonstrable experience in Databases like MySQL, PostgreSQL, Oracle PL/SQL development etc

Strong coding skills, good analytical and problem-solving skills

Excellent understanding of Authentication, Identity Management, REST APIs, security and best practices

 Good understanding of web servers like Tomcat Apache, nginx or Vertex/ Grizzly, JBoss etc

 Experience in OAuth principles

 Strong understanding of various Design patterns

Other Skills:

  Familiarity with Java Cryptography Architecture (JCA)

 Understanding of API Gateways like Zuul, Eureka Server etc..

 Familiarity with Apache Kafka, MQTT etc.

Responsibilities:

 Design, develop, test and debug software modules for an enterprise security product

 Find areas of optimization and produce high quality code

 Collaborate with product managers and other members of the project team in requirements specification and detailed engineering analysis.

 Collaborate with various stake holders and help bring proactive closure on the issues

 Evaluate various technology trends and bring in the best practices

 Innovate and come out of the box solutions

Adapt, thrive and deliver in a highly evolving and demanding product development team

Come up with ways to provide an improved customer experience

CTC Budget: 35-55LPA

Location: Hyderabad (Remote after 3 months WFO)

Company Overview:

An 8-year-old IT Services and consulting company based in Hyderabad providing services in maximizing product value while delivering rapid incremental innovation, possessing extensive SaaS company M&A experience including 20+ closed transactions on both the buy and sell sides. They have over 100 employees and looking to grow the team.

• 6 plus years of experience as a Python developer.
• Experience in web development using Python and Django Framework.
• Experience in Data Analysis and Data Science using Pandas, Numpy and Scifi-Kit - (GTH)
• Experience in developing User Interface using HTML, JavaScript, CSS.
• Experience in server-side templating languages including Jinja 2 and Mako
• Knowledge into Kafka and RabitMQ (GTH)
• Experience into Docker, Git and AWS
• Ability to integrate multiple data sources into a single system.
• Ability to collaborate on projects and work independently when required.
• DB (MySQL, Postgress, SQL)

Selection Process: 2-3 Interview rounds (Tech, VP, Client)

Job Description:

Engage in code design, testing, integration, deployment, and enhancements

Write high-quality code and take responsibility for tasks

Solve performance bottlenecks

Communicate and collaborate with product manager, QA, and UI/UX teams

Deliver with quality, on-time in a fast-paced start-up environment

Have a strong sense of code quality

Candidate Profile:

Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)

At least 5+ years of relevant experience as a back-end engineer

Excellent Java and object-oriented development skills

Experience in building and scaling microservices

Strong problem-solving skills, technical troubleshooting, and diagnosing

Solid knowledge of RDBMS and NoSQL technologies

Experience in developing back-ends for enterprise systems

Knowledge of debugging performance and optimization techniques

Experience in Java, Mongo, MySQL, AWS technologies, ELK stack, Spring boot, Kafka

Good knowledge of cloud technologies eg. AWS

Demonstrated ability to deliver in a fast-paced environment

KEY RESPONSIBILITIES

• Building a website based on the given requirements and ensure it’s successfully deployed
• Responsible for designing, planning, and testing new web pages and site features
• A propensity for brainstorming and coming up with solutions to open-ended problems
• Work closely with other teams, and project managers, to understand all stakeholders’ requirements and ensure that all specifications and requirements are met in final development
• Troubleshoot and solve problems related to website functionality
• Takes ownership of initiatives and drives them to completion.
• Desire to learn and dive deep into new technologies on the job, especially around modern data storage and streaming open source systems
• Responsible for creating, optimizing, and managing REST APIs
• Create website content and enhance website usability and visibility
• Ensure cross-browser compatibility and testing for mobile responsiveness
• Ability to integrate payment processing and search functionality software solutions
• Stay up-to-date with technological advancements and the latest coding practices
• Collaborate with the team of designers, content managers, and developers to determine site goals, functionality, and layout
• Monitor website traffic and overall system’s health with Google analytics to ensure high GTmetrix score
• Build the front-end of applications through appealing visual design
• Design client-side and server-side architecture
• Develop server-side logic and APIs that integrate with front-end applications.
• Architect and design complex database structures and data models.
• Develop and implement backend systems to support scalable and high-performance web applications.
• Create automated tests to ensure system stability and performance.
• Ensure security and data privacy measures are maintained throughout the development process.
• Maintain an up-to-date changelog for all new, updated, and fixed changes.
• Ability to document and manage all the software design, requirements, reusable & transferable code, and other technical aspects of the project.
• Create and convert storyboards and wireframes into high-quality full-stack code
• Write, execute, and maintain clean, reusable, and scalable code
• Design and implement low-latency, high-availability, and performant applications
• Implement security and data protection
• Ensure code that is platform and device-agnostic

EDUCATION & SKILLS REQUIREMENT

• B.Tech. / BE / MS degree in Computer Science or Information Technology
• Expertise in MERN stack (MongoDB, Express.js, React.js, Node.js)
• Should have prior working experience of at least 3 years as web developer or full stack developer
• Should have done projects in e-commerce or have preferably worked with companies operating in e-commerce
• Should have expert-level knowledge in implementing frontend technologies
• Should have worked in creating backend and have deep understanding of frameworks
• Experience in the complete product development life cycle
• Hands-on experience with JavaScript, HTML, CSS, JQuery, JSON, PHP, XML
• Proficiency in databases, including analytical (e.g., mySQL, MongoDB, PostgreSQL, DynamoDB, Redis, Hive, Elastic etc.)
• Knowledge of architecting or implementing search APIs
• Great understanding of data modeling and RESTful APIs
• Strong knowledge of CS fundamentals, data structures, algorithms, and design patterns
• Strong analytical, consultative, and communication skills
• Excellent understanding of Microsoft office tools : excel, word, powerpoint etc.
• Excellent organizational and time management skills
• Experience with responsive and adaptive design (Web, Mobile & App)
• Should be a self starter and have ability to work without being supervised
• Excellent debugging and optimization skills
• Experience building high throughput/low latency systems.
• Knowledge of big data systems such as Cassandra, Elastic, Kafka, Kubernetes, and Docker
• Should be willing to be a part of a small team and working in fast-paced environment
• Should be highly passionate about building products that create a significant impact.
• Should have experience in user experience design, website optimization techniques and different PIM tools

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development,  Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of  using Python/Perl/Shell

Please note - Hbase hive and spark are must.

Your Opportunity

• Own and drive business features into tech requirements
• Design & develop large scale real time server side systems
• Quickly create quality prototypes
• Staying updated on emerging technologies
• Ensuring that all deliverables adhere to our world class standards
• Promote coding best practices
• Mentor and develop junior developers in the team

Required Experience:

• 4+ years of relevant experience as described below
• Excellent grasp of Core Java, Multi Threading and OO design patterns
• Experience with Scala, functional, reactive programming and Akka/Play is a plus
• Excellent understanding of data structures and algorithms
• Solid grasp of large scale distributed real time systems
• Prior experience on building a scalable and resilient micro service
• Solid understanding of relational databases, NoSQL databases and Caching systems
• Good understanding of Big Data technologies such as Spark, Hadoop is a plus
• Experience on one of AWS, Azure or GCP

Who you are :

• You have excellent and effective communication and collaborative skills
• You love problem solving
• You stay up to date with the latest technologies and then apply them in real life
• You love paying attention to detail
• You thrive in meeting tight deadlines and prioritising workloads
• Ability to collaborate across multiple functions

Education:

Bachelor’s degree in Engineering or equivalent experience within the field

Spark / Scala experience should be more than 2 years.

Combination with Java & Scala is fine or we are even fine with Big Data Developer with strong Core Java Concepts. - Scala / Spark Developer.

Strong proficiency Scala on Spark (Hadoop) - Scala + Java is also preferred

Complete SDLC process and Agile Methodology (Scrum)

Version control / Git