Python Developer

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.

Required Skills:

• Python: Advanced proficiency with extensive experience in building data pipelines.
• AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
• Spark: Proficient in using Apache Spark for large-scale data processing.
• Scala: Working knowledge of Scala for Spark programming.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with SQL and relational databases.
• Familiarity with data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Hiring For SDE II - Python (Remote)

The Impact you will create:

• Build campaign generation services which can send app notifications at a speed of 10 million a minute

• Dashboards to show Real time key performance indicators to clients

• Develop complex user segmentation engines which creates segments on Terabytes of data within few seconds

• Building highly available & horizontally scalable platform services for ever growing data

• Use cloud based services like AWS Lambda for blazing fast throughput & auto scalability

• Work on complex analytics on terabytes of data like building Cohorts, Funnels, User path analysis, Recency Frequency & Monetary analysis at blazing speed

• You will build backend services and APIs to create scalable engineering systems.

• As an individual contributor, you will tackle some of our broadest technical challenges that requires deep technical knowledge, hands-on software development and seamless collaboration with all functions.

• You will envision and develop features that are highly reliable and fault tolerant to deliver a superior customer experience.

• Collaborating various highly-functional teams in the company to meet deliverables throughout the software development lifecycle.

• Identify and improvise areas of improvement through data insights and research.

Primary Responsibilities

• End-to-end ownership of product development, from design, through implementation, testing, deployment, and maintenance

• Translating high-level requirements and end-user use cases into design proposals, decomposing complex features into smaller, short-term deliverable tasks

• Maintaining constant focus on scalability, performance and robustness of architecture

• Designing and implementing logging, monitoring and alerting systems for existing and new infrastructure

• Documenting API's and architecture design

• Mentor and guide juniors on their path to become solid developers

   

What we look for?

• 4+ of industry experience in technical leadership roles

• Solid knowledge of Python, SQL, NoSQL, shell scripting and Linux operating environment

• End-to-end experience in design and development of highly scalable enterprise and cloud data products

• Ability to challenge and redefine existing architecture to create robust, scalable and reliable products

• Hands-on experience with design and troubleshooting of scalable web services, queue based systems, distributed databases and streaming services

• Experience with modern DevOps technologies such as kOps, Kubernetes and Docker, CI/CD, monitoring and autoscaling

Key Responsibilities:

● Work closely with product managers, designers, frontend developers, and other

cross-functional teams to ensure the seamless integration and alignment of frontend and

backend technologies, driving cohesive and high-quality product delivery.

● Develop and implement coding standards and best practices for the backend team.

● Document technical specifications and procedures.

● Stay up-to-date with the latest backend technologies, trends, and best practices.

● Collaborate with other departments to identify and address backend-related issues.

● Conduct code reviews and ensure code quality and consistency across the backend team.

● Create technical documentation, ensuring clarity for future development and

maintenance.

Requirements;

● Experience: 4-6 years of hands-on experience in backend development, with a strong

background in product-based companies or startups.

● Education: Bachelor’s degree or above in Computer Science or a related field.

● Programming skills: Proficient in Python and software development principles, with a

focus on clean, maintainable code, and industry best practices. Experienced in unit

testing, AI-driven code reviews, version control with Git, CI/CD pipelines using GitHub

Actions, and integrating New Relic for logging and APM into backend systems.

● Database Development: Proficiency in developing and optimizing backend systems in

both relational and non-relational database environments, such as MySQL and NoSQL

databases.

● GraphQL: Proven experience in developing and managing robust GraphQL APIs,

preferably using Apollo Server. Ability to design type-safe GraphQL schemas and

resolvers, ensuring seamless integration and high performance.

● Cloud Platforms: Familiar with AWS and experienced in Docker containerization and

orchestrating containerized systems.

● System Architecture: Proficient in system design and architecture with experience in

developing multi-tenant platforms, including security implementation, user onboarding,

payment integration, and scalable architecture.

● Linux Systems: Familiarity with Linux systems is mandatory, including deployment and

management.

● Continuous Learning: Stay current with industry trends and emerging technologies to

influence architectural decisions and drive continuous improvement.

Benefits:

● Competitive salary.

● Health insurance.

● Casual dress code.

● Dynamic & Collaboration friendly office.

● Hybrid work schedule.

Industry

• IT Services and IT Consulting

Employment Type

Full-time

• Design and build user-facing products, owning the entire process from gathering functional requirements from teams, through testing and staging, to deploying in a Python based stack
• Guide the team in making technical trade-offs
• Proactively identify bottlenecks, areas for improvement and put forth a plan to course-correct
• Design and implement maintainable backend services, including data processing pipelines, APIs and internal tools
• Coordinating with internal teams to understand user requirements and provide technical solutions

We're looking for exprienced Python developers with over 2+ years of production experience and strong expertise in building web applications and APIs using Python, Django and DRF. We are looking for cadidates who are go-getters and are leaning towards leadership positions. Candidates must have a proven history of building, scaling, optimising and securing Python based backends and APIs using a microservice architecture.

Bonus Skills : Experience with ReactJs, Node.js, FastAPI

We would prefer candidates who can join immediately or are currently serving their notice period. Jumpers please excuse, your application will be ignored

Key Skills Required

1. Proficiency in Python 3.x based web and backend development
2. Solid understanding of Python concepts
3. Strong experience in building web applications using Django
4. Experience building REST APIs using DRF or Flask
5. Experience with some form of Machine Learning (ML)
6. Experience in using libraries such as Numpy and Pandas
7. Hands on experience with RDBMS such as Postgres or MySQL including querying
8. Comfort with Git repositories, branching and deployment using Git
9. Working experience with Docker
10. Basic working knowledge of ReactJs
11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku

Responsibilities

1. Understanding requirement and congributing to engineering solutions at a conceptual stage to provide the best possible solution to the task/challenge
2. Building high quality code using coding standards based on the SRS/Documentation
3. Building component based, maintainable, scalable and reusable backend libraries/modules.
4. Building & documenting scalable APIs on the Open Spec standard
5. Unit testing development modules and APIs
6. Conducting code reviews to ensure that the highest quality standard are maintained
7. Securing backend applications and APIs using industry best practices
8. Troubleshooting issues and fixing bugs raised by the QA team efficiently.
9. Optimizing code
10. Building and deploying the applications

• Employment type

  Full-time

• Excellent knowledge in one or more of Python/NodeJS REST Frameworks 
• Hands on experience in system architecture and data modelling. Experience with databases like MySQL, Postgres, MongoDB.
• Devops capabilities - with good understanding of deployments and cloud infrastructure. In depth knowledge of container architecture using Docker is must. 
• Scaled systems using RabbitMQ/ Redis /Celery/ Kafka