SDE-3 (Python)

Job Summary

We are seeking a motivated Data Engineer with strong skills in SQL, Python, and Linux to design, build, and maintain scalable data pipelines and support data-driven decision-making. The ideal candidate should have experience working with large datasets, ETL processes, and relational databases while ensuring data quality and performance.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write optimized SQL queries, stored procedures, and database objects.
• Develop Python scripts for data extraction, transformation, and automation.
• Work in Linux environments to manage scripts, cron jobs, and system processes.
• Monitor and troubleshoot data pipeline failures.
• Ensure data integrity, consistency, and quality across systems.
• Collaborate with data analysts, software engineers, and business stakeholders.
• Optimize database performance and query execution.
• Participate in code reviews and follow best engineering practices.

Required Skills

• Strong proficiency in SQL (joins, subqueries, window functions, CTEs, indexing, query optimization).
• Good programming experience in Python.
• Hands-on experience with Linux commands and shell scripting.
• Understanding of ETL/ELT concepts and data warehousing.
• Knowledge of relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server.
• Familiarity with Git for version control.
• Strong problem-solving and analytical skills.

• Experience in Python
• Experience in any Framework like Django, and Flask.
• Primary and Secondary skills - Python, OOPs and Data Structure
• Good understanding of Rest Api 
• Familiarity with event-driven programming in Python 
• Good analytical and troubleshooting skills

Responsibilities:

• Take on complex problems that span multiple components and teams.

• Independently own one or more multiple modules, which include: requirement analysis, design, development, maintenance & support

• Write extensive, efficient code to address complex modules that handle the interaction between multiple components.

• Rapidly iterate to add new functionalities and solves complex problems with simple and intuitive solutions

• Produce architecture with clean interfaces, that are efficient and scalable

• Participate and contribute to architectural discussions

• Solve production issues. Investigate and provide solutions to minimize the business impact due to the outage

• Continuously improve performance metrics of modules you own.

• Collaborate effectively across teams to solve problems, execute and deliver results

Requirements:

• Experience: 3+ years

• A Bachelor's or Master's Degree in Computer Science

• Software engineering and product delivery experience, with a strong background in algorithms

• Experience in architecting & building real-time, large-scale e-commerce applications

• Experience with high-performance websites catering to millions of daily traffic is a plus

• Excellent command over Data Structures and Algorithms

• Experience with web technologies, Go/Java/Python

• Language: GO or Python

• Strong expertise in DS and Algo

• Strong leadership skills - have experience mentoring, building products from scratch or incumbent in design and architecture.

• Have worked in the scaling of the system right from scratch.

• Someone worked in small user base to a large user base and wrote optimized code

• Both HLD and LLD

DUKAAN - Create Your Online Store in 30 Seconds

Dukaan is an app that allows offline businesses to sell their products and services online. On our app, the users can make beautiful product catalogues (catalogs) right from a smartphone and share with their customers easily on different social media apps such as Whatsapp Business, Whatsapp, Facebook, Instagram etc. Praised by users all over India, this app has saved declining businesses by helping them transfer their shop online. The journey has just begun and we are on a mission to make India truly Digital.

Dukaan is currently powering over 5M ecommerce stores built by indian small businesses and growing at a crazy rate.  

We are looking for a Backend Engineer to join our team who will be part of our new innovations team.

Requirements:

1. Strong knowledge of Django, Django Rest Framework and their design principles.
2. Strong knowledge of Django ORM, should be able to leverage it to write complex and optimized queries (E.x Q queries, Case, When, Select related, prefetch related, Subqueries, Annotations, Aggregations, Filtering, etc.) .
3. Should be able to override DRF serializers, filters and viewsets completely according to needs.
4. Should have good experience in Class Based Views to write the backend API’s.
5. Sound knowledge of database design patterns and modelling them to Django models.
6. Sound knowledge of how to write test cases for the APIs.
7. Should be able to write optimized pythonic code adhering to python PEP standards.
8. Strong knowledge of python packaging and how to architect a code base that should be easily scalable and not get cluttered.
9. Strong knowledge of REST API design patterns.
10. Ability to write RAW sql queries and further database level coding will be a plus.
11. Good Understanding of python’s asyncio, threading and multiprocessing library, their benefits and limitations along with their appropriate use cases.
12. Hands on knowledge of celery and its corresponding message broker such as RabbitMQ, Redis, etc.
13. Experience with building a CDC(Change Data Capture) pipeline will be a plus.
14. Experience with Apache Kafka, Kafka connect and Debezium will be a plus.
15. Experience with open source will be a plus.
16. Good knowledge of Algorithms and data structures.

Responsibilities:

1. Understand the ins and out of existing codebase and have a good grasp over it.
2. Write clean, stable and scalable code.
3. Write unit test cases for the APIs.
4. Do whitebox and blackbox testing for your own code and as well as others if required.
5. Understand and implement fast prototype solutions for the business needs.

• Architect new and optimize existing software codebases and systems used to crawl, launch, run, and monitor the Anakin family of app crawlers
• Deeply own the lifecycle of software, including rolling out to operations, managing configurations, maintaining and upgrading, and supporting end-users
• Configure and optimize the automated testing and deployment systems used to maintain over 1000+ crawlers across the company
• Analyze data and bugs that require in-depth investigations
• Interface directly with external customers including managing relationships and steering requirements

• Extremely effective, self-driven builder
• 2+ years of experience as a backend software engineer
• 2+ years of experience with Python
• 2+ years of experience with AWS services such as EC2, S3, Lambda, etc.
• Should have managed a team of software engineers
• Deep experience with network debugging across all OSI layers (Wireshark)
• Knowledge of networks or/and cybersecurity

• Broad understanding of the landscape of software engineering design patterns and principles
• Ability to work quickly and accurately in a highly stressful environment during removing bugs in run-time within minutes
• Excellent communicator, both written and verbal

• Must be available to work extended hours and weekends when needed to meet critical deadlines
• Must have an aversion to politics and BS. Should let his/her work speak for him/her.
• Must be comfortable with uncertainty. In almost all the cases, your job will be to figure it out.
• Must not be bounded to comfort zone. Often, you will need to challenge yourself to go above and beyond.

• Should be a Backend Developer - Python only
• Should be MCA/B.Tech IT
• Should have Database Knowledge
• Should have DJango Knowledge
• Writing effective, scalable code
• Good Communication