Python Distributed System Engineer

Job Title: Back-End Developer

Department: IT

Experience: 3.5 Years+

Location: Mohali

Shift: Rotational Shifts

Employment Type: Full-time

Job Overview:

The Senior Backend Developer will be responsible for the full lifecycle of our backend services, focusing on architecture, security, and performance.

Key Responsibilities:

• Core API Development & Logic: Design, build, and maintain robust, scalable, and secure RESTful/ GraphQL APIs using Node.js and Python to serve both internal and external consumers.
• System Architecture: Lead the design and implementation of application components, focusing on microservices architecture, ensuring services are loosely coupled and highly available.
• Database Management: Expertly manage and optimize complex database schemas and queries for both SQL (PostgreSQL/MySQL) and NoSQL (MongoDB/Redis) systems, ensuring data integrity and high performance.
• Performance and Scalability: Identify and resolve performance bottlenecks, implement caching strategies, and optimize server-side code and architecture for maximum speed and scalability.
• Code Quality and Standards: Write clean, efficient, well-documented, and testable code. Conduct thorough code reviews and mentor junior developers on best practices, design patterns, and coding standards.
• Security Implementation: Implement security and data protection settings,including authentication, authorization, and encryption protocols.
• DevOps and Deployment: Work with DevOps pipelines (CI/CD, Docker, Kubernetes) for smooth and automated deployment of services to cloud platforms (AWS/Azure/GCP).
• Collaboration: Work closely with cross-functional teams (Frontend, Product, QA) to understand requirements and translate them into technical specifications and deliver high-quality features.

Required Skills & Qualifications:

• Programming Expertise: Deep, demonstrable expertise in Node.js and Python.
• Node.js: Strong command of asynchronous programming, event loops, and related frameworks (e.g., Express.js).
• Python: Extensive experience with web frameworks (e.g., Django, Django Rest Framework, Flask).
• API Design: Proven ability to design and implement highly performant and secure RESTful APIs. Experience with GraphQL is a strong advantage.
• Databases: Expert knowledge of both Relational (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Redis, Cassandra). Proficiency in query optimization and schema design.
• Cloud & Tools: Experience with cloud computing platforms (e.g., AWS, Azure, or GCP). Proficiency with Docker and Git.
• Testing: Strong experience with unit, integration, and end-to-end testing frameworks.

Soft Skills & Leadership

• Problem-Solving: Excellent analytical and problem-solving skills with a track record of troubleshooting complex production issues.
• Communication: Strong verbal and written communication skills to articulate technical decisions and collaborate effectively with diverse teams.
• Ownership: Proven ability to take ownership of complex projects, drive them to completion, and manage technical debt.

Responsibilities:

- Collaborate with cross-functional teams including front-end developers, designers, and system administrators to develop robust and scalable server-side applications.

- Design and implement RESTful APIs and services using Node.js, ensuring efficient data handling and integration.

- Develop database schemas and models for MongoDB, optimizing queries and ensuring data integrity.

- Implement data migration and transformation tasks between different data sources.

- Write efficient and reusable code, following best practices and coding standards.

- Conduct thorough testing and debugging of applications to identify and fix issues promptly.

- Collaborate with DevOps team to deploy applications on servers or cloud platforms.

- Continuously monitor application performance and optimize it for scalability and reliability.

- Stay updated on emerging technologies and trends, actively suggesting improvements and innovative solutions.

Requirements:

- Strong proficiency in Node.js and JavaScript.

- Solid understanding of server-side development and asynchronous programming concepts.

- Experience working with NoSQL databases (e.g., MongoDB).

- Knowledge of database design and query optimization techniques.

- Familiarity with web application security principles and best practices.

- Proficiency in using version control systems (e.g., Git).

- Good understanding of agile development methodologies.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration abilities.

Sizzle is an exciting new startup that’s changing the world of gaming.  At Sizzle, we’re building AI to automate gaming highlights, directly from Twitch and YouTube streams. We’re looking for a superstar Python expert to help develop and deploy our AI pipeline. The main task will be deploying models and algorithms developed by our AI team, and keeping the daily production pipeline running. Our pipeline is centered around several microservices, all written in Python, that coordinate their actions through a database. We’re looking for developers with deep experience in Python including profiling and improving the performance of production code, multiprocessing / multithreading, and managing a pipeline that is constantly running. AI/ML experience is a plus, but not necessary. AWS / docker / CI/CD practices are also a plus. If you are a gamer or streamer, or enjoy watching video games and streams, that is also definitely a plus :-)

You will be responsible for:

• Building Python scripts to deploy our AI components into pipeline and production
• Developing logic to ensure multiple different AI components work together seamlessly through a microservices architecture
• Managing our daily pipeline on both on-premise servers and AWS
• Working closely with the AI engineering, backend and frontend teams

You should have the following qualities:

• Deep expertise in Python including:
• Multiprocessing / multithreaded applications
• Class-based inheritance and modules
• DB integration including pymongo and sqlalchemy (we have MongoDB and PostgreSQL databases on our backend)
• Understanding Python performance bottlenecks, and how to profile and improve the performance of production code including:
• Optimal multithreading / multiprocessing strategies
• Memory bottlenecks and other bottlenecks encountered with large datasets and use of numpy / opencv / image processing
• Experience in creating soft real-time processing tasks is a plus
• Expertise in Docker-based virtualization including:
• Creating & maintaining custom Docker images
• Deployment of Docker images on cloud and on-premise services
• Experience with maintaining cloud applications in AWS environments
• Experience in deploying machine learning algorithms into production (e.g. PyTorch, tensorflow, opencv, etc) is a plus
• Experience with image processing in python is a plus (e.g. openCV, Pillow, etc)
• Experience with running Nvidia GPU / CUDA-based tasks is a plus (Nvidia Triton, MLFlow)
• Knowledge of video file formats (mp4, mov, avi, etc.), encoding, compression, and using ffmpeg to perform common video processing tasks is a plus.
• Excited about working in a fast-changing startup environment
• Willingness to learn rapidly on the job, try different things, and deliver results
• Ideally a gamer or someone interested in watching gaming content online

Seniority: We are looking for a mid to senior level engineer

Salary: Will be commensurate with experience. 

Who Should Apply:

If you have the right experience, regardless of your seniority, please apply.

Work Experience:  4 years to 8 years

About Sizzle

Sizzle is building AI to automate gaming highlights, directly from Twitch and YouTube videos. Sizzle works with thousands of gaming streamers to automatically create highlights and social content for them. Sizzle is available at www.sizzle.gg. 

WHO WILL LOVE THIS JOB?

• Attracted to creativity, innovation, and eagerness to learn

• Alignment to a fast-paced organization and its short-term and long-term goals

• An engaging, open, genuine personality that naturally encourages interaction with individuals at all levels

• Strong value system and sense of ethics • Absolute dedication to premium quality

• Want to build strong core product team capable of developing solutions for complex, industry-first problems.

• Build balance of experience, knowledge, and new learnings

ROLES AND RESPONSIBILITIES?

• Driving the success of the software engineering team at Datamotive.

• Collaborating with senior and peer engineers to prioritize and deliver features on the roadmap.

• Build strong development team with focus on building optimized & usable solutions.

• Research, Design & Develop distributed solution to handle workload mobility across multi & hybrid cloudsr

• Assist in Identifying, Researching & Designing newer features and cloud platform support in areas of disaster recovery, data protection, workload migration etc.

• Assist in building product roadmap.

• Conduct pilot tests to assess the functionality of newly developed programs.

• Front facing customers for product introduction, knowledge transfer, solutioning, bugs triaging etc.

• Assist customers by giving product demos, conducting POCs, trainings etc.

• Manage Datamotive infrastructure, bring innovative automation for optimizing infrastructure usage through monitoring and scripting. • Design test environments to simulate customer behaviours and use cases in VMware vSphere, AWS, GCP, Azure clouds. • Help write technical documentation, generate marketing content like blogs, webinars, seminars etc.

TECHNICAL SKILLS?

• Experience in software development with relevant domain understanding of Data Protection, Disaster Recovery, Ransomware Recovery.

• A strong understanding and demonstrable experience with at least one of the major public cloud platforms (GCP, AWS, Azure or VMware)

• A strong understanding and experience of designing and developing architecture of complex, distributed systems.

• Insights into development of client-server SaaS applications with good breadth across networking, storage, micro-services, and other web technologies.

• Experience of building and leading strong development teams with systems product development background

• Programming knowledge in either of GO Lang, C, C++, Python or Shell script.

• Should be a computer science graduate with strong fundamentals & problem-solving abilities.

• Good understanding of virtualization, storage and cloud platforms like VMware, AWS, GCP, Azure and/or Kubernetes will be preferable

About us

At Lucidity, we are a year and a half old company and we work on helping large enterprises manage their cloud storage platform. 

Our founders bring with them more than a decade of experience working with top tech Gaints in the world, building and selling large tech products from zero to one. We are seeing a lot of early traction and expanding aggresively.

We are a B2B product based startup building the next generation of storage orchestration system for cloud. We are hiring agressively across multiple roles and looking for passionate engineers to join a very young and energetic team at Lucidity.

What you'll do

Technology is at the heart of our organization. As part of the tech team you will

• Understand product requirements and brainstorm ways to address them.
• Build features from scratch and have complete ownership for it.
• Deliver efficient, reliable, scalable code with high automated test coverage.
• Contribute to team decisions in the overall architecture and practices of the company.

What you'll need

Must haves

• At least 1 year experience in a product based company.
• Experience working with distributed environments.
• Comfortable with at least one Object Oriented Programming language.
• Hands on with AWS or at least one other public cloud.

Good to have

• Experience handling highly scalable systems.
• Experience with at least one among C++, Java.
• Experience with docker and Kubernetes.
• Experience with Linux file systems.

Additional

• B Tech/M Tech in Computer Science or equivalent from a reputed college.
• Good problem solving skills.
• Deeply technical with a track record of successful delivery.

Why us
We're hiring a set of highly skilled, enthusiastic and passionate people who thrive in a high growth environment. We believe the best way to grow is to give everyone the opportunity to pursue their interests. At Lucidity, you have complete freedom to work on projects that interest you. Plus, with benefits like flexible hours, company offsites, unlimited leaves, we ensure you enjoy the journey as much as we do.