Python Developer

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

• Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
• Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
• Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

• Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
• Ensure the reliability, scalability, and performance of the data infrastructure.
• Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

• Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
• Ensure data is accurately and efficiently processed and available for analytics and reporting.
• Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

• Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
• Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
• Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

• Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
• Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
• Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

• Work closely with stakeholders to understand business requirements and translate them into technical specifications.
• Communicate effectively with non-technical stakeholders to explain data concepts and progress.
• Participate in strategic planning and decision-making processes.

Skills Required:

• Proven experience in designing and building scalable data infrastructures and pipelines.
• Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
• Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
• Solid understanding of database technologies, both SQL and NoSQL.
• Experience with data modeling, data warehousing, and ETL processes.
• Strong analytical and problem-solving abilities.
• Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:

• 
  
• Experience in HR technology or recruitment platforms.
• Familiarity with machine learning and AI technologies.
• Knowledge of data governance and data security best practices.
• Contributions to open-source projects or active participation in the tech community.

Responsibilities:

• Understanding requirements from the product manager and translating to technical specifications
• DB schema development
• API development (structuring REST endpoints + real-time endpoints like socket.io integration)
• Integrating 3rd party services for payments, email, whatsapp, and other such services
• Optimizing our current architecture & processes for scale (we expect usage to go up)
• Guiding junior developers on best coding practices

Requirements:

• Experience in at least one Python-based Web Framework like Flask or Django
• Experience in SQL databases & API design
• Experience with Docker
• Hands on experience in full lifecycle development and deployment of a platform/system
• Being a self-starter with the ability to thrive in ambiguous and high pressure scenarios working towards a common goal with other teams

We're looking for someone to join a team dedicated to building performant APIs and backend services that deal with large volumes of data for the company's flagship, global consumer product. Small, high-impact teams require conscious planning and decision-making when it comes to design, architecture, and product features. So, it's essential that you enjoy working in such an environment.

We're a team that cares about simplicity and being able to build reliable, deterministic systems and platforms. Hence, our choice of tooling is usually battle-tested reliable software with a robust test suite.

How we work

1. You won't deal with the hustle culture. We're focused on building well-thought-out, stable and reliable software and we try our best to ensure everyone understands the big picture and the immediate goals.
2. We work a solid 6-8 hour days and don't slave away 24/7.
3. We're a remote engineering team. This makes effective communication extremely important. Our teams have benefitted greatly from good written communication. This includes everything from the product specification to the API spec. We spend a lot of time writing READMEs. As a result our engineers work with greater clarity and planning.
4. We deploy several times a day and rely on a good test suite to ensure we're not making life hard for our colleagues.
5. We don't expect anyone to know everything, but we are curious and learn along the way.
6. We learn about the fitness space and what it means to really be fit and not just Instagram fit.

The Python Backend Engineer position may be a good fit for you if:

1. You have 3 (or more) years of experience building and maintaining cloud applications.
2. You have built APIs with Python, Flask, Django or FastAPI before.
3. You have experience working with relational databases like PostgresSQL or MySQL and have spent time writing SQL queries for large datasets.
4. Experience in writing Unit tests with pytest.
5. You have worked with Docker, docker-compose.
6. Familiarity with the AWS ECS stack.

We want you to care about

1. Good object oriented design
2. Performant APIs
3. Analysing why queries are slow and how to go about improving them.
4. Understanding DNS, Load balancing, Caching and Hashing.
5. Customer data and privacy.

Our API Stack services use:

1. Python 3.8+, Typescript
2. FastAPI, Flask, HapiJs
3. PostgresSQL, MySQL
4. Redis
5. Celery
6. Pytest, Jest for unit testing.
7. Gitlab CI/CD
8. Amazon ECS container services