SDE-3 (Python)

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

• Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
• Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
• Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

• Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
• Ensure the reliability, scalability, and performance of the data infrastructure.
• Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

• Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
• Ensure data is accurately and efficiently processed and available for analytics and reporting.
• Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

• Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
• Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
• Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

• Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
• Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
• Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

• Work closely with stakeholders to understand business requirements and translate them into technical specifications.
• Communicate effectively with non-technical stakeholders to explain data concepts and progress.
• Participate in strategic planning and decision-making processes.

Skills Required:

• Proven experience in designing and building scalable data infrastructures and pipelines.
• Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
• Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
• Solid understanding of database technologies, both SQL and NoSQL.
• Experience with data modeling, data warehousing, and ETL processes.
• Strong analytical and problem-solving abilities.
• Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:

• 
  
• Experience in HR technology or recruitment platforms.
• Familiarity with machine learning and AI technologies.
• Knowledge of data governance and data security best practices.
• Contributions to open-source projects or active participation in the tech community.

• BS in CS or EE or equivalent
• Experience working on large scale systems in rapid growth environments
• Experience with public cloud offerings (AWS, GCP, Azure)
• Solid programming skills; preferred experience in Java, and/or Python
• Experience with modern web frameworks, advanced algorithms/data intelligence, public
• cloud platforms and streaming data pipelines
• Familiarity with containerization, microservices architecture, continuous integration, and delivery
• 5+ years’ experience preferred

• Integration of client-side elements developed by a frontend developers with server side logic
• Building reusable code and libraries for future use
• Test and debug programs
• Coordinate with other team members to understand user requirements and provide technical solutions

Skills and Competencies:

• Proficient knowledge of Python with a backend server framework like Flask or Django
• Understanding accessibility and security compliance from the Business statement & implement them accordingly
• Building API endpoints - Project structuring, build reusable components, etc
• Integration of multiple data sources and databases into the application code
• Creating database schemas that represent and support the business use case
• Experience with building the infrastructure for serving the front-end app and assets would be a value-add
• Experience with scripting for task automation and data analysis
• Basic understanding of front-end technologies and platforms, such as JavaScript, HTML, and CSS would be a value-add
• Professional, precise communication skills

Qualification and Experience:

• B.E. / B. Tech. / MCA / PGDCA / M.Sc. (CS) /M.E. / M. Tech
• At least 2 years of experience in Backend Development
• Proficient knowledge of Python or any other back-end programming language
• Demonstrated experience with Object Oriented design and development
• Experience in working with MongoDB or other NoSQL databases would be a value-add
• Knowledge of Microservices, Dockers, Kubernetes
• Exposure to Google Cloud Platform and/or Amazon Web Services

·      The Objective:

You will play a crucial role in designing, implementing, and maintaining our data infrastructure, run tests and update the systems

·      Job function and requirements

o  Expert in Python, Pandas and Numpy with knowledge of Python web Framework such as Django and Flask.

o  Able to integrate multiple data sources and databases into one system.

o  Basic understanding of frontend technologies like HTML, CSS, JavaScript.

o  Able to build data pipelines.

o  Strong unit test and debugging skills.

o  Understanding of fundamental design principles behind a scalable application

o  Good understanding of RDBMS databases among Mysql or Postgresql.

o  Able to analyze and transform raw data.

·      About us

Mitibase helps companies find warm prospects every month that are most relevant, and then helps their team to act on those with automation. We do so by automatically tracking key accounts and contacts for job changes and relationships triggers and surfaces them as warm leads in your sales pipeline.

• 6+ years of experience with expertise in Django CMS, Python, REST framework, AI framework
• MySQL Db usage, SQL queries
• Experience in using scraping tools.
• Microservices
• Docker and Kubernetes hands-on experience
• AWS Redis cache integration
• Deployment on AWS cloud, auto-scale
• Work will be rotational Shifts/ UK Shift
• Must be flexible to work on weekends/stretch for some hours

• Manage and improve the engineering process continuously and make sure the team delivers the quality code with zero-waste.
• Should provide technical leadership to major projects, but also build and manage a team of 5-8 top-notch engineers.
• Should do sprint planning and run daily stand-ups and deliver 100% hit rate.
• Maintain the legacy code base and reduce tech debt on a continuous basis.
• Able to handle multiple projects and deliver with stringent timelines without compromising the code quality.
• Work with the product team for roadmap planning and delivery as per the plan.
• Conduct sprint planning & sizing, engineering grooming, daily stand-ups, and deliver with zero spillovers.
• Prepare & publish sprint reports to the leadership team and provide visibility to stakeholders.
• Hire and mentor junior/ senior team and make them engineering champions.
• Mentor the engineering team with your technical skills to write scalable, generic, reusable code.
• Develop and Coach engineers on the team, share engineering pointers, conduct regular 1-1s with the team, and help them advance in their careers.

Requirements

• Having work experience in a Product organization with 7 -10 yrs also in leading a cross-functional engineering team that includes API Development and Backend & Middleware development.
• Should have experience in the continuous delivery process. Ship new features and improvising the code base continuously.
• Should have involved in setting up engineering process.
• Must have experience in microservices and distributed patterns.
• Must have worked on high traffic and throughput application.
• Must have prior experience in handling mid to large-size projects.
• Must have worked on high traffic and throughput application.
• Should have managed and lead the engineering team of Web App and Backend development teams.
• Must-Have Experience in Python programming & Postgressql/ Nosql (MongoDB as a data store.
• Must have experience in modern back-end tech stacks (Django, Postgress, NoSQL) and cloud design & deployment patterns.
• Must be conversant with AWS, Docker/Kubernetes
• Should be good with design patterns and integration patterns.
• Should have knowledge/ experience in concurrent programming & distributed locks.
• Requires solid understanding of technologies and architecture in a highly scalable and available set-up.
• Should have handled multiple epics, themes, and experience of delivering high-quality projects on time.
• Should have managed end to end development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations