SDE II | Python/Java | Open for remote work - Fulltime | 3+ Years

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

• Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
• Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
• Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

• Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
• Ensure the reliability, scalability, and performance of the data infrastructure.
• Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

• Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
• Ensure data is accurately and efficiently processed and available for analytics and reporting.
• Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

• Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
• Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
• Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

• Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
• Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
• Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

• Work closely with stakeholders to understand business requirements and translate them into technical specifications.
• Communicate effectively with non-technical stakeholders to explain data concepts and progress.
• Participate in strategic planning and decision-making processes.

Skills Required:

• Proven experience in designing and building scalable data infrastructures and pipelines.
• Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
• Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
• Solid understanding of database technologies, both SQL and NoSQL.
• Experience with data modeling, data warehousing, and ETL processes.
• Strong analytical and problem-solving abilities.
• Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:

• 
  
• Experience in HR technology or recruitment platforms.
• Familiarity with machine learning and AI technologies.
• Knowledge of data governance and data security best practices.
• Contributions to open-source projects or active participation in the tech community.

Job Description

Roles and Responsibilities

· Design, Code, test, debug, implement and document complex WSO2 sequences.

· Monitoring and logging tool stacks - Splunk/ELK/Prometheus, Grafana 4 Design, Code, test, debug, implement and document complex WSO2 sequences.

· Perform Build activities for WSO2 ESB Middleware integration, involves writing XSLT, ESB coding, configuration, and Analysis activities.

· Trouble shooting various problems in different stages of development using logs files, Traces and Log Analyzer.

· Responsible for understanding the requirement, solution design, coordinate the development and testing activities (end to end)

· Guide the team regarding WSO2 platform best practices, framework, reusable artefacts and ensure code quality and timely deliverables.

· Work with functional and technical customers to determine solutions that drive additional business value.

· Work with Github, Azure Devops and CI tools to automate dev, build, deployment and testing.

· Good knowledge in messaging brokers: WSO2 Message Broker, Apache Kafka.

· Monitoring the server (Monitoring logs and WSO2 metrics).

· Desired Candidate Profile

Desired Candidate Profile

· Candidate must have minimum 2+ years of hands-on experience in WSO2, preferably with WSO2 certification.

· Extensive experience in Integration by using WSO2 Product Stack (API Manager 2.6/3.x, Enterprise Integrator 6.5 and Identity Server 5.7.0)

· Experience in Implementing APIs in WSO2 EI and On-boarding APIs into WSO2 API Manager

· Experience in WSO2 API Manager for designing API facades and designing and implementing API Proxies.

· Hands-on experience in designing and developing high volume web services using API Protocols and Data Formats (REST, JSON, SOAP & XML).

· Must have hands on experience / knowledge with CI tools to automate dev, build, deploy.

· Experience in programming languages: Java, JavaScript, Python

· Experience in on boarding web applications into WSO2 Identity Server for authentication and authorizatio

Qualifications

• Minimum of a Bachelor's or Master’s degree in Computer Science, or a related four-year degree.

• 4 years of hands on experience in Integration

Experience:

The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database and distributed System is mandatory.

Required Skills:

Mandatory: -

1. Core Java or Scala
2. Experience in Big Data, Spark
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.
4. Should have the ability to analyze, design, develop and test complexity of spark job.
5. Working knowledge of Unix/Linux.
6. Hands on experience in Spark, creating RDD, applying operation - transformation-action

Good To have: -

1. Python
2. Spark streaming
3. Py Spark
4. Azure/AWS Cloud Knowledge of Data Storage and Compute side

Job Description

• Develop p2p infrastructure systems to support blockchain interoperability
• Improve engineering standards, tooling, and processes
• Coding with concurrency, efficiency and scalability as primary motive
• Rigor on Unit testing, coverage and best practices
• Document systems, build runbooks, and automate those processes
• Being hands on by writing, testing, and deploying high-performance networking code.

Required qualifications

1+ years of experience in Golang, Strong knowledge of Go programming language, paradigms, constructs, and idioms, willingness to learn on the go, ability to write clean code, a strong sense of responsibility.

Tech Stack

Go, git, linux, bash, ability to work with Docker.

Nice to have

Experience developing in c++, cryptography and system software development experience,understanding of design patterns, understanding of operating systems, networks.