Cutshort logo
Pluginlive logo
Senior Data engineer
Senior Data engineer
Pluginlive's logo

Senior Data engineer

Harsha Saggi's profile picture
Posted by Harsha Saggi
5 - 20 yrs
₹10L - ₹30L / yr
Chennai
Skills
skill iconPython
SQL
skill iconJava
skill iconDjango
skill iconFlask

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

  • Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
  • Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
  • Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

  • Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
  • Ensure the reliability, scalability, and performance of the data infrastructure.
  • Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

  • Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
  • Ensure data is accurately and efficiently processed and available for analytics and reporting.
  • Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

  • Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
  • Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
  • Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

  • Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
  • Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
  • Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

  • Work closely with stakeholders to understand business requirements and translate them into technical specifications.
  • Communicate effectively with non-technical stakeholders to explain data concepts and progress.
  • Participate in strategic planning and decision-making processes.

Skills Required:

  • Proven experience in designing and building scalable data infrastructures and pipelines.
  • Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
  • Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
  • Solid understanding of database technologies, both SQL and NoSQL.
  • Experience with data modeling, data warehousing, and ETL processes.
  • Strong analytical and problem-solving abilities.
  • Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:


  • Experience in HR technology or recruitment platforms.
  • Familiarity with machine learning and AI technologies.
  • Knowledge of data governance and data security best practices.
  • Contributions to open-source projects or active participation in the tech community.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Pluginlive

Founded :
2022
Type :
Services
Size
Stage :
Bootstrapped

About

Shifting gears… Go to the Next Level!
Read more

Connect with the team

Profile picture
Harsha Saggi

Company social profiles

N/A

Similar jobs

Kochi (Cochin)
6 - 12 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconMongoDB
skill iconAmazon Web Services (AWS)
+2 more
Key Responsibilities:

 Design, build, and maintain efficient, reusable, and reliable Python services &components
 Ensure the best possible performance, quality, and security
 Identify bottlenecks and bugs, and devise solutions to these problems
 Help maintain code quality, organization
 Understanding of established software development life cycles
 Ability to prioritize and multi-task in order to meet deadlines
 Resolves technical issues through debugging, research and investigation
 Collaborate across various teams and with external clients
 Contribute innovative designs and ideas for improving our company products and services

Required Skills Sets

 Atleast 4+ years of experience in Design and Development with Python.
 Experience in Flask / Django
 Familiar with version control (Git)
 Understanding of SQL
 Strong Unit Testing practice
 Understanding of design patterns, Microservices Architecture
 Understanding of Scrum Agile methodology
 Experience in data engineering & Docker is a plus.
Candidate Profile:
 4+ Years of relevant experience with Python and its Principles.
 Graduate in Computer Science or any related discipline (like BS / B.E. / B-Tech in Electronics,
Electrical, IT)
Read more
CEDRETO MARKETING PRIVATE LIMITED
Ankit Agarwal
Posted by Ankit Agarwal
Bengaluru (Bangalore)
1 - 3 yrs
₹4L - ₹7L / yr
skill iconPython
skill iconDjango
skill iconFlask
RESTful APIs
skill iconAmazon Web Services (AWS)
+5 more

JOB DESCRIPTION 

DYT - Do Your Thng, is an app, where all social media users can share brands they love with their followers and earn money while doing so! We believe everyone is an influencer. Our aim is to democratise social media and allow people to be rewarded for the content they post. How does DYT help you? It accelerates your career through collaboration opportunities with top brands and gives you access to a community full of experts in the influencer space. 

RESPONSIBILITIES 

  • Expert in Python with knowledge of Python best practices (PEP8) 
  • Strong knowledge of python web frameworks such as Django, Flask • Strong knowledge of building RESTful APIs using Django Rest Framework • Good Understanding of Django ORM Libraries 
  • Able to integrate multiple data sources and databases into one system • Strong experience on Linux 
  • Solid database skills in a relational database (i.e. PostgresSQL,MYSql) • Able to create database schemas that represent and support business processes • Strong unit test and debugging skills 
  • Proficient understanding of code versioning tools (git) 
  • Experience deploying on AWS is desirable 
  • Experience with Docker,Test Drive Development will be a plus 
  • Excellent interpersonal, leadership, influence and communication skills • Experience in designing scalable micro-services is desirable 

QUALIFICATIONS 

  • 1-3 years of experience as a backend developer 
  • At least one product build and published 
  • SKILLS Contribute in all phases of the development lifecycle 
  • Write well designed, testable, efficient code 
  • Work well under pressure and meet deadlines without sacrificing quality • Work with distributed development teams 
Read more
company logo
Agency job
via Zyvka Global Services by Shraddha Jain
Remote only
2 - 6 yrs
₹1L - ₹24L / yr
skill iconPython
skill iconDjango
skill iconFlask
Roles and Responsibilities

⦁ 2+ years of working experience as a software engineer.
⦁ Engineer capable of designing solutions, writing code, and deployment
⦁ Demonstrated skills, knowledge, and expertise with statistical computer languages (Python, Django) and the related ecosystem (PyCharm, Jupyter)
⦁ Good knowledge of Python.
⦁ Creative problem-solving ability and sound judgment ability to use own initiative and take responsibility for decisions.


Candidate must have
⦁ Good knowledge of Python
⦁ Django, Flask, FastApi
⦁ Candidates must have knowledge about Product Development.
⦁ Candidates must have Technical Degree.

Skills
⦁ Developing back-end components.
⦁ Design and develop web applications in Python, and Django.
⦁ Good knowledge of Django, Flask, FastApi
⦁ Must be proficient in writing python codes
⦁ Must have worked on back-end development
⦁ Integrate Python application with other internal applications.
⦁ Strong spoken and written communication skills in English
Read more
Madsapiens Pte Ltd
at Madsapiens Pte Ltd
1 recruiter
marshall david
Posted by marshall david
Remote only
2 - 5 yrs
₹15L - ₹30L / yr
skill iconPython
skill iconDjango
Our organisation is looking for a Django Developer who is extremely knowledgeable and a driven individual to assist the organisation in designing and programming web applications. You will look after the developing backend code which efficiently and effectively interfaces with front end code to transact data. You will need to liaise with front end developers extremely regularly, so being a good communicator and collaborator is extremely important.
Read more
Claristaio
at Claristaio
3 recruiters
Suvrat Bansal
Posted by Suvrat Bansal
Pune
2 - 4 yrs
₹8L - ₹12L / yr
skill iconPython
skill iconDjango
SQL
skill iconMongoDB

What You'll Do

You will be part of our data platform & data engineering team. As part of this agile team, you will work in our cloud native environment and perform following activities to support core product development and client specific projects:

  • You will develop the core engineering frameworks for an advanced self-service data analytics product.
  • You will work with multiple types of data storage technologies such as relational, blobs, key-value stores, document databases and streaming data sources.
  • You will work with latest technologies for data federation with MPP (Massive Parallel Processing) capabilities
  • Your work will entail backend architecture to enable data modeling, data queries and API development for both back-end and front-end data interfaces.
  • You will support client specific data processing needs using SQL and Python/Pyspark
  • You will integrate our product with other data products through Django APIs
  • You will partner with other team members in understanding the functional / non-functional business requirements, and translate them into software development tasks
  • You will follow the software development best practices in ensuring that the code architecture and quality of code written by you is of high standard, as expected from an enterprise software
  • You will be a proactive contributor to team and project discussions

 

Who you are

  • Strong education track record - Bachelors or an advanced degree in Computer Science or a related engineering discipline from Indian Institute of Technology or equivalent premium institute.
  • 2-3 years of experience in data queries, data processing and data modeling
  • Excellent ANSI SQL skills to handle complex queries
  • Excellent Python and Django programming skills.
  • Strong knowledge and experience in modern and distributed data stack components such as the Spark, Hive, Airflow, Kubernetes, Docker etc.
  • Experience with cloud environments (AWS, Azure) and native cloud technologies for data storage and data processing
  • Experience with relational SQL and NoSQL databases, including Postgres, Blobs, MongoDB etc.
  • Familiarity with ML models is highly preferred
  • Experience with Big Data processing and performance optimization
  • Should know how to write modular, optimized and documented code.
  • Should have good knowledge around error handling.
  • Experience in version control systems such as GIT
  • Strong problem solving and communication skills.
  • Self-starter, continuous learner.

 

Good to have some exposure to

  • Start-up experience is highly preferred
  • Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
  • Agile software development methodologies.
  • Working in multi-functional, multi-location teams

 

What You'll Love About Us – Do ask us about these!

 

  • Be an integral part of the founding team. You will work directly with the founder
  • Work Life Balance. You can't do a good job if your job is all you do!
  • Prepare for the Future. Academy – we are all learners; we are all teachers!
  • Diversity & Inclusion. HeForShe!
  • Internal Mobility. Grow with us!
  • Business knowledge of multiple sectors

 

Read more
Fynd
at Fynd
3 recruiters
Agency job
via Response Informatics by Pratibha Jha
Remote, Mumbai
2 - 8 yrs
₹8L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconFlask
SQL
skill iconMongoDB
+1 more
  • Relevant Experience : Minimum 2 Years
  • You have prior experience developing and working on consumer facing web/app products
  • Hands-on experience on Python. Exceptions can be made if you’re really good on any other language with experience on building web/app based tech products
  • Experience in at least one of the following frameworks - Django, Flask, Falcon, web2py, Twisted, Tornado
  • Working knowledge of MySQL, MongoDB, Redis
  • Good understanding of Data Structures, Algorithms and Operating Systems
  • You've worked with core AWS services in the past and have experience with EC2, ELB, AutoScaling, CloudFront, S3
  • You can dabble in Frontend codebases using HTML, CSS and Javascript
  • You love doing things efficiently. At Fynd, the work you do will have a disproportionate impact on the business. We believe in systems and processes that let us scale our impact to be larger than ourselves
  • You might not have experience with all the tools that we use but you can learn those given the guidance and resources
Read more
Ellicium Solutions Private Limited
Rutuja Deshpande
Posted by Rutuja Deshpande
Remote, Pune, Bengaluru (Bangalore)
1 - 4 yrs
₹3L - ₹4L / yr
skill iconPython
skill iconDjango
skill iconFlask
Skills and Responsibilities:
We are looking for an experienced individual to join our engineering teams as a python developer.
You would be responsible for developing solutions as per business requirements. Working closely with a global team of developers and product managers and develop the solution according to the business requirements.

Required/ Must have:
• Be passionate about programming
• Understand requirements, validate assumptions, and design and develop solutions independently for users
• Ability to learn new python skills to deliver solutions
• Writing reusable, testable, and efficient code
• Identify and suggest various opportunities to improve efficiency and functionality.
• An ability to perform well in a fast-paced environment
• Review existing python solutions for quality and provide feedback
• Agile methodology experience with able to translate user stories and features into python code
• Knowledge of Pandas and experience of automating Microsoft excel and preferably other office apps
• Be flexible to learn and undertake other responsibilities as required by the team

Preferable/Good to have:
• Good knowledge in writing QA test cases and performing QA is preferable
• Coordinate with internal teams to understand user requirements and provide technical solutions
• Write and implement software solutions that integrate different systems.
• Work experience with libraries: Win32, Openpyxl, Pypdf, Pandas, Selenium
• Hands on experience with Git repository
• SQL experience is preferred
• Good Interpersonal Skills & Ability to work Independently
Read more
Fintech start-up offering Self-Checkouts and easy payments.
Fintech start-up offering Self-Checkouts and easy payments.
Agency job
Bengaluru (Bangalore)
3 - 7 yrs
₹22L - ₹25L / yr
skill iconPython
skill iconDjango
skill iconJava
skill iconJavascript
  • 5+ years experience
  • Previously managed a team
  • Built & managed backend systems from scratch previously.
  • Lead the core backend engineering team, including mentoring, coaching, architecture, devops, code review and software infrastructure
  • Should be more proficient with Django.
  • Work with the executive team to shape and execute the product roadmap
  • Direct our team environment to achieve sprint deliverables and acceptance criteria
  • Design and monitor metrics to assess product and infrastructure performance
  • Hire, build and shape the team
Read more
goplaybook app
at goplaybook app
3 recruiters
Avijeet Gumber
Posted by Avijeet Gumber
NCR (Delhi | Gurgaon | Noida)
0 - 2 yrs
₹3L - ₹6L / yr
skill iconPython
MEAN stack
skill iconDjango
RESTful APIs
Job Duties : 1. Optimising existing Stack & Architecture 2. Has Expertise in handling Backend Microservices Architecture, High-Concurrency, Multi-Thread, Server-side system. 3. Develop efficient, reusable, reliable & Scalable Code. 4. Has the Hustle and Ownership approach. Also, Has the ability to lead technical team. 5. Implementation of security and Data storage solution. Requirements : 1. Has Expertise of 0-2 years on Python and related frameworks. 2. Has Experience with micro-services architecture 3. Has Experience with relational DBs and Linux environments 4. Has Expertise in development and use of REST/3P APIs. 5. Has a great understanding of SQL and NoSQL worlds. We use both Firebase as well as PostgreSQL. 6. Has Experience in handling AWS 7. Has Experience in payment gateway implementation. 8. Has Experience building high-traffic systems 9. Knowledge in Node.js is a plus. 10. Has Experience of leading a team/project/startup in tech role.
Read more
Doctor Insta
at Doctor Insta
3 recruiters
Doctor Insta
Posted by Doctor Insta
NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹7L - ₹10L / yr
skill iconPython
Web
skill iconDjango
skill iconProgramming
MySQL
+9 more
1.Hands on experience with Python 2.Experience with Web Technologies like Django, etc. 3.Database programming - MySQL 4.Data structure and implementing optimized algorithms 5.Good understanding of HTML, CSS, JAVA Script, Angular JS 6.Experience using code versioning systems like SVN, GIT is desirable 7.Additional Qualifications –node.js, npm, Knows SQL 8.Quick Learner, creative problem solver and resourceful Experience: 2-6/7 years of experience in Python required. Educational Qualifications: BTech/ BE Interested candidates can mail me at [email protected]
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos