Cutshort logo
Pluginlive logo
Senior Data engineer
Senior Data engineer
Pluginlive's logo

Senior Data engineer

Harsha Saggi's profile picture
Posted by Harsha Saggi
5 - 20 yrs
₹10L - ₹30L / yr
Chennai
Skills
skill iconPython
SQL
skill iconJava
skill iconDjango
skill iconFlask

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

  • Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
  • Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
  • Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

  • Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
  • Ensure the reliability, scalability, and performance of the data infrastructure.
  • Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

  • Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
  • Ensure data is accurately and efficiently processed and available for analytics and reporting.
  • Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

  • Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
  • Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
  • Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

  • Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
  • Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
  • Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

  • Work closely with stakeholders to understand business requirements and translate them into technical specifications.
  • Communicate effectively with non-technical stakeholders to explain data concepts and progress.
  • Participate in strategic planning and decision-making processes.

Skills Required:

  • Proven experience in designing and building scalable data infrastructures and pipelines.
  • Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
  • Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
  • Solid understanding of database technologies, both SQL and NoSQL.
  • Experience with data modeling, data warehousing, and ETL processes.
  • Strong analytical and problem-solving abilities.
  • Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:


  • Experience in HR technology or recruitment platforms.
  • Familiarity with machine learning and AI technologies.
  • Knowledge of data governance and data security best practices.
  • Contributions to open-source projects or active participation in the tech community.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Pluginlive

Founded :
2022
Type :
Services
Size
Stage :
Bootstrapped

About

Shifting gears… Go to the Next Level!
Read more

Connect with the team

Profile picture
Harsha Saggi

Company social profiles

N/A

Similar jobs

best-in-class IT solution services company
best-in-class IT solution services company
Agency job
via Jobdost by Sathish Kumar
Pune
7 - 9 yrs
₹12L - ₹18L / yr
skill iconPython
skill iconDjango
DRF
skill iconPostgreSQL

1.   Should have worked in Agile methodology and microservices architecture

2.   Should have 7+ years of experience in Python and Django framework

3.   Should have a good knowledge of DRF

4.   Should have knowledge of User Auth (JWT, OAuth2), API Auth, Access Control List, etc.

5.   Should have working experience in session management in Django

6.   Should have expertise in the Django MVC and uses of templates in frontend

7.   Should have working experience in PostgreSQL

8.   Should have working experience in the RabbitMQ messaging channel and Celery Analytics

9.   Good to have javascript implementation knowledge in Django templates

Read more
golden eagle it technologies pvt ltd
Akansha Kanojia
Posted by Akansha Kanojia
Indore
4 - 5 yrs
₹3L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconFlask
AWS Lambda
NumPy
+2 more

Job Description:-

Designation : Python Developer

Location : Indore | WFO

Skills : Python, Django, Flask, Numpy, Panda,  RESTful APIs, AWS.

Python Developer Responsibilities:- 

1. Coordinating with development teams to determine application requirements.

2. Writing scalable code using Python programming language.

3. Testing and debugging applications.

4. Developing back-end components.

5. Integrating user-facing elements using server-side logic.

6. Assessing and prioritizing client feature requests.

7. Integrating data storage solutions.

8. Coordinating with front-end developers.

9. Reprogramming existing databases to improve functionality.

10. Developing digital tools to monitor online traffic.

Python Developer Requirements:-

1. Bachelor's degree in computer science, computer engineering, or related field.

2. At Least 3+ years of experience as a Python developer.

3. Expert knowledge of Python and related frameworks including Django and Flask.

4. A deep understanding and multi-process architecture and the threading limitations of Python.

5. Familiarity with server-side templating languages including Jinja 2 and Mako.

6. Ability to integrate multiple data sources into a single system.

7. Familiarity with testing tools.

8. Ability to collaborate on projects and work independently when required.

Skills - Python, Django, Flask, Numpy, Panda,  RESTful APIs, AWS.

Read more
Gurugram, Noida, Mohali, Indore
2 - 8 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask
  • Experience with Django/Flask Framworks
  • Worked on web app and mobile app
  • Understanding of DevOps tools - Jekins/Kubernetes/Azure/AWS/Docker will be a plus
Read more
eGovernments Foundation
Aparna  Sathianathan
Posted by Aparna Sathianathan
Remote only
1 - 8 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconFlask

The 10BedICU team within eGovernments Foundation works as a small distributed start-up in the NGO space. We are a technology oriented team on the journey to make critical healthcare more accessible across the country. 

 

As a banckend dev in the team, you will be working on some of the most interesting challenges and collaborating with telented and highly skilled individuals across the industry. 

 

Read more
Leena AI
at Leena AI
13 recruiters
Preethi Gothandam
Posted by Preethi Gothandam
Remote only
3 - 8 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconGo Programming (Golang)

Responsibilities: 

  • Design and code efficient, scalable systems that can accept feedback from multiple hundred thousand employees and generate insights 
  • Design efficient and scalable event driven systems to process complex machine learning pipeline
  • Experiment with data to come up with unique insights and that can benefit our clients
  • Identify libraries and technologies worth experimentation
  • Participate in brainstorming sessions to bring more value to our clients
  • Investigate performance issues / scalability bottlenecks, existing queries and/or write new queries with performance optimization in mind
  • Develop RESTful APIs that can be used by frontend to show insights
  • Debug and fix production level bugs as and when they crop up
  • Support ad hoc data analytics upon requests by clients, and believe us nothing creates a better DB understanding than handling ad hoc data requests 

Requirements: 

  • 3+ years of experience in architecture and developing high performance web applications 
  • Experience with systems ingesting/processing high amounts of data is a plus 
  • In-depth understanding of the entire web development process (design, development, and deployment) 
  • Experience with SQL and NoSQL database 
  • Working knowledge of RESTful API paradigms  
  • Experienced in microservices architecture  
  • Solid engineering principles and a clear understanding of data structures and algorithms
  • Passion for products, empathy for users, and aspiration to make a big impact
  •  
Read more
smartSense Consulting Solutions
smartSense Solutions
Posted by smartSense Solutions
Gandhinagar, Ahmedabad
5 - 9 yrs
₹10L - ₹20L / yr
skill iconPython
skill iconDjango
skill iconFlask
RabbitMQ
skill iconPostgreSQL
+2 more

We are looking for developers who are passionate about Python and know what are the benefits of python well.

 

Responsibilities:

  • Design & implement new software modules based on the product requirements
  • Debug existing software components, fix issues, and avoid regressions
  • Be proactive, take ownership, and be accountable
  • Familiar with Test Drive Development.
  • Participate in software architecture, design discussions, and code reviews

 

Technologies we’re hiring for:

  • Developed HTTP based REST APIs and implemented Authentication, Caching
  • Worked with relational and NoSQL databases and aware of concepts like ORM, Migrations
  • Languages & Frameworks: Python Django/Flask
  • Database: Postgres/ Mongo
  • Must have worked in a Unix/Linux based environment
  • Advanced middleware like RabbitMQ, Celery Beat is definitely a plus.

 

Minimum 3+ year hands-on experience in Python needed

Read more
The next Unicorn
The next Unicorn
Agency job
via Etaash Consultants by Harsitha Anandkumar
Bengaluru (Bangalore)
4 - 10 yrs
₹10L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconElastic Search
skill iconPostgreSQL
REST

DUKAAN - Create Your Online Store in 30 Seconds


Dukaan is an app that allows offline businesses to sell their products and services online. On our app, the users can make beautiful product catalogs (catalogs) right from a smartphone and share with their customers easily on different social media apps such as Whatsapp Business, Whatsapp, Facebook, Instagram, etc. Praised by users all over India, this app has saved declining businesses by helping them transfer their shop online. The journey has just begun and we are on a mission to make India truly Digital.


Dukaan is currently powering over 5M e-commerce stores built by Indian small businesses and growing at a crazy rate.  


We are looking for a Backend Engineer to join our team who will be part of our new innovations team.


Requirements:

  1. Strong knowledge of Django, Django Rest Framework, and their design principles.
  2. Strong knowledge of Django ORM, should be able to leverage it to write complex and optimized queries (E.x Q queries, Case, When, Select related, prefetch related, Subqueries, Annotations, Aggregations, Filtering, etc.).
  3. Should be able to override DRF serializers, filters, and view set completely according to needs.
  4. Should have good experience in Class-Based Views to write the backend API.
  5. Sound knowledge of database design patterns and modeling them to Django models.
  6. Sound knowledge of how to write test cases for the APIs.
  7. Should be able to write optimized pythonic code adhering to python PEP standards.
  8. Strong knowledge of python packaging and how to architect a codebase that should be easily scalable and not get cluttered.
  9. Strong knowledge of REST API design patterns.
  10. The ability to write RAW SQL queries and further database-level coding will be a plus.
  11. Good Understanding of python’s asyncio, threading, and multiprocessing library, their benefits and limitations along with their appropriate use cases.
  12. Hands-on knowledge of celery and its corresponding message broker such as RabbitMQ, Redis, etc.
  13. Experience with building a CDC(Change Data Capture) pipeline will be a plus.
  14. Experience with Apache Kafka, Kafka connect and Debezium will be a plus.
  15. Experience with open source will be a plus.
  16. Good knowledge of Algorithms and data structures.

Responsibilities:

  1. Understand the ins and out of the existing codebase and have a good grasp of it.
  2. Write clean, stable, and scalable code.
  3. Write unit test cases for the APIs.
  4. Do whitebox and blackbox testing for your own code and as well as others if required.
  5. Understand and implement fast prototype solutions for business needs.
Read more
A CMM Level 5 Organisation
A CMM Level 5 Organisation
Agency job
via Millions Advisory by Vasuki N
Chennai, Bengaluru (Bangalore)
9 - 16 yrs
₹15L - ₹25L / yr
skill iconPython
skill iconMongoDB
skill iconDjango

Experience: 9 to 16 Yrs

Notice Period: Immediate to 15 days

Job Description:

- The Lead Engineer is responsible for deriving the technical architecture, detailed design, implementation, Performance, and Scalability of the developed system.

 

- The individual should be capable of single-handedly understanding the requirement, liaison with the product owner and external teams; produce the technical output required.

 

- Strong Leadership skills to contradict, produce a new design to current trends is required.

 

- Should be an avid technology enthusiast with strong views on technical architecture.

Technical Skills:

1) Strong Python and Mongo DB is mandatory

2) Web Application Architecture - One Large Project Experience of Development & Maintenance

3) Knowledge in one or more frameworks like WSGI(uwsgi), Django, Flask, Web Application development

4) Exposure to Databases like MongoDB, BigQuery, Elastic Search, Redis, etc.,

5) Knowledge of Code Quality Process and Discipline (Git, Jenkins, etc)

Read more
Artificial Learning Systems
at Artificial Learning Systems
1 video
3 recruiters
Bindu Varma
Posted by Bindu Varma
Bengaluru (Bangalore)
5 - 8 yrs
₹5L - ₹20L / yr
Game Design
skill iconNodeJS (Node.js)
skill iconPython
skill iconJavascript
skill iconHTML/CSS
+4 more
Artificial Learning Systems India Pvt Ltd is looking for an exceptional Technical Lead who will work with the engineering team and will have a good background in, and understanding of, software systems, and one who has the ability to work closely with the rest of the Engineering team from the early stages of design all the way through identifying and resolving production issues. Candidate Profile: The ideal candidate will be passionate about this role which involves deep knowledge of both the application and the product, and he/she will also believe that automation is key to operating large-scale systems Education: BTech from IIT or equivalent Job Type: Full time, permanent Job Location: Bangalore Technical skills required: 5+ years’ experience as a backend web developer in python Do software design for the product development Strong understanding of the 3 key areas of web application architecture server backend, frontend presentation (HTML, CSS) and interactive web (Javascript and jQuery) Proficiency in python Proficiency in a modern open-source NoSQL database such as Cassandra, MongoDB Proficient in HTTP protocol, REST APIs, JSON Ability to do database design and modeling Experience with Flask/Django Experience with Javascript, jQuery Experience with Gunicorn, Celery Artificial Learning systems (Artelus) is a 16 month young company, bootstrapped and working in the Deep Learning space to solve healthcare problems. The company seeks to make products, which would complement the knowledge and assist clinicians in making faster and more accurate diagnoses. Our team comprises a group of dedicated scientists trying to make the world a healthier place using the latest advances in computer science and machine learning and applying it to the field of medicine and healthcare. Why Artelus? You will be joining a world-class, multidisciplinary team and will be participating in cutting-edge research in machine intelligence and artificial intelligence. You will be providing quality answers to large-scale problems with broad impact.
Read more
DailyRounds/Marrow
at DailyRounds/Marrow
1 video
8 recruiters
Abhilasha Chatterjee
Posted by Abhilasha Chatterjee
Bengaluru (Bangalore)
3 - 5 yrs
₹14L - ₹20L / yr
skill iconFlask
skill iconPython
RESTful APIs
skill iconMongoDB
Apache Kafka
+1 more
Responsibilities  Work with the team to create backend services by translating application storyboards and use cases into functional applications  Design, build and maintain efficient, reusable, and reliable Python code  Ensure the best possible performance, quality, and responsiveness of the applications  Identify bottlenecks and bugs and devise solutions to these problems  Help maintain code quality, organization, and automatization Skills  Deep understanding of how RESTful APIs work  Familiar with various design and architectural patterns  Sound knowledge of Databases MongoDB is a must,  Work-experience in Python, with knowledge of Flask Framework.  Knowledge of user authentication and authorization between multiple systems, servers, and environments  Strong unit test and debugging skills Ability to communicate complex technical concepts to both technical and non-technical audiences  Experience with Queue based streaming systems like Kafka, Celery  Understanding of fundamental design principles behind a scalable application  Able to create database schemas that represent and support business processes  Proficient understanding of code versioning tools, such as Git We expect an entrepreneurial mindset, someone who is not afraid to take on new challenges every day and who considers the product as his own by taking complete ownership of it.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos