Cutshort logo
Pluginlive logo
Senior Data engineer
Senior Data engineer
Pluginlive's logo

Senior Data engineer

Harsha Saggi's profile picture
Posted by Harsha Saggi
5 - 20 yrs
₹10L - ₹30L / yr
Chennai
Skills
skill iconPython
SQL
skill iconJava
skill iconDjango
skill iconFlask

Company: PluginLive

About the company:

PluginLive Technology Pvt Ltd is a leading provider of innovative HR solutions. Our mission is to transform the hiring process through technology and make it easier for organizations to find, attract, and hire top talent. We are looking for a passionate and experienced Data Engineering Lead to guide the data strategy and engineering efforts for our Campus Hiring Digital Recruitment SaaS Platform.

Role Overview:

The Data Engineering Lead will be responsible for leading the data engineering team and driving the development of data infrastructure, pipelines, and analytics capabilities for our Campus Hiring Digital Recruitment SaaS Platform. This role requires a deep understanding of data engineering, big data technologies, and team leadership. The ideal candidate will have a strong technical background, excellent leadership skills, and a proven track record of building robust data systems.

Job Description

Position: Data Engineering Lead - Campus Hiring Digital Recruitment SaaS Platform

Location: Chennai

Minimum Qualification:  Bachelor’s degree in computer science, Engineering, Data Science, or a related field. Master’s degree or equivalent is a plus.

Experience:  7+ years of experience in data engineering, with at least 3 years in a leadership role.

CTC:  20-30 LPA 

Employment Type:  Full Time

Key Responsibilities:

Data Strategy and Vision:

  • Develop and communicate a clear data strategy and vision for the Campus Hiring Digital Recruitment SaaS Platform.
  • Conduct market research and competitive analysis to identify trends, opportunities, and data needs.
  • Define and prioritize the data roadmap, aligning it with business goals and customer requirements.

Data Infrastructure Development:

  • Design, build, and maintain scalable data infrastructure and pipelines to support data collection, storage, processing, and analysis.
  • Ensure the reliability, scalability, and performance of the data infrastructure.
  • Implement best practices in data management, including data governance, data quality, and data security.

Data Pipeline Management:

  • Oversee the development and maintenance of ETL (Extract, Transform, Load) processes.
  • Ensure data is accurately and efficiently processed and available for analytics and reporting.
  • Monitor and optimize data pipelines for performance and cost efficiency.

Data Analytics and Reporting:

  • Collaborate with data analysts and data scientists to build and deploy advanced analytics and machine learning models.
  • Develop and maintain data models, dashboards, and reports to provide insights and support decision-making.
  • Ensure data is easily accessible and usable by stakeholders across the organization.

Team Leadership:

  • Lead, mentor, and guide a team of data engineers, fostering a culture of collaboration, continuous improvement, and innovation.
  • Conduct code reviews, provide constructive feedback, and ensure adherence to development standards.
  • Collaborate with cross-functional teams including product, engineering, and marketing to ensure alignment and delivery of data goals.

Stakeholder Collaboration:

  • Work closely with stakeholders to understand business requirements and translate them into technical specifications.
  • Communicate effectively with non-technical stakeholders to explain data concepts and progress.
  • Participate in strategic planning and decision-making processes.

Skills Required:

  • Proven experience in designing and building scalable data infrastructures and pipelines.
  • Strong proficiency in programming languages such as Python, R, Data visualization tools like Power BI, Tableau, Qlik, Google Analytics
  • Expertise in big data technologies such as Apache Airflow, Hadoop, Spark, Kafka, and cloud data platforms like AWS, Oracle Cloud.
  • Solid understanding of database technologies, both SQL and NoSQL.
  • Experience with data modeling, data warehousing, and ETL processes.
  • Strong analytical and problem-solving abilities.
  • Excellent communication, collaboration, and leadership skills.

Preferred Qualifications:


  • Experience in HR technology or recruitment platforms.
  • Familiarity with machine learning and AI technologies.
  • Knowledge of data governance and data security best practices.
  • Contributions to open-source projects or active participation in the tech community.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Pluginlive

Founded :
2022
Type :
Services
Size
Stage :
Bootstrapped

About

Shifting gears… Go to the Next Level!
Read more

Connect with the team

Profile picture
Harsha Saggi

Company social profiles

N/A

Similar jobs

ChicMic Studios
manpreet kaur
Posted by manpreet kaur
Mohali, Chandigarh
2 - 8 yrs
₹4L - ₹8L / yr
skill iconDjango
skill iconFlask
RESTful APIs

ob Description: Jr. / Sr. Python Developer


We are looking for a highly skilled and experienced Jr. / Sr. Python Developer to join our dynamic team. The ideal candidate will have a robust background in developing web applications using Django and Flask, with expertise in deploying and managing applications on AWS. Proficiency in Django Rest Framework (DRF), a solid understanding of machine learning concepts, and hands-on experience with tools like PyTorch, TensorFlow, and transformer architectures are essential.


Location : Mohali

Exp : 2-8 yrs


Key Responsibilities

● Develop and maintain web applications using Django and Flask frameworks.

● Design and implement RESTful APIs using Django Rest Framework (DRF).

● Deploy, manage, and optimize applications on AWS services, including EC2, S3, RDS,

Lambda, and CloudFormation.

● Build and integrate APIs for AI/ML models into existing systems.

● Create scalable machine learning models using frameworks like PyTorch, TensorFlow,

and scikit-learn.

● Implement transformer architectures (e.g., BERT, GPT) for NLP and other advanced AI use

cases.

● Optimize machine learning models through advanced techniques such as hyperparameter tuning, pruning, and quantization.

● Deploy and manage machine learning models in production environments using tools

like TensorFlow Serving, TorchServe, and AWS SageMaker.

● Ensure the scalability, performance, and reliability of applications and deployed models.

● Collaborate with cross-functional teams to analyze requirements and deliver effective

technical solutions.

● Write clean, maintainable, and efficient code following best practices.

● Conduct code reviews and provide constructive feedback to peers.

● Stay up-to-date with the latest industry trends and technologies, particularly in AI/ML.


Required Skills and Qualifications

● Bachelor’s degree in Computer Science, Engineering, or a related field.

● 2-8 years of professional experience as a Python Developer.

● Proficient in Python with a strong understanding of its ecosystem.

● Extensive experience with Django and Flask frameworks.

● Hands-on experience with AWS services for application deployment and management.

● Strong knowledge of Django Rest Framework (DRF) for building APIs.

● Expertise in machine learning frameworks such as PyTorch, TensorFlow, and scikit-learn.

● Experience with transformer architectures for NLP and advanced AI solutions.

● Solid understanding of SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).

● Familiarity with MLOps practices for managing the machine learning lifecycle.

● Basic knowledge of front-end technologies (e.g., JavaScript, HTML, CSS) is a plus.

● Excellent problem-solving skills and the ability to work independently and as part of a team.

● Strong communication skills and the ability to articulate complex technical concepts to

non-technical stakeholders.


Thanks

Read more
a globally recognized marketing technology SaaS company
a globally recognized marketing technology SaaS company
Agency job
via Jobdost by Saida Jabbar
Bengaluru (Bangalore), Mumbai
3 - 7 yrs
₹15L - ₹35L / yr
skill iconPython
skill iconDjango
skill iconFlask

Hiring For SDE II - Python (Remote)

 

The Impact you will create:

  • Build campaign generation services which can send app notifications at a speed of 10 million a minute

  • Dashboards to show Real time key performance indicators to clients

  • Develop complex user segmentation engines which creates segments on Terabytes of data within few seconds

  • Building highly available & horizontally scalable platform services for ever growing data

  • Use cloud based services like AWS Lambda for blazing fast throughput & auto scalability

  • Work on complex analytics on terabytes of data like building Cohorts, Funnels, User path analysis, Recency Frequency & Monetary analysis at blazing speed

  • You will build backend services and APIs to create scalable engineering systems.

  • As an individual contributor, you will tackle some of our broadest technical challenges that requires deep technical knowledge, hands-on software development and seamless collaboration with all functions.

  • You will envision and develop features that are highly reliable and fault tolerant to deliver a superior customer experience.

  • Collaborating various highly-functional teams in the company to meet deliverables throughout the software development lifecycle.

  • Identify and improvise areas of improvement through data insights and research.



Primary Responsibilities

  • End-to-end ownership of product development, from design, through implementation, testing, deployment, and maintenance

  • Translating high-level requirements and end-user use cases into design proposals, decomposing complex features into smaller, short-term deliverable tasks

  • Maintaining constant focus on scalability, performance and robustness of architecture

  • Designing and implementing logging, monitoring and alerting systems for existing and new infrastructure

  • Documenting API's and architecture design

  • Mentor and guide juniors on their path to become solid developers



What we look for?

  • 4+ of industry experience in technical leadership roles

  • Solid knowledge of Python, SQL, NoSQL, shell scripting and Linux operating environment

  • End-to-end experience in design and development of highly scalable enterprise and cloud data products

  • Ability to challenge and redefine existing architecture to create robust, scalable and reliable products

  • Hands-on experience with design and troubleshooting of scalable web services, queue based systems, distributed databases and streaming services

  • Experience with modern DevOps technologies such as kOps, Kubernetes and Docker, CI/CD, monitoring and autoscaling


Read more
Fintech company in chennai
Fintech company in chennai
Agency job
via The Hub by Sridevi Viswanathan
Taminadu, kerla, Indore, Jaipur
3 - 6 yrs
₹7L - ₹18L / yr
skill iconPython
skill iconFlask
NOSQL Databases

Requirements:

• Should be a go-getter, ready to shoulder more responsibilities, and shows enthusiasm and interest in work.

• Excellent core Python skills including threading, dictionary, OOPS Concept, Data structure, and Web service.

• Should have work experience on the following stacks/libraries: Flask

• Familiarity with some ORM (Object Relational Mapper) libraries

• Able to integrate multiple data sources and databases into one system

• Understanding of the threading limitations of Python, and multi-process architecture Familiarity with event-driven programming in Python

• Basic understanding of front-end technologies, such as Angular, JavaScript, HTML5 and CSS3

• Writing reusable, testable, and efficient code

• Design and implementation of low-latency, high-availability, and performant applications

• Understanding of accessibility and security compliance

• Experience in both RDBMS(MySQL), NoSQL databases (MongoDB, HDFS, HIVE etc) or in-memory caching technologies such as ehcache etc is preferable.

Read more
Robosoft Technologies
at Robosoft Technologies
2 recruiters
Sayantani Ghosh
Posted by Sayantani Ghosh
Mumbai, Pune, Bengaluru (Bangalore), udupi
6 - 15 yrs
₹10L - ₹25L / yr
skill iconPython
skill iconDjango
skill iconFlask
  • 6+ years of experience with expertise in Django CMS, Python, REST framework, AI framework
  • MySQL Db usage, SQL queries
  • Experience in using scraping tools.
  • Microservices
  • Docker and Kubernetes hands-on experience
  • AWS Redis cache integration
  • Deployment on AWS cloud, auto-scale
  • Work will be rotational Shifts/ UK Shift
  • Must be flexible to work on weekends/stretch for some hours

 


Read more
Leading Fintech Startup
Leading Fintech Startup
Agency job
via Qrata by Seemi Ejaz
Bengaluru (Bangalore)
3 - 4 yrs
₹10L - ₹15L / yr
skill iconPython
skill iconDjango

We are looking for someone who: ● Has 3+ years of experience working as a Backend Developer in high-growth consumer internet companies ● Is proficient in building RESTful APIs, has a strong understanding of relational and non-relational databases ● Prior working knowledge of Python/Django is a big plus ● Familiarity with modern CI/CD tools ● Knowledge of AWS or any other Cloud Platform services ● Ability to analyze and convert business requirements into technical requirements ● Has a high sense of ownership and a bias for action ● Is a people’s person and can lead without authority What will they be responsible for ● They will work on one or more of the tracks mentioned above ● Own the end-to-end delivery - design, execute, test and deploy ● Work as an individual contributor, champion code quality ● Build and train a team of rockstar engineers as the organization grows Why should this role excite you We are just getting started and people who join us at this juncture will: ● Do fulfilling, high-impact work ● Work directly with the founders and engineering leads ● Own and deliver, get complete ownership of whatever you do ● Work with colleagues from strong diverse backgrounds ● Solve a problem that millions of Indians are emotionally attached to but hasn’t seen any innovation ● Learn and grow at an unprecedented pace Tactical details ● Current stack: Python/Django, React, Kafka, Docker, AWS ● Location: Bengaluru (Work from office) ● Compensation: Structured as Fixed + ESOPs

Read more
DolphinChat
at DolphinChat
5 recruiters
Ashish Sharma
Posted by Ashish Sharma
Gurugram
3 - 4 yrs
₹5L - ₹10L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconMongoDB
Object Oriented Programming (OOPs)
+6 more
Roles & Responsibilities :

- Optimizing components for maximum performance across a vast array of web-capable devices and browsers

- Ability to understand business requirements and translate them into technical requirements

- You will ensure that these components and the overall application are robust and easy to maintain.

- Have a good understanding of design and user experience principles.

- Open-minded, flexible, and willing to adapt to changing situations

- Ability to work independently as well as on a team and learn from colleagues

- High adaptability in a dynamic start-up environment

- Ensuring technologies are used efficiently, profitably, and securely. Evaluating and implementing new systems and infrastructure.

- Excellent troubleshooting, analytical and problem-solving abilities with a tenacious commitment to finding the root cause of issues.

Qualifications :

- B. Tech/ B.E. /M. Tech/ BCA / MCA or a related technical discipline from reputed universities

Skills Required :

- Minimum 2+ years of experience in REST API development using python.

- Must have experience with anyone popular python frameworks like Django, Flask, and FastAPI Framework.

- Experience in designing and developing Restful Web services and Remote procedure calls.

- Able to integrate multiple data sources and databases into one system

- Knowledge of load testing and optimizing code for performance, security, and scalability

- Experience with Unit testing frameworks in Python

- Knowledge of modern authorization & authentication mechanisms.

- Able to create database schemes that represent and support business processes

- Knowledge of Version Control System & basics of CI/CD

- Write and maintain technical documentation

- Solid foundation in OOPS, Data structures, and Algorithms

- Knowledge of SDLC phases of project development.

- Experience in one or more No SQL Databases such as MongoDB, and Cassandra.

- Experience with event-based databases and programming

- Good experience in synchronous programming and thread-based programming.

- Experience with schedulers.

- Good to have knowledge of Linux shell commands.

- Good to have experience in Kubernetes & Docker

- Knowledge of any Cloud Service like GCP or AWS would be an added advantage

- Cares deeply about writing Quality, Testable & Modular code

- Good to have an understanding of NLP.
Read more
The company is looking for Python developers in Thrissur loc
The company is looking for Python developers in Thrissur loc
Agency job
Thrissur
3 - 5 yrs
₹2L - ₹6L / yr
skill iconDjango
skill iconPython

Requirements:

  • Expert in Python, with good knowledge in Django technology.
  • Able to integrate multiple data sources and databases into one system.
  • Understanding of the threading limitations of Python, and multi-process architecture.
  • Knowledge of user authentication and authorization between multiple systems, servers, and environments.
  • Experience in Flask will be an add-on
  • Understanding of fundamental design principles behind a scalable application.
  • Familiarity with event-driven programming in Python.
  • Able to create database schemas that represent and support business processes.
  • Proficient understanding of code versioning tools.
  • Good communication skills.
Read more
FinTech product company from UK,
FinTech product company from UK,
Agency job
via CHANSYS Global Solutions by Channaraju GD
Bengaluru (Bangalore)
8 - 14 yrs
₹35L - ₹45L / yr
skill iconPython
skill iconDjango
skill iconFlask

Your Responsibilities:

  • Own the backend stack – Python based, that powers our product
  • Collaborate with Data Scientists, Backend Developers(Node.js), Front-end developers, DevOps to design and implement new features
  • Build and maintain several Backend Jobs and REST’ful Services which will be used internally in a Macroservices/Distributed services environment.
  • Deploy and monitor the Jobs and endpoints ensuring availability and scalability(ability to handle 100X data processing load)
  • Work on full project lifecycle starting from requirements gathering/understanding the problem to deploying and maintaining the project.

 

Skills that you bring Along:

  • A minimum 8+ years of extensive work experience with Python and related frameworks – particularly Flask.
  • Extensive experience in designing and scheduling backend Python jobs
  • Hands on working in different file formats like Json, Parquet, csv etc. coming from Data Science side.
  • Extensive experience with databases such as Postgres and Mongo.
  • Extensive experience in Cloud Infrastructure (AWS based) – e.g. AWS API Gateway, Lambda Functions etc.
  • Experience with cache like Redis and/or Memory cache
  • Good experience in Microservices/Macroservices or Event driven Architectures
  • Good experience with design patterns
  • Experience in writing advanced SQL-queries, good knowledge of PL/SQL
  • Good understanding of Software Design Principles and domain-driven design
  • Good experience with Continuous Delivery and Containerization(Docker)
  • Good experience in designing and maintaining REST’ful API endpoints
  • Ideally maintaining infrastructure-as-code using Terraform
  • Ideally experience in parallel data processing and building end-to-end Data Pipelines using tools such as Airflow/Prefect and Spark/Dask
  • Excellent communication skills and the ability to explain complex topics in a simple manner
Read more
Fulfil.IO
Fulfil.IO
Agency job
via Mango Consulting by Naila Kazi
Remote only
3.5 - 12 yrs
₹15L - ₹30L / yr
skill iconPython
SQLAlchemy
skill iconDjango
SQL
skill iconPostgreSQL
+3 more

Senior Software Engineer (Python)

 

Job description


Fulfil’s software engineers develop the next-generation technologies that change how millions of customer orders are fulfilled by merchants. Our products need to handle information at massive scale. We're looking for engineers who bring fresh ideas from all areas into our technology.

As a senior software engineer, you will work on our python based ORM and applications that scales to handle millions of transactions every hour. This is mission critical software and your primary focus will be building robust and scalable solutions that are easy to maintain.

In this role, you will be collaborating closely with the rest of the team working on different layers of infrastructure in an international environment. Therefore, a commitment to collaborative problem solving, sophisticated design, and quality product are important.


What You’ll Do:

  • Own definition and implementation of API interfaces (REST and GraphQL). We take pride in our 100% open API with over 600 endpoints.
  • Implement simple solutions to complex business logic that enables our merchants to manage financials, orders and shipments across millions of transactions.
  • Build reusable components and packages for future use.
  • Translate specs and user stories into reviewable, test covered patches.
  • Peer review code and refactor existing code.
  • Integrate with our eCommerce partners (Shopify, BigCommerce, Amazon), shipping partners (UPS, USPS, FedEx, DHL) and EDI.
  • Manage Kubernetes and Docker based global deployment of our infrastructure.

Requirements


We’re Looking for Someone With:

  • Experience working with ORMs like SQLAlchemy or Django
  • Experience with SQL and databases (Postgres preferred)
  • Experience in developing large server side applications and microservices
  • Ability to create high quality code
  • Experience with python testing tools (pytest) and test automation
  • Familiarity with code versioning tools like GIT
  • Strong sense of ownership and leadership quality
  • Experienced in the tools of our web stack
    • Python
    • Celery
    • Postgres
    • Redis
    • RabbitMQ

Nice to Haves:

  • Prior experience at a growth stage Internet/Software company
  • Experience with ReactJS, Google Cloud, Heroku
  • Cloud deployment and scaling experience

About Us:


Fulfil.io helps high growth, high volume merchants simplify operations and scale for growth. With the rise in omni-channel commerce, Fulfil was founded with the simple idea that merchant operations need to be simplified in order to deliver amazing retail experiences. Fulfil enables businesses to turn their back office operations into an accelerator for growth by integrating order management, inventory management, warehouse management, vendor/supplier management, wholesale, manufacturing, financials and customer service, into one seamless solution. We believe merchants should love their operations platform, and we work hard to make that happen every single day. Fulfil.io is a trusted solution for brands like EndySleep, Mejuri, Lie-Nielson Toolworks, and many more.  

Fulfil.io is a venture backed technology company with offices in San Francisco, Toronto, and Bangalore. The team is made up of people who want to feel challenged at work, be the best at their craft and learn from one another. We come from different backgrounds and experiences, all passionate about the work we do, the team we do it with, and the customers we do it for. Join us in our journey to simplify operations and empower merchants around the world!  

 

Read more
Aviso Inc
at Aviso Inc
1 video
11 recruiters
Chaitanya Penugonda
Posted by Chaitanya Penugonda
Bengaluru (Bangalore), Hyderabad
3 - 9 yrs
Best in industry
skill iconPython
skill iconDjango
RESTful APIs
skill iconMongoDB
Data Structures
+1 more

About Aviso:

Aviso is the AI Compass that guides Sales and Go-to-Market teams to close more deals, accelerate revenue growth, and find their True North. 

We are a global company with offices in Redwood City, San Francisco, Hyderabad, and Bangalore. Our customers are innovative leaders in their market. We are proud to count Dell, Honeywell, MongoDB, Glassdoor, Splunk, FireEye, and RingCentral as our customers, helping them drive revenue, achieve goals faster, and win in bold new frontiers. 

Aviso is backed by Storm Ventures, Shasta Ventures, Scale Venture Partners and leading Silicon Valley technology investors

What you will be doing:

● Write effective, scalable, extensible and testable code
● Develop back-end components to improve responsiveness and overall performance of the application.
● Develop database layer with optimised queries
● Detect the bottlenecks in legacy code and provide feasible solution to make things better.
● Implement security and data protection solutions
● Coordinate with internal teams to understand user requirements and provide technical solutions
● Manage individual project priorities, deadlines, and deliverables.

What you bring:

● Bachelor's Degree or equivalent in Computer Science with good academic record
● 3+ years of hands on experience in Python and Django
● Experience in the development of highly scalable applications
● A high degree of motivation to learn new technologies, tools and libraries
● Experience developing in Unix/Linux environment
● Experience in the development of REST API
● Basic understanding on databases like MongoDB and Postgres
● Good knowledge of Data Structures and Algorithms
● Understand the deployment aspects after developing the feature
● Excellent interpersonal skills, written and verbal communication skills, and
professionalism

Aviso offers:

● Dynamic, diverse, inclusive startup environment driven by transparency and velocity
● Bright, open, sunny working environment and collaborative office space
● Convenient office locations in Redwood City, Hyderabad and Bangalore tech hubs
● Competitive salaries and company equity, and a focus on developing world class talent operations
● Comprehensive health insurance available (medical) for you and your family
● Unlimited leaves with manager approval and a 3 month paid sabbatical after 3 years of service
● CEO moonshots projects with cash awards every quarter
● Upskilling and learning support including via paid conferences, online courses, and certifications
● Every month Rupees 2,500 will be credited to Sudexo meal card
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos