Cutshort logo
Genspark logo
Senior Data Engineer
Senior Data Engineer
Genspark's logo

Senior Data Engineer

Agency job
5 - 9 yrs
₹9L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Coimbatore
Skills
Apache Kafka
Apache
MLOps
skill iconAmazon Web Services (AWS)

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

  1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
  3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
  4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
  5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
  6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
  7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
  8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
  9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Genspark

Founded :
2023
Type :
Services
Size :
20-100
Stage :
Profitable

About

Empower Today,Excel Tomorrow

Read more

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Empower Today,

Excel Tomorrow

Company social profiles

N/A

Similar jobs

MindCrew Technologies
at MindCrew Technologies
3 recruiters
Agency job
via TIGI HR Solution Pvt. Ltd. by Vaidehi Sarkar
Remote only
8 - 12 yrs
₹10L - ₹15L / yr
skill iconPython
skill iconPostgreSQL
FastAPI
CI/CD
skill iconDocker
+4 more

Position: Lead Backend Engineer

Location: Remote

Experience: 10+ Years

Budget: 1.7 LPM

Employment Type: [Contract]


Required Skills & Qualifications:

  • 10+ years of proven backend engineering experience.
  • Strong proficiency in Python.
  • Expertise in SQL (Postgres) and database optimization.
  • Hands-on experience with OpenAI APIs.
  • Strong command of FastAPI and microservices architecture.
  • Solid knowledge of debugging, troubleshooting, and performance tuning.


Nice to Have:

  • Experience with Agentic Systems or ability to quickly adopt them.
  • Exposure to modern CI/CD pipelines, containerization (Docker/Kubernetes), and cloud platforms (AWS, Azure, or GCP).


Read more
Wekan Enterprise Solutions
Bengaluru (Bangalore)
7 - 12 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconMongoDB
Microservices
NestJS
skill iconAmazon Web Services (AWS)
+4 more

Backend - Software Development Engineer III


Experience - 7+ yrs


About Wekan Enterprise Solutions


Wekan Enterprise Solutions is a leading Technology Consulting company and a strategic investment partner of MongoDB. We help companies drive innovation in the cloud by adopting modern technology solutions that help them achieve their performance and availability requirements. With strong capabilities around Mobile, IOT and Cloud environments, we have an extensive track record helping Fortune 500 companies modernize their most critical legacy and on-premise applications, migrating them to the cloud and leveraging the most cutting-edge technologies.


Job Description


We are looking for passionate software engineers eager to be a part of our growth journey. The right candidate needs to be interested in working in high-paced and challenging environments leading technical teams, designing system architecture and reviewing peer code. Interested in constantly upskilling, learning new technologies and expanding their domain knowledge to new industries. This candidate needs to be a team player and should be looking to help build a culture of excellence. Do you have what it takes?

You will be working on complex data migrations, modernizing legacy applications and building new applications on the cloud for large enterprise and/or growth stage startups. You will have the opportunity to contribute directly into mission critical projects directly interacting with business stakeholders, customers technical teams and MongoDB solutions Architects.


Location - Chennai or Bangalore


  • Relevant experience of 7+ years building high-performance back-end applications with at least 3 or more projects delivered using the required technologies
  • Good problem solving skills
  • Strong mentoring capabilities
  • Good understanding of software development life cycle
  • Strong experience in system design and architecture
  • Strong focus on quality of work delivered
  • Excellent verbal and written communication skills


Required Technical Skills


  • Extensive hands-on experience building high-performance web back-ends using Node.Js and Javascript/Typescript
  • Min two years of hands-on experience in NestJs
  • Strong experience with Express.Js framework
  • Implementation experience in monolithic and microservices architecture
  • Hands-on experience with data modeling on MongoDB and any other Relational or NoSQL databases
  • Experience integrating with any 3rd party services such as cloud SDKs (Preferable X), payments, push notifications, authentication etc…
  • Hands-on experience with Redis, Kafka, or X
  • Exposure into unit testing with frameworks such as Mocha, Chai, Jest or others
  • Strong experience writing and maintaining clear documentation


Good to have skills:


  • Experience working with common services in any of the major cloud providers - AWS or GCP or Azure
  • Technical certifications in AWS / Azure / GCP / MongoDB or other relevant technologies


Read more
InnovationM
at InnovationM
2 recruiters
Nandita Naithani
Posted by Nandita Naithani
Noida
4 - 7 yrs
₹1L - ₹17L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
RESTful APIs
+5 more


InnovationM is looking for a Java Developer with experience in Spring Boot, Microservices, and MongoDB to join our team. The ideal candidate should have hands-on experience in designing and developing REST APIs using Spring Boot, building microservices-based applications, working with MongoDB and have experience in deploying applications in AWS.


What you must be good at:

● Develop and maintain REST APIs using Spring Boot framework

● Build microservices-based applications using Spring Boot and related frameworks

● Design and develop data models and queries for MongoDB database

● Deploy applications in AWS using EC2, ECR, and other relevant AWS services

● Work in an Agile development environment

● Collaborate with cross-functional teams to deliver high-quality software


What you must be good at:

● 4+ years of experience in Java development

● Strong experience in Spring Boot and related frameworks

● Hands-on experience in building microservices-based applications

● Proficient in designing and developing REST APIs

● Strong experience in MongoDB, including data modeling and query optimization

● Good understanding of AWS services and deployment methodologies

● Experience working in an Agile development environment

● Proficient in Git and version control systems

Read more
cirruslabs
shivani sagar
Posted by shivani sagar
Hyderabad
3 - 6 yrs
₹8L - ₹16L / yr
skill iconPython
skill iconDjango
skill iconFlask
AWS Lambda
skill iconAmazon Web Services (AWS)
+16 more
Role Specific Responsibilities
 Interfaces with other processes and/or business functions to ensure they can leverage the
benefits provided by the AWS Platform process
 Responsible for managing the configuration of all IaaS assets across the platforms
 Hands-on python experience
 Manages the entire AWS platform(Python, Flask, RESTAPI, serverless framework) and
recommend those that best meet the organization's requirements
 Has a good understanding of the various AWS services, particularly: S3, Athena, Python code,
Glue, Lambda, Cloud Formation, and other AWS serverless resources.
 AWS Certification is Plus
 Knowledge of best practices for IT operations in an always-on, always-available service model
 Responsible for the execution of the process controls, ensuring that staff comply with process
and data standards
Qualifications
 Bachelor’s degree in Computer Science, Business Information Systems or relevant experience and
accomplishments
 3 to 6 years of experience in the IT field
 AWS Python developer
 AWS, Serverless/Lambda, Middleware.

 Strong AWS skills including Data Pipeline, S3, RDS, Redshift with familiarity with other components
like - Lambda, Glue, Step functions, CloudWatch
 Must have created REST API with AWS Lambda.
 Python relevant exp 3 years
 Good to have Experience working on projects and problem solving with large scale multivendor
teams.
 Good to have knowledge on Agile Development
 Good knowledge on SDLC.
 Hands on AWS Databases, (RDS, etc)
 Good to have Unit testing exp.
 Good to have CICD working knowledge.
 Decent communication, as there will be client interaction and documentation.

Education (degree): Bachelor’s degree in Computer Science, Business Information Systems or relevant
experience and accomplishments
Years of Experience: 3-6 years
Technical Skills
 Linux/Unix system administration
 Continuous Integration/Continuous Delivery tools like Jenkins
 Cloud provisioning and management – Azure, AWS, GCP
 Ansible, Chef, or Puppet
 Python, PowerShell & BASH
Job Details
 JOB TITLE/JOB CODE: AWS Python Develop[er, III-Sr. Analyst
 RC: TBD
 PREFERRED LOCATION: HYDERABAD, IND
 POSITION REPORTS TO: Manager USI T&I Cloud Managed Platform
 CAREER LEVEL: 3
Work Location:
Hyderabad
Read more
QUT
QUT
Agency job
via Hiringhut Solutions Pvt Ltd by Neha Bhattarai
Bengaluru (Bangalore)
4 - 7 yrs
₹7L - ₹10L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Apache Kafka
+5 more
What You'll Do

•Design and develop distributed, scalable, high availability web services.
•Work independently completing small to Mid-sized projects while
managing competing priorities in a demanding production environment.
•you will be writing reusable and maintainable quality code.

What You'll Bring

•BS in CS (or equivalent) and 4+ years of hands-on software design and
development experience in building high-availability, scalable backend
systems.
•hands-on coding experience is a must.
•Expertise in working on Java technology stacks in Linux environment -
Java, Spring/ Hibernate, MVC frameworks, TestNG, JUnit.
•Expertise in Database Schema Design, performance efficiency, and SQL
working on leading RDBMS such as MySQL, Oracle, MSSQL, etc.
•Expertise in OOAP, Restful Web Services, and building scalable systems
Preferred Qualifications:
•Experience using Platforms such as Drools, Solr, Memcached, AKKA, Scala,
Kafka etc. is a plus
•Participation in and Contributions to Open-Source Software Development and contributions
Read more
senrysa technologies (p) ltd
Joyita Guha
Posted by Joyita Guha
Bengaluru (Bangalore)
4 - 10 yrs
₹6L - ₹15L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
DevOps
skill iconAmazon Web Services (AWS)

Job Description

We are looking for a ROR developer. If you're a creative problem solver who is eager to develop amazing products and hungry for a new adventure, a word class workplace is waiting for you in the heart of Bengaluru / Kolkata or remote.

  • Production experience in Ruby.
  • A completed technical degree in Computer Science or any related fields.
  • 3+ years of professional product development experience.
  • Being comfortable with microservices architectures, API-based
  • You are a pragmatic programmer who understands what is needed to get things done.
  • Problem solving and collaborative mindset.
  • Experience working with DevOps (Docker, Kubernetes, Terraform).
  • Experience with AWS (RDS, DDB, Lambda, CW, EC2, SQS, SNS, Cognito, Kinesis).
  • Experience with performance improvements (Caching Techniques, SQL Query Optimization, Performance monitoring and profiling.
  • Deep understanding of service-oriented and microservices architectural patterns, troubleshooting methods and best practices.
  • Takes end to end ownership of the development and operation of complete features.
Read more
Jivox Software India Pvt Ltd
Kiranmai Banisetty
Posted by Kiranmai Banisetty
Bengaluru (Bangalore)
3 - 6 yrs
₹15L - ₹19L / yr
skill iconScala
skill iconJava
Data Structures
Algorithms
skill iconAmazon Web Services (AWS)

Your Opportunity

  • Own and drive business features into tech requirements
  • Design & develop large scale real time server side systems
  • Quickly create quality prototypes
  • Staying updated on emerging technologies
  • Ensuring that all deliverables adhere to our world class standards
  • Promote coding best practices
  • Mentor and develop junior developers in the team

Required Experience

  • 4+ years of relevant experience as described below
  • Excellent grasp of Core Java, Multi Threading and OO design patterns 
  • Experience with Scala, functional, reactive programming and Akka/Play is a plus
  • Excellent understanding of data structures and algorithms
  • Solid grasp of large scale distributed real time systems
  • Prior experience on building a scalable and resilient micro service
  • Solid understanding of relational databases, NoSQL databases and Caching systems
  • Good understanding of Big Data technologies such as Spark, Hadoop is a plus
  • Experience on one of AWS, Azure or GCP 

Who you are

  • You have excellent and effective communication and collaborative skills
  • You love problem solving
  • You stay up to date with the latest technologies and then apply them in real life
  • You love paying attention to detail
  • You thrive in meeting tight deadlines and prioritising workloads
  • Ability to collaborate across multiple functions

Education

Bachelor’s degree in Engineering or equivalent experience within the field

Read more
Jobdost
at Jobdost
17 recruiters
Agency job
via Jobdost by Heena K
Bengaluru (Bangalore)
4 - 5 yrs
₹5L - ₹10L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconFlask
skill iconAmazon Web Services (AWS)
SQL
+2 more

Position: Backend Developer 1 / Backend Engineer:

Location: Bangalore

Experience:  .5 to 4 years, preferably in an agile environment

 

Strong Knowledge Node.js and MongoDB
Good Knowledge on Flask, SQL and other databases
Good Knowledge on Deployment Process (Nginix, Docker, AWS, Digital Ocean)
Basic Knowledge on Python

Read more
Bridgei2i Analytics Solutions
Venniza Glades
Posted by Venniza Glades
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹16L / yr
Neo4J
Graph Databases
skill iconAmazon Web Services (AWS)
Graph theory
Gremlin

Role and Responsibilities

 

The candidate for the role will be responsible for enabling single view for the data from multiple sources. 

  • Work on creating data pipelines to graph database from data lake
  • Design graph database
  • Write Graph Database queries for front end team to use for visualization
  • Enable machine learning algorithms on graph databases
  • Guide and enable junior team members

Qualifications and Education Requirements

 

B.Tech with 2-7 years of experience

 

Preferred Skills

 

Must Have

Hands-on exposure to Graph Databases like Neo4J, Janus etc..

 

  1. Hands-on exposure to programming and scripting language like Python and PySpark
  2. Knowledge of working on cloud platforms like GCP, AWS etc.
  3. Knowledge of Graph Query languages like CQL, Gremlin etc.
  4. Knowledge and experience of Machine Learning 

Good to Have

 

  • Knowledge of working on Hadoop environment
  • Knowledge of graph algorithms
  • Ability to work on tight deadlines
Read more
Oxxus Technologies Pvt Ltd
Kartik Menon
Posted by Kartik Menon
Navi Mumbai, Mumbai
2 - 5 yrs
₹4L - ₹7L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
skill iconAmazon Web Services (AWS)
RESTful APIs
Uniserved is at heart a curated marketplace, where we provide our customers (Small and medium sized System Integrators and Hardware Distributors) with validated skilled resources in various technologies like Enterprise Telephone, Information Security, Cloud Applications etc. We also provide our freelance partners (Small companies and freelancers with the above mentioned skills) with access to the infrastructure and credibility of a established setup Job Description We are looking for a Django developer to join the team developing the Uniserved ISM (infrastructure Services Management) product. We are looking for someone who has the following technical skills: - 2-3 years experience in Python Development. - 2-3 years experience in Django Web Services (REST) implementation. - Experience in using AWS(Amazon Web Services) with at least one service/product. - Experience with Postgresql - Should be comfortable on Git and have used it regularly Good to Have skills: - Familiar with Linux working environment. - Familiarity with nginx,gunicorn. - Ability to work on projects with the Agile Team. We are looking for the following non negotiable personality traits: - Dedication to completing the task on hand - Ability to solve problems and more importantly when to ask for help We have a fun working environment, with a startup vibe, even though we are a four year old company. We can promise you continual challenges and an excellent opportunity for growth. Will explain in greater detail during the interview.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos