Cutshort logo
Genspark logo
Senior Data Engineer
Senior Data Engineer
Genspark's logo

Senior Data Engineer

Agency job
5 - 9 yrs
₹9L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Coimbatore
Skills
Apache Kafka
Apache
MLOps
skill iconAmazon Web Services (AWS)

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

  1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
  3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
  4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
  5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
  6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
  7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
  8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
  9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Genspark

Founded :
2023
Type :
Services
Size :
20-100
Stage :
Profitable

About

Empower Today,Excel Tomorrow

Read more

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Empower Today,

Excel Tomorrow

Company social profiles

N/A

Similar jobs

Deqode
at Deqode
1 recruiter
Apoorva Jain
Posted by Apoorva Jain
Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹18L / yr
skill iconJava
skill iconSpring Boot
Spring
Microservices
skill iconAmazon Web Services (AWS)

Responsibilities

  • Provide technology contributions in
  • Working in an agile development environment
  • Translating business requirements into low-level application design
  • Application code development through a collaborative approach
  • Doing Full-scale unit testing
  • Applying test-driven and behaviour-driven development (TDD/BDD) QA concepts
  • Applying continuous integration and continuous deployment (CI/CD) concepts

Soft Skills

  • Should be able to contribute as an individual contributor
  • Should be able to execute his/her responsibility independently
  • Excellent problem-solving skills and attention to detail.
  • Focus on self-planning activities
  • Firm with communication skills

Mandatory Skills

  • Java, Spring Boot, Python and relational / non-relational databases
  • Container orchestration - Kubernetes, Docker
  • Development experience in Linux environment
  • Modern SDLC tooling (Maven, Git)
  • Micro services design-oriented application development and deploying the same using Container orchestration in the cloud environment
  • Understanding CI/CD pipeline & related system development environment

Nice-to-have Skills

  • Front-end technologies (JavaScript, HTML5, CSS, Angular)


Read more
ADTRAN
at ADTRAN
1 recruiter
Reema Meshram
Posted by Reema Meshram
Bengaluru (Bangalore)
3 - 7 yrs
₹12L - ₹35L / yr
skill iconScala
Functional programming
Akka
Apache Kafka
skill iconPostgreSQL

Key Responsibilities

  • Provide technical leadership in the design, development, and delivery of scalable, high-performance software systems.
  • Partner with product managers, architects, and cross-functional teams to define technical strategy and ensure alignment with business objectives.
  • Lead by example in writing high-quality, testable, and maintainable code.
  • Drive best practices in software engineering, including code reviews, system design, and performance optimization.
  • Mentor and guide engineers across teams, fostering a culture of technical excellence and continuous learning.
  • Evaluate and introduce new technologies, tools, and frameworks to improve productivity, scale and system robustness.

Required Skills & Qualifications

  • Strong foundation in computer science fundamentals: data structures, algorithms, and functional programming techniques.
  • Expertise in Scala, with strong preference for functional programming.
  • Solid experience in software design, implementation, and debugging, including inter-process communication and multi-threading.
  • Hands-on experience with distributed systems and event-driven architectures.
  • Familiarity with databases (Postgres preferred).
  • Proficiency with Apache Kafka for messaging and persistence.
  • Working knowledge of Python for unit and integration testing.
  • Basic to intermediate experience with Ansible for automation.
  • Strong problem-solving, analytical, and communication skills.

Nice-to-Have / Bonus Skills

  • Experience with modeling in YANG.
  • Experience with Scala libraries such as Cats Effect (2/3), Monix, and Akka.
  • Experience working in Agile/Scrum environments.

What We Offer

  • Opportunity to work on cutting-edge technologies in a collaborative environment.
  • A role with strong ownership, technical influence, and visibility across teams.
  • Competitive compensation and benefits.


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Seema Srivastava
Posted by Seema Srivastava
Bengaluru (Bangalore), Mumbai
5 - 10 yrs
Best in industry
skill iconJava
06692
Microservices
skill iconAmazon Web Services (AWS)
Apache Kafka
+1 more

Job Description: We are looking for a talented and motivated Software Engineer with

expertise in both Windows and Linux operating systems and solid experience in Java

technologies. The ideal candidate should be proficient in data structures and algorithms, as

well as frameworks like Spring MVC, Spring Boot, and Hibernate. Hands-on experience

working with MySQL databases is also essential for this role.


Responsibilities:

● Design, develop, test, and maintain software applications using Java technologies.

● Implement robust solutions using Spring MVC, Spring Boot, and Hibernate frameworks.

● Develop and optimize database operations with MySQL.

● Analyze and solve complex problems by applying knowledge of data structures and

algorithms.

● Work with both Windows and Linux environments to develop and deploy solutions.

● Collaborate with cross-functional teams to deliver high-quality products on time.

● Ensure application security, performance, and scalability.

● Maintain thorough documentation of technical solutions and processes.

● Debug, troubleshoot, and upgrade legacy systems when required.

Requirements:

● Operating Systems: Expertise in Windows and Linux environments.

● Programming Languages & Technologies: Strong knowledge of Java (Core Java, Java 8+).

● Frameworks: Proficiency in Spring MVC, Spring Boot, and Hibernate.

● Algorithms and Data Structures: Good understanding and practical application of DSA

concepts.

● Databases: Experience with MySQL – writing queries, stored procedures, and performance

tuning.

● Version Control Systems: Experience with tools like Git.

● Deployment: Knowledge of CI/CD pipelines and tools such as Jenkins, Docker (optional)

Read more
Recro
at Recro
1 video
32 recruiters
Mounashree JP
Posted by Mounashree JP
Remote, Bengaluru (Bangalore)
3 - 5 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+1 more
  • 3+ years of experience in the Development in JAVA technology.
  • AWS or cloud Experience
  • Strong Java Basics
  • SpringBoot or Spring MVC
  • Hands on experience on Relationl Databases (SQL query or Hibernate) + Mongo (JSON parsing)
  • Proficient in REST API development
  • Messaging Queue (RabitMQ or Kafka)
  • Microservices
  • Any Caching Mechanism
  • Good at problem-solving


Good to Have Skills:


  • 3+ years of experience in using Java/J2EE tech stacks
  • Good understanding of data structures and algorithms.
  • Excellent analytical and problem solving skills.
  • Ability to work in a fast paced internet start-up environment.
  • Experience in technical mentorship/coaching is highly desirable.
  • Understanding of AI/ML algorithms is a plus.


Read more
Quolam Business Solutions
Lakshmi Vedanarayanan
Posted by Lakshmi Vedanarayanan
Remote, Navi Mumbai, Mumbai
2 - 4 yrs
₹3.5L - ₹6.5L / yr
skill icon.NET
ASP.NET
Windows Azure
skill iconC#
DevOps
+5 more
Development skills required
• Microsoft: http://asp.net/" target="_blank">ASP.NET Core, Azure, C#/Web API 
• Web: Azure Web Apps, HTML, HTML5, Javascript, CSS3 , BootStrap 
• Frameworks: .NET Core 2.1+ (required), Azure PaaS, Jquery, ReactJS 
• Experience with Azure, .NET Core, RESTful services, AWS, 
• Databases: NoSQL db (Azure Cosmos or MongoDB), SQL Server, Azure SQL, Azure Tables, Stored Procedure Development, Performance Tuning 
Read more
e6data
at e6data
1 recruiter
Vinola  Mercy
Posted by Vinola Mercy
Bengaluru (Bangalore)
2 - 5 yrs
$20K - $40K / yr
skill iconDjango
Object Oriented Programming (OOPs)
skill iconPython
Data Structures
skill iconMongoDB
+4 more

Who We are

At e6data (https://e6x.io/">https://e6data.io) we’re building core algorithms that makes querying 25 - 200X more performant (i.e. faster and/or cheaper) than every other analytics platform in the world. This results in billions of dollars of value unlocked across faster analytics, savings on compute / infra, and new use cases becoming possible.

Our core team has 100+ years of combined experience and 10+ patents across diverse but complementary disciplines like real time databases, time series databases, SQL OLAP engines, distributed computing platforms, stream processing, and log analytics. Two of the founding team are second time founders with past exits.

We are passionate about solving the deepest and most important problems in computer science, and believe in making our technology available to customers regardless of their location, size, or budget. Our vision is for e6data to power every analytical workload in the world - regardless of deployment scenario (cloud, on-premise, edge), across every use case (end user queries, ETL / data pipelines), and every latency requirement (batch, streaming / real time).

What you'll do?

  • Write awesome code
  • The focus will be on performance of our data platform
  • Identify tactical and long-term product improvements (could be code, script, etc.)
  • Responsible for Planning and executing Metadata and Governance tool supports
  • Build our internal Data Platform using exdata
  • Adding scalable functionality to the system for new features like UDF's, sql functions etc

What are we looking for?

  • Worked with Python for a minimum of 2 years
  • Well versed with Django REST framework
  • Knowledge of document based data stores like MongoDB
  • Strong team player
  • A passion for continuous learning and growth (both at a personal and team level)
  • Experience (or enjoys) working in a startup will be an added advantage
Read more
Nest Pro Inc
at Nest Pro Inc
1 recruiter
Suraj Gaydhane
Posted by Suraj Gaydhane
Mumbai, Navi Mumbai
1 - 3 yrs
₹4L - ₹8L / yr
skill iconGo Programming (Golang)
skill iconAmazon Web Services (AWS)
skill iconKubernetes
skill iconDocker
RESTful APIs
+4 more

Nest is a gamified investment platform for the next-generation and young millennials of the world, to invest, play and earn returns more than a regular savings bank account. The world of gaming is merging with finance to offer a more immersive user experience and help users learn how to manage their money. We’re creating a new breed of asset managers and fin-fluencers with Nest.

We are seeking a dedicated Golang developer to join our growing company.

You will collaborate with other technical staff to deliver and maintain a fully-functional mobile application. We hope you can put your passion for software engineering to work for creating highly immersive user applications.

Your duties will include maintaining code repositories via GitHub and internal server storage modules.

 

Responsibilities

Below are some of the responsibilities a Golang developer is expected to undertake in their position:

  • Implement AWS containers to support Go implementation and successful repository maintenance
  • Utilize Kubernetes to ensure successful application development, deployment, and scaling
  • Implement Docker for smaller-scale applications that require simpler deployments
  • Employ Linux Terminal command structures to allow easy back-end operations for less-expert technical staff
  • Structure our user interface with React and ensure REST API access is available for enterprise-grade finance customers on-demand
  • Collaborate with other technical staff to ensure consistent and smooth DevOps workflows
  • Choose and implement other JavaScript libraries that will optimize performance without sacrificing security and base functionality
  • Manage multiple projects within reasonable design specifications and budget restrictions
  • QA design for errors
  • Implement feedback and changes whenever possible
  • Create visualizations that convey accurate messaging for the project.

Job Qualifications and Skill Sets

Bachelor’s degree in computer science, IT, or a related field, such as programming. Other critical skills required are:

  • Provable proficiency in Go programming
  • Excellent written and verbal communication skills
  • Minimum of two years’ experience working in programming or information technology
  • Attention to detail and Knowledge in Java is recommended
  • Portfolio of work with examples that showcase technical skill
  • Strong analytical skills
  • Time management and organizational skills
  • Knowledge of Go templating, common frameworks, and tools
  • Experience working with a team

What you’ll receive

  • A compensation competitive to premier firms
  • Incredible learning and exposure to every aspect of a funded financial startup as an early member, working directly with the founders.
  • Recognition and experience of working on a platform with an exponential user growth curve.
  • A fun and receptive work culture which promises to never get mundane!
  • If you love party, it is on us!

 

Read more
Arvind Internet, A Division of Arvind Limited
Arvind Internet, A Division of Arvind Limited
Agency job
via Talent GPS by Brenston Quadros
Ashoknagar, Bengaluru (Bangalore)
6 - 11 yrs
₹19L - ₹35L / yr
skill iconJava
Data Structures
Algorithms
Systems design
skill iconKubernetes
+5 more

What will you do?

  • You will be responsible for the design and development of large-scale, multi-tenant, distributed systems using scalable, fault-tolerant architecture with distributed queues (kafka), distributed caches (redis), high volume data stores (MongoDB, Cassandra, elasticsearch), container-centric deployments (kubernetes).
  • Write Java codes using best practices with high quality standards.
  • Participate in code reviews and deep dive into design discussions.
Read more
SMhack
at SMhack
1 recruiter
Pravin Kumar
Posted by Pravin Kumar
Chennai
3 - 7 yrs
₹6L - ₹10L / yr
skill iconJavascript
skill iconJava
skill iconAmazon Web Services (AWS)
MySQL
NOSQL Databases
We, at SMhack, are on a lookout for a full-stack web developer. To us, a full-stack developer is someone who - is a jack of all trades who can do well enough to handle projects from start to end. - is familiar with each layer of SAAS - has a deep interest in everything software and technology. If it sounds like you, then read on as we throw in a few more details. - Has at least 3 years of development and delivery experience with Java - Has hands-on experience in analysis, design, coding, and implementation of complex, custom-built applications. - Sports great OO skills, including strong design patterns knowledge. - Is familiar with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL, etc. - Experience working with, or an interest in Agile Methodologies, such as Extreme - Programming (XP) and Scrum. - Has a desire to contribute to the wider technical community through collaboration, coaching, and mentoring of other technologists. At SMhack, you can be sure of a great stack of learning and fun experiences. And a full-stack developer is the ideal need of a startup. No? So, write to us with your resume to [email protected] To know more about what we do, visit our website at https://smhack.io/
Read more
RentSher
at RentSher
1 recruiter
Abhijit Shaha
Posted by Abhijit Shaha
Bengaluru (Bangalore)
6 - 15 yrs
₹6L - ₹12L / yr
skill iconPHP
skill iconJavascript
skill iconNodeJS (Node.js)
skill iconMongoDB
LAMP Stack
+2 more
Work in a role of Principal Developer to build industry-defining features of sharing economy startup. You will need to manage the entire codebase, ensure scalability, security, and performance, do coding as and when required and manage in-house as well as external teams
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos