Cutshort logo
Genspark logo
Senior Data Engineer
Senior Data Engineer
Genspark's logo

Senior Data Engineer

Agency job
5 - 9 yrs
₹9L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Coimbatore
Skills
Apache Kafka
Apache
MLOps
skill iconAmazon Web Services (AWS)

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

  1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
  3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
  4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
  5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
  6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
  7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
  8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
  9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Genspark

Founded :
2023
Type :
Services
Size :
20-100
Stage :
Profitable

About

Empower Today,Excel Tomorrow

Read more

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Empower Today,

Excel Tomorrow

Company social profiles

N/A

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Janane Mohanasankaran
Posted by Janane Mohanasankaran
Mumbai, Pune
4 - 9 yrs
Best in industry
skill iconJava
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)
RESTful APIs

JOB DESCRIPTION:


Location: Pune, Mumbai

Mode of Work : 3 days from Office


DSA(Collections, Hash maps, trees, Linkedlist and Arrays, etc), Core Oops concepts(Multithreading, Multi Processing, Polymorphism, Inheritance etc) Annotations in Spring and Spring boot, Java 8 Vital features, database Optimization, Microsevices and Rest API

  • Design, develop, and maintain low-latency, high-performance enterprise applications using Core Java (Java 5.0 and above).
  • Implement and integrate APIs using Spring Framework and Apache CXF.
  • Build microservices-based architecture for scalable and distributed systems.
  • Collaborate with cross-functional teams for high/low-level design, development, and deployment of software solutions.
  • Optimize performance through efficient multithreading, memory management, and algorithm design.
  • Ensure best coding practices, conduct code reviews, and perform unit/integration testing.
  • Work with RDBMS (preferably Sybase) for backend data integration.
  • Analyze complex business problems and deliver innovative technology solutions in the financial/trading domain.
  • Work in Unix/Linux environments for deployment and troubleshooting.


Read more
With a global provider of Business Process Management.
With a global provider of Business Process Management.
Agency job
via Jobdost by Saida Pathan
Bengaluru (Bangalore), Chennai, Pune, Mumbai, Visakhapatnam, Nashik, Gurugram
4 - 8 yrs
₹8L - ₹20L / yr
Appian
BPM
SQL server
Sails.js
MySQL
+4 more
Job Description
· Participate in analysis, design, and new development of Appian based applications
· Build applications: interfaces, process flows, expressions, data types, sites, integrations, etc.
· Proficient with SQL queries and with accessing data present in DB tables and views
· Experience in Analysis, Designing process models, Records, Reports, SAIL, forms, gateways, smart
services, integration services and web services
· Experience working with different Appian Object types, query rules, constant rules and expression
rules
Primary Responsibilities:
· Responsible for systems analysis for a designated set of applications
· Work closely with BA and System Architect & Delivery Manager. Own the accurate translation of
business requirements in the form of high-level design and system requirements specifications.
· Ensure sign-off of SRS and High-Level Design Specification
· Assist the PM in the estimation of effort to deliver the solution based on the SRS and the timelines.
· Liaise with Infra teams in the production of an infrastructure solution design and requirements as
and when the proposed solution involves infrastructure components
· Provide further clarity and detail to feasible options proposed by BA and help in selection of the
right option in consultation with the Design Authority.
· Work closely with the Application Development team (Tech Delivery Lead) and Testing teams (Test
Manager and Test Engineer) to ensure that the Low-level design, test plans and test cases are aligned to
the approved SRS.
· Participate in progress review meetings and review and sign-off deliverables produced by technical
delivery team and testing teams.
Qualifications
- B.Sc. (Computer Science), B.E
· Minimum 5 years of experience in Insurance domain
· At least 4 years of experience in Implementing BPM solutions using Appian 19.x or higher.
· Over 5 years in Implementing IT solutions using BPM or integration technologies.
· Experience in Scrum/Agile methodologies with Enterprise level application development projects
· Good understanding of database concepts and strong working knowledge any one of the major
databases e g Oracle SQL Server MySQL
Additional information
Skills Required
·
· Appian BPM application development and System Analysis
· 8-10 years of proven software System Analysis and design experience
· Ability to work on large and complex projects.
· Strong technical knowledge of existing Insurance/F&A application
· Excellent documentation, communication, and presentation skills
· Ability to understand business requirements, analyze and translate them into system
requirements
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Praffull Shinde
Posted by Praffull Shinde
Pune, Bengaluru (Bangalore)
4 - 9 yrs
Best in industry
skill iconPython
Linux
Python Scripting
DevOps
skill iconAmazon Web Services (AWS)
+3 more

Job Description: Python Engineer


Role Summary

We are looking for a talented Python Engineer to design, develop, and maintain high-quality backend applications and automation solutions. The ideal candidate should have strong programming skills, familiarity with modern development practices, and the ability to work in a fast-paced, collaborative environment.


Key Responsibilities:


Python Development & Automation

  • Design, develop, and maintain Python scripts, tools, and automation frameworks.
  • Build automation for operational tasks such as deployment, monitoring, system checks, and maintenance.
  • Write clean, modular, and well-documented Python code following best practices.
  • Develop APIs, CLI tools, or microservices when required.

Linux Systems Engineering

  • Manage, configure, and troubleshoot Linux environments (RHEL, CentOS, Ubuntu).
  • Perform system performance tuning, log analysis, and root-cause diagnostics.
  • Work with system services, processes, networking, file systems, and security controls.
  • Implement shell scripting (bash) alongside Python for system-level automation.

CI/CD & Infrastructure Support

  • Support integration of Python automation into CI/CD pipelines (Jenkins).
  • Participate in build and release processes for infrastructure components.
  • Ensure automation aligns with established infrastructure standards and governance.
  • Use Bash scripting together with Python to improve automation efficiency.

Cloud & DevOps Collaboration (if applicable)

  • Collaborate with Cloud/DevOps engineers on automation for AWS or other cloud platforms.
  • Integrate Python tools with configuration management tools such as Chef or Ansible, or with Terraform modules.
  • Contribute to containerization efforts (Docker, Kubernetes) leveraging Python automation.


Read more
strektech
Venitha N
Posted by Venitha N
Chennai
5 - 10 yrs
₹15L - ₹30L / yr
skill iconJava
Apache Kafka
Messaging
Multithreading
Microservices

Hiring for Java Developer


Experience : 5 to 10 yrs

Notice Period : 0 to 15 days

Location : Pune

Work Mode : WFO (5 days)


As Java developer you would be expected to perform many duties throughout the development lifecycle of applications, from concept and design right through to testing. Here are some of the responsibilities you may have:


Develop high-level design and define software architecture

Implement and maintain quality systems within the group

Proficiently estimates, design approaches and nimbly move to alternate apporaches, if needed, develop and execute unit test strategies

Monitor and track tasks, and report status

Assist project heads to conceptualize, design, develop, test and implement technology solutions

Effectively collaborate with stakeholders and users to ensure customer satisfaction


Skill Set :

Java 7 / Java 8 with microservices, Multithreading, Springboot, Junit, kafka, Splunk (Good to have), Open Shift (Good to Have), Authentication/ Spring Security (Good to have)


Read more
Founding Minds
at Founding Minds
1 recruiter
Aswathy Moodadi
Posted by Aswathy Moodadi
Kochi (Cochin), Thiruvananthapuram
3 - 5 yrs
₹3L - ₹8L / yr
skill iconJava
skill iconSpring Boot
RESTful APIs
skill iconAmazon Web Services (AWS)

About FoundingMinds:


We are one of the preferred product development partners in the software industry. We work with clients across the globe to design and develop products for them. We are also an incubator for many startups. As a contributor, you will get an opportunity to work with different ideas, brainstorm with diverse people, widen your way of thinking, learn different technologies, research what you have to do, contribute your best to the projects and take ownership of what you do to your project. If you are passionate you will have no dearth in opportunities to build your career in Founding Minds.


 

Profile required 

  • Experience in Java stack (preferably Springboot)
  • Strong knowledge in Design Principles & Patterns and Development methodologies
  • Must have Good experience working on Rest services
  • Good experience with Java Microservices architecture
  • Strong Expertise with RDBMS and NoSQL databases
  • Experience in test driven development (unit testing. Mocking, BDD)
  • Strong experience in Agile methodologies
  • Preferable to have experience working on Angular and React 
  • Preferable to have experience on Docker and kubernetes
  • Preferable to have experience in finance domain
  • Preferable to have experience in AWS or any other cloud services

 

The ideal candidate should have

 

  • Strong fundamentals in Core Java, JDBC, and J2EE.
  • Hands-on experience of development and support of enterprise-level cloud-native application
  • Hands-on experience in Java, Spring, Spring Boot, ORM Tools, and Cloud technologies
  • Hands-on experience of Java Microservices architecture
  • Hands-on experience with AWS services
  • Good communication & presentation skills
  • Have a good sense of humor


If you’re an innovative thinker with a passion for technology and a drive to make a difference, we’d love to meet you. Apply now and take the next step in your career with FoundingMinds!


Read more
kbstechsolutions
Lalitha KBS
Posted by Lalitha KBS
Hyderabad
8 - 12 yrs
₹12L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconAmazon Web Services (AWS)
Angular
skill iconAngular (2+)
+3 more

Job Title: Engineering Lead


Role Overview:

We are looking for an Engineering Lead to take end-to-end ownership of technical delivery, design, architecture, and quality for our multi-customer SaaS product. You will lead and mentor the engineering team, drive scalable design and high-quality delivery, manage releases across customer environments, and ensure the stability and performance of the product in production.


Key Responsibilities:

·        Delivery & Release Management: Plan and deliver product features and customer-specific releases on time with high quality, ensuring operational readiness and stability across environments.

·        Technical Design & Architecture: Lead technical design and high-scale architecture for new and existing modules, ensuring scalability, performance, and maintainability.

·        Team Management: Mentor and guide engineers, ensure clarity in priorities, unblock challenges, and foster a culture of ownership and quality within the team.

·        Requirement to Delivery: Work with product and customer teams to understand requirements, translate them into designs and implementation plans, and track them through to delivery.

·        Product Quality: Establish and maintain engineering best practices, code reviews, automated testing, and CI/CD pipelines to ensure high product quality and reliability.

·        Troubleshooting & Support: Lead the team in debugging complex issues in development and production, ensuring minimal downtime and strong customer satisfaction.

·        Hands-on Contribution: Actively contribute technically where needed, providing architectural guidance and coding support aligned with the team’s stack.


Requirements:

·        Experience: 8–12 years in software engineering with at least 3+ years in a lead role.

·        Proven experience in designing scalable, high-performance architectures and technical solutions.

·        Experience delivering multi-customer SaaS product releases, including phased and customer-specific configurations.

·        Strong track record of ensuring product quality and stability through structured processes, testing, and monitoring.

·        Ability to troubleshoot complex issues and guide teams towards resolution.

·        Experience in mentoring and managing engineering teams to drive aligned delivery and high performance.

·        Hands-on experience with your relevant tech stack (e.g., Python, Django, Angular, AWS, Docker, Redis, RabbitMQ).

·        Excellent communication and collaboration skills with Product, QA, and Customer Support teams.

·        Bachelor’s or Master’s degree in Engineering or related field.

Read more
Freestone Infotech Pvt. Ltd.
at Freestone Infotech Pvt. Ltd.
1 video
7 recruiters
Pratima Jadhav
Posted by Pratima Jadhav
Remote only
5 - 8 yrs
Best in industry
skill iconSpring Boot
Microservices
skill iconJava
J2EE
Hibernate (Java)
+4 more

Core Experience:

•Experience in Core Java, J2EE, Spring/Spring Boot, Hibernate, Spring REST, Linux, JUnit, Maven, Design Patterns.

• Sound knowledge of RDBMS like MySQL/Postgres, including schema design.

• Exposure to Linux environment.

• Exposure to Docker and Kubernetes.

• Basic Knowledge of Cloud Services of AWS, Azure, GCP cloud provider.

• Proficient in general programming, logic, problem solving, data structures & algorithms

• Good analytical, grasping and problem-solving skills.


Secondary Skills:

• Agile / Scrum Development Experience preferred.

• Comfortable working with a microservices architecture and familiarly with NoSql solutions.

• Experience in Test Driven Development.

• Excellent written and verbal communication skills.

• Hands-on skills in configuration of popular build tools, like Maven and Gradle

• Good knowledge of testing frameworks such as JUnit.

• Good knowledge of coding standards, source code organization and packaging/deploying.

• Good knowledge of current and emerging technologies and trends.


Job Responsibilities:

• Design, Development and Delivery of Java based enterprise-grade applications.

• Ensure best practices, quality and consistency within various design and development phases.

• Develop, test, implement and maintain application software working with established processes.

Work with QA and help them for test automation

• Work with Technical Writer and help them documenting the features you have developing.

 

Education and Experience:

• Bachelor’s / master’s degree in computer science or information technology or related field

Read more
AJACKUS
at AJACKUS
1 video
6 recruiters
Kaushik Vedpathak
Posted by Kaushik Vedpathak
Mumbai
3 - 7 yrs
Best in industry
skill iconJava
skill iconSpring Boot
Hibernate (Java)
Microservices
skill iconAmazon Web Services (AWS)

Location: Mumbai, Maharashtra, India


Desired Experience: 3+ years


Roles and Responsibilities :


We are seeking an experienced Java Engineer to join our team. The ideal candidate will be responsible for designing and developing scalable applications using Java and related frameworks.


Core Accountabilities:


  • Design and develop high-quality Java applications using best practices and design patterns Write clean, maintainable, and testable code using Java and related frameworks
  • Collaborate with cross-functional teams to develop and deploy applications
  • Develop and maintain continuous integration and continuous deployment pipelines using Git and related tools
  • Troubleshoot and debug applications in production and development environments
  • Stay up-to-date with emerging trends and technologies in software engineering and Java development


Experience required :


  • Bachelor's degree in Computer Science or a related field
  • 3+ years of experience in developing applications using Java and related frameworks
  • Strong experience in Core Java, Spring Framework, Hibernate, and related Java frameworks
  • Experience in working with Git for version control and collaboration.


Additional optional requirements


  • Knowledge of AWS services
  • Experience in working with NoSQL databases such as MongoDB and Cassandra
  • Experience in other programming languages such as Python and Node.js


Skills required :


  • Excellent problem-solving skills and ability to work in a fast-paced environment Strong communication and collaboration skills
Read more
Dremio
at Dremio
4 recruiters
Kiran B
Posted by Kiran B
Hyderabad, Bengaluru (Bangalore)
15 - 20 yrs
Best in industry
skill iconJava
Data Structures
Algorithms
Multithreading
Problem solving
+7 more

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for technical leaders with passion and experience in architecting and delivering high-quality distributed systems at massive scale.

Responsibilities & ownership

  • Lead end-to-end delivery and customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product
  • Lead and mentor others about concurrency, parallelization to deliver scalability, performance and resource optimization in a multithreaded and distributed environment
  • Propose and promote strategic company-wide tech investments taking care of business goals, customer requirements, and industry standards
  • Lead the team to solve complex, unknown and ambiguous problems, and customer issues cutting across team and module boundaries with technical expertise, and influence others
  • Review and influence designs of other team members 
  • Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
  • Partner with other leaders to nurture innovation and engineering excellence in the team
  • Drive priorities with others to facilitate timely accomplishments of business objectives
  • Perform RCA of customer issues and drive investments to avoid similar issues in future
  • Collaborate with Product Management, Support, and field teams to ensure that customers are successful with Dremio
  • Proactively suggest learning opportunities about new technology and skills, and be a role model for constant learning and growth

Requirements

  • B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
  • Fluency in Java/C++ with 15+ years of experience developing production-level software
  • Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models and their use in developing distributed and scalable systems
  • 8+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
  • Subject Matter Expert in one or more of query processing or optimization, distributed systems, concurrency, micro service based architectures, data replication, networking, storage systems
  • Experience in taking company-wide initiatives, convincing stakeholders, and delivering them
  • Expert in solving complex, unknown and ambiguous problems spanning across teams and taking initiative in planning and delivering them with high quality
  • Ability to anticipate and propose plan/design changes based on changing requirements 
  • Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
  • Passion for learning and delivering using latest technologies
  • Hands-on experience of working projects on AWS, Azure, and GCP 
  • Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure,  and GCP) 
  • Understanding of distributed file systems such as  S3, ADLS or HDFS
  • Excellent communication skills and affinity for collaboration and teamwork

 

Read more
Leaf Innovation Pvt Ltd
Chiraag Kapil
Posted by Chiraag Kapil
NCR (Delhi | Gurgaon | Noida)
2 - 5 yrs
₹7L - ₹10L / yr
skill iconNodeJS (Node.js)
skill iconAmazon Web Services (AWS)
skill iconMongoDB
Agile/Scrum
skill iconAngularJS (1.x)
+1 more
About Us : LEAF is safety technology company started from February 2015 with the mission to solve the problem of human safety by disrupting the largely unorganized security market.  LEAF launched their first product Safer, a smart safety wearable in 2015 to solve the problem of women safety which was sold in more than 25 countries. LEAF was a part of Prime Minister Modi's delegation to silicon valley as the Top 10 Innovators of India. With first Indian company to win prestigious Million Dollar X Prize Award at United Nations, Leaf is on the mission to make Billion people safe. We are working on an innovative idea which has gained a lot of interest already from client and investor side. The pilot was done using freelancers now we are looking for a full-time hire who can lead this project.  Skillset : - Node.js, PostGIS, and experience with AWS - PostgreSQL and MongoDB - Loopback framework - Self-driven, and passionate to make an impact in the world What kind of person we are looking : - Experience integration of data storage solutions like MongoDB and nosql cloud data store. - Work as part of a team developing applications and services using Agile development methods - Writing reusable, testable, and efficient code - Code, test and operate node.js based services - Design and implementation of low-latency, high-availability, and performant applications - Strong knowledge of Node.js and frameworks like Loopback. - Good understanding of server-side templating languages such as Jade, EJS. - Strong understanding of front-end technologies such as Angular JS, HTML5 and CSS.  - Deployed and managed critical applications using a number of AWS services like (not limited to) S3, EC2, Route 53, Lambda etc. - User authentication and authorization between multiple systems, servers, and environments - Understanding of fundamental design principles behind scalable applications - Creating database schemas that represent and support business processes - Integration of multiple data sources and databases into one system - Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform - Proficient understanding of code versioning tools, such as Gitlab, Github, Bitbucket etc.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos