The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.
Key Responsibilities
- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
- Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
- Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
- Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
- Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
- Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
- Ensure adherence to data governance, privacy, and security standards across all data handling activities.
- Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.

About Genspark
About
Empower Today,Excel Tomorrow
Candid answers by the company
Empower Today,
Excel Tomorrow
Company social profiles
Similar jobs
Hiring: Java Developer (Spring Boot, AWS, Microservices) 🚀
📍 Location: [Specify Location] | 💼 Experience: [4+] Years | 🏢 Full-time
We’re looking for a Java Developer to build scalable, cloud-based applications using Spring Boot, Microservices, and AWS. If you love coding, designing robust APIs, and working with cutting-edge tech, join us!
🔹 Must-Have: Java, Spring Boot, Microservices, AWS
🔹 Good-to-Have: Docker, Kubernetes, CI/CD
- 2+ year of experience in Development in JAVA technology.
- Strong Java Basics
- SpringBoot or Spring MVC
- Hands on experience on Relationl Databases (SQL query or Hibernate) + Mongo (JSON parsing)
- Proficient in REST API development
- Messaging Queue (RabitMQ or Kafka)
- Microservices
- Any Caching Mechanism
- Good at problem solving
- 4+ years of experience in using Java/J2EE tech stacks
- Good understanding of data structures and algorithms.
- Excellent analytical and problem solving skills.
- Ability to work in a fast paced internet start-up environment.
- Experience in technical mentorship/coaching is highly desirable.
- Understanding of AI/ML algorithms is a plus.


What will I be doing? 👩💻👨💻
Leading parts of the product from inception to launch, and own large parts of the product’s execution.
Working with our Sales and frontend team to build products with the goal of delighting and increasing the success of our users.
Architecting, building, testing, and releasing product-facing features.
Contributing to our side projects and free tools for the education industry.
What do I need? 🤓
1-2 years of industry experience in a software engineering role, preferably building a SaaS product. You can demonstrate significant impact that your work has had on the product and/or the team.
Deep knowledge of a high-level programming language (for example, PHP, Python, etc.) but it doesn’t need to be a language that we use here! Great people are effective and learn what we use quickly (or introduce us to better ways of working)
Deep knowledge of SQL Databases
Experience with scalable distributed systems, both built from scratch as well as on AWS primitives
Willingness to learn and use new technologies
Extremely data-driven
Ability to debug complex systems
Brownie points 🍰
Using a framework (for example, Laravel, Code Igniter, Django)
Understanding of containerisation (Docker/Kubernetes) along with ability to deploy to AWS ECS (or similar tools)
Feel free to apply even if you feel unsure about whether you meet every single requirement in this posting. As long as you're a quick learner, and are excited about changing the status quo for tech recruitment, we're happy to support you as you come up to speed with our tech stack.
Perks 😍
Flexible vacation
Take a tutorial, on us
Monthly remote meals
Tech stack 🔨
PHP
Laravel
NodeJS
VueJS
Ionic Angular
Digital Ocean
AWS
MySQL
Why Classcard? 🚀
We are still in the early stages of our journey. You will be working closely with our users, acting on both their feedback and what our data says. Things you build here will have tremendous impact on both our business and Classcard as a company.
What happens after I apply? 🤔
-
Quick phone call with a member of our engineering team to find out more about your experience and why you want to work at Classcard.
-
Video interview:
Technical discussion with a senior engineer
Pairing on an interesting problem
Meet the founders
Work as a member of a team responsible for developing a HIPAA compliant secure care coordination platform in accordance with established processes. You will apply your knowledge of building scalable, distributed applications and have the opportunity to work with new technologies & frameworks such as Spring Cloud Netflix, AWS, Azure, NoSQL DB.
Essential Functions include but are not limited to the following.
You will be expected to:
- Contribute to all phases in the software lifecycle – requirements analysis, solution design, development, and deployment
- Maintain high quality standards for the work undertaken and be responsible for the quality of deliverables
- Ensure assigned projects are developed in accordance with established engineering processes, adhering to scope, schedule constraints and agile project plans
- Guide/mentor the less experienced team members
- Participate in code reviews
- Work effectively as part of a distributed team
- Document the features worked by him/her
Key technical expertise areas expected for this role:
Strong programming skills in Java 8(+) with clear understanding of Object-Oriented and Functional programming.
- Experience on REST API Programming based on a Microservices Architecture
- Good Understanding of Databases (MySQL & Mongo) and proficiency in database schema designing & writing efficient SQL Queries
- Strong troubleshooting skills
- Demonstrable ability to learn new programming languages and frameworks quickly
- Experience with distributed systems with specific focus on security and scalability
- Experience with modern cloud technologies such as AWS or Azure
Additional areas that would add value:
- Spring Cloud
- Experience working with AES 256 based encryption algorithms
- Strong understanding of Design Patterns & their application in system design
- Using DevOps & Infrastructure tooling such as GoCD/Jenkins, Git
- Experience working on projects, preferably in the healthcare domain
- Experience working with Virtualization and Containerization technologies including Docker, Kubernetes.
- Automated Unit/Integration testing
- Experience working with Linux and Shell scripting
- Frontend web development with JavaScript frameworks like AngularJS
- Test Driven & Behavior Driven Development
- Experience working in Agile Scrum/Kanban methodologies
Education and Experience:
- Bachelors or Master’s in Computer Science or related fields.
- 5+ years of experience
*) 7+ years of strong experience in Java/J2EE technologies (Core Java, Spring, Springboot, Hibernate, JPA, Microservices)
*) Experience with working on Java 8.0 and its emerging road map for 11
*) Hands on experience in Springboot and good knowledge of MySQL, MongoDB
*) Hands on experience in working with Angular 6 and above. Experience working with product management and UI/UX designers having knowledge of advanced Javascript, JQuery
*) Working knowledge on components, modules, data/event bindings, templates, using and creating directives, writing routes, services, forms and models
*) Solid understanding of the full frontend and backend development life cycle
*) Strong experience in Spring Framework (Spring MVC, Spring security, Spring data, OAuth)
*) Experience with Webservices (SOAP and REST) and API integration. Good knowledge of JSON and Swagger and Postman is required
*) Experience with web application servers like Tomcat, Jetty, JBoss. Knowledge of Kafka with MQTT would be an added advantage
*) Experience with TDD, code testability standards, JUnit
*) Experience in managing configurations and deploying and hosting applications in AWS
*) Experience with DevOps tools like Git, Maven, SourceTree, Jenkins, Docker and CICD model of development
*) Good experience of OOPS, algorithms, data structures, multi-threading, design patterns and industry best practices
*) Must have good understanding in SOLID principles and why design principles are used.
*) Experience with Eclipse/IntelliJ and VS Code

- Translation of complex functional requirements into technical requirements
- Design, develop and maintain complex systems using best of the breed development practices and technology.
- Responsible for the overall software development life cycle.
- Delivery of High Quality & Scalable systems and applications with a sharp focus on timelines.
- Being on the lookout for bettering the software engineering practices and tools within the organization
- Collaboration with other stakeholders to provide robust and well-rounded solutions
- Report on the status of product delivery and quality to management, customer support and product teams.
- Experience of 5+ years in designing & developing highly scalable, performant web applications
- Strong programming, debugging, and problem-solving skills
- Strong Computer Science Fundamentals (Data structures and Algorithms)
- Sound understanding of object-oriented programming and excellent software design skills.
- Good experience of Restful services using Java Springboot
- Strong understanding of database design and SQL (PostgreSQL / MySQL) development
- Good to have knowledge of NoSQL technologies like Redis, MongoDB, Cassandra or any other NoSQL database
- Knowledge of design patterns and good to have experience of large-scale applications
- Should have experience in Apache Kafka, RabbitMQ, SQS or other Queueing systems.
- Experience of working with Amazon Web Services (AWS), Google Cloud Computing (GCP) would be considered as an advantage
- Experience of developing with Serverless Model will be an advantage.

- 3+ years of experience with Ruby On Rails.
- Strong Project & Time Management Skills, along with the ability to apply these skills while working independently, or as part of a team.
- Knowledge of blockchain technology, smart contracts and cryptocurrency will be an added advantage
- Experience in fintech domain will be another added advantage
- Bachelor’s degree in computer programming, computer science, or a related field.
- Fluency or understanding of specific languages, such as Java, PHP, or Python, and operating systems may be required.

Perks
- Best hardware and software to help you get the job done in the best way possible
- Remote office allowance to support you regardless of where you work
- Learning and development allowance to help you grow your career
- Flexible leave policy to give you more control over your time.
- Health insurance for your family and you to keep you well.
Required experience and skills
- Bachelors degree in Computer Science and Engineering. Bonus: Masters degree.9+ years of total full-time work experience, preferably shipping SaaS applications.
- Startup experience strongly desired.
- Played a pivotal role in scaling a company and led teams in an agile environment where iteration has led to perfection.
- Proven track record of on time project deliveries with balanced calls on technical designs and tech debt.
- Expert proficiency in:
- 1. Ruby, Ruby on Rails, Mysql, Linux, Git, AWS, CI/CD, NewRelic.
- 2. broad range of internet technologies and applications.
- 3. interacting, building, and improving the performance of systems end-to-end.
- 4. architecting/designing complex systems
- Strong collaborator and thought partner to Product team.Driven by outcomes more than output.
- Have led projects with small, dynamic, and fast-paced teams (3-5 engineers), with great flexility and adaptability on large projects, delegating working effectively.
- Viewed by the team as their evangelist, role model and bar raiser.
- Past teams and co-workers attest to your prowess & agility in building great products, and driving sound technical decision making.Mentored engineers within and outside own team.
- High on EQ, humility, curiosity and self drive.
Responsibilities
We use a rubric / career ladder as a framework to help our engineers grow in their careers. Please refer to the SDE IV section in the rubric (https://docs.google.com/spreadsheets/d/1z_51E1mZ3qf0MBuAyfHjKE1HN6h_yghAx2WMaB1z-Ms/edit?usp=sharing">click to view) to understand our expectations on your role and responsibilities.
Your responsibilities include:
- Leading completion and delivery of multiple concurrent projects with clear deliverable timelines and milestones
- Providing key input and guidance in helping to solve our most difficult and challenging issues, and providing recommendations for preventing or mitigating the effects of the issues in the future
- Identifying inconsistencies caused by lack of best practices and patterns, and proactively collaborate with the team to gather input to define and rollout new best practices
- Mentoring other engineers on increasing their impact both within and outside of their team, including identifying opportunities for them to do so
- Participate in shaping longer term technical and architectural goals in consideration of product/company strategy, organizational growth, scalability, security, and other factors
About Tophatter

● Responsible for developing high end web applications in various areas related to
SAAS (Software as a service)
● Developing ideas for new programs, products, or features by monitoring industry
developments and trends
● Collaborating with the front-end developers and other team members to establish
objectives and design more functional, cohesive codes to enhance the user
experience
● Liaise with developers, designers and customer success teams to identify new
features
● Should have experience to integrate & customize third party plugins
● Knowledge of SaaS or e-commerce industry will be preferred
Required Skills:
● 5-7 years’ experience as a Sr. Web Developer in developing web applications
● Strong experience in PHP, MySQL, Laravel, Rest APIs, Ajax & jQuery
● Good exposure in Payment Gateway process
● Should have good exposure in Server Setup, AWS Console, Digital Ocean,
Handling DNS and Linux/Ubuntu command line
● Fluency or good understanding of Nodejs & MongoDB will be preferred
● In-depth understanding of the entire web development process such as design,
development and deployment
● Familiarity with front-end languages like HTML, JavaScript and CSS
● Strong understanding of the web development and programming techniques and tools
● Focus on efficiency, user experience, and process improvement
● Excellent analytical and time management skills
● Excellent communication and problem-solving attitude
● Familiarity with SaaS Products is a plus
● Degree from IT/Computer Science background is preferred


