The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.
Key Responsibilities
- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
- Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
- Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
- Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
- Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
- Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
- Ensure adherence to data governance, privacy, and security standards across all data handling activities.
- Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.

About Genspark
About
Empower Today,Excel Tomorrow
Candid answers by the company
Empower Today,
Excel Tomorrow
Company social profiles
Similar jobs
The tech stack looks like the below (expect this to change as we scale):
- Typescript for APIs (REST and GraphQL)
- Kafka, Spark, and data warehouses for ML pipelines (spark on python/scala)
- Solidity + hardhat for smart contracts (in the future, rust, go and move)
- AWS & Terraform
- Full nodes
You can expect to do some or all of the following:
- Read through protocols’ whitepapers and smart contracts to derive metrics and analyze risks
- Architect the backend for APIs, async jobs, and blockchain integration
- Build clean, concise APIs for customer integration, along with the documentation
- Setup, run and maintain full and archive nodes across different chains
- Integrate with multiple partners like exchanges and custody providers
- Fool-proof security across the stack - encryption, hashing, privacy, VPC, etc.
- Infrastructure as code - build terraform scripts and ensure easy replication of the infra across different regions
- Research the top DeFi protocols to uncover better insights for our customers and evaluate their risk profiles, security, and historical returns
- Manage production deployments, logging, and monitoring
We expect you to be fairly comfortable with working with both web3 and web2 stacks. We do not expect that you have web3 experience on day 1, but you should be willing to wear multiple hats, learn things quickly and move fast.
About you
- Generalist, a solid engineer who can learn things on your own and have an eye for clean, tested, and well-documented code
- We don’t look at the number of years of work experience as a criterion, but rather see what you have done in your life so far (side projects, open-source contributions, blogs, etc.). We don’t care about degrees, the institutions you went to, or the companies you worked for before. We are open to talking as long as you have good judgment, great clarity, align with our values and have a strong track record of thoughtful work
- Understand the fundamentals of building and integrating APIs and secure systems. Bonus if you know a bit about blockchains and protocols
- You can be strong on the backend, front-end, or can dabble everywhere. We want you to play to your strengths and will provide enough opportunities to learn and do things outside of your comfort zone
Pay and benefits We offer a solid, competitive package (including early-stage equity) that is location agnostic. We give you the flexibility to choose the split between cash and equity.
Roles and Responsibilities:
- Proven experience in Java 8, Spring Boot, Microservices and API
- Strong experience with Kafka, Kubernetes
- strong experience in using RDBMS (Mysql) and NoSQL.
- Experience working in Eclipse or Maven environments
- Hands-on experience in Unix and Shell scripting
- hands-on experience in fine-tuning application response and performance testing.
- experience in Web Services.
- Strong analysis and problem-solving skills
- Strong communication skills, both verbal and written
- Ability to work independently with limited supervision
- Proven ability to use own initiative to resolve issues
- Full ownership of projects and tasks
- Ability and willingness to work under pressure, on multiple concurrent tasks, and to deliver to agreed deadlines
- Eagerness to learn
- Strong team-working skills


Key Responsibilities:
- SDLC development of product features, enhancements, UAT/production issues.
- Work with development team members for development of product features.
- Client-side and server-side development.
- Develop and manage well-functioning databases and application.
- Write/ design product APIs and write unit test cases.
- Follow standard agile scrum practices for software development.
- Peer review, pull requests, code refactoring and managing source code per standards and ensure quality.
Required Experience & Skills:
- 5+ years of software development experience using Microsoft .Net technology stack.
- Strong experience in .Net, .Net Core, C#, Entity Framework, SQL server, JavaScript, jQuery, etc.
- Experience in using unit test framework e.g., xUnit, Moq.
- Experience in Web API development.
- Experience in Agile / SCRUM development process.
- Good to have experience in Domain driven design development and Microservice architecture.
- Excellent communication and teamwork skills
- Good to have knowledge and experience in ABP.IO framework, Angular 8+, PostgreSQL and AWS cloud service and CI/CD process.
JD-Backend Intern (NodeJs)
Internship Span – 6 Months (Fulltime)
Ventura Securities is establishing its fintech team - a remote-first, work from anywhere team with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stockbroking business for 20+ years and it is a robust and profitable franchise with 1000+ employees currently. We are looking for passionate techies with skills primarily around AWS and Node’s/JS who are aspiring for a fast-track career.
Your Key Responsibilities:
• Build out of the Ventura cloud-based backend platform from scratch
• Ownership and monitoring of our D2C backend
• Robust documentation skills and desire to share information with others
• Desire and ability to prototype ideas quickly, and be willing to experiment and learn
Basic Requirements:
• Very strong Nodejs, AWS Lambda, Postgres, ORM (Sequelize)
• Clean coding skills around Nodejs
• Hands-on experience around writing testable code, working with git, doing peer-level code review, daily standups, and generally championing software excellence.
• Should have concepts cleared around Nodejs and JS
• Strong proficiency with JavaScript
• Ability to use Async programming to improve performance & productivity
• Strong problem solving skills with understanding of Data Structures and Algorithms.
• What you get:
• Chance to build out a next-gen fintech product from ground 0
• Opportunity to influence the design of the product
• Flexible and work anywhere environment running out of Slack
• Flat org structure
• This internship is paid internship.
Requirement :
- Good knowledge of Java and Spring F/W (Spring Boot, Spring Security, Spring ORM, Spring Rest, Spring Cloud)
- Good knowledge of relational database design and query via both SQL and ORM (hibernate, spring data)
- Good knowledge of ElasticSearch or other document-oriented database
- Good knowledge of Microservice architecture, including REST API design
- Good knowledge of asynchronous data pipelines using Kafka or AWS SNS/SQS or similar modern messaging framework
- Good knowledge of AWS or other public cloud environment
- Hands-on experience with Redis Cache, Memcache or Ehcache
- Good knowledge of domain-driven design is a huge plus
- Web services & API standards (REST/OAuth/JSON)
Desired Candidate Profile
- A team focus with strong collaboration and communication skills
- Exceptional ability to quickly grasp high-level business goals, derive requirements, and translate them into effective technical solutions
- Exceptional object-oriented thinking, design and programming skills (Java 8 or 11)
- Expertise with the following technologies : Data Structures, Design Patterns ,Code Versioning Tools(Github/bitbucket/..), XML, JSON, Spring Batch Restful, Spring Cloud, Grafana(Knowledge/Experience), Kafka, Spring Boot, Microservices, DB/NoSQL, Docker, Kubernetes, AWS/GCP, Architecture design (Patterns) Agile, JIRA.
- Penchant toward self-motivation and continuous improvement; these words should describe you: dedicated, energetic, curious, conscientious, and flexible.

Java with cloud
Core Java, SpringBoot, MicroServices |
- DB2 or any RDBMS database application development |
- Linux OS, shell scripting, Batch Processing |
- Troubleshooting Large Scale application |
- Experience in automation and unit test framework is a must |
- AWS Cloud experience desirable |
- Agile Development Experience |
- Complete Development Cycle ( Dev, QA, UAT, Staging) |
- Good Oral and Written Communication Skills |
Infrastructure
Pocket Gems wants to build the greatest games and interactive entertainment in the world.
That’s the mission our founders began within an apartment above a pizza shop back in 2009
and we continue it today.
Pocket Gems has grown to over 250 people in San Francisco. With $155 million in backing from
Sequoia Capital and Tencent, we’re constantly breaking new ground with graphically rich mobile
games, fun new genres of mobile entertainment, and innovative technologies like our mobilefirst Mantis Engine.
Our products have been downloaded over 325 million times by players around the world. We
have several flagship products including the most recent - Adventure Chef Merge Explorer, a
casual merge and explore game. Some of our other ongoing hits include Episode, a mobile
storytelling network and platform, and War Dragons, a visually stunning 3D real-time strategy
game.
Pocket Gems is home to some of the most massive and delightful mobile-first games, like War
Dragons and Episode. Those games need a solid backend platform, to function critical tasks to
delight our players, and is supported and optimized by our Central Engineering team. As a Sr.
Software Engineer on the Central Infrastructure Team, you will build microservices that acts as
the core of all our games, facilitate the processing and recording of billions of events per day,
support critical systems for marketing, finance. You will be responsible for some of our biggest
projects as you build APIs and infrastructure that scales to millions of players in real-time
games.
What You’ll Do:
• Implement flexible, reusable, and scalable solutions to improve our data pipeline
• Develop microservices for critical infrastructure like A/B tests, Offer recommendation, etc
that is mission-critical to the business
• Develop microservices for our games such as real-time communication platforms,
leaderboard, etc
• Build and maintain integrations with third-party APIs that you suggest or write yourself
• Build scalable web tools (including open source tools) to support data analysis and
visualization for the company and influence what we build for our games’ players
What You Bring to the Central Infrastructure Engineering team:
• Minimum of 7 years of professional experience (including 3+ years backend experience)
• A degree in computer science, engineering, or relevant field
• Experience leading complex projects, preferably involving distributed systems
• Deep experience with AWS, GCP, or Hadoop, and related backend technologies is a
plus
• Strong skills in data structures, algorithms, software design, and OOP
• A love for delighting users, both internal and external, with reliable tools, data, and
creative and highly technical solutions to their problems
Extra Gems for:
• Experience in working with microservices

- 3+ years of experience in Ruby / RoR
• Experience with data files processing (xls, csv, json, xls, text: 834, NACHA, segments)
• Experience working with relational databases (PostgreSQL)
• Experience with Git
• Good written and spoken English (Intermediate and higher)
• Experience deploying Rails applications
• RESTful API, JSON API
Will be a plus:
• Experience working with Unit and Integration Testing (Rspec, Capybara)
• Experience of integration with 3rd party systems and services and cloud technologies ( AWS stack: EC2, RDS, S3, etc.)
• Experience with RuboCop, JSHint/JSLint
• Experience with Microservice Architecture
• Knowledge of HTML5, CSS3
• Experience working with modern JavaScript frameworks — Ember.js, Vue.js
Responsibilities & ownership
- Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
- Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
- Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
- Lead the team to solve complex and unknown problems
- Solve technical problems and customer issues with technical expertise
- Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
- Mentor other team members for high quality and design
- Collaborate with Product Management to deliver on customer requirements and innovation
- Collaborate with Support and field teams to ensure that customers are successful with Dremio
Requirements
- B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
- Fluency in Java/C++ with 3alm+ years of experience developing production-level software
- Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
- 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
- Hands-on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
- Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
- Passion for learning and delivering using latest technologies
- Ability to solve ambiguous, unexplored, and cross-team problems effectively
- Hands on experience of working projects on AWS, Azure, and Google Cloud Platform
- Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud)
- Understanding of distributed file systems such as S3, ADLS, or HDFS
- Excellent communication skills and affinity for collaboration and teamwork
- Ability to work individually and collaboratively with other team members
- Ability to scope and plan solution for big problems and mentors others on the same
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team

