The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.
Key Responsibilities
- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
- Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
- Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
- Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
- Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
- Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
- Ensure adherence to data governance, privacy, and security standards across all data handling activities.
- Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.

About Genspark
About
Empower Today,Excel Tomorrow
Candid answers by the company
Empower Today,
Excel Tomorrow
Company social profiles
Similar jobs
-
3+ years of Experience in software Design and development and familiar with technologies - Java, Java-J2EE, Spring Boot, Hibernate, Ajax, REST API, Micro services etc.
-
Working knowledge of JVM internals
-
Working knowledge of any database (MySQL or HSQLDB)
-
Working knowledge of No-SQL database (Mongo or Dynamo DB)
-
Working experience with messaging (JMS/RabbitMQ)
-
R & D on new advanced cloud-based technologies in a test-driven agile development.
-
Knowledge in designing and architecting systems with high scalability and performance requirements.
-
Ability to understand infrastructure for performance evaluation and reporting of cloud-based services, namely AWS
-
knowledge of key AWS services like EC2, S3, Lambda, CloudWatch etc.
-
Certification on AWS Fundamendals
-
Excellent communication skills
-
ability to effectively articulate technical challenges and solutions
-
skilled in interfacing with internal and external technical resources
-
Good in debugging problems and mentoring teams on technical front
Responsibility and duties
• Understand the business objectives and create a weekly/quarterly roadmap for the team • Integration of user-facing elements developed by front-end developers with server-side logic.
• Reviewing the code written by subordinates to maintain quality of code
• Planning and implementing tests for the codes and fixing bugs
• Developing ideas for new programs, products, or features by monitoring industry developments and trends.
• Qualification and skills *
• Bachelor's Degree in Computer Science [Preferably B. Tech./B.E. (CSE/IT)]
• 2 Years+ experience in Back-end development • Knowledge of Redis assisted client-side caching
•Intermediate skill in Amazon Web Services frameworks and modules • Familiarity with relational or non-relational database [Preferably SQL and MongoDB]
• Familiarity with NodeJS
• Proficient in Ms Excel/Trello
EWar Games focuses on Sports, Mobile Games, Technology, Online Gaming, and Real Money Online Gaming. Their company has offices in Bengaluru. They have a small team that's between 11-50 employees.
BASIC QUALIFICATIONS
- At least 8+ years of IT experience most of which will have been in helping the design and implementation of the software suite/module.
- 2+ years on any Cloud Platform (AWS, Azure, Google etc).
- Bachelor’s degree in Information Science / Information Technology, Computer Science, Engineering, Mathematics, Physics, or a related field.
- Strong verbal and written communication skills, with the ability to work effectively across internal and external organizations.
- Strong programming skills in Java.
- Strong hands-on experience in integrating multiple databases like Oracle, SQL Server, PostgreSQL etc.
- Deep hands-on experience in the design, development and deployment of business software at scale.
- Customer facing skills to represent AWS well within the customer’s environment and drive discussions with senior personnel regarding trade-offs, best practices, project management and risk mitigation
- Leading/Involved in highly-available and fault-tolerant enterprise and web-scale software applications.
- Experience in performance optimization techniques
- High end Troubleshooting and Communication skills.
- Proven experience with software development life cycle (SDLC) and agile/iterative methodologies required
PREFERRED QUALIFICATIONS
- Implementing experience with primary AWS services (EC2, ELB, RDS, Lambda, API Gateway Route53 & S3).
- AWS Solutions Architect Certified
- Experience in programming languages like Java/Python.
- Demonstrated ability to think strategically about business, product, and technical challenges
- Integration of AWS cloud services with on-premise technologies from Microsoft, IBM, Oracle, HP, SAP etc.
- Experience with IT compliance and risk management requirements (eg. security, privacy, SOX, HIPAA etc.).
- Extended travel to customer locations may be required to sell and deliver professional services as needed
Come be a part of one of the most exciting e-learning startup! A product based company building a B2C subscription product for kids around the world. Best understood as a combination of Netflix + Skillshare + Instagram for kids of ages 5 - 15, there is going to be something new every week to work on!
Already present in over 148 countries, kids of all backgrounds, languages and ages use DIY.org on website, iOS and Android. DIY is a place online where kids truly discover themselves.
We are looking for a Product Engineer - Senior Backend Engineer to join our early stage startup with experience in building B2C products.
If you have experience of working in product based companies (preferably startups), and are looking to build exciting things that children across the world will use - come talk to us!
What you get to do:
- Design and build advanced applications from scratch keeping scalability and performance in mind
- A good handle on both client and server architecture.
- Work on bug fixing and improving application performance.
- Comfortable in owning large scale products and continuously re-evaluating and innovating.
Who are we looking for:
- Experience of 7+ years across product based companies
- Should have worked on building B2C products. Having experience in building edtech products would be a major plus.
- Should be an avid programmer with great problem solving skills.
- Should have a great grasp over NodeJs/Typescript/ AWS microservices/DB design/System Design.
- Should have experience in building scalable server-side systems. Should have significant experience in cloud infrastructure and designing databases.
- Should have knowledge of software architecture, system thinking and design patterns.
We are looking for strong Backend developers to join our growing Team and help build Software applications and Tools that help streamline enterprise processes and build efficiency.
Roles & Responsibilities:
-Well versed with Javascript / Typescript, Node.js, Node.js frameworks like Nest.js, express.js, Postgres DB (relational databases), Redis / Memcache, Queues.
- Should be able to deploy code and manage CI/CD pipeline on Microsoft Azure / AWS, GitHub skills.
- Plus points if s/he is versed with JS Unit testing frameworks, Python.
- Work with the development team and product manager to ideate software solutions and document cards on PM tools.
- Design client-side and server-side architecture and explain it well to technical and non-technical audiences.
- Build client and server code that is fast, testable, and high quality.
- Should be testing code thoroughly, we strongly discourage throwing code over the wall.
- Excellent coding, problem-solving, and debugging skills
- You strive to create highly intuitive and responsive products.
- You’re a fast learner, can contribute from day one, and can bring good thoughtful opinions to the table.
- You have an excellent command of written and spoken English and communicate about what you're doing with your coworkers.


How would you leverage your technical expertise to create extraordinary impact for our clients?
ThoughtWorks is a global software consultancy with an aim to create a positive impact on the world through technology. Our community of technologists thinks disruptively to deliver pragmatic solutions for our clients' most complex challenges. We are curious minds who come together as collaborative and inclusive teams to push boundaries, free to be ourselves and make our mark in tech.
Our developers have been contributing code to major organizations and open source projects for over 25 years. They’ve also been writing books, speaking at conferences and helping push software development forward, changing companies and even industries along the way.
You could influence the digital strategy of a retail giant, build a bold new mobile application for a bank or redesign platforms using event sourcing and intelligent data pipelines. You will use the latest Lean and Agile thinking, create pragmatic solutions to solve mission-critical problems and challenge yourself every day.
For a team to thrive, it needs active collaboration and room for healthy, respectful debate. Senior Developers are the technologists who cultivate this environment while driving teams toward delivering on an ambitious tech vision and acting as mentors for more junior-level consultants. They leverage their deep technical knowledge to solve more complex business problems and actively assess their team’s health, code quality and nonfunctional pipelines.
You’ll spend time on the following:
- You will use continuous delivery practices to deliver high-quality software as well as value to end customers as early as possible.
- You will work in collaborative, value-driven teams to build innovative customer experiences for our clients
- Create large-scale distributed systems out of microservices
- You will apply the latest technology thinking from our tech radar to solve client problems
- Efficiently utilize DevOps tools and practices to build and deploy software
- You will lead or take part in the entire cycle of software consulting and delivery from ideation to deployment and everything in between
- You will act as a mentor for less-experienced peers through both your technical knowledge and leadership skills
Here’s what we’re looking for:
- You have at least 5 years of experience with two or more development languages such as Java, C#, or Ruby
- You can skillfully write high-quality, well-tested code and you are comfortable with Object-Oriented programming
- Presence in the external tech community: you proactively share your expertise with others via speaking engagements, contributions to open source, blogs and more
- Comfortability with Agile methods, such as Extreme Programming (XP), Scrum and/or Kanban
- You enjoy influencing others and always advocate for technical excellence while being open to change when needed
- You’re willing and able to commit to travel to client sites in order to solve their business problems
- You’re resilient in ambiguous situations and can approach challenges from multiple perspectives
- Bonus points if you have working knowledge of cloud technology such as AWS, Azure, Kubernetes and Docker
Job Description:
We are looking for talented Technical Managers to be part of the Product Engineering team. The candidate should have good experience with Java/J2ee based technologies and will be responsible for delivering features that are meaningful to the customer and consistent with the product vision through the management of a cross-functional team. The person will also contribute to the team as a servant leader and ensure that the team has everything needed to be successful.
Technical Competencies
- Strong Java/J2EE development experience with demonstrated ability to develop and troubleshoot large mission applications & Software Products
- Experience on exception handling, correct use of data structures, multi-threaded programming, memory management and application tuning
- Excellent exposure in Object Oriented Design skills using Java/J2ee along with:
- Core Java Language (Collections, Concurrency/Multithreading)
- JDBC concepts (connection pooling, statement, result set)
- Web Technologies (Struts/Struts 2, Spring (IOP, MVC, AOP), Hibernate, JSP, Web services)
- Database optimization and profiling
- Core/JEE/Integration Design patterns/UML
- Should have experience in Unit Testing
- Good hands on experience with RDBMS like MySQL/Oracle with ability to write SQL Queries/Stored Procedures/Triggers/Joins/View etc
- Practical application of software product development standards and methodologies including Agile, XP, Kanban, RUP and UML
- Ability to apply design patterns consistently and also accurate when building per design requirements
- Good experience in source control, unit testing, code verification, documentation, automated build, continuous integration, metrics, and code reviews.
- Demonstrated problem solving, analytic and troubleshooting skills.
- Strong written and oral communication skills are required to effectively engage internal stakeholders and their technical representatives.
Responsibilities:
- Manages the team in producing working software each iteration in accordance with the team’s commitments
- Facilitates planning sessions, team meetings, and other “rituals,” such as the daily standup, iteration planning, iteration kickoff, iteration review, and retrospectives
- Ensures that the backlog of work for the team is well-defined with respect to scope, clarity of requirements, and acceptance criteria
- Helps remove roadblocks to delivery success.
- Helps the team follow its defined process, and leads process improvement efforts
- Understands the client’s business strategy and objectives as it relates to the product being developed; ensures that the client’s expectations are met or exceeded.
- Oversees the completion of stories, ensuring that the team understands what “Done” means for each story.
- Interfaces between the team and the customer
- Communicates effectively within the team and with all stakeholders by providing high-quality visibility into planned and actual deliverables.
- Is a model developer, with sharp coding skills and a passion for excellence
- Participates in design and coding activities, and helps with requirements, analysis, and testing as needed
- Ensures that the architecture of the product is sound
- Ensures product quality through effective monitoring of quality trends, test automation, defect tracking and root cause analysis.
- Assures that all production deliveries meet acceptance, operational, and quality criteria
- Develops camaraderie and strong collaboration across both the 3Pillar team and client team,
- Actively demonstrates and teaches strong consulting skills to teammates,
- Understands the full set of product development capabilities and speaks to them holistically,
- Proactively develops a deep "trusted advisor" relationship with the primary buyer,
- Assists in developing strategies to take advantage of opportunities within the account and works collaboratively with the Client Partner to execute them
Benefits
- A competitive annual salary based on experience and market demands
- Flexi-timings
- Medical insurance with the option to purchase a premium plan or HSA option for your entire family
- In-house Food & Refreshments
- Regular Health check-up camps arranged by the company
- Recreational activities
- Business casual atmosphere




