The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.
Key Responsibilities
- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
- Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
- Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
- Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
- Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
- Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
- Ensure adherence to data governance, privacy, and security standards across all data handling activities.
- Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.

About Genspark
About
Empower Today,Excel Tomorrow
Candid answers by the company
Empower Today,
Excel Tomorrow
Company social profiles
Similar jobs
Responsibilities include:
- Develop and maintain data validation logic in our proprietary Control Framework tool
- Actively participate in business requirement elaboration and functional design sessions to develop an understanding of our Operational teams’ analytical needs, key data flows and sources
- Assist Operational teams in the buildout of Checklists and event monitoring workflows within our Enterprise Control Framework platform
- Build effective working relationships with Operational users, Reporting and IT development teams and business partners across the organization
- Conduct interviews, generate user stories, develop scenarios and workflow analyses
- Contribute to the definition of reporting solutions that empower Operational teams to make immediate decisions as to the best course of action
- Perform some business user acceptance testing
- Provide production support and troubleshooting for existing operational dashboards
- Conduct regular demos and training of new features for the stakeholder community
Qualifications
- Bachelor’s degree or equivalent in Business, Accounting, Finance, MIS, Information Technology or related field of study
- Minimum 5 years’ of SQL required
- Experience querying data on cloud platforms (AWS/ Azure/ Snowflake) required
- Exceptional problem solving and analytical skills, attention to detail and organization
- Able to independently troubleshoot and gather supporting evidence
- Prior experience developing within a BI reporting tool (e.g. Spotfire, Tableau, Looker, Information Builders) a plus
- Database Management and ETL development experience a plus
- Self-motivated, self-assured, and self-managed
- Able to multi-task to meet time-driven goals
- Asset management experience, including investment operation a plus
JAVA Developer
Exp: 8+ Years
Location: Bengaluru
Notice period: 0-30 days
Key Responsibilities:
Design & Develop Scalable Microservices:
- Architect, develop, and deploy RESTful APIs & Microservices using SpringBoot.
- Ensure high availability and fault tolerance using Resilience4J and circuit breakers.
Database & Caching Optimization:
- Work with PostgreSQL, MySQL, MongoDB, or Cassandra for optimal data persistence.
- Implement caching strategies using Redis or Memcached.
Security & Performance Best Practices:
- Apply OAuth2, OpenID Connect, or Keycloak for authentication.
- Secure APIs using JWT, Role-Based Access Control (RBAC), and API Gateways.
- Use Spring Security and OWASP guidelines to harden the system.
Event-Driven & Asynchronous Processing:
- Implement Kafka, RabbitMQ, or ActiveMQ for real-time event-driven achitecture.
- Use Spring WebFlux for reactive programming in high-throughout applications.
Testing & Code Quality:
- Write unit tests using JUnit, Mockito, and TestContainers.
- Perform contract testing with Pact or Spring Cloud Contract.
- Ensure code quality using SonarQube, PMD, and Checkstyle.
Observability & Logging:
- Use ELK Stack (Elasticsearch, Logstash, Kibana) or Grafana & Prometheus for monitoring.
- o Implement distributed tracing using Jaeger or Zipkin.
Collaboration & Agile Development:
- Follow Agile and Scrum methodologies with JIRA, Confluence, or Trello.
- Work closely with frontend, DevOps, and product teams.
Required Skills & Technologies:
• Languages: Java, Kotlin (Good to Have)
• Frameworks: Spring Boot, Spring Cloud, Spring WebFlux
• Microservices & API Development: REST, GraphQL, gRPC
• Cloud Platforms: AWS, Azure, GCP or any
• CI/CD & DevOps: Docker, Kubernetes (K8s), Helm, terraform (nice to have)
• Databases: PostgreSQL, MySQL, MongoDB, Redis
• Messaging Systems: Kafka, RabbitMQ, ActiveMQ
• Security & Authentication: OAuth2, OpenID Connect, JWT, Keycloak
• Testing Frameworks: JUnit, Mockito, TestContainers, Pact
• Logging & Monitoring: ELK Stack, Prometheus, Grafana, Jaeger
• Version Control: Git, GitHub, GitLab
• Agile Methodologies: Scrum, Kanban
Job Description: Backend Developer – Design Qandy
Who are we?
Design Qandy delivers personalised luxury interior design to India’s discerning homeowners and corporates. Led by highly admired luxury brand builders, internationally trained designers, world-class technology professionals and curated teams of turnkey project execution specailists. We seek perfection in design and are committed to bringing back trust and excitement in the design process.
Know more about us on designqandy.com and https://instagram.com/designqandy?igshid=YmMyMTA2M2Y=
Our work culture?
We are a lean team of high performing go-getters, we take ownership in our roles and lead with knowledge. Debates and discussions are an important part of our culture and we encourage people to bring unique perspectives to their conversations. Most importantly, we love solving problems.
Each day is inspiring and we encourage you to apply for this role and experience it for yourself.
What would you be required to do?
· Write code and tests, build prototypes, solve issues, profile, and analyze bottlenecks
· Design performance gauging, building robust APIs to support mobile and desktop clients
· Manage and optimize scalable distributed systems on the cloud
· Optimization of web applications for performance and scalability
· Develop automated tests to ensure business needs are met and allow for regression testing
· Participate in the entire application lifecycle, focusing on coding and debugging
· Write clean code to develop functional web applications
· Troubleshoot and debug applications
· Perform UI tests to optimize performance
· Manage cutting-edge technologies to improve legacy applications
· Collaborate with Front-end developers to integrate user-facing elements with server-side logic.
· Gather and address technical and design requirements
· Provide training and support to internal teams
· Build reusable code and libraries for future use
What skills we are looking for?
· Good communication skill to communicate with stakeholders, project managers, quality assurance teams, Regularly and other developers regarding progress on the long-term technology roadmap
· Curious and progressive mind to Create and maintain workflows with teams to provide visibility and to ensure workload balance for consistent visual designs
· Good technical knowledge to Produce quality code, raising the bar for the whole team on quality and speed
· Through analytical skills to Recommend system solutions by comparing advantages and disadvantages of custom development and purchase alternatives
Skills Needed:
· PHP Laravel Framework, PHP Design Patterns.
· Proficient in MySQL, PostgreSQL, MongoDB
· APIs, REST API, SOAP API, API Security, Open APIs
· Push Notifications, Laravel Events, Queue, Observers
· Excellent foundation in computer science, algorithms, and web design
· Experience writing highly secure web applications
· Experience with core AWS web-enabling technologies
· Growth mindset, challenging status quo to find new solutions and out-of-the-box ideas
· Experience designing RESTful APIs, specifically for mobile apps
· Computer science degree or equivalent experience
· Experience leading a team
· 3-6 Years’ experience in back-end development.
● Proven work experience as a Back-end developer.
● In-depth understanding of the entire web development process (design, development and deployment).
● Proficient in Java, with a good knowledge of its ecosystems
● Basic understanding of JVM, its limitations, weaknesses, and workarounds
● Ability to decide when to use relational vs NoSQL databases and must be experienced with at least one of
the relational databases (MySQL) as well as experience with ElasticSearch will be good to have
● Familiarity with concepts of MVC, JDBC, and RESTful
● Experience with Spring, Spring Boot, Spring MVC
● Experience in CI/CD and Cloud technologies
● Expertise in developing enterprise-level web applications and RESTful APIs using MicroServices, with
demonstrable production-scale experience
● Familiarity with front-end languages (e.g. HTML, JavaScript and CSS) - Not mandatory
● Participation in coding competitions such as hackathon, hackerrank will be added advantage.
- Design, build and maintain efficient, reusable, and reliable Java code.
- Providing technical oversight to the team, involved in design and code review.
- You would also be spending most of the time in development activities in varied technologies and should have a passion to write code.
- Should be able to create good technical documents.
- Translate application storyboards and use cases into functional applications.
- Ensure the best possible performance, quality, and responsiveness of the applications.
- Identify bottlenecks and bugs, and devise solutions to these problems - Help maintain code quality, organization, and automatization.
- Prepare the technical design of complex technology components as well as suggest the pros and cons of using a certain technology stack or component or design pattern versus another, to the clients.
- Team Management.
Required Skills and Qualifications
- Qualifications: BTECH/MTECH/MCA/MSc.
- Proficient in Java, with a good knowledge of its ecosystems with a knack for writing clean, readable Java code, writing reusable Java libraries along with knowledge of multithreading, concurrency patterns, and collections in Java.
- Solid understanding of object-oriented programming along with various design and architectural patterns.
- Hands on experience with JMS, JPA, Spring (MVC, Boot & Cloud preferred) & Hibernate.
- Familiarity with concepts of MVC, JDBC, and RESTful. Experience with Presentation Layer (JSP/Servlets), JS Frameworks (Angular, jQuery, react, etc.).
- Creating database schemas that represent and support business processes and experience with both external and embedded databases. Implementing automated testing platforms and unit tests.
- Proficient understanding of code versioning tools, such as Git, Ant, Maven, and Gradle; continuous integration.
- Knowledge in xml based mappings, SAML, rest clients, CAS authentication and Jetty.
- Knowledge of Apache Camel and Kafka and Drools Rule Engine is preferred.
• Design, build, and maintain scalable applications using Python.
• Contribute to the entire implementation process including driving the definition of improvements
based on business need and architectural improvements.
• Act as a subject matter expert for Application Software developers and Engineers.
• Handle server-side code for a production platform and contribute to new features
To be the right fit, you'll need:
• More than 4+ years of experience as a software developer in Python, with knowledge of at least one Python web framework such as Django, Flask, etc.
• Good understanding of common design patterns and architecture principles to design reliable and Scalable applications
• Strong communication skills
• Knowledge of databases line NoSQL or MongoDB
• Good to have AWS and Docker or Web services
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
Your Opportunity
- Own and drive business features into tech requirements
- Design & develop large scale real time server side systems
- Quickly create quality prototypes
- Staying updated on emerging technologies
- Ensuring that all deliverables adhere to our world class standards
- Promote coding best practices
- Mentor and develop junior developers in the team
Required Experience:
- 4+ years of relevant experience as described below
- Excellent grasp of Core Java, Multi Threading and OO design patterns
- Experience with Scala, functional, reactive programming and Akka/Play is a plus
- Excellent understanding of data structures and algorithms
- Solid grasp of large scale distributed real time systems
- Prior experience on building a scalable and resilient micro service
- Solid understanding of relational databases, NoSQL databases and Caching systems
- Good understanding of Big Data technologies such as Spark, Hadoop is a plus
- Experience on one of AWS, Azure or GCP
Who you are :
- You have excellent and effective communication and collaborative skills
- You love problem solving
- You stay up to date with the latest technologies and then apply them in real life
- You love paying attention to detail
- You thrive in meeting tight deadlines and prioritising workloads
- Ability to collaborate across multiple functions
Education:
Bachelor’s degree in Engineering or equivalent experience within the field
• Knowledge of professional software engineering practices & best practices for the full
software development life cycle, including coding standards, code reviews, source
control management, build processes, testing, and operations.
• Experience in communicating with users, other technical teams, and management to
collect requirements, describe software product features, and technical designs.
• Minimum 2 years of experience in developing web application using .Net
framework/MVC
• Minimum 1 year of experience in cloud native application development using AWS or
Azure or google cloud.
• Minimum 2 years of experience in modern front-end JavaScript framework (Vue, React or
Angular).
• Expertise in - Creating APIs using JavaScript on NodeJS or in C# on .NET core.
• Expertise in working with relational and non-relational databases.
• Working experience in Test driven development (TDD).
• Working experience in SOLID principles.
• Experience and understanding of Agile Development methodologies, especially Scrum.
• Fast learner, open to learning new technologies when needed.
• Sound understanding of how modern web apps are architecture with JavaScript driving
the application flow and APIs as the backend.
• Experience building complex software systems that have been successfully delivered to
customers.
• Self-directed and detail oriented.
Morningstar is an equal opportunity employer.

- Translation of complex functional requirements into technical requirements
- Design, develop and maintain complex systems using best of the breed development practices and technology.
- Responsible for the overall software development life cycle.
- Delivery of High Quality & Scalable systems and applications with a sharp focus on timelines.
- Being on the lookout for bettering the software engineering practices and tools within the organization
- Collaboration with other stakeholders to provide robust and well-rounded solutions
- Report on the status of product delivery and quality to management, customer support and product teams.
- Experience of 5+ years in designing & developing highly scalable, performant web applications
- Strong programming, debugging, and problem-solving skills
- Strong Computer Science Fundamentals (Data structures and Algorithms)
- Sound understanding of object-oriented programming and excellent software design skills.
- Good experience of Restful services using Java Springboot
- Strong understanding of database design and SQL (PostgreSQL / MySQL) development
- Good to have knowledge of NoSQL technologies like Redis, MongoDB, Cassandra or any other NoSQL database
- Knowledge of design patterns and good to have experience of large-scale applications
- Should have experience in Apache Kafka, RabbitMQ, SQS or other Queueing systems.
- Experience of working with Amazon Web Services (AWS), Google Cloud Computing (GCP) would be considered as an advantage
- Experience of developing with Serverless Model will be an advantage.
About Alore
Alore brings revenue velocity to businesses by being their dependable growth operating system.
For further information on what Alore can do for growing businesses, please visit http://alore.io">alore.io
Alore is based out of Singapore with an office at Bangalore.
Who should not apply for this job
- If you are looking for a 100% hike in your salary but can't commit to what value you will bring on the table
- If you never read books
- If you jump companies every 11-12 months
- If you are not comfortable working on Saturdays
- If you have less than 2 years of experience
- If you have more than 4 years of experience
- If you have never worked in a product-led company
CTC:
8.5-10.5 LPA based on experience and on performance in the interview round (70% Fixed - 30% Variable Incentive based on delivery schedule) (We do ZERO deductions since the salary will be paid from Singapore)
At this position you will:
- Get solid experience with high-load distributed architecture using REST and Kafka services.
- Work with automated CI/CD processes, AWS cloud, and VoIP.
- Implement and support microservices based on Spring MVC, Camel, MySQL, Mongo, and Kafka.
Requirement
- At least 1 year of experience with Java Core, Java EE, Spring Core, Spring Boot.
- Not more than 3 years of experience in Java Core, Java EE, Spring Core, Spring Boot.
- Deep understanding of SQL database technologies.
- Experience with Scrum / Agile methodology.
- Willingness to learn and explore new technologies.
- Git: merge, rebase, cherry-pick should be fluent.
- Good level of English B1 or higher.
It would be a nice bonus to have:
-
Experience with distributed architecture.
-
Hands-on experience with Kafka, MongoDB, and Apache Camel.
-
Experience with cloud infrastructure (AWS, Google Cloud, Azure, Heroku, etc.).
-
Experience with client-side development (we use Angular8 for website).
-
A degree in computer science.









