Database Engineer
at Next gen BI platform for data driven performance marketers
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Python
Django
PostgreSQL
RedisJob Title : Python Django Developer
Experience : 3+ Years
Location : Gurgaon Sector - 48
Working Days : 6 Days WFO (Monday to Saturday)
Job Summary :
We are looking for a skilled Python Django Developer with strong foundational knowledge in backend development, data structures, and operating system concepts.
The ideal candidate should have experience in Django and PostgreSQL, along with excellent logical thinking and multithreading knowledge.
Main Technical Skills : Python, Django (or Flask), PostgreSQL/MySQL, SQL & NoSQL ORM, Microservice Architecture, Third-party API integrations (e.g., payment gateways, SMS/email APIs), REST API development, JSON/XML, strong knowledge of data structures, multithreading, and OS concepts.
Key Responsibilities :
- Write efficient, reusable, testable, and scalable code using the Django framework
- Develop backend components, server-side logic, and statistical models
- Design and implement high-availability, low-latency applications with robust data protection and security
- Contribute to the development of highly responsive web applications
- Collaborate with cross-functional teams on system design and integration
Mandatory Skills :
- Strong programming skills in Python and Django (or similar frameworks like Flask).
- Proficiency with PostgreSQL / MySQL and experience in writing complex queries.
- Strong understanding of SQL and NoSQL ORM.
- Solid grasp of data structures, multithreading, and operating system concepts.
- Experience with RESTful API development and implementation of API security.
- Knowledge of JSON/XML and their use in data exchange.
Good-to-Have Skills :
- Experience with Redis, MQTT, and message queues like RabbitMQ or Kafka.
- Understanding of microservice architecture and third-party API integrations (e.g., payment gateways, SMS/email APIs).
- Familiarity with MongoDB and other NoSQL databases.
- Exposure to data science libraries such as Pandas, NumPy, Scikit-learn.
- Knowledge in building and integrating statistical learning models.
Java
Spring BootJob Title: Senior Java Developer – Multi-SaaS / Microservices / Pub-Sub
About the Role
We are seeking a highly skilled Senior Java Developer with strong leadership abilities to join our team. The ideal candidate will have deep expertise in Java, micro services architecture, multi-tenant SaaS systems, pub/sub messaging, and cloud-based deployments on AWS EKS. This role requires not only technical mastery but also the ability to mentor teams, influence architecture decisions, and ensure best practices through Test-Driven Development (TDD).
Key Responsibilities
- Lead design and development of Java-based multi-tenant SaaS applications using microservices architecture.
- Implement pub/sub messaging systems for event-driven communication.
- Deploy, monitor, and optimize services on AWS EKS.
- Ensure system reliability, scalability, and security using AWS CloudWatch and other observability tools.
- Apply TDD principles to drive high-quality, maintainable code.
- Collaborate with product managers, architects, and other developers to translate requirements into technical solutions.
- Lead code reviews, mentor junior engineers, and promote engineering best practices.
- Take ownership of end-to-end delivery, from architecture design to production rollout.
Required Skills & Qualifications
- Proficiency in Java with 6+ years of professional development experience.
- Strong background in microservices architecture and multi-tenant SaaS systems.
- Expertise in pub/sub messaging patterns (e.g., Kafka, RabbitMQ, or AWS SNS/SQS).
- Hands-on experience with AWS EKS and container orchestration (Kubernetes).
- Strong understanding of monitoring and logging using AWS CloudWatch or similar tools.
- Proven experience applying Test-Driven Development (TDD) in real-world projects.
- Demonstrated leadership skills – mentoring, decision-making, and driving engineering excellence.
- Solid understanding of software engineering best practices, CI/CD, and version control (Git).
JavaJob Role: We are seeking a skilled Java Developer to contribute to the development and enhancement renowned banking application, which supports automatic reconciliation and unified data reporting for their clients. This role involves working on high-impact enhancements, data pipeline integration, and platform modernization. The ideal candidate will be a quick learner, self-motivated, and able to ramp up quickly in a fast-paced environment.
Key Responsibilities:
Design, develop, and maintain Java-based applications using Java 17 and Spring Boot.
Implement and manage message routing using Apache Camel.
Develop and monitor data pipelines using Kafka.
Support and enhance existing cloud-native applications.
Work with OpenShift Container Platform (OCP 4) for container orchestration and deployments.
Utilize Jenkins for CI/CD pipeline automation and management.
Collaborate with cross-functional teams to integrate multiple data sources into a unified reporting platform.
Participate in code reviews, unit testing, and performance tuning.
Troubleshoot and resolve production issues in collaboration with operations teams.
Document development processes and system configurations.
Required Skills:
Strong proficiency in Java 17 and Spring Boot frameworks.
Hands-on experience with Apache Camel for message routing and transformation.
Solid experience in Kafka development and monitoring tools.
Good understanding of cloud pipeline architectures and deployment strategies.
Experience working with OpenShift (OCP 4).
Familiarity with Jenkins for CI/CD and automated deployments.
Understanding of cloud deployment platforms (AWS, Azure, or GCP preferred).
Strong analytical and debugging skills.
Ability to learn quickly and adapt to evolving project requirements.
Nice to Have:
Experience in financial services or transaction reporting platforms.
Familiarity with microservices architecture and containerization best practices.
Knowledge of monitoring tools (e.g., Prometheus, Grafana).
Java- Strong experience in Java programming.
- Must have experience on MicroServices using Spring boots /Jersy /Swagger / any other Microservices technology stack
- Good experience in either Spring or Hibernate
- Must have at least 1to 2 years’ experience in Web application
- Knowledge of OOP concepts, industry best practices, and design
- Good understanding of web technology/enterprise-level applications
- Good to have experience in JavaScript frameworks
- Good to have experience in Agile Methodology
- Self-motivated and a Quick Learner
- Creative ideas with a problem-solving mindset.
- Ability to consistently perform and meet deadlines
- Attention to detail and follow-through
- A good understanding of customer satisfaction
- Ability to work effectively in a team as well as in an individual environment
- Excellent written and verbal communication skills
Go Programming (Golang)
Ruby on Rails (ROR)
RubyPythonJavaAs a Go lang Developer, you will be working on Blockchain Layer 1.
● Advanced proficiency in Golang programming language, and good skills in languages such as C++,
Java, Solidity and Python (good to have).
● Extensive experience in back-end development, algorithms, and data structures.
● Extensive Knowledge of blockchain structure, protocol development or Smart Contract
● Writing clean, efficient, and reusable code that follows best practices and coding standards.
● knowledge of distributed and decentralized network protocols
● Knowledge of various decentralized ledger technologies and protocols
● Understanding of gossip protocol and consensus protocol
● Knowledge of best practices in data protection.
● Collaborating with managers to determine technology needs and envisaged functionalities.
● Creating application features and interfaces by using programming languages and writing multithreaded codes.
● Applying the latest cryptology techniques to protect digital transaction data against cyberattacks and information hacks.
● Maintaining client and server-side applications.
Go Programming (Golang)
KubernetesAt F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.
F5 is looking for Software Engineer II with in-depth experience in high scale distributed systems. You will participate in the design and implementation of of our Edge Computing platform that is used to deploy global, scalable and secure applications. Your work includes, but not limited to, Research, design and build highly reliable, available and scalable platforms, API definition, implementation, deployment, operational management, and debugging.
Responsibilities:
- Deliver solutions that will help create, deploy and manage the service components of the platform
- Investigate various open source and close source technologies, components, libraries, tools etc. and help build a highly available, highly scalable and easily manageable system
- Take ownership of software components and deliver a complete product satisfying functional, scale, performance and manageability requirements.
- Hands-on coding in multiple languages while considering performance, scalability, maintainability, and flexibility
- Understanding and exposure to design patterns and coding practices especially as applied to microservices architectures and API design, implementation and management
- Experience in Cloud native providers like MS Azure or AWS or Google Cloud or any major Cloud vendors in the market and their services
- Independently investigate, present options, review and implement completely new functionality
- You will work closely with other development teams, product management, UX, and QA to define and implement a new product offering while ensuring continued functionality.
- Perform code reviews, set coding practices and guidelines within the team
- Ability to implement all phases of a development cycle for a software product from understanding requirements, going through design, development and deploy phases
- Work with geographically distributed teams
Minimum Qualifications:
- Knowledge and experience in highly distributed software systems, ability to understand the nuances and solve problems related to scale, performance and resiliency of such a system
- Experience in programming languages: Golang, Java, Python any objected oriented high level proprietary or open source language with strong programming constructs.
- Good understanding of programming fundamentals & their application to highly scalable web-based systems
- Experience in developing polyglot software using service definition language and framework like gRPC, Thrift, Google Protocol Buffers, OpenAPI etc.
- Must have hands on SQL or No SQL technologies.
- Experience working on CICD methodology and Git based workflow
- Experience in Docker technologies including experience in optimizing Docker image and managing Docker image lifecycle. Experience in orchestration systems like Kubernetes and container technologies like Docker, rkt is a plus
- Excellent written and verbal communication skills
- Strong interpersonal, team building, and mentoring skills
- BS/MS degree in Computer Science or equivalent with 3+ years of software development experience
Javascript
NodeJS (Node.js)
.NET
JavaSpring Boot- B.E/B.Tech or any relevant Masters degree from reputed college
- 2 to 4 years of experience with Java / J2EE application development stack
- Experience with: Spring framework(Core, JPA, Security, Boot), Hibernate, Secure APIs using JWT/OAUTH
- Good understanding of OOPS concepts
- Proficient understanding of code quality standards
- Solid experience in design, coding, unit testing and debugging
Good to have: Optional
- Working experience with microservices, sonar, docker, K8s, jenkins
- Knowledge of AWS cloud
- 4-8 years of experience in BI/DW
- 3+ years of experience with Microstrategy schema, design and development
- Experience in Microstrategy Cloud for Azure and connecting with Azure Synapse as Data Source
- Extensive experience in developing reports, dashboards and cubes in Microstrategy
- Advanced SQL coding skills
- Hands on development in BI reporting and performance tuning
- Should be able to prepare unit test cases and execute unit testing
JavaPython
CC++scalability, accessibility, usability, design, and security in mind. If you don't have all
of these, that's ok, but be excited about learning the few you don't know.
Familiar with building complex web applications using Javascript / AJAX, XHTML,
CSS.
Experience with or knowledge of jQuery, Java, Struts, and other website technologies.
Strong, object-oriented design and coding skills (C/C++ and/or Java preferably on a
UNIX or Linux platform)
Solid software development background including design patterns, data structures,
test driven development
Knowledge of Perl or other scripting languages a plus
Experience with distributed (multi-tiered) systems, algorithms, and relational
databases
Software development experience in building highly scalable applications
Master’s degree in Computer Science, Computer Engineering or related technical
discipline
Experience in eCommerce and Deep hands-on technical expertise
Ability to handle multiple competing priorities in a fast-paced environment
Experience working with service oriented architectures and web based solutions.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon