Database Engineer
Next gen BI platform for data driven performance marketers
Database Engineer
at Next gen BI platform for data driven performance marketers
Agency job
via CutShort Team
3 - 7 yrs
₹30L - ₹45L / yr
Bengaluru (Bangalore)
Skills
Database architecture
Database Design
Datawarehousing
Data warehouse architecture
Database performance tuning
Distributed Systems
Databases
Microservices
Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar
Software Engineer, MemorresFor 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
Similar jobs
Mumbai
4 - 10 yrs
Best in industry
JavaJ2EE
Spring BootHibernate (Java)
Spring
+4 more
• Experience in Core Java and Spring Boot.
• Extensive experience in developing enterprise-scale applications and systems. Should possess good architectural knowledge and be aware of enterprise application design patterns.
• Should have the ability to analyze, design, develop and test complex, low-latency client facing applications.
• Good development experience with RDBMS.
• Good knowledge of multi-threading and high-performance server-side development.
• Basic working knowledge of Unix/Linux.
• Excellent problem solving and coding skills.
• Strong interpersonal, communication and analytical skills.
• Should have the ability to express their design ideas and thoughts.
Read more
Remote only
4 - 15 yrs
Best in industry
Go Programming (Golang)
Ruby on Rails (ROR)
Ruby
PythonJava +5 more
As a Go lang Developer, you will be working on Blockchain Layer 1.
● Advanced proficiency in Golang programming language, and good skills in languages such as C++,
Java, Solidity and Python (good to have).
● Extensive experience in back-end development, algorithms, and data structures.
● Extensive Knowledge of blockchain structure, protocol development or Smart Contract
● Writing clean, efficient, and reusable code that follows best practices and coding standards.
● knowledge of distributed and decentralized network protocols
● Knowledge of various decentralized ledger technologies and protocols
● Understanding of gossip protocol and consensus protocol
● Knowledge of best practices in data protection.
● Collaborating with managers to determine technology needs and envisaged functionalities.
● Creating application features and interfaces by using programming languages and writing multithreaded codes.
● Applying the latest cryptology techniques to protect digital transaction data against cyberattacks and information hacks.
● Maintaining client and server-side applications.
Read more
Bengaluru (Bangalore), Chennai
4 - 10 yrs
₹8L - ₹30L / yr
JavaJ2EE
Spring BootHibernate (Java)
Microservices
Looking For Java Developer who will help Build large scale distributed systems. The ideal candidate will be a thinker and a team player with a passion for technology and with a knack for benchmarking and optimization.
• Computer Science fundamentals in object-oriented design, data structures, algorithms, problem solving, and complexity analysis
• Must have hands on experience on coding in Core Java, multithreading, concurrency and collection.
Good knowledge of Microservices.
• Knowledge of professional software engineering practices. Understanding of full software development life cycle, including coding standards, code reviews.
• Strong technical Design and Development skills
• Ability to work effectively under pressure in a dynamic environment.
• Agility to switch across multiple teams/ products/ applications and perform
• Experience in translating requirements into technical design specifications and documentation, as well as executing development projects from conception to delivery
• Excellent verbal and written communication skills
Read more
Hyderabad
4 - 12 yrs
₹15L - ₹40L / yr
.NET Core
Windows Azure
Microservices
.NETASP.NET
+8 more
Requirements
- Experienced in automated deployment tools such Continuous Integration (Azure DevOps/Git).
- Excellent debugging skills; able to debug complex technical issues involving multiple system components. Good to have knowledge on online & offline sync capabilities in Progressive Web Application (PWA) implementation.
- Knowledge on Azure DevOps is optional.
- Knowledge on INFORM, WARN and ERROR logging in Azure Application Insights, error handling, access authorization, data connectivity in C# is mandatory.
- Knowledge on publisher/subscriber queueing such as RabbitMQ.
- All C# code must contain descriptive comments to functions, or complex/nested loops, if, or case statements.
- Knowledge on NetSuite is an advantage.
- Knowledge on Azure Active Directory is an advantage. Knowledge on OAuth 2.0 & JWT Tokens is mandatory. Writing high-level design and technical analysis documents.
- Should have worked on Agile framework
- Strong Experience on. NET Core, . NET Microservices, C# 5.0 Xunit - Unit Test Framework - C#, Entity Framework/Entity Framework and RESTful Design, Redis
- Experience with SQL Server 2012 & above
- Should be well versed with RabbitMQ
- Knowledge on Azure Active Directory, Application Insights, Azure Devops/Git/Bitbucket Pipeline, Serverless / Azure functions, Azure Service Fabric / Functions
- Hands-on JWT Tokens, API Authorization, OAuth 2.0 JSON or XML
- Exposure to NetSuite, Workato will be an added advantage
Read more
Mumbai
2 - 5 yrs
₹5L - ₹13L / yr
NodeJS (Node.js)
MongoDBMicroservices
JavascriptRESTful APIs
+1 more
We are helping hire for an early-stage funded startup - a digital first, multi-brand consumer goods company owned and operated under one house, with each of its brands working together toward one mission: To help Indians lead a more fulfilling life surrounded by wellness and grace.
The business is creating a family of purposeful brands with products that solve a particular problem for a small segment of people. Each brand provides the essentials to make an individual segment of people lead a graceful life full of purpose and wellbeing. Each brand offers high quality, responsibly-made products that are inviting and easy to use, paired with access to ongoing guidance and support.
Role
You will be responsible for architecting and setting the standards for building our core backend/microservices. Also, you will be responsible for shaping up the entire system for scale and collaborating intensively with the frontend and design teams to create the best consumer experiences.
Responsibilities
● Develop microservices that will be used by the frontend through API endpoints.
● Translate business requirements into high quality code.
● Ensure that the code is deployed in a secure and scalable fashion.
● Focus on code maintainability and performance of application.
● Provide technical advice and assists in solving programming problems.
● Enhance Analytics and overall backend architecture for better performance.
Requirements
● At least 1 years of experience on NodeJS
● Practical experience in building APIs
● Experience with RabbitMQ or similar queuing system
● Experience with Redis/ElasticSearch is a plus
● Familiarity with CI/CD pipeline tools like Jenkins
● Practical experience with Git
● A knack for benchmarking and optimization
● Experience with AWS services is a plus
***Client works for 6 days a week***
The business is creating a family of purposeful brands with products that solve a particular problem for a small segment of people. Each brand provides the essentials to make an individual segment of people lead a graceful life full of purpose and wellbeing. Each brand offers high quality, responsibly-made products that are inviting and easy to use, paired with access to ongoing guidance and support.
Role
You will be responsible for architecting and setting the standards for building our core backend/microservices. Also, you will be responsible for shaping up the entire system for scale and collaborating intensively with the frontend and design teams to create the best consumer experiences.
Responsibilities
● Develop microservices that will be used by the frontend through API endpoints.
● Translate business requirements into high quality code.
● Ensure that the code is deployed in a secure and scalable fashion.
● Focus on code maintainability and performance of application.
● Provide technical advice and assists in solving programming problems.
● Enhance Analytics and overall backend architecture for better performance.
Requirements
● At least 1 years of experience on NodeJS
● Practical experience in building APIs
● Experience with RabbitMQ or similar queuing system
● Experience with Redis/ElasticSearch is a plus
● Familiarity with CI/CD pipeline tools like Jenkins
● Practical experience with Git
● A knack for benchmarking and optimization
● Experience with AWS services is a plus
***Client works for 6 days a week***
Read more
![[x]cube LABS](/_next/image?url=https%3A%2F%2Fcdnv2.cutshort.io%2Fcompany-static%2F639877aa0ad87e002533a1c5%2Fuser_uploaded_data%2Flogos%2Fx_whiteB_eeCk0gqs.png&w=256&q=75)
Hyderabad
3 - 8 yrs
₹9L - ₹15L / yr
Spring BootJavaHibernate (Java)
Microservices
Docker- Skilled in Java / J2EE including frameworks like Microservices, Spring boot, hibernate etc
- Experience with microservices-based architecture including building
- Good knowledge of SQL (MySQL / Oracle / SQL Server / Postgres), NoSQL (MongoDB / Cassandra), App server Knowledge (Tomcat/JBoss etc.), OSGi, REST Web Services
- Working / Usage experience of Docker, Microservices, Jenkins, Multithreading, Design patterns, Java 1.8 and Container
- Experience with Cloud computing in added advantage (AWS / Azure)
- Strong Debugging and Troubleshooting Expertise.
- Strong communication skills (oral and written)
Read more
Bengaluru (Bangalore)
2 - 4 yrs
₹6L - ₹15L / yr
JavaSpring
Microservices
J2EE
Work Location: Indira Nagar, Bangalore
Work Days: Sunday to Thursday OR Monday to Friday
Shift: Day Time
Week Off: Friday & Saturday OR Saturday & Sunday
JD:
Development of applications in Java including:
Building data processing platforms.
Developing micro service-oriented applications (Mandatory).
Interact with stakeholders of the applications being developed.
Desired Candidate Profile:
Must have experience in Java JEE, Spring Framework, Microservices (Mandator)
Experience in SQL and JDBC
Experience in build tools Maven, git
Experience in Cloud Platforms AWS, Azure is a plus.
Read more
Pune
4 - 8 yrs
₹4L - ₹18L / yr
AngularJS (1.x)Spring
Spring MVC
Spring BootMicroservices
+5 more
We have a role for Fullstack Developer who can join within 2 weeks- Strong experience in Java along with any MVC framework like : Play/Spring/Grails/Struts along with Hibernate/JPAExperience with frontend technologies : Angular JS, HTML & CSS- Strong OOP fundamentals, Java, XML, JSON, AJAX, Web Services, RDBMS, NoSQL, Web socket, Session Management- Experience in JSON/XML and REST based Web Service based integrations.- Creating database schemas & multiple distributed architecture along with migration, transformation using queries and scripting- User authentication and authorization between multiple systems,servers, and environments- Proficient understanding of code versioning tools, such as GIT- Understanding accessibility and security compliance- Experience with Agile/Scrum development methodologiesPlease let me know your salary details and notice period.
Read more
Pune
3 - 12 yrs
₹10L - ₹50L / yr
Distributed Systems
File systems
C++
Data Structures
Algorithms
Design, develop, test and debug highly distributed storage service.
Strong background in algorithms and data structures required
Read more
Mumbai
2 - 6 yrs
₹20L - ₹35L / yr
Data Structures
Algorithms
Software Development
RubyRuby on Rails (ROR) +2 more
Cogoport is looking for a tech enthusiast who is capable of building creative features that positively impact hundreds of millions of international customers, and is highly motivated with a passion for building high-level systems that scale to hundreds of millions of transactions.
Ideal candidate should be able to guide multiple projects at once in a dynamic and expeditious environment. You will be responsible for developing a world-class product with clean, well-documented code and at the same time ensuring high performance & scalability using proper design principles. You will be responsible for writing server-side web application logic as well as for the integration of the front-end part. Needless to mention you have demonstrated ability towards urgency, ownership, sharing success and competent enough to excel prevailing engineering velocity at Cogoport.
You should be a modern thinker and believer of manager and hierarchy free organisation like Cogoport. The ideal candidate would be assessed basis the defined role fitment. Critical is that you are curious and learner to be able to seek out and evaluate new ideas and bringing them back into the organisation. If you have outstanding programming skills and a great passion for developing beautiful, innovative applications, then let's get in touch!
1. Problem Solving: You should have the rigour and discipline to approach most of the problems and ensure the delivery of quality work ahead of timelines. You are able to look at a problem, define and brainstorm ways to achieve an optimal solution and pick the best engineering approach to bring the software productivity.
2. Architectural Design: You should have in-depth knowledge to design highly scalable architecture. You have strong experience in building products ensuring scalability in tech architecture & design implementation.
3. Database: Should have strong expertise in the database to manipulate data in the software system to minimize data redundancy and maximize the speed of retrieval. Knowledge of MongoDB, MySql, PostgreSQL database is preferred.
4. Algorithm Skills: You should be adept in all algorithm aspects to define an efficient way of solving the problem. You will solve complex problems with algorithms embedded in logical thinking and creating the most efficient and optimum code.
5. Code Quality: Enhancing the code quality by structuring the code & making sure that all the guidelines are followed to ensure enhancing code efficiency & reduction of code failure & bug rectification.
6. Product Inclination: A Software Engineer not only gets involved in coding but should equally understand the product/feature to think & cover all the possible business edge cases coming on the way.
Ideal candidate should be able to guide multiple projects at once in a dynamic and expeditious environment. You will be responsible for developing a world-class product with clean, well-documented code and at the same time ensuring high performance & scalability using proper design principles. You will be responsible for writing server-side web application logic as well as for the integration of the front-end part. Needless to mention you have demonstrated ability towards urgency, ownership, sharing success and competent enough to excel prevailing engineering velocity at Cogoport.
You should be a modern thinker and believer of manager and hierarchy free organisation like Cogoport. The ideal candidate would be assessed basis the defined role fitment. Critical is that you are curious and learner to be able to seek out and evaluate new ideas and bringing them back into the organisation. If you have outstanding programming skills and a great passion for developing beautiful, innovative applications, then let's get in touch!
1. Problem Solving: You should have the rigour and discipline to approach most of the problems and ensure the delivery of quality work ahead of timelines. You are able to look at a problem, define and brainstorm ways to achieve an optimal solution and pick the best engineering approach to bring the software productivity.
2. Architectural Design: You should have in-depth knowledge to design highly scalable architecture. You have strong experience in building products ensuring scalability in tech architecture & design implementation.
3. Database: Should have strong expertise in the database to manipulate data in the software system to minimize data redundancy and maximize the speed of retrieval. Knowledge of MongoDB, MySql, PostgreSQL database is preferred.
4. Algorithm Skills: You should be adept in all algorithm aspects to define an efficient way of solving the problem. You will solve complex problems with algorithms embedded in logical thinking and creating the most efficient and optimum code.
5. Code Quality: Enhancing the code quality by structuring the code & making sure that all the guidelines are followed to ensure enhancing code efficiency & reduction of code failure & bug rectification.
6. Product Inclination: A Software Engineer not only gets involved in coding but should equally understand the product/feature to think & cover all the possible business edge cases coming on the way.
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar
Software Engineer, MemorresFor 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort