4+ Database architecture Jobs in Bangalore (Bengaluru) | Database architecture Job openings in Bangalore (Bengaluru)

Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.

This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.

What you'll do

- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.

What you bring

We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.

- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.

Main responsibilities: + Management of a growing technical team + Continued technical Architecture design based on product roadmap + Annual performance reviews + Work with DevOps to design and implement the product infrastructure Strategic: + Testing strategy + Security policy + Performance and performance testing policy + Logging policy Experience: + 9-15 years of experience including that of managing teams of developers + Technical & architectural expertise, and have evolved a growing code base, technology stack and architecture over many years + Have delivered distributed cloud applications + Understand the value of high quality code and can effectively manage technical debt + Stakeholder management + Work experience in consumer focused early stage (Series A, B) startups is a big plus Other innate skills: + Great motivator of people and able to lead by example + Understand how to get the most out of people + Delivery of products to tight deadlines but with a focus on high quality code + Up to date knowledge of technical applications

Think of industries still untouched by startup driven innovation. If you can foresee that changing over the next few years, wouldn’t that be a great startup to join today? The global logistics industry is one of the few trillion-dollar markets that has mostly been untapped by startups for various reasons. Hyper competitive environments, high degree of regulation and large, complex operations – have delayed disruption in the industry. But a lot is changing. Increasing adoption of technology and emerging digital platforms are improving the way businesses buy, sell & deliver logistics services. The industry is at the helm of a large-scale transformation and we, at Terminal2, aim to contribute significantly to this change. About us Terminal 2 is an online B2B marketplace for the logistics industry. The platform provides tools & methodologies for users to maximize profitability and find quick solutions to their logistics requirements. The founders of Terminal2 come with a collective experience of 40+ years with a solid track record of corporate as well as entrepreneurial experience in the logistics industry. They got together back in 2016 and have since developed, refined & tested the idea and created a prototype that is now ready to be taken to the market. If you're looking to make a move, come join us as we go after a trillion-dollar market for an exciting & rewarding career… Job summary We are looking for a Senior Software Engineer to produce and implement functional software. You will work with upper management to define software requirements and take the lead on operational and technical projects. In this role, you should be able to work independently with little supervision and will primarily be. Responsibilities: - Develop high-quality software design and architecture. - Product Development & Deployment on AWS. - Direct team of developers in day to day activities. - Provide guidance on technical requirements and troubleshoot issues. - Identify, prioritize and execute tasks in the software development life cycle. - Develop tools and applications by producing clean, efficient code. - Develop automated solutions to build, deploy (CI/CD), and test - applications in cloud environment. - Review and debug code. - Perform validation and verification. - Own, implement and deliver key modules, and when necessary develop quick working prototypes. - Develop Identity & Access Management modules. - Document development phases and monitor systems. - Create database schemas, write SQL queries to store and retrieve data. - Manage Third party integrations such as payment gateways, CRM and other tools. - Ensure that code developed is easy to test, easy to understand, extensible. - Ensure unit tests, integration tests are written for all modules. - Support in project estimation, planning. - Perform the role of a Specialist by ensuring the consistency and efficient integration of the separate modules of software that meets the product specification. - Directing software development projects. - Producing, testing and debugging code. - Leading engineers and developers. Your goal will be to develop high-quality software that is aligned with user needs and business goals. Requirements: - Proven experience as a Senior Software Engineer. - Extensive experience in software development, scripting and project management. - Good knowledge of application development using Agile and DevOps concepts and practices. - Experience using system monitoring tools and automated testing frameworks. - Understanding and implementation of security and data protection. - Must have hands on experience with Node JS, MySQL, Angular4, HTML5 & CSS3. - In-depth knowledge of relational databases (e.g. PostgreSQL, MySQL) and NoSQL databases (e.g. MongoDB). - Ability to create and host REST APIs and consume in frontend application. - Familiarity with various operating systems (Linux, Mac OS, Windows). - Experience with GIT version control tools. - Up-to-date with the latest trends, techniques, and technologies in cloud computing. - Analytical mind with problem-solving aptitude. - Ability to work independently. - Excellent organizational and leadership skills.