Database Engineer
Next gen BI platform for data driven performance marketers
Database Engineer
at Next gen BI platform for data driven performance marketers
Agency job
via CutShort Team
3 - 7 yrs
₹30L - ₹45L / yr
Bengaluru (Bangalore)
Skills
Database architecture
Database Design
Datawarehousing
Data warehouse architecture
Database performance tuning
Distributed Systems
Databases
Microservices
Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
Similar jobs
Bengaluru (Bangalore)
3 - 5 yrs
₹30L - ₹45L / yr
Data modeling
JavaSpring
Microservices
SQL
Looking for candidates only with tier 1 colleges OR have experience in a product-based company.
Desired Skills :
● Experience with data modeling and SQL/NoSQL databases
● Experience with distributed systems and microservices
● Good experience in working with any of Java/SpringBoot, GoLang or NodeJS
● Excellent problem solving and debugging skills
● Passionate about the experience of software engineering as much as the output
● A strong sense of ownership
● Ability to communicate your ideas and approach to solving problems with clarity
Read more
Bengaluru (Bangalore)
5 - 8 yrs
Best in industry
JavaJ2EE
Spring BootHibernate (Java)
Microservices
5+ years of Experience designing, building and testing Java EE applications
Experience designing, implementing, and integrating Spring and/or Spring Boot
Good knowledge in recent version of Java, Oracle, JBoss, Hibernate
Experience in working with Messaging systems like Apache Kafka
Developing low level designs based on HLD
Reviewing code to check coding standards and best practices to ensure quality.
Hands on knowledge in Unit testing Framework like Junit and good understanding on Exception Handling in Java
Good Knowledge in UI like React or Angular
Experience designing SOAP / RESTful web services
Working on bug fixing and improving application performance
Familiarity with build tools such as Maven and Gradle.
Familiar with various design and architectural patterns
Familiarity with continuous integration
Read more
Pune
4 - 5 yrs
₹8L - ₹15L / yr
Spring BootHibernate (Java)
Microservices
Databases
JavaJob Summary:
Java developer will be responsible for many duties throughout the development lifecycle of applications, from concept and design right through to testing.
Duties/Responsibilities:
- To support and maintain existing Java code base, debug the application
- To analyse user and business requirements and design and implement appropriate solutions
- To design and code programs following in-house standards and good design principles
- To ensure that all programs are documented to the company standards
- To create unit test plans and perform unit testing of the programs
- To provide advice and guidance to other members of the team
Required Skills/Abilities:
- Hands on experience in designing and developing applications using Java EE platforms
- Object Oriented analysis and design using common design patterns
- Good knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
- Experience in the Spring Framework
- Experience in developing web applications using at least one popular web framework (JSF, Wicket, GWT, Spring MVC)
- Experience in RESTFul webservices
- Experience with test-driven development
- Exposure to portal/mobility development - Desired
- Exposure to any of middleware solutions like MQ, Oracle fusion middleware(WebLogic), WebSphere, Open Source
Read more
Bengaluru (Bangalore)
4 - 7 yrs
Best in industry
JavaJ2EE
Spring BootHibernate (Java)
Microservices
Qualifications:
- A Bachelor’s degree in Computer Science (or equivalent experience)
- M-Tech or advanced degree a plus
- Hackathon participation and accolades are a plus
Job Role:
- 4+ years of object-oriented Java / J2EE development
- Full SDLC experience (requirements gathering, architecture, development, QA, etc)…
- Experience with Spring (MVC, IOP/DI, REST, Security) & Hibernate/Spring
- Experience with SOAP / REST web services
- Knowledge of SQL
- Knowledge of No SQL concepts, understanding of Solr, Redis and Mongo DB is desirable
- Must have worked on any one messaging solutions
- Bonus Points for micro service design and development experience
- Bonus points for any mobile development experience
- Used Agile methodology
- Bonus Points for experience working on Unix, shell scripting & Build Systems
- Experience in performance optimization is an added advantage
Read more
Hyderabad, Bengaluru (Bangalore), Pune, Mumbai
4 - 10 yrs
₹2L - ₹8L / yr
JavaJ2EE
Spring
Hibernate (Java)
Microservices
+1 more
Required technical skills and knowledge--:
Commercial software development experience
Strong object-oriented design and coding skills in Java, springboot, Hibernate, Microservices.
Strong understanding of data structures and algorithms
Experience leading a team of software engineers
Experience with accurately measuring the productivity of a team
Experience writing scalable software
Ability to work collaboratively within a team environment of engineers
Excellent English Speaking and Writing skills
Experience with web services technology (REST, SOAP, etc)
Read more
Remote only
8 - 10 yrs
₹15L - ₹20L / yr
JavaJ2EE
Hibernate (Java)
Elastic SearchSpring Boot +5 more
Java Elastic Search
- Java Microservices ELK stack(Elasticsearch, Logstash, Kibana, Beats, X-Pack, APM),
- Build Custom Reports
Java + NodeJS
- Java with Node.js- Microservices Development,
- Using graphql with node.js,
- Backend development with Node.JS
Java Microservices
- Working experience in Java and spring boot (microservices)
- Strong understanding of OOPs concepts
- Proficient in API design and development using RESTful services
- Knowledge and understanding of design principles behind building a scalable application
- Source code management using git
Read more
Pune, Gandhinagar
5 - 8 yrs
₹11L - ₹17L / yr
J2EE
JavaMicroservices
edi mapping
EDI Development with Java-Microservices.
• Atleast 5+ years of experience in Java development (J2EE, J2SE 8)
• Atleast 3+ years for EDI development experience.
• Degree, diploma or Certificate in Computer Science or IT.
* Troubleshooting of FTP networking for all EDI situations, sets up and edits all SQL reports. * Bring out and supervises all self loading scripts to guarantee effective EDI document travel. * Monitor effective working of all the given projects, manages various departments to provide efficiency for support staff, makes all EDI maps, business procedures and works out all the execution issues. * Experience in preparing all cost advice reference papers and takes part in different test developments, enforcement plans, strategies and supervises all communication for projects as per work plan. * Experience in dealing with all the scheme or system designs and follows through new designs and helps to enforce brand for all the new clients. * Coordination with non EDI sources to fix, design and implement all the answers for the same, and makes all data map to guarantee effective management of all dealings. * Experience in helping to all the e-trade dealings and the trade units in same processes and comes up with an update on architecture if needed. * Experience in leading projects that support the EDI techie regions, and helps the other projects as characterized by the team lead of applications development. * Experience in functioning as a direct liasion with fundamental users in limited structural areas of the trade. * Experience in EDI procedures and daily functions to ensure best performance, completeness and superiority.
• Atleast 5+ years of experience in Java development (J2EE, J2SE 8)
• Atleast 3+ years for EDI development experience.
• Degree, diploma or Certificate in Computer Science or IT.
* Troubleshooting of FTP networking for all EDI situations, sets up and edits all SQL reports. * Bring out and supervises all self loading scripts to guarantee effective EDI document travel. * Monitor effective working of all the given projects, manages various departments to provide efficiency for support staff, makes all EDI maps, business procedures and works out all the execution issues. * Experience in preparing all cost advice reference papers and takes part in different test developments, enforcement plans, strategies and supervises all communication for projects as per work plan. * Experience in dealing with all the scheme or system designs and follows through new designs and helps to enforce brand for all the new clients. * Coordination with non EDI sources to fix, design and implement all the answers for the same, and makes all data map to guarantee effective management of all dealings. * Experience in helping to all the e-trade dealings and the trade units in same processes and comes up with an update on architecture if needed. * Experience in leading projects that support the EDI techie regions, and helps the other projects as characterized by the team lead of applications development. * Experience in functioning as a direct liasion with fundamental users in limited structural areas of the trade. * Experience in EDI procedures and daily functions to ensure best performance, completeness and superiority.
Read more
Bengaluru (Bangalore)
8 - 15 yrs
₹10L - ₹40L / yr
Ruby on Rails (ROR)
Go Programming (Golang)MySQL
Microservices
Tech Stack:
Golang, Microservices (AWS ECS, App Mesh), Ruby, Rails, MySQL, Postgres, Redis, NATS.
Required Skills:
- 5+ years of experience with Ruby on Rails OR 2+ years of experience with Golang.
- 5+ years of experience with MySQL or Postgres and relational data modelling.
- Experience consuming and writing REST APIs.
- Focus on writing clear, maintainable, tested code.
- Experience with Git, continuous integration and regular deployments.
- Experience with complex Rails projects and design principles.
- Strong willingness to learn and use Golang at work.
- Experience with CI (continuous integration).
- Strong understanding of Linux.
- Strong understanding of Docker.
- You must be a strong communicator who can explain complex ideas to anyone regardless of background.
Preferred Skills:
- 2+ years of experience with Golang.
- Experience with Microservices deployed in Kubernetes.
- Experience with AWS ECS, App Mesh and Lambda.
- Ability and interest in mentoring junior engineers a plus.
- Excellent written communication skills and diligent ability to contribute to the team by performing code reviews.
- B.S. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience
Read more
Hyderabad
6 - 15 yrs
₹10L - ₹25L / yr
JavaEJB
Microservices
What you bring to the table
- Education: Bachelor's degree in IT, computer science or related
- Experience: 5-9 years of relevant experience for SSE role
- Exposure to microservices, API management tools like Swagger
- Must have experience in working on Agile Scrum teams in the past and exposure to any of the Agile project management tools like Jira, Mingle, RTC, TFS etc.
- Proficient in application log analysis.
- Experience Java/JEE Development - especially EJB 2.1 / 3.0, JDBC
- Experience with application servers such as JBoss AS or IBM WAS is an advantage
- Experience in SQL programing using PostgreSQL / MySQL /Maria DB and JPA (Annotation Based)
- Knowledge of build tools such as Maven or Gradle and of continuous integration tools such as Jenkins, Nexus
- Basic knowledge of web services (SOAP or REST) and web technologies (HTML, CSS, JS)
- Basic knowledge of containers like Dockers, basic knowledge of cloud infrastructure
- Ability to interact and coordinate with employees at different levels, different groups, and different geographical locations within the company
- Ability to support multiple existing applications as well as work on building new ones
- Ability to provide accurate project estimates and make recommendations on specific technologies to use based on business requirements
- Good verbal and written Communication.
- Readiness for short term Domestic and International Travels
Preferred
- Industry knowledge with respect to payments systems and processing in the Debit/Credit and Account based payments (EFT Switching) from different channels like POS, ATM or ecommerce, Card Management System and Real Time Payment Systems.
- Exposure to the Interchange Interfaces like Visa Net, MasterCard, BankNet
- Exposure to Interchange Simulators and Mandates Management.
Read more
Remote, NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore)
2 - 8 yrs
₹5L - ₹10L / yr
JavaSpring
Microservices
Elastic SearchMultithreading
+4 more
- Exp- 3+ yrs
- Must be very good in Java- 2.5+ yrs
- At least 1 yr of working experience in any one DB of Neo4j, Cassandra, Elastic Search
- Should have good devops working knowledge - Knowledge of AWS, Ansibleetc is a necessity
- Experience in TDD/BDD is required
- Minimum 1 yr working experience in Samza& Kafka.
- Knowledge of Azure is added advantage
- Understanding of AKKA and Play framework
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort