Database Engineer
Next gen BI platform for data driven performance marketers
Database Engineer
at Next gen BI platform for data driven performance marketers
Agency job
via CutShort Team
3 - 7 yrs
₹30L - ₹45L / yr
Bengaluru (Bangalore)
Skills
Database architecture
Database Design
Datawarehousing
Data warehouse architecture
Database performance tuning
Distributed Systems
Databases
Microservices
Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
Similar jobs
Remote only
5 - 12 yrs
Best in industry
JavaJ2EE
Spring BootHibernate (Java)
Microservices
What You will do
● Create beautiful software experiences for our clients using design thinking, lean and agile methodology.
● Work on software products designed from scratch using the latest cutting edge technologies, platforms and languages such as JAVA, python, Javascript, GoLang and Scala.
● Work in a dynamic, collaborative, transparent, non-hierarchical culture.
● Work in collaborative, fast-paced and value-driven teams to build innovative customer experiences for our clients.
● Help to grow the next generation of developers and have a positive impact on the industry.
Basic Qualifications
● Experience: 4+ years.
● Hands-on development experience with a broad mix of languages such as JAVA, Python, Javascript etc.
● Server-side development experience mainly in JAVA, (Python and nodeJS can be considerable)
● UI development experience in ReactJS or AngularJS or PolymerJS or EmberJS or Jquery etc. are good to have.
● Passion for software engineering and follow the best coding concepts. ● Good to great problem solving and communication skills.
Nice to have Qualifications
● Product and customer-centric mindset.
● Great OO skills, including design patterns.
● Experience with devops, continuous integration & deployment.
● Exposure to big data technologies, Machine Learning and NLP will be a plus.
Benefits
● Competitive salary.
● Work from anywhere.
● Learning and gaining experience rapidly.
● Reimbursement for basic working set up at home.
● Insurance (including a top up insurance for COVID).
Location
Remote - work from anywhere
Read more
Remote only
4 - 12 yrs
Best in industry
JavaJ2EE
Spring BootHibernate (Java)
Microservices
+2 more
What You will do
● Create beautiful software experiences for our clients using design thinking, lean and agile methodology.
● Work on world-class software products using the latest cutting edge technologies and platforms.
● Work in a dynamic, collaborative, transparent, non-hierarchical culture.
● Work in collaborative, fast-paced and value-driven teams to build innovative customer experiences for our clients.
● Help to grow the next generation of developers and have a positive impact on the industry.
Basic Qualifications
● Experience: 4+ years.
● Hands-on development experience in backend, Java, SprintBoot, Hibernate, SQL, MongoDB, Jenkins, Microservices etc...
● Server-side development experience mainly in JAVA.
● Passion for software engineering and follow the best coding concepts. ● Good to great problem solving and communication skills.
● Experience in working with cross-border, distributed teams is a must.
Nice to have Qualifications
● Product and customer-centric mindset.
● Great OO skills, including design patterns.
● Experience with large-scale enterprise systems
Read more
Hyderabad
5 - 12 yrs
₹5L - ₹29L / yr
JavaApache Kafka
Microservices
J2EE
Spring Boot +1 more
Technical specifications/Skill Set:
- Minimum of 5+ years of significant experience in application development.
- Proficient with software development lifecycle (SDLC) methodologies like Agile, Test- driven development
- Knowledge of system architecture, object-oriented design, and design patterns.
- Required technical skills: Strong Core Java, J2EE, Spring boot, Akka, API development & distributed application development experience.
- Desirable technical skills: Micro-services pattern, Kafka, Knative Eventing, Camel-K, Container Technologies like Docker, Kubernetes, NoSql preferably Cassandra.
- Experience working with high volume data and computationally intensive system.
- Domain knowledge in Financial Industry and Capital Markets is a plus.
- Excellent communication skills are essential, with strong verbal and writing proficiencies.
Read more
Pune
4 - 6 yrs
₹15L - ₹18L / yr
.NETASP.NET
C#Microservices
Web API
+3 more
Job Role: .Net Developer
Company: MNC
Location: Pune (Currently WFH)
Experience: 4-6 Years
Shift: 11:30AM - 8:30PM
Skills: .Net Core, Microservices, Web API / Rest API, C#, Azure Functions, CosmosDB
Job Details:
Company: MNC
Location: Pune (Currently WFH)
Experience: 4-6 Years
Shift: 11:30AM - 8:30PM
Skills: .Net Core, Microservices, Web API / Rest API, C#, Azure Functions, CosmosDB
Job Details:
- Develop client projects using Asp.net core 3.1 and above, MySQL Database, Azure Functions, CosmosDB, C#.
- Communicate with external clients on a regular basis regarding progress, challenges, timelines and results of client projects
- Gather technical requirements as needed
- Create and update, design and functional documents
- Identify and troubleshoot issues as needed
- Perform a new development as required
- Implement project applications according to specifications
- Research technical issues and provide recommendations to enhance client websites
- Work both independently and as part of a team to create reliable and high-performing Web Applications
- Unit test code to ensure quality
- Develop client projects using Asp.net core 3.1 and above, MySQL Database, Azure Functions, CosmosDB, C#.
- Communicate with external clients on a regular basis regarding progress, challenges, timelines and results of client projects
- Gather technical requirements as needed
- Create and update, design and functional documents
- Identify and troubleshoot issues as needed
- Perform a new development as required
- Implement project applications according to specifications
- Research technical issues and provide recommendations to enhance client websites
- Work both independently and as part of a team to create reliable and high-performing Web Applications
- Unit test code to ensure quality
Read more
Bengaluru (Bangalore)
3 - 12 yrs
₹2.5L - ₹10L / yr
Go Programming (Golang)
Django
FlaskMySQL
PostgreSQL +7 more
Bachelor’s degree in Computer Science or related field plus 4-12 Years of Full Stack experience
• 3+ Years of experience as a Go Developer
• Experience in ReactJS (most preferred) or AngularJS similar front end frameworks
• Experience with the Python or/and Golang (preferably both), SQL, and design/architectural
patterns
• Experience in Java or dotnet or other opensource technologies is an added advantage
• Hands-on experience on SQL, Query optimization, DB server migration
• Preferably experience in Postgre SQL or MySQL
• Knowledge of NOSQL databases will be an added advantage
• Experience in Cloud platforms like AWS, Azure with knowledge of containerization, Kubernetes is an
added advantage
• Knowledge of one or more programming languages along with HTML5/CSS3,Bootstrap
• Familiarity with architecture styles/APIs (REST, RPC)
• Understanding of Agile methodologies
• Experience with Threading, Multithreading and pipelines
• Experience in creating RESTful API’s With Golang or Python or Java in JSON, XMLs
• Experience with GitHub, Tortoise SVN Version Control
• Strong attention to detail
• Strong knowledge of asynchronous programming with the latest frameworks
• Excellent troubleshooting and communication skills
• Strong knowledge of unit testing frameworks
• Proven knowledge of ORM techniques
• Skill for writing reusable libraries Understanding of fundamental design principles for building a scalable
applicatio
• 3+ Years of experience as a Go Developer
• Experience in ReactJS (most preferred) or AngularJS similar front end frameworks
• Experience with the Python or/and Golang (preferably both), SQL, and design/architectural
patterns
• Experience in Java or dotnet or other opensource technologies is an added advantage
• Hands-on experience on SQL, Query optimization, DB server migration
• Preferably experience in Postgre SQL or MySQL
• Knowledge of NOSQL databases will be an added advantage
• Experience in Cloud platforms like AWS, Azure with knowledge of containerization, Kubernetes is an
added advantage
• Knowledge of one or more programming languages along with HTML5/CSS3,Bootstrap
• Familiarity with architecture styles/APIs (REST, RPC)
• Understanding of Agile methodologies
• Experience with Threading, Multithreading and pipelines
• Experience in creating RESTful API’s With Golang or Python or Java in JSON, XMLs
• Experience with GitHub, Tortoise SVN Version Control
• Strong attention to detail
• Strong knowledge of asynchronous programming with the latest frameworks
• Excellent troubleshooting and communication skills
• Strong knowledge of unit testing frameworks
• Proven knowledge of ORM techniques
• Skill for writing reusable libraries Understanding of fundamental design principles for building a scalable
applicatio
Read more
Bengaluru (Bangalore), Mumbai
8 - 20 yrs
₹25L - ₹38L / yr
JavaJ2EE
Spring BootHibernate (Java)
Microservices
+8 more
- The Architect/ Lead Backend Engineer will handle the digital experience from inception to go-live model.
- The role holder is expected to create a vision and roadmap for the digital experience to provide best in class customer experience for each of the product solutions handled. The role holder will play a critical role in leading the innovation and growth of our front end web and mobile platforms.
- Must be from Good Companies and have been working on high Scale of Traffic
- Proficiency in engineering practices and writing high quality code, with expertise in either one of Java or Groovy or Go.
- 3+ years of experience building microservices.
- Strong experience in architecting and building distributed systems, scalability, and availability
- Strong knowledge of data structures, algorithms, and designing for performance
- Strong knowledge of cloud technologies like AWS/Google Cloud/Azure
- Good understanding of RxJava or Actors framework
- Proficient with RDBMS
- Strong knowledge on data stores, database design, data modelling and SQL queries
- Extensive experience building and owning large- scale distributed backend systems
- Experience working with three or more of : Unix/Linux environments, Distributed and parallel systems, Workflow automation, CI/CD Platform development, Cloud platforms development e.g. AWS/GCP, Kubernetes/Container platforms based development
Read more
Remote only
4 - 8 yrs
₹5L - ₹10L / yr
NodeJS (Node.js)
NextJs (Next.js)Node
Javascript
MongoDB +3 more
Key Skills
- In depth knowledge of Node.js
- Knowledge of integration with front-end JavaScript libraries and frameworks like react js
- Should be experienced with Micro-services.
- Knowledge of both SQL and NoSQL databases such as MySQL, Oracle, MongoDB
- Working experience of Git preferably bitbucket.
- Good knowledge of CI/CD preferably using bitbucket pipelines and Jenkins.
- Working knowledge of agile methodologies and techniques
Read more
Bengaluru (Bangalore)
2 - 5 yrs
₹5L - ₹7L / yr
JavaJ2EE
Spring
Spring BootMicroservices
We have opening for Java Developer for permanent position with our concern.
Skills Needed: Java,Spring,Springboot,Microservices
Should have hands-on experience with Java
Should have hands-on experience with technologies like spring & springboot
Should have hands-on experience with Microservices Architecture
Experience:2 Yrs to 5 Yrs
Notice Period: Immediate to 10 Days(Max)
Location: Bangalore
Work from Home till Pandemic End
Skills Needed: Java,Spring,Springboot,Microservices
Should have hands-on experience with Java
Should have hands-on experience with technologies like spring & springboot
Should have hands-on experience with Microservices Architecture
Experience:2 Yrs to 5 Yrs
Notice Period: Immediate to 10 Days(Max)
Location: Bangalore
Work from Home till Pandemic End
Read more
Chandigarh
2 - 5 yrs
₹14L - ₹25L / yr
Software Development
AWS RDS
Amazon Web Services (AWS)C#
Visual Studio +9 more
Do you look forward to working for a well know ed-tech brand and be part of their growth story? Then here is a fantastic role.. read on.
Our client is a revolutionary Educational services platform, that brings in innovation and expertise in their ways of learning. Awarded as one of the best Google apps of 2017, the app provides students with a variety of online courses that cover K12 subjects, Entrance exams, Engineering and FInance stream topics, as well as Self-help notes.
Their unique and simple AI based site and app feature 500+ courses, nearly a lakh videos and tests, and also imparts strength and weakness analysis for the students to improve their knowledge base. The 5yr old organisation is one of the most loved ed-tech platforms that reaches more than 4.5Mn registered users.
Our client is a revolutionary Educational services platform, that brings in innovation and expertise in their ways of learning. Awarded as one of the best Google apps of 2017, the app provides students with a variety of online courses that cover K12 subjects, Entrance exams, Engineering and FInance stream topics, as well as Self-help notes.
Their unique and simple AI based site and app feature 500+ courses, nearly a lakh videos and tests, and also imparts strength and weakness analysis for the students to improve their knowledge base. The 5yr old organisation is one of the most loved ed-tech platforms that reaches more than 4.5Mn registered users.
As a Sr. Backend Developer, you will optimize applications for maximum speed and troubleshoot and fix bugs / flaws to ensure company applications are running optimally.
What you will do:
- Planning and implementing company's application and data model structures for scalability.
- Maintaining central databases, ensuring high performance, and responding to requests from the front-end.
- Developing reusable code and libraries for future use. Building for new features and maintaining the present ones.
- Implementing comprehensive security and data protection.
- Has 2-5 years of experience working on a growth stage product, where they first scaled from 0 to 1 and then 1 to n.
- You have studied Computer science (or a similar degree) from a Tier 1 college OR have a great set of experiences working at products that scaled massively.
- You understand product and database architecture like you understand basic Maths and have worked on it for 3 to 7 years. Further, you know how to optimise AWS/ GCP for both efficiency and cost.
- You have experience in managing a team and setting up the best processes / practices (1yr+ Engineering Manager experience)
- You are deeply driven for creating an impact. You obsess over doing things the right way, and you enjoy writing beautiful code.
- Though technology stack is not the primary concern, we would value some experience in C#/ Visual Studio, RDS/ MySQL, ElasticSearch, System Architecture and general AWS solutions.
- Ownership: Absolute ownership of the product and your code, with relentlessness to deliver with speed and precision.
- Dynamic & Resourceful: Should be comfortable in dealing with lots of changes in a fast paced environment. Super willing to learn new technologies and systems. And resourceful and inventive in the face of every problem.
- Deep Love for coding: You write code because you love doing it and not just because it's a job for you.
- Perfection/ Obsession/ Hygiene: You deeply understand & achieve perfection in even the 'small' features. And you deeply care about the quality of your code.
- Good eye for usability & design and willing to put-in extra effort for delivering the best user experience.
- Creating Algorithms that can change the game: Should understand requirements and design algorithms accordingly.
- Driven by Data: Strong analytical and troubleshooting skills leveraging/finding all data available.
- Team player: Keeps the team over themselves. Has a knack for influencing without being authoritative. Goes out of the way to help wherever the team needs them.
Read more
Bhubaneswar
7 - 10 yrs
₹6L - ₹10L / yr
SSAS
Databases
SSIS
SQL server
Microsoft Business Intelligence (MSBI)
Duration of contract: 12 Months
Total Yrs. of Experience: 7years
Relevant Yrs. of experience: 7years
Detailed JD *(Roles and Responsibilities):
· 7 yrs experience with technology.
· Proven experience with heavy usage of SSIS and SQL database tool and related infrastructure like development, deployment, administration and investigation of issues with quick turnaround (functional as well as performance).
· Demonstrated development/deployment/administration/support with SSAS Tabular project using advanced concepts like percentile, partitioning, row level security implementation is a must
· Good understanding of reporting UIX and demonstrated development of reports using "Online Microsoft Power BI" features and visuals for 5K+ users.
· Demonstrated effective and proactive communication with clients
· In general, the candidate would be working in fast paced agile environment having around 8-10 team members to work with and direct daily client interaction (in second shift 2pm to 11pm) in GDM model. The daily activities would be as below but not limited to
o identify data needs and analyze available data
o comprehend business and technical requirements
o analysis of code and understanding existing system
o and preparing high level design document, low level design
o contributions to schedule and effort estimation
o Build, Unit testing, Understanding of configuration management
· SQS Server 2016 experience is plus
· Azure experience related to Microsoft business intelligence stack is a plus
· SSRS experience is good to have
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort