Database Engineer
at Next gen BI platform for data driven performance marketers
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
.NET
DockerJob Title: .NET Developer
Experience: 5+ Years
Location: Bangalore, India
Notice Period: Immediate Joiners Preferred
Job Type: Full-time
Job Summary:
We are looking for an experienced and proactive .NET Developer with over 5 years of hands-on experience in developing enterprise-grade applications. The ideal candidate will have strong expertise in ASP.NET, Microservices architecture, and containerization tools like Docker. This is an excellent opportunity to work in a dynamic team, building scalable and high-performance systems.
Key Responsibilities:
- Design, develop, test, and deploy secure and scalable .NET applications.
- Work with ASP.NET (MVC/Web API/Core) to build server-side applications.
- Develop and maintain microservices in a cloud-native environment.
- Containerize applications using Docker for streamlined deployment.
- Collaborate with cross-functional teams to understand business requirements.
- Ensure high performance, quality, and responsiveness of applications.
- Troubleshoot and debug production issues efficiently.
Key Requirements:
- 5+ years of hands-on experience in software development using .NET technologies.
- Proficient in ASP.NET MVC / Web API / .NET Core.
- Strong experience in Microservices architecture.
- Practical knowledge of Docker and containerization best practices.
- Good understanding of RESTful services and API development.
- Experience with version control systems (e.g., Git).
- Familiarity with Agile methodologies.
- Strong problem-solving and communication skills.
Java
Amazon Web Services (AWS)Job Description: We are looking for a talented and motivated Software Engineer with
expertise in both Windows and Linux operating systems and solid experience in Java
technologies. The ideal candidate should be proficient in data structures and algorithms, as
well as frameworks like Spring MVC, Spring Boot, and Hibernate. Hands-on experience
working with MySQL databases is also essential for this role.
Responsibilities:
● Design, develop, test, and maintain software applications using Java technologies.
● Implement robust solutions using Spring MVC, Spring Boot, and Hibernate frameworks.
● Develop and optimize database operations with MySQL.
● Analyze and solve complex problems by applying knowledge of data structures and
algorithms.
● Work with both Windows and Linux environments to develop and deploy solutions.
● Collaborate with cross-functional teams to deliver high-quality products on time.
● Ensure application security, performance, and scalability.
● Maintain thorough documentation of technical solutions and processes.
● Debug, troubleshoot, and upgrade legacy systems when required.
Requirements:
● Operating Systems: Expertise in Windows and Linux environments.
● Programming Languages & Technologies: Strong knowledge of Java (Core Java, Java 8+).
● Frameworks: Proficiency in Spring MVC, Spring Boot, and Hibernate.
● Algorithms and Data Structures: Good understanding and practical application of DSA
concepts.
● Databases: Experience with MySQL – writing queries, stored procedures, and performance
tuning.
● Version Control Systems: Experience with tools like Git.
● Deployment: Knowledge of CI/CD pipelines and tools such as Jenkins, Docker (optional)
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
Javascript- You have experience with two or more development languages preferably Java or Python and React, etc
- You can skillfully write high-quality, well-tested code and you are comfortable with Object-Oriented programming
- Comfortability with Agile methods, such as Extreme Programming (XP), Scrum and/or Kanban
- Bonus points if you have working knowledge of cloud technology such as AWS, Azure, Kubernetes and Docker
JavaJavascriptAngular (2+)Work Experience: 3 to 5 years
Official Notice Period – Immediate to 15 days ONLY
Excellent communication skills
Job Location – Mumbai
Mandatory Skills – Java 8, Spring boot, Hibernate, Microservices, Angular
Java Commercial software development experience
Strong object-oriented design and coding skills in Java, springboot, Hibernate, Microservices.
Strong understanding of data structures and algorithms
Experience leading a team of software engineers
Experience with accurately measuring the productivity of a team
Experience writing scalable software
Ability to work collaboratively within a team environment of engineers
Excellent English Speaking and Writing skills
Experience with web services technology (REST, SOAP, etc)
Java
PythonBasic Qualifications:
- 2+ years of non-internship professional software development experience
- Programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
- 1+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
Additional Job requirements
- BS/MS/PhD in Computer Science/Math or equivalent
- BS in computer science or related field.
- 2+ years of relevant professional software development experience: designing, developing, and delivering software written in Java, C#, or C++, web development.
- Knowledgeable in object-oriented design patterns.
- Experience building highly scalable and distributed systems
Preferred Qualifications
- Experience with service-oriented architecture and application/services development
- Passion for performance debugging and benchmarking
- Ability to clearly and concisely communicate with technical and non-technical stakeholders across all levels of the organization
Go Programming (Golang)
Ruby on Rails (ROR)
RubyPythonJavaRoles and Responsibilities
- Develop data analysis and processing engines using Python
- Develop server-side applications
- Develop and deploy applications on AWS
- Individually manage multiple projects with end-to-end oversight
- Undertake POCs on new tech stacks and integrate them in applications on a functional level
- Design small and large applications on an enterprise level
- Understand business requirements and translate them into applications
- Plan projects with complete details such as efforts, timelines, and wireframes
- Work under tight timelines
- Assist in project management of micro-innovation projects
- Create tools, templates, SOPs / training manuals, process documents etc
- Work with cross-functional / domain teams
- Work in a fast-paced and agile development environment
Desired Candidate Profile
- 3+ years of relevant experience with Object Oriented Programming.
- Expertise in Web frameworks: Django, Flask.
- Should have working knowledge in Programming: Python Advanced.
- Hands on knowledge on Source Control: GIT.
- And RESTFul Services.
- Strong knowledge of MVC / MVT framework, Apache Web Server/IIS/nginx, Docker, etc
- Proficiency in writing Web APIs / Rest APIs
- Ability to develop client server architecture applications
- Excellent understanding of relational databases such MySQL, MS SQL, and NoSQL(Mongodb)
- Strong understanding of how to connect a database with a chosen back-end language, with adequate grip over architecture
- Understanding of security-related concepts / within a server-side application
- Adequate knowledge on SDLC
RubyRuby on Rails (ROR)We are looking for an experienced Senior Software Engineer (Integrations) to contribute to PriceLabs' ambitious plans. We have an existing product that's being used by thousands of customers worldwide and are looking to upgrade our design and launch new features that will serve customers worldwide.
What you will learn at PriceLabs:
Scaling:
- We currently exchange tens of millions of prices between us and our partners multiple times every day! As we continue to grow, designing our architecture to keep working seamlessly is going to need a lot of teamwork
- Doubling in size every year brings unique scaling challenges. Our product started with one single server doing everything needed, but over time we've created a fairly distributed architecture of micro-services. Ensuring our systems continue to provide the same level of service with twice the number of customers next year teaches us (and you!) forward thinking!
Fundamentals:
- We have a very strong emphasis on fundamentals - writing code in strict memory requirements, setting up a server from scratch, being able to use open source services (like nginx, mysql, linux servers, redis, rabbitmq) to get the best performance out sets our team up for long term success.
- Implementing to the standards of operating systems, working in a thread safe/unsafe environment.
- Understand how servers interact with each other in a data center. How does nginx and unicorn power the communication for our APIs.
Customer-centric engineering:
- Making a product that needs to work for both single home-owners as well as enterprise customers to property management businesses - we're on a journey towards design and process thinking to ensure systems are easy to use. Expect strong collaboration with customer facing, design and data science teams!
New products:
- We have a lot of ground level infrastructure available for us to build new products for both our customers and our industry partners to use. Architecting these systems from scratch is a joy in itself (our team has done this a few times!)
Amazing team:
- Our engineering team is very focused on getting things done, and getting them done the right way so the last long! Write better code everyday, solving customer and co-worker pain points, and learning from our peers is what keeps us going!
Responsibilities:
- You will work with Ruby, we are a RoR platform so understanding how ruby interacts with database would be ideal but not preferred.
- Build new integrations with property management systems (PMS) and also maintain existing ones.
- Understand nuances of downstream systems and design and architect your solution keeping in mind third party systems
- Talk to existing PMS and understand what new features can be incorporated and what existing features need to be updated.
- Fix issues that break and keep a track of daily status and understand inefficiencies.
- Engage with PMS partners and optimise the existing pipeline.
- Continuous improvement to our web stack, set standards, automate mundane tasks
Requirements:
- 4+ years experience in back end web development and understanding Ruby would be great but not mandatory.
- You should be comfortable working with git, visual studio code(or any IDE that you prefer) and test your own code thoroughly before making a PR.
- Ability to architect and develop systems so it can connect seamlessly with PMS and third party systems.
- Ability to understand Message queues and how a pub-sub system works with multiple servers
- Experience in building distributed systems that integrate with RESTful APIs and SOAP XMLs.
PostgreSQLAmazon Web Services (AWS)Designation: Database Developer
Job Description
As a Database Developer at our company, you will be responsible for designing, testing, planning, implementing, protecting, operating, managing and maintaining our company's databases.Communication and organization skills are keys for this position,along with a problem-solution attitude. Ultimately, you should be able to ensure our database systems run effectively and securely on a daily basis
Requirement:
-
4 - 8 years of relevant experience in database management in Postgresql and at least 1 year of working experience in an AWS environment.
-
Hands on experience in database development working with PostgreSQL including stored procedures, functions, triggers, and views.
-
Experience working with Windows and Linux systems in a production setting.
-
Working knowledge of handling batch bulk data loads.
-
Proactively adopt new cloud infrastructure and technology.
-
Manage environments in AWS to ensure optimal capacity, performance, security, and availability.
-
Exposure to ElasticSearch, Snappy data is a plus.
-
Must have working knowledge of handling Disaster Recovery and Business Continuity in the AWS cloud.
-
Knowledge of JSON and PostgreSQL support for JSON.
-
Ability to efficiently write database code without compromising data quality, privacy or security.
-
Knowledge of database design principles,queryoptimization,index management,integrity checks, statistics and isolation levels
-
Experience with DB migration projects added advantage
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon