Database Engineer
at Next gen BI platform for data driven performance marketers
This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.
What you'll do
- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.
What you bring
We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.
- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
Javascript- You have experience with two or more development languages preferably Java or Python and React, etc
- You can skillfully write high-quality, well-tested code and you are comfortable with Object-Oriented programming
- Comfortability with Agile methods, such as Extreme Programming (XP), Scrum and/or Kanban
- Bonus points if you have working knowledge of cloud technology such as AWS, Azure, Kubernetes and Docker
Go Programming (Golang)
Ruby on Rails (ROR)
RubyWhat are we looking for?
We are looking for hands-on coders who love what they do, have high attention to detail and are looking for challenging opportunities which involve building products from scratch. Someone who is proactive, and always keen to learn.
What will you be doing?
On a daily basis, some of your work will involve but is not limited to:
- Write clean, secure, and well-tested code
- Build tools and integrate systems to scale the effectiveness of the product
Work Culture at Merge:
Commitment to excellence - In every output, we produce as individuals and as a company, we have to strive for world-class quality. We’re making a change in the world. It will push us out of our comfort zones. We operate in a rapidly changing market and strive to deliver high-quality products faster than anyone else.
We get it done - We take ownership of what we do. Working here is about really, truly owning everything you do. There’s no such thing as “Not my job.” If you see a problem that needs solving, you can – and should – be the one to solve it
Requirements
Skills That Will Help You Excel At Merge
- You have 2 to 5 years of experience building highly reliable and scalable backend systems
- Experience in two or more languages. Go, Node.js, Python, or Java would be ideal.
- You have experience in high-throughput distributed systems and microservices
- Experience with AWS and CI/CD workflow
- Driven, and passionate about building products
- You take ownership of your code
- You have good communication skills in English
- You are familiar with security best practices
PythonJavascript
Amazon Web Services (AWS)A Fintech start up company that bridges the gap between the digital payments
and the micro-retailing industry of the market. A nexus for the B2B sector providing multi-utility services via an Android app, enabling the micro-retailers across India to revolutionize their business and thus providing them with an opportunity to generate more revenue by offering multiple micropayment and digital services at their offline store. We intend to leverage the mode of smartphone technology in the rural and urban markets across India, thus empowering micro-retailers and creating a sustainable self-employment for this segment.
Overall Competencies:
1. Tech Depth/Breadth/Problem Solving.
2. Design & Architecture (Code/Design review).
3. Team Management.
Leadership Competency:
- Managing & mentoring a team.
- Ability to deliver projects/sprints on time.
- Obsessed with quality: Design reviews, code reviews, testing (system/performance).
- Spending at least 50% time with hands-on coding while doing the above Programming.
Tech Competency:
- Hands-on with Python/Django/Flask.
- Knowledge of PHP & Laravel is a plus.
- Experience with any JavaScript framework (Angular / React ).
- Prior experience in micro-services based architecture.
- Good understanding of SQL (MySQL, Postgres, or similar).
- Good understanding of one no-SQL (MongoDB / DynamoDB etc).
- Comfortable producing and refactoring code without assistance.
- Can reason about the complexity of algorithms (time and space).
- Basic CI/CD and DevOps.
- Experience in Docker & Kubernetes.
- Design, QA, and Infrastructure.
- Knowledge of design patterns and cloud scaling.
- AWS & GCP experience. AWS is mandatory.
- Understands BDD/TDD/Performance/Security/Smoke testing/Unit Testing
- Understands REST principles and Microservices
- Understands version control & branching strategies
- Understands application security fundamentals and potential security risks
Education: Bachelors in Computer Science|
Go Programming (Golang)
Docker
PostgreSQL• Have strong experience in Go
• Have expertise in implementing microservices (using tools and technologies for messaging, GraphQL, GRPC, REST API, etc)
• Have implementation experience in data visualization (knowledge graph, for example), workflow or business process management
• Have expertise in design and development using PostresSQL
• Have experience with Containerization (Docker, Kubernetes, AWS)
• Experience of Cloud AWS based instances and services (e.g. EC2, S3, ELB, RDS, IAM, Route53, CloudFront, ElastiCache)
• Strong experience in enterprise application development, data structures, modern design patterns and microservices architecture
Java
Spring BootSenior Software Engineer - Backend: Innovation Accelerator
Cloudera is looking for a passionate Backend Software Engineer to play a key role in advancing Cloudera’s database offerings across multiple cloud providers. Since its origin, Cloudera has enabled several enterprise organizations to effectively manage and use their data using the on-premise infrastructure. We are now building software solutions that enable our customers to leverage cloud infrastructure to facilitate their growing data needs, and thereby accelerating Cloudera’s next stage of growth.
At Cloudera, our culture, our ethos, is centered on our values. We're here not only because we're experts at what we do, but also because we hold these values in common.
We are always moving forward. We believe in open. We are empathetic. We believe in We.
The Team
The team is a new and growing Innovation Accelerator that is exploring new ideas to expand the business. As part of the team, you will work on innovative projects that are fast paced and iterate quickly. You will learn about the modern data stack ecosystem. You will also be involved in every stage of the project - from ideation to delivering products and features to customers. Cloudera customers include the largest banks, telecom providers, and companies in pharma, financial services, retail, manufacturing, oil and gas and government.
You will:
-
Build robust and scalable data infrastructure software
-
Design and create services and system architecture for your projects
-
Contribute to and provide feedback to other team members
-
Improve code quality through writing unit tests, automation, and code reviews
-
Brainstorm and contribute ideas to our technology, algorithms and products
-
Work with product, design, customer-success teams to understand end-user requirements, formulate use cases, and translate those into effective technical solutions
-
Dive into challenging technical problems and successfully deliver results
-
And since we believe in high quality software engineering environments, you likely have:
-
Worked with a team of designers/engineers who reviewed each other's code/designs and held each other to an extremely high bar for quality of code/designs
-
Be comfortable providing estimates and sticking to estimates!
-
Written unit tests and testable code
-
Depended on continuous integration, and participated in build and release processes
-
Own the quality of the code you wrote even (especially!) when it is running in production
You have:
-
Bachelor's/Master’s degree in Computer Science or related field/experience
-
5+ years of experience building software
-
Experience building distributed systems/databases
-
Experience with one or more of the following:
-
Nodejs, Python, java
-
Cloud services like Amazon Web Services, Google Compute Platform, Microsoft Azure
-
Kubernetes
-
PythonJavaEximius is a micro-VC fund which invests into early-stage startups. One of our portfolio startup iTribe is looking for "Hustlers", "First Principle Thinkers", "Crazy and trips on creating products out of the box from scratch", "Outspoken", "unafraid of users ripping your product".
About iTribe:
iTribe is on a mission to make discussing finance from being a taboo topic to a dinner table topic, which means making "Bharat" financially literate and independent. iTribe is a social network which allows anyone to discover, discuss, vet ideas and seek advice from like-minded iTribe aims at making Finance simple, witty and fun for everyone
Founded in 2021 by IIT Kharagpur alumni to convert their own journey of becoming investors into a product to help billion users. An emerging startup backed by some of the most respected investors around the world.
Responsibilities
- Craft clean, manageable code, maintain proper documentation and code integrity
- Maintain quality and ensure 100% uptime
- Create, test and deploy the applications on production servers
- Continuously discover, evaluate, and implement new technologies and frameworks to maximize development efficiency
- Responsible for security and data protection.
- Working alongside Product managers to architect and design new features.
- Collaborate with the rest of the engineering team to launch new features.
- Unblock peers and keep all the internal and external teams informed about the progress of development
Requirements
- 2 - 5 years of experience in designing and developing Server side component (REST APIs, Micro service Architecture)
- Good understanding and strong in data structures and algorithms (Degree in computer science is an added advantage)
- OOP implementation experience with back-end programming languages (Ex: JavaScript, Python, Java, etc).
- Good to have experience with event driven architecture.
- Good understanding of databases such as MongoDB, PostgreSQL, MySQL.
- Well-versed with Software Development Life Cycle
- Demonstrate the ability to be a self-starter, learn and implement new technologies/ frameworks
- Excellent analytical and problem-solving skills
Why you should join iTribe?
- Building a product which is not done in decades.
- Be a part of the founding team and work directly with the founders.
- Competitive Salary
- ESOPs - ownership in the company
- Medical Insurances
- Subscriptions to premium platforms for learning
- Books that you ask for
- Friendly leave policy
JavaPaytm is looking for hands-on technologists, who will be responsible for architecting & designing new age mobile & web 3.0 products at Paytm.
Key Responsibilities
- Incumbent will be architecting our futuristic mobile & web 3.0 products and choose the best technologies, components and subsystems on different server side tech.
- Driving innovations in the product constantly to remain ahead of the curve.
- Serve as a thought leader and mentor on technical, architectural, design and related issues.
- Proactively identify architectural weaknesses and recommend appropriate solutions.
- Balance short-term versus long-term actions, strategic versus tactical requirements, while continuing to move forward towards the strategic vision.
- Collaborate with cross functional teams to solve complex problems and building products spanning across multiple teams to deliver end-to-end products & features.
- Estimates efforts, identify risks, devises and meets project schedules.
- Provide functional, design, and code reviews in related areas of expertise with-in team and cross-team.
- Mentor / coach engineers to facilitate their development and provide technical leadership to them.
Skills required
- MS or BS/B.Tech in computer science or equivalent experience from top college.
- Strong software design/development experience in building massively large scale distributed internet systems and products.
- Should have experience leading small teams.
- Hands-on experience in Advance Java and frameworks, Multithreading, collections and MySQL/NoSQL, golang, etc.
- Excellent data structure & algorithm and problem solving skills.
- Experience and knowledge of open source tools & frameworks, broader cutting edge technologies around server side development.
- Should be an active contributor to developer communities like Stackoverflow, Topcoder, Github, Google Developer Groups (GDGs).
- Superior organization, communication, interpersonal and leadership skills.
- Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast growing and start-up workplace.
- Must be a self-starter who can work well with minimal guidance and in fluid environment.
PythonGo Programming (Golang)
NodeJS (Node.js)
JavaPython
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon