11+ Data warehouse architecture Jobs in Bangalore (Bengaluru) | Data warehouse architecture Job openings in Bangalore (Bengaluru)

Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.

This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.

What you'll do

- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.

What you bring

We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.

- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.

Responsibilities

Must have a Bachelor’s degree in computer science or equivalent Must have at least 6 years of experience as a Java developer

Must have at least 2 years of experience as a technical lead in a product company Must have worked in at least one NoSql solution like MongoDB Must have developed RESTful microservices in Springboot Should have extremely good knowledge of design patterns Should have worked in cloud computing platforms like AWS/GCP/Azure

Lead Software Engineer - Backend

It is evolving the way people discover the world by connecting them with exceptional experiences in their city at the push of a button. We are building a magical platform that gets everyone to head out and have fun in a matter of seconds; no matter where you are and what you want to do. We are combining a delightful product experience, data-driven decisions, sophisticated supply side logistics network, and world-class operations to solve a huge basic human problem: how do we have a good time?

We’re growing rapidly with over $200M in annualized sales, 150,000 monthly transactions and profitable unit economics. We are backed by some of the finest investors in Silicon Valley & India. 

We like to solve real-world problems in the simplest, most elegant manner possible. We’re looking for a QA Lead with the ability and passion for building solutions to people-centered problems that are created at the intersection of human behavior and technology. You should also be capable of building and mentoring a fast-growing passionate, young, and talented team. We love folks who have a sense of humor and know how to have fun.Dream, build and iterate. That's our mantra. Because good just isn't good enough.

👩‍💻 The Role

• Full responsibility of designing and building core modules on the application and infrastructure layer.
• Lead a fast-growing team of young, passionate, talented and fun loving superstars.
• Solve challenging architectural and design problems.
• Get your hands dirty with clustering, replication, databases, build systems and infrastructure automation etc.
• Be responsible for building concurrent, performant and scalable services which will power the entire Headout ecosystem.
• Build and contribute to open-source libraries and components.

🌟 Our Dream Engineer

• A penchant for learning and building with new technologies and frameworks.
• You love working with people and have worked in a lead position in the past.
• A knack for writing the most performance optimized code along with it being modular and scalable.
• No challenge is too big to solve; love thinking product and excited to ideate & build stuff all by yourself.
• You're interested in being an early employee at a growing company, with the influence and responsibility that entails.
• You have broad and deep knowledge across a variety of contemporary technologies.

💝 We like

• Strong CS fundamentals, good working knowledge of classic algorithms and data structures.
• 2+years experience developing server-side technologies using any language or framework.
• Excellent communication, collaboration and people management skills.
• Experience working with Spring, Relational Databases, Concurrent Programming, NoSQL flavors, AWS.
• Experience designing scalable, fault-tolerant systems and databases.
• Experience with setting setting up systems and infrastructure.
• Solid understanding of how the web works and its underlying communication protocols.
• People who can't live without solving that algorithm problem that they just stumbled upon.
• People who will give up anything to squeeze in that last bit-level performance.
• Anything else than can surprise us.
• Nice to Haves: An interest in travel, local experiences & hospitality.

Key Responsibilities: 

• Rewrite existing APIs in NodeJS. 
• Remodel the APIs into Micro services-based architecture. 
• Implement a caching layer wherever possible. 
• Optimize the API for high performance and scalability. 
• Write unit tests for API Testing.
• Automate the code testing and deployment process.

 

Skills Required: 

• At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
• Excellent hands-on experience using MySQL or any other SQL Database. 
• Good knowledge of MongoDB or any other NoSQL Database. 
• Good knowledge of Redis, its data types, and their use cases. 
• Experience with graph-based databases like GraphQL and Neo4j. 
• Experience developing and deploying REST APIs. 
• Good knowledge of Unit Testing and available Test Frameworks. 
• Good understanding of advanced JS libraries and frameworks. 
• Experience with Web sockets, Service Workers, and Web Push Notifications. 
• Familiar with NodeJS profiling tools. 
• Proficient understanding of code versioning tools such as Git. 
• Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
• Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
• Experience building a large scale social or location-based app.

Job Details: 

• Three plus years of experience in IT systems analysis and application program development
• Experience in an Object Oriented Programming language such as Java is a must
• The candidate must be a hands-on coder doing active development
• Extensive experience programming in Java Application Development & RESTful API
• Experience in AWS Cloud technologies is optional but good to have
• Proficient in Object-Oriented Programming (OOP) concepts, workflows, and design patterns

We focus on client adoption of disruptive technologies, technology architecture and providing specialized skills related to integration, custom software engineering, testing, application modernization, agile and more. We help our clients with the most complex projects including working in open web platforms, DevOps platforms as well as intelligent Computing and Architecture enhancement.

 

We are looking for hands on, smart thinking Applications developer to join our fast-growing team of talented professionals. You will have the opportunity to work on large enterprise solutions and deliver solutions that deliver business performance for our customers.

 

WORK YOU’LL DO

• Design and develop microservices/APIs using either Java/Spring boot, ISTIO, Kubernetes, Docker, CI / CD Pipelines
• You would scale micro services using Kafka or similar messaging systems.
• Collaborate with clients, architects, and application architectures to understand the operational objectives and purpose of the future system integration.
• Understand the points of integration between the different systems and highlight the potential risks associated with the delivery of solutions
• Collaborate with Functional Designers and Developers in order to find best solutions
• Produce detailed functional and technical specifications.
• Assist in producing solutions with threat assessments and associated security awareness.
•  

WHAT WE ARE LOOKING FOR

• 5- 8 years of hands-on experience designing and developing microservices using either Java/Spring Boot
• 3-5 years of experience with system integration
• Minimum of 3 years of relevant experience with API concepts and technologies such as REST, JSON, XML, SOAP, YAML, GraphQL, and Swagger
• Experience developing within agile methodology using CI/CD pipeline
• Experienced in 3-tier, n-tier, cloud computing, microservices architectures and SOA.
• Good knowledge of integration architectures
• Experience supporting and/or implementing complex integration projects
• Excellent client management skills
• Experience with Data modelling would be an asset

 

QUALIFICATIONS

• Experience of working in an Agile Environment
• Ability to drive design from Stories and Requirements
• Adept at UML, Design Patterns, Reusable Services Development,
• Knowledge on Scaling Microservices

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

 

Top Skills

 

• You write high quality, maintainable, and robust code, often in Java or C++/C/Python/ROR/C#
• You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
• You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

 

• You solve problems at their root, stepping back to understand the broader context.
• You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
• You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
• You recognize and use design patterns to solve business problems.
• You understand how operating systems work, perform and scale.
• You continually align your work with Amazon’s business objectives and seek to deliver business value.
• You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
• You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
• You communicate clearly with your team and with other groups and listen effectively.

 

Skills & Experience

 

• Bachelors or Masters in Computer Science or relevant technical field.
• Experience in software development and full product life-cycle.
• Excellent programming skills in any object oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
• Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
• Proficiency in SQL and data modeling.

We have urgent opening for Java Developer with leading IT Industry for Chennai,Bangalore and Gurgaon locations

Notice Period: Immediate to 60 Days

Below is the JD

 Expert: Micro services. Core Java and Spring framework (MVC, Boot).
 Practitioner: IT experience in Agile, Test Driven Development approach and software delivery best practice. Strong design and technical skills. Continuous integration/deployment pipelines.
 Desirable: ReactJS, Experience with Databases. Preferably Oracle. Knowledge of working in cloud environment. Preferably PCF and AWS.

Joining location will be either Gurgaon, Chennai & Bangalore only.

Skills Mandatory Skills 
JAVA Micro service Java8+, Spring Boot, Micro services Devops, CI/CD 40

We are looking for an experienced Back-end developer to join our IT team! As a Back-end Developer, you will be responsible for the server-side web application logic as well as for the integration of the front-end part. 

• Be involved and participate in the overall application lifecycle
• Main focus on coding and debugging
• Collaborate with Front-end developers 
• Define and communicate technical and design requirements
• Provide training, help and support to other team members
• Build high-quality reusable code that can be used in thew future
• Develop functional and sustainable web applications with clean codes
• Troubleshoot and debug applications
• Learn about new technologies
• Stay up to date with current best practices
• Conduct UI tests and optimize performance
• Manage cutting-edge technologies to improve applications
• Collaborate with multidisciplinary team of designers, developers and system administrators
• Follow new and emerging technologies

Responsibilities Include:
You will break down business opportunities and problems into software solutions. You will work closely with the CTO to help product and marketing stakeholders distill the product vision and roadmap, into a technology vision. You will be responsible for the evolution of an already bleeding-edge highly distributed systems at the back-end, and would need to work with front-end architects to come up with the best user experience for the gaming platform. You will be required to make decisions quickly, and work under strict timelines. You would lead technology strategy through analysis of market trends and product requirements. You would help set coding guidelines and help bring the most modern tools to keep engineering processes most efficient.
Requirements:
● B.E/MS in Computer Science or equivalent.
● 10+ years or more of progressive software technology experience with at least 3 years
in an architectural role.
● Completely hands on with technology and architecture. Start-up experience is a huge
plus.
● Ability to quickly prototype and demonstrate technology value adds and educate + drive
adoption within the extended technology team
● Excellent and robust understanding of scalable product system architecture(s),
platforms and core technologies
● Demonstrated problem-solving and leadership skills to pursue correct engineering
process in adverse conditions. Ability to embrace and demonstrate leadership beyond
ownership
● Work with engineering leadership to setup and manage processes.
● Track record of thought leadership and out of the box thinking in the technology arena.
● Ability to work efficiently in an entrepreneurial and in a start-up environment
● A Java/Spring/Akka, Javascript or Golang rockstar.
● Deep and hands on knowledge of some of these technologies - MySQL, NodeJS,
message brokers such as Kafka/RabbitMQ, NoSQL datastore such as Mongo, Cassandra,
Arango, distributed caches such as Redis/memcached, container technology such as
Docker and Kubernetes etc.
● Great proficiency in distributed systems design, with an ability to make the right
trade-offs for creating future-proof solutions.