11+ Data warehouse architecture Jobs in Bangalore (Bengaluru) | Data warehouse architecture Job openings in Bangalore (Bengaluru)

Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.

This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.

What you'll do

- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.

What you bring

We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.

- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.

Role and Responsibilities

Design, develop, implement, and document test changes in microservices-based applications. Initiate design reviews for new applications while adhering to the software development standards. Perform cross-functional training and facilitate information sharing among the team members. Recommend new software development technologies and development processes. Perform unit testing on all application functionalities along with supporting integration and load testing activities. Collaborate with the team members to ensure that the deliverables are on schedule. Participate in requirement gathering and functional specification activities. Assist System Analysts in translating business requirements and functional designs into technical designs. Resolve and mitigate production application issues. Work with other business and technology teams to resolve end-user inquiries. Establish, maintain, and ensure compliance with standards for application development, testing, and documentation.

Required Skills

5-8 years of experience as a Java/J2EE developer. 1-3 years of experience with Angular / React is desirable. 1-3 years of experience in using Spring and Spring Boot frameworks. Thorough knowledge of server-side development. Proven experience as a Full Stack Developer or similar role. Good understanding of web services (WSDL SOAP, RESTful). Hands-on experience in using Application Servers like WebSphere. Expertise in relational databases (Oracle, SQL Server). E-commerce domain knowledge is desirable. Prior experience in developing desktop and mobile applications. Familiarity with common stacks. Knowledge of multiple frontend languages and libraries, like HTML/ CSS, JavaScript, XML, jQuery. Experience in implementation of Microservices Experience with AWS (S3, SQS, SNS, ECS, EC2, ALB, API Gateway, Lambda, etc.) is highly desirable Good understanding of Docker & Kubernetes is highly desired. Familiarity with databases (MySQL, MongoDB, PostgresSQL), web servers (Apache), and UI/UX designs. Excellent communication and teamwork skills.

  

Responsibilities

Must have a Bachelor’s degree in computer science or equivalent Must have at least 6 years of experience as a Java developer

Must have at least 2 years of experience as a technical lead in a product company Must have worked in at least one NoSql solution like MongoDB Must have developed RESTful microservices in Springboot Should have extremely good knowledge of design patterns Should have worked in cloud computing platforms like AWS/GCP/Azure

What are we looking for
● You’ve been building scalable backend solutions for web applications.
● You have experience with any of these backend programming languages -- Python,
NodeJS or Java.
● You write an understandable, very high quality, testable code with an eye towards
maintainability.
● You are a strong communicator. Explaining complex technical concepts to designers,
support, and other engineers is no problem for you.
● You possess strong computer science fundamentals: data structures, algorithms,
programming languages, distributed systems, and information retrieval.
● You have completed a bachelor's degree in Computer Science, Engineering or related
field, or equivalent training, fellowship, or work experience.

As Sr. Java Engineer for Blume Global, you will:

• Work with product team to understand product vision and requirements
• Solve complex technical problems and perform the code reviews for junior team members.
• Produce deliverables at a consistently high rate and with consistently excellent quality
• Work with a team of engineering professionals to ensure the highest quality product delivery

As a member of our team, you will be responsible for insuring the successful launch of many product features.

Key responsibilities

• Work in a product based R&D team and collaborate with other teams to integrate.
• Write code that is of high quality and consistent with our coding standards
• Analyze highly complex business requirements, break the requirements to multiple applications; generate technical
specifications to design or redesign complex software components and applications
• Maintain best practices for development/code changes as needed
• Design and architect software applications
• Conducting code reviews and enforcing the quality standards
• Conducting the daily SCRUM meetings and removing the roadblocks
• Performance testing and tuning for scalability
• Develop quick proof of concepts to set the technical direction for rest of the team.
• Work with Devops and Automation team to develop automation strategy for your application.

Requirements

• Bachelor’s Degree (Masters preferred) in Computer Science or related field
• 3+ years of software development experience on web applications
• Experience in working in an onsite and offshore development model
• Must have hands-on design and development experience in Cloud (GCP/AWS/Azure), Kubernetes, Microservices,
Java, J2EE, Spring/Boot, Hibernate, JUnit and Integration with front end via rest interfaces.
• Must have Hands-on experience in Multi-threading, Non-blocking IO, Kafka, JMS
• Strong integration background required. Experience with Microservices, REST, JSON and APIs is required
• Experience with as many of the following is highly desirable: Tomcat, Node.js, XML, XSLT, XPath, Web Services,
MongoDB, MYSQL, and query performance tuning
• Experience with code management and continuous integration techniques and tools such as Maven, Gradle, Github,
JMeter, Jenkins, NPM etc. is highly desirable
• Experience building complex software systems that have been successfully delivered to customers
• Strong Computer Science fundamentals and working knowledge in data structures, algorithms, problem-solving and
complexity analysis
• Knowledge of professional software engineering practices and best practices for the full software development life
cycle (SDLC), including coding standards, code reviews, source control management, build processes, testing, and
operations
• Proven ability to troubleshoot issues in production including root cause analysis
• Self-directed and capable of working effectively in a highly innovative and fast-paced environment
• Experience with Agile software development in a UNIX/Linux environment
• Experience with system architecture/design



Qualifications

• Passionate about technology and technical challenges of all types excite you
• Eagerness to learn and learn fast, enjoy working in a fast-paced environment
• Ability to develop detailed design and deliver a scalable implementation.
• Mentor developers in analysis, design, coding and unit testing techniques
• Motivated self-starter and team player; you inspire others to achieve great things
• Driven to provide the best customer experience via technology
• Supply chain industry experience is preferred
• Proven ability to work effectively in a cross-functional team
• Strong problem solving and troubleshooting skills with the ability to come up with creative solutions for different
problems
• Strong written/spoken communication skills
• Experience with distributed systems operating in a scalable/high volume environment
• Ability to drive innovation

• Strong experience in Java Development
• Deep expertise and hands-on experience with Web Applications
• Experience in programming languages such as HTML, CSS, JavaScript, JQuery, React JS, and API.
• Expertise in Java, Spring Boot is an added advantage.
• Hands-on design experience with Web Services (REST, SOAP, etc ..).
• Strong grasp of security principles.

Abilities:

• Developer with  strong ability to develop web application using Java and ReactJS
• Should be able to code, design, and implement
• Maintain code integrity and organization

 

Myntra’s Engineering team builds the technology platform that empowers our customers’ shopping experience and enables the smooth flow of products from suppliers to our customers’ doorsteps. We work on areas such as building massive-scale web-applications, engaging user-interfaces, big-data analytics, mobile apps, workflow systems, inventory-management etc. We are a small technology team where each individual makes a huge impact. You will have the opportunity to be part of a rapidly growing organization and gain exposure to all the parts of a comprehensive ecommerce platform.

You will be a part of: Supply Chain Management (SCM)

Myntra-Jabong Supply Chain Management systems form the backbone of our core business and customer experience. Any business runs on a simple construct of Demand (Consumer) and Supply (Producer). However, a set of complex and intricate methods, processes and systems connect the demand with supply in a deterministic and predictable way. These methods, processes and systems collectively form the Supply Chain for the business. The multi-billion-dollar Myntra-Jabong business fundamentally rests on a set of highly scalable, robust and intelligent Supply Chain Management systems that solve real-world problems of predicting the demand from millions of our customers, for a combination of millions of products from our product catalogue, and intelligently connecting that demand to thousands of national and international sellers or suppliers using a set of advanced homegrown tech products that we build and manage.

SCM engineering employs new-age technologies such as Distributed Computing constructs, Machine Learning, Deep Learning, Computer Vision, Artificial Intelligence; scalable data stores in Mongo, Redis, Cassandra, MySQL, Elastic Search, Solr; scalable programming constructs in Node.js, GoLang, Java; JavaScript, Python, and new-age frameworks such as ReactJS and ReactNative to solve some of the hardest problems in the e-commerce business
with world-class software products.

The SCM engineering at Myntra-Jabong operates within two distinct verticals: Supply-chain Outbound (Fulfilment systems) & Supply-chain Inbound (Selection systems, Partner experience).

Your Responsibilities:

● Own the architecture of Myntra’s new product platforms to drive business results
● Be a visible leader to drive and own the architecture and design of some of the most advanced & complex software systems / products in the industry to create company wide impact.
● Help build, mentor and coach a team of very talented Engineers, Architects, Quality engineers, System Operation Engineers and DevOps engineers in architectural and design best practices.
● Be an operational and technical leader with a passion for distributed systems, cloud service
development, deployment and delivery.
● Be accountable for the design, for the ease of evolution, quality of the systems, performance, scaling, and availability characteristics and limitations of the systems.
● Envision and develop the long-term architectural direction, with emphasis on platforms/ reusable components while adopting a nimble delivery process. Establish structures and processes that ensure a high level of quality and reliability and extensibility of deliverables.
● Drive the creation of next generation extensible web, mobile and fashion commerce platforms, security protocols, customisation and tools to support continuous scaling, internationalization and platform extensions
● Drive code and design reviews of components / systems / products in scope and drives the
architectural governance for them
● Set directional paths for the teams/department for adoption of new technology stacks for solving business problems
● Be a very visible representative of multiple technology domains and represent Myntra in external technical forums
● Work with product management, business stakeholders and other engineering leaders to help define mid-term, long-term roadmaps and shape business directions
● Initiate and deliver leadership training within the engineering organisation, including training new managers, and drive the growth of leaders to create a strong leadership bench

Desired Skills and Experience

● 12 - 16 years of experience in software product development
● Must have a degree in Computer Science or related field
● A solid engineer at heart with excellent abstraction, coding and system design skills
● Proven track record of leading the architecture and delivery in a startup/e-commerce ecosystem within a high growth & matrix environment
● Successfully architected and led technology for consumer-facing products in the global market along with being an efficient proficient problem-solver who envisions business and technical perspectives to develop workable solutions
● Must have exposure to leading product development end-end (portfolio to delivery, re-architectures)
● Strong hands-on technology experience building and running large scale systems handling
multi-million sessions/transactions per day
● Solid experience in large scale Database systems like RDBMS & NoSQL stores
● Strong design/development experience in building massively large scale distributed internet systems and products
● Excellent programming skills in Java/GO and expertise in multi-threading and performance-oriented programming
● Solid experience in Distributed systems, highly scalable products, performance & reliability
● Excellent understanding of processing platforms and queues
● Experience and knowledge of open source software, frameworks and broader cutting edge
technologies around server-side development in Java
● Strong understanding of object-oriented programming, concurrency and fundamentals of
computer-science

Data Platform engineering at Uber is looking for a strong Technical Lead (Level 5a Engineer) who has built high quality platforms and services that can operate at scale. 5a Engineer at Uber exhibits following qualities: 

 

• Demonstrate tech expertise › Demonstrate technical skills to go very deep or broad in solving classes of problems or creating broadly leverageable solutions. 
• Execute large scale projects › Define, plan and execute complex and impactful projects. You communicate the vision to peers and stakeholders.
• Collaborate across teams › Domain resource to engineers outside your team and help them leverage the right solutions. Facilitate technical discussions and drive to a consensus.
• Coach engineers › Coach and mentor less experienced engineers and deeply invest in their learning and success. You give and solicit feedback, both positive and negative, to others you work with to help improve the entire team.
• Tech leadership › Lead the effort to define the best practices in your immediate team, and help the broader organization establish better technical or business processes.

What You’ll Do

• Build a scalable, reliable, operable and performant data analytics platform for Uber’s engineers, data scientists, products and operations teams.
• Work alongside the pioneers of big data systems such as Hive, Yarn, Spark, Presto, Kafka, Flink to build out a highly reliable, performant, easy to use software system for Uber’s planet scale of data. 
• Become proficient of multi-tenancy, resource isolation, abuse prevention, self-serve debuggability aspects of a high performant, large scale, service while building these capabilities for Uber's engineers and operation folks.

 

What You’ll Need

• 7+ years experience in building large scale products, distributed systems in a high caliber environment.
• Architecture: Identify and solve major architectural problems by going deep in your field or broad across different teams. Extend, improve, or, when needed, build solutions to address architectural gaps or technical debt.
• Software Engineering/Programming: Create frameworks and abstractions that are reliable and reusable. advanced knowledge of at least one programming language, and are happy to learn more. Our core languages are Java, Python, Go, and Scala.
• Platform Engineering: Solid understanding of distributed systems and operating systems fundamentals such as concurrency, multithreading, file systems, locking etc.
• Execution & Results: You tackle large technical projects/problems that are not clearly defined. You anticipate roadblocks and have strategies to de-risk timelines. You orchestrate work that spans multiple teams and keep your stakeholders informed.
• A team player: You believe that you can achieve more on a team that the whole is greater than the sum of its parts. You rely on others’ candid feedback for continuous improvement.
• Business acumen: You understand requirements beyond the written word. Whether you’re working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, your attention to details leads to a delightful user experience.