Be Part Of Building The Future
Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.
About the Role
The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.
Responsibilities & ownership
- Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
- Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
- Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
- Lead the team to solve complex and unknown problems
- Solve technical problems and customer issues with technical expertise
- Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
- Mentor other team members for high quality and design
- Collaborate with Product Management to deliver on customer requirements and innovation
- Collaborate with Support and field teams to ensure that customers are successful with Dremio
Requirements
- B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
- Fluency in Java/C++ with 8+ years of experience developing production-level software
- Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
- 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
- Hands-on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
- Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
- Passion for learning and delivering using latest technologies
- Ability to solve ambiguous, unexplored, and cross-team problems effectively
- Hands on experience of working projects on AWS, Azure, and Google Cloud Platform
- Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud)
- Understanding of distributed file systems such as S3, ADLS, or HDFS
- Excellent communication skills and affinity for collaboration and teamwork
- Ability to work individually and collaboratively with other team members
- Ability to scope and plan solution for big problems and mentors others on the same
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
About Dremio
About
Connect with the team
Similar jobs
About the role
Checking quality is one of the most important tasks at Anakin. Our clients are pricing their products based on our data, and minor errors on our end can lead to our client's losses of millions of dollars. You would work with multiple tools and with people across various departments to ensure the accuracy of the data being crawled. You would setup manual and automated processes and make sure they run to ensure the highest possible data quality.
You are the engineer other engineers can count on. You embrace every problem with enthusiasm. You remove hurdles, are a self-starter, team player. You have the hunger to venture into unknown areas and make the system work.
Your Responsibilities would be to:
- Understand customer web scraping and data requirements; translate these into test approaches that include exploratory manual/visual testing and any additional automated tests deemed appropriate
- Take ownership of the end-to-end QA process in newly-started projects
- Draw conclusions about data quality by producing basic descriptive statistics, summaries, and visualisations
- Proactively suggest and take ownership of improvements to QA processes and methodologies by employing other technologies and tools, including but not limited to: browser add-ons, Excel add-ons, UI-based test automation tools etc.
- Ensure that project requirements are testable; work with project managers and/or clients to clarify ambiguities before QA begins
- Drive innovation and advanced validation and analytics techniques to ensure data quality for Anakin's customers
- Optimize data quality codebases and systems to monitor the Anakin family of app crawlers
- Configure and optimize the automated and manual testing and deployment systems used to check the quality of billions of data points of over 1000+ crawlers across the company
- Analyze data and bugs that require in-depth investigations
- Interface directly with external customers including managing relationships and steering requirements
Basic Qualifications:
- 2+ years of experience as a backend or a full-stack software engineer
- Web scraping experience with Python or Node.js
- 2+ years of experience with AWS services such as EC2, S3, Lambda, etc.
- Should have managed a team of software engineers
- Should be paranoid about data quality
Preferred Skills and Experience:
- Deep experience with network debugging across all OSI layers (Wireshark)
- Knowledge of networks or/and cybersecurity
- Broad understanding of the landscape of software engineering design patterns and principles
- Ability to work quickly and accurately in a highly stressful environment during removing bugs in run-time within minutes
- Excellent communicator, both written and verbal
Additional Requirements:
- Must be available to work extended hours and weekends when needed to meet critical deadlines
- Must have an aversion to politics and BS. Should let his/her work speak for him/her.
- Must be comfortable with uncertainty. In almost all the cases, your job will be to figure it out.
- Must not be bounded to comfort zone. Often, you will need to challenge yourself to go above and beyond.
We are a Fintech Start up targeting to capture $ 900 BN consumer payment &lending opportunity. We are building platform of the future in which the offline / online merchants would be able to expand their consumer base. We also empower merchants to collect payment digitally and help build their identity through our offerings.
Consumers would be able to make their purchase decisions and would get the options to convert their purchases in to easy EMIs
The founders brings over 4 decade of banking & financial services experience with strong market connect to bring required resources (like Customer, Capital, relevant business team etc.). Detailed business model can discussed during the meeting process.About you
You are passionate, a strong technical contributor, and an emerging leader. You have a proven track record of creating reliable, scalable, and high-performance products, building large-scale distributed systems
Responsibilities
- Developing front end website architecture
- Designing user interactions on web pages
- Developing back end website applications
- Creating servers and databases for functionality
- Ensuring cross-platform optimization for mobile phones
- Ensuring responsiveness of applications
- Working alongside graphic designers for web design features
- Seeing through a project from conception to finished product
- Designing and developing APIs
- Meeting both technical and consumer needs
- Staying abreast of developments in web applications and programming languages.
Requirements
- Java 8 and above
- Experiencein databases Mongodb, MySQL, SQL Oracle etc.
- Working knowledge in IOC Container / Spring boot& ORM, Spring Security, AOP JMS.
- Experience in Microservices, Eureka, Zuul, Ribbon would be an added advantage.
- Experience with build tools like Ant, Gradle or Maven and troubleshoot build issues.
- Should have exposure to GIT, Jira etc..
- Develops resealable frameworks/components and POCs based on Product Architecture RoadMap.
- Uses best practices during web services implementations and works with the REST
- Strong analytic problem-solving skills.
- Proactive work ethic.
As Back end developer, we expect you to be motivated in solving real-life complex problems and create compelling experiences for our Resellers. Being a small company we have a culture of creative problem solving, intellectual design, fast-paced development, and passionate product delivery. Enhance or build Restful web services for our mobile app.
Responsibilities:
- Develop server-side components, REST APIs
- Assume ownership for existing and new modules including design, development, and unit testing for enhancements of existing modules and development of new modules.
- Analyse problems logically and exercise sound judgment in defining, evaluating, and solving difficult technical and operational problems where solutions may be of a precedent-establishing nature.
- Lead the design and architectural improvements
- Participate and collaborate with team members in design discussions, determines areas of complexity, potential risks to successful implementation, suggest enhancements to architecture, implement POCs, and enhance application.
- Reduce technical debt with quality coding
Requirements:
- A solid grounding in Computer Science fundamentals (based on a BS or MS in CS or related field) from IITs and Premier Engineering College.
- Excellent Object Orientation, coupled with excellent problem solving and debugging skills.
- Highly skilled at Java and related technologies, including Java Frameworks like Spring-boot or Drop wizard, RESTful web services, JSON, Servlet, JSP, MySQL, MongoDB, Kafka, AWS Solr.
- Must have hands-on experience in building scalable and secure back end systems.
- Have hands-on experience with systems that are asynchronous, RESTful and demand concurrency
- Good to have knowledge of best software engineering practices for all stages of the software development life cycle, including coding standards, code reviews, testing, deployment.
Essential duties and responsibilities include the following. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
- Lead a software development project and manage software development from inception to delivery.
- Be both a highly technical hands-on coder and effective at mentorship.
- Coach and mentor team members for skill development and experience.
- Establish goals and objectives for the team that aligns with the overall roadmap and delivery schedules.
- Works to increase team efficiency and effectiveness in order to achieve long term goals.
- Participates in hiring of new team members.
- Performs any HR related tasks.
- Analyze performance and develop improvements to performance of web application.
- Perform upgrades to 3rd party libraries and tools used by the web application.
- Implement new web application software features and products following best practices such as authoring of unit tests, writing maintainable code, applying established patterns and algorithms.
- Specialize in client or server-side web application development as a member of a project team. Preference for familiarity with the full technical stack.
- Develop software to support internal initiatives, tools, update framework and application functionality.
- Work as part of an Agile SCRUM team in the planning, scoping, estimation and execution of technical solutions.
- Work within a wide range of new and legacy code and technologies in a mature codebase • Other duties as assigned.
Qualifications
To be considered for and to perform this job successfully, an individual must be able to perform each essential duty and responsibility satisfactorily. The requirements listed below are representative of the knowledge, skill and/or ability required.
Qualifications include:
- 7+ years for experience in developing highly scalable, reliable, secure web applications.
- Experience with Javascript (preferably TypeScript), Node.js and React.js.
- Experience or willingness with developing serverless architecture.
- Experience designing data persistence and caching concepts using both SQL and NoSQL DBMS (MySQL, DynamoDB, Redis, etc.)
- Experience testing software in alignment with the Test Pyramid.
- Strong CS fundamentals including familiarity with data structures and especially the asynchronous challenges that face JavaScript developers today.
- Experience owning the responsibility for delivering frontend and backend work as well as coordinating with QA, Design, and PM.
- Willingness to accept responsibility not only for your own work but the work of the team as a whole.
- Excellent communication skills, both verbal and written.
- Enjoy being part of a highly collaborative, remote-friendly environment.
- One year of experience using AWS services, such as Lambda, SES, SQS, EC2, RDS, ELB’s and have knowledge of VPC’s (AWS and/or RightScale knowledge a plus.
- 1years of experience in product or SaaS development.
- Experience with modern front-end frameworks.
Required Technical Skills:
- Java (highly capable)
- SQL (highly capable)
- Strong knowledge of software best practices, build processes, IDEs, database tools (e.g. SQL Developer, SQL Management Studio)
- Strong knowledge of source code control systems (GIT)
- Confident with Windows, Linux, Unix operating systems including command line
- Working knowledge of JIRA
Beneficial Technical Skills:
- .Net
- C
- Javascript
- Experience in test management and test execution
- Experience of Agile development methods
Additional Skills and Behaviour Required
- Experience of full software development lifecycle
- Considers competing solutions and evaluates options to create the best outcome in all aspects of the role.
- Willingness to takes ownership of whole project and engineers assigned.
- Confident to make suggestions and recommendations for improvements.
- Excellent written and verbal communication skills and ability to build good rapport
- Fluency in English, both written and oral
- Collaborates with others to achieve objectives and ensure information flow
- Seeks assistance and feedback as appropriate
Education
- Bachelor's degree (or equivalent) in Computer Science or Engineering or other relevant discipline (MCA, MSc in Computer Science etc.)