Software Development Engineer I / II /III

Key Responsibilities:

• Rewrite existing APIs in NodeJS.
• Remodel the APIs into Micro services-based architecture.
• Implement a caching layer wherever possible.
• Optimize the API for high performance and scalability.
• Write unit tests for API Testing.
• Automate the code testing and deployment process.

Skills Required:

• At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds.
• Excellent hands-on experience using MySQL or any other SQL Database.
• Good knowledge of MongoDB or any other NoSQL Database.
• Good knowledge of Redis, its data types, and their use cases.
• Experience with graph-based databases like GraphQL and Neo4j.
• Experience developing and deploying REST APIs.
• Good knowledge of Unit Testing and available Test Frameworks.
• Good understanding of advanced JS libraries and frameworks.
• Experience with Web sockets, Service Workers, and Web Push Notifications.
• Familiar with NodeJS profiling tools.
• Proficient understanding of code versioning tools such as Git.
• Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms.
• Should be a fast learner and a go-getter — without any fear of trying out new things Preferences.
• Experience building a large-scale social or location-based app.

Who We are

At e6data (https://e6x.io/">https://e6data.io) we’re building core algorithms that makes querying 25 - 200X more performant (i.e. faster and/or cheaper) than every other analytics platform in the world. This results in billions of dollars of value unlocked across faster analytics, savings on compute / infra, and new use cases becoming possible.

Our core team has 100+ years of combined experience and 10+ patents across diverse but complementary disciplines like real time databases, time series databases, SQL OLAP engines, distributed computing platforms, stream processing, and log analytics. Two of the founding team are second time founders with past exits.

We are passionate about solving the deepest and most important problems in computer science, and believe in making our technology available to customers regardless of their location, size, or budget. Our vision is for e6data to power every analytical workload in the world - regardless of deployment scenario (cloud, on-premise, edge), across every use case (end user queries, ETL / data pipelines), and every latency requirement (batch, streaming / real time).

What you'll do?

• Write awesome code
• The focus will be on performance of our data platform
• Identify tactical and long-term product improvements (could be code, script, etc.)
• Responsible for Planning and executing Metadata and Governance tool supports
• Build our internal Data Platform using exdata
• Adding scalable functionality to the system for new features like UDF's, sql functions etc

What are we looking for?

• Worked with Python for a minimum of 2 years
• Well versed with Django REST framework
• Knowledge of document based data stores like MongoDB
• Strong team player
• A passion for continuous learning and growth (both at a personal and team level)
• Experience (or enjoys) working in a startup will be an added advantage

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

Top Skills

• You write high quality, maintainable, and robust code, often in Java or C++/C/Python/ROR/C#
• You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
• You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

• You solve problems at their root, stepping back to understand the broader context.
• You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
• You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
• You recognize and use design patterns to solve business problems.
• You understand how operating systems work, perform and scale.
• You continually align your work with Amazon’s business objectives and seek to deliver business value.
• You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
• You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
• You communicate clearly with your team and with other groups and listen effectively.

Skills & Experience

• Bachelors or Masters in Computer Science or relevant technical field.
• Experience in software development and full product life-cycle.
• Excellent programming skills in any object oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
• Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
• Proficiency in SQL and data modeling.

What you need to have:

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team