Automation Engineer

About the Role

The Dremio India team owns the development of the cloud infrastructure and services that power Dremio's Data Lake Engine. With focus on query performance optimization, supporting modern table formats like Iceberg, Deltalake and Nessie, this team provides endless opportunities to to define the products for next generation of data analytics.

In this role, you will get opportunities to impact high performance system software and scalable SaaS services through application of continuous performance management. You will plan, design,  automate, execute the runs followed by deep analysis and identification of key performance fixes in collaboration with developers. Open and flexible work culture combined with providing employees ownership of the work they do will help you develop as a leader. The inclusive culture of the company will provide you a platform to bring fresh ideas and innovate. 

Responsibilities

• Deliver end to end performance testing independently using agile methodologies
• Prepare performance test plans, load simulators and test harnesses to thoroughly test the products against the approved specifications
• Translate deep insight of architecture, product & usage into an enhanced automated performance measurement & evaluation framework to support continuous performance management.
• Evaluate & apply the latest tools, techniques and research insights to drive improvements into a world-class data analytics engine
• Collaborate with other engineering and customer success functions to simulate customer data and usage patterns, workloads to execute performance runs, identify and  fix customer issues and make sure that customers get highly performant, optimized and scalable Dremio experience 
• Analyze performance bottlenecks, root cause issues, file defects, follow up with developers, documentation and other teams on the resolution.
• Publish performance benchmark report based on test runs in accordance with industry standards
• Regularly communicate leadership team with an assessment of the performance, scalability, reliability, and robustness of products before they are exposed to customers
• Analyze and debug performance issues in customer environments.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Actively participate in code and design reviews to maintain exceptional quality and deepen your understanding of the system architecture and implementation

Basic Requirements

• B.Tech/M.Tech/Equivalent in Computer Science or a related technical field 
• 8+ years of performance automation engineering experience on large scale distributed systems
• Proficiency in any of Java/C++/Python/Go and automation frameworks
• Hands on experience in integration performance automation using CI/CD tools like Jenkins
• Experience in planning and executing performance engineering tasks to completion and taking ownership of performance epics during a set of sprints.
• Experience in designing, implementing, executing and analyzing automated performance tests for complex, production system software.
• Experience in analyzing performance bottlenecks in system, performing root cause analysis, and following issue resolution workflow to tune the system to provide optimized performance
• Ability to derive meaningful insights from the collected performance data, articulate performance findings effectively with senior team members to evaluate design choices.
• Experience with database systems internals, query optimization, understanding and tuning query access plans, and query execution instrumentation.
• Hands on experience of working projects on AWS, Azure and Google Cloud Platform 
• Understanding of distributed file systems like S3 or ADLS or HDFS and HIVE
• Ability to create reusable components to automate repeatable, manual activities
• Ability to write technical reports and summary and present to leadership team
• Passion for learning and delivering using latest technologies
• Excellent communication skills and affinity for collaboration and teamwork
• Passion and ability to work in a fast paced and agile development environment.

Preferred Qualification 

• Hands on experience of multi-threaded and asynchronous programming models
• Hands on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems