Site Reliability Engineer

Roles and Responsibilities

• Managing Availability, Performance, Capacity of infrastructure and applications.
• Building and implementing observability for applications health/performance/capacity.
• Optimizing On-call rotations and processes.
• Documenting “tribal” knowledge.
• Managing Infra-platforms like Mesos/Kubernetes,CICD,Observability (Prometheus/New Relic/ELK),Cloud Platforms (AWS/ Azure),Databases,Data Platforms Infrastructure
• Providing help in onboarding new services with production readiness review process.
• Providing reports on services SLO/Error Budgets/Alerts and Operational Overhead.
• Working with Dev and Product teams to define SLO/Error Budgets/Alerts.
• Working with Dev team to have in depth understanding of the application architecture

          and its bottlenecks.

• Identifying observability gaps in product services, infrastructure and working with stake

          owners to fix it.

• Managing Outages and doing detailed RCA with developers and identifying ways to

          avoid that situation.

• Managing/Automating upgrades of the infrastructure services.
• Automate toil work.
•  

Experience & Skills

• 6+ years of total experience
• Experience as an SRE/DevOps/Infrastructure Engineer on large scale microservices and infrastructure.

• A collaborative spirit with the ability to work across disciplines to influence, learn, and

         deliver.

• A deep understanding of computer science, software development, and networking principles.
• Demonstrated experience with languages, such as Python, Java, Golang etc.
• Extensive experience with Linux administration and good understanding the various

linux kernel subsystems (memory, storage, network etc).

• Extensive experience in DNS, TCP/IP, UDP, GRPC, Routing and Load Balancing.
• Expertise in GitOps, Infrastructure as a Code tools such as Terraform etc.. and
• Configuration Management Tools such as Chef, Puppet, Saltstack, Ansible.
• Expertise of Amazon Web Services (AWS) and/or other relevant Cloud Infrastructure

solutions like Microsoft Azure or Google Cloud.

• Experience in building CI/CD solutions with tools such as Jenkins, GitLab, Spinnaker,

Argo etc.

• Experience in managing and deploying containerized environments using Docker,

Mesos/Kubernetes is a plus.

Who You Are

• Creative thinker and strong problem solver with meticulous attention to detail
• Highly organized, creative, motivated, and passionate about achieving results
• Able to balance multiple tasks and projects effectively and quickly adapt to new situations and technologies
• Able to work both independently and as part of a team
• Systematic problem-solver, coupled with a strong sense of ownership and drive

What you need

• 3-7 years of experience as a Site Reliability Engineer or a mix of a software engineer and DevOps.
• Strong hands-on knowledge of Linux fundamentals, System administration scripting, performance tuning/scalability, troubleshooting.
• Write great quality code using SOLID principles including unit and integration tests.
• Hands-on development experience in an object-orientated programming language like Python.
• Hands-on experience developing task automations
• Experience using tools to create and manage CI (continuous integration) and CD (continuous delivery) pipelines.
• Familiarity with software development tools: source code management (SCM systems), code review systems, issue tracking tools, build tools, test frameworks, code quality tools.
• Experience implementing open-source observability and alerting tools, like Prometheus, Grafana, Cortex, Thanos, Alertmanager etc
• Have decent knowledge on networking (VPC, VNet, DNS etc) and of the TCP/IP stack, internet routing and load balancing.
• Worked with log and configuration management tool
• Prior experience of working with AWS, Azure, GCP is a plus
• Prior experience of working with Kubernetes, Docker and containers is plus
• Strong interpersonal communication skills (including listening, speaking, and writing) and ability to work well in a diverse, team-focused environment with other SREs, Engineers, Product Managers, etc.
• Documenting your work should be in your DNA

What you get

• A chance to develop and build something (probably from scratch) which you can be proud of
• Build and Implement modern systems observability solutions including monitoring, alerting, metrics, logging, and APM & distributed tracing.
• Scale systems sustainably through automation and evolve systems by pushing for changes that improve reliability and velocity.
• Maintain business continuity by identifying and driving opportunities to make systems highly resilient and human-free.
• Closely work with the software engineering team to ensure accurate monitoring and metrics are being built into applications before going to production.
• Develop and maintain software modules for use and re-use in cloud and on-premise systems automation.
• Identify process gaps and implement process improvements to increase operational reliability
• Drive standardization efforts across the services, infrastructure, systems, and practices
• Develop Systems & Tools to help with Development team to uphold the Reliability principles

Preferred Technical Skills:

• 7+ years experience with troubleshooting Unix/Linux
• Understanding of Networking concepts - TCP/IP, SSL/TLS, IPSec, GRE, VPN
• Experience with algorithms, data structures, complexity analysis, and software design
• Experience in one or more of the following: C, C++, Python, Go
• Experience in managing a large-scale web operations role
• Bonus points for experience with Ansible, Kubernetes, SQL and NoSQL datastores, CI/CD
• Hands-on working with private or public cloud services in a highly available and scalable production environment. 

Desired Technical Skills:

• Knowledge of distributed systems is a big plus.

 Additional Skills

• Great written and verbal communication
• Ability to work for a geo-distributed cross-functional group
• Demonstrated ability to own and deliver projects independently
• Demonstrated ability of technical mentoring and coaching 
• Strong interpersonal communication skills (including listening, speaking, and writing) and the ability to work well in a diverse, team-focused environment with other SREs, developers, Product Managers, etc

About the Role

Dremio’s SREs ensure that our internal and externally visible services have reliability and uptime appropriate to users' needs and a fast rate of improvement. You will be joining a newly formed team that will spearhead our efforts to launch a cloud service. This is an opportunity to join a very fast growth startup and help build a cloud service from the ground up.

Responsibilities and Ownership

• Ability to debug and optimize code and automate routine tasks.
• Evangelize and advocate for reliability practices across our organization.
• Collaborate with other Engineering teams to support services before they go live through activities such as system design consulting, developing software platforms and frameworks, monitoring/alerting, capacity planning and launch reviews.
• Analyze and optimize our core product by developing and implementing reliability and performance practices.
• Scale systems sustainably through automation and evolve systems by pushing for changes that improve reliability and velocity.
• Be on-call for services that the SRE team owns.
• Practice sustainable incident response and blameless postmortems.

Qualifications

• 6+ years of relevant experience in the following areas: SRE, DevOps, Cloud Operations, Systems Engineering, or Software Engineering.
• Excellent command of cloud services on AWS/GCP/Azure, Kubernetes and CI/CD pipelines.
• Have moderate-advanced experience in Java, C, C++, Python, Go or other object-oriented programming languages.
• You are Interested in designing, analyzing and troubleshooting large-scale distributed systems.
• You have a systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
• You have a great ability to debug and optimize code and automate routine tasks.
• You have a solid background in software development and architecting resilient and reliable applications.

• 5+ years of software development or site reliability engineering or equivalent experience
• Skilled at problem solving, algorithms, and data structures
• Building tools and scripting frameworks from scratch
• Working with Cloud Automation tools like CloudFormation, Terraform, CDK, aws-cli
• Scripting languages like Python, Groovy, PowerShell, Bash, Perl etc.
• Configuration automation using Ansible or equivalent tools
• Exposure to Windows, Linux administration skills
• Project management tools like Jira, Trello
• Prior experience in dealing with Datastore technologies like Postgres, MySQL, SQL, DynamoDB is desirable
• Familiarity with basic networking, security and cloud engineering concepts
• Team player who is eager to help others to succeed through mentoring and leading by example
• Highly collaborative with effective written and verbal communication skills