Site Reliability Engineer

at A startup company providing AI based software platforms

 

Roles and Responsibilities

• Managing Availability, Performance, Capacity of infrastructure and applications.
• Building and implementing observability for applications health/performance/capacity.
• Optimizing On-call rotations and processes.
• Documenting “tribal” knowledge.
• Managing Infra-platforms like Mesos/Kubernetes,CICD,Observability (Prometheus/New Relic/ELK),Cloud Platforms (AWS/ Azure),Databases,Data Platforms Infrastructure
• Providing help in onboarding new services with production readiness review process.
• Providing reports on services SLO/Error Budgets/Alerts and Operational Overhead.
• Working with Dev and Product teams to define SLO/Error Budgets/Alerts.
• Working with Dev team to have in depth understanding of the application architecture

          and its bottlenecks.

• Identifying observability gaps in product services, infrastructure and working with stake

          owners to fix it.

• Managing Outages and doing detailed RCA with developers and identifying ways to

          avoid that situation.

• Managing/Automating upgrades of the infrastructure services.
• Automate toil work.
•  

Experience & Skills

• 6+ years of total experience
• Experience as an SRE/DevOps/Infrastructure Engineer on large scale microservices and infrastructure.

• A collaborative spirit with the ability to work across disciplines to influence, learn, and

         deliver.

• A deep understanding of computer science, software development, and networking principles.
• Demonstrated experience with languages, such as Python, Java, Golang etc.
• Extensive experience with Linux administration and good understanding the various

linux kernel subsystems (memory, storage, network etc).

• Extensive experience in DNS, TCP/IP, UDP, GRPC, Routing and Load Balancing.
• Expertise in GitOps, Infrastructure as a Code tools such as Terraform etc.. and
• Configuration Management Tools such as Chef, Puppet, Saltstack, Ansible.
• Expertise of Amazon Web Services (AWS) and/or other relevant Cloud Infrastructure

solutions like Microsoft Azure or Google Cloud.

• Experience in building CI/CD solutions with tools such as Jenkins, GitLab, Spinnaker,

Argo etc.

• Experience in managing and deploying containerized environments using Docker,

Mesos/Kubernetes is a plus.

Requirement
- At least 3 years of experience with relative experience in managing development operations
- Hands-on experience with AWS
- Thorough knowledge on setting up release pipeline, managing multiple environments like Beta, Staging, UAT, and Production
- Thorough knowledge about best cloud practices and architecture
- Hands-on with benchmarking and performance monitoring
- Identifying various bottlenecks and taking pre-emptive measures to avoid downtime
- Hands-on knowledge with at least one toolset Chef/Puppet/Ansible
- Hands-on with CloudFormation / Terraform or other Infrastructure as code is a plus.  
- Thorough experience with Shell Scripting and should not know to shy away from learning new technologies or programming languages
- Experience with other cloud providers like Azure and GCP is a plus
- Should be open to R&D for creative ways to improve performance while keeping costs low

What we want the person to do?

- Manage, Monitor and Provision Infrastructure - Majorly on AWS
- Will be responsible for maintaining 100% uptime on production servers (Site Reliability)
- Setting up a release pipeline for current releases. Automating releases for Beta, Staging & Production
- Maintaining near-production replica environments on Beta and Staging
- Automating Releases and Versioning of Static Assets (Experience with Chef/Puppet/Ansible)
- Should have hands-on experience with Build Tools like Jenkins, GitHub Actions, AWS CodeBuild etc
- Identify performance gaps and ways to fix.
- Weekly meetings with Engineering Team to discuss the changes/upgrades. Can be related to code issue/architecture bottlenecks.
- Creative Ways of Reducing Costs of Cloud Computing
- Convert Infrastructure Deployment / Provision to Infrastructure as Code for reusability and scaling.

• We are looking for a Senior SRE with a proven track record of success leading complex cloud-hybrid environments. You will have:
• Strong sense of Being an Owner, Wearing the Customer Shoes, with the ability to Empower Others demonstrated through clear
• communication and collaboration.
• Skills to work independently with multiple global teams, developing, configuring, deploying, and operating our global infrastructure on AWS and on-prem.
• Operational experience in complex distributed and real-time systems, including experience with SLO/SLAs towards high availability,reliability and DR goals.
• DevOps experience in building tools and frameworks, with an understanding of continuous deployment processes.
• Ability to think at scale, bringing a focus on continuous delivery methodologies from design through deployment and operations.
• Experience building and managing systems with tools including Kubernetes, Chef/Ansible/Puppet, Kafka, Docker, and Terraform.

• 5+ years experience in a Software and/or Site Reliability Engineering role
• Experience writing automation code in GoLang, Python or Java
• Experience developing and operating large scale distributed systems with Kubernetes and Docker
• Experience in running real time and low latency high available applications (Kafka, gRPC, RTP)
• Experience running public cloud environments on AWS
• Experience running hybrid clouds and on-prem infrastructures on Red Hat Enterprise Linux / CentOS
• Bachelor degree in Engineering, Computer Science or equivalent experience
• The ability to lead, partner, and collaborate cross functionally across an engineering organization

About the Role

Dremio’s SREs ensure that our internal and externally visible services have reliability and uptime appropriate to users' needs and a fast rate of improvement. You will be joining a newly formed team that will spearhead our efforts to launch a cloud service. This is an opportunity to join a very fast growth startup and help build a cloud service from the ground up.

Responsibilities and Ownership

• Ability to debug and optimize code and automate routine tasks.
• Evangelize and advocate for reliability practices across our organization.
• Collaborate with other Engineering teams to support services before they go live through activities such as system design consulting, developing software platforms and frameworks, monitoring/alerting, capacity planning and launch reviews.
• Analyze and optimize our core product by developing and implementing reliability and performance practices.
• Scale systems sustainably through automation and evolve systems by pushing for changes that improve reliability and velocity.
• Be on-call for services that the SRE team owns.
• Practice sustainable incident response and blameless postmortems.

Qualifications

• 6+ years of relevant experience in the following areas: SRE, DevOps, Cloud Operations, Systems Engineering, or Software Engineering.
• Excellent command of cloud services on AWS/GCP/Azure, Kubernetes and CI/CD pipelines.
• Have moderate-advanced experience in Java, C, C++, Python, Go or other object-oriented programming languages.
• You are Interested in designing, analyzing and troubleshooting large-scale distributed systems.
• You have a systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
• You have a great ability to debug and optimize code and automate routine tasks.
• You have a solid background in software development and architecting resilient and reliable applications.

What are we looking for:
● Research, propose and evaluate with a 5-year vision, the architecture, design, technologies,
processes and profiles related to Telco Cloud.
● Participate in the creation of a realistic technical-strategic roadmap of the network to transform
it to Telco Cloud and be prepared for 5G.
● Using your deep technical expertise, you will provide detailed feedback to Product Management
and Engineering, as well as contribute directly to the platform code base to enhance both the
Customer experience of the service, as well as the SRE quality of life.
● The individual must be aware of trends in network infrastructure as well as within the network
engineering and OSS community. What technologies are being developed or launched?
● The individual should stay current with infrastructure trends in the telco network cloud domain.
● Be responsible for the Engineering of Lab and Production Telco Cloud environments, including
patches, upgrades, and reliability and performance improvements.
Required Minimum Qualifications: (Education and Technical Skills/Knowledge)
● Software Engineering degree, MS in Computer Science or equivalent experience
● Years of experiences as an SRE, DevOps, Development and/or Support related role
● 0-5 years of professional experience for a junior position
● At least 8 years of professional experience for a senior position
● Unix server administration and tuning : Linux / RedHat / CentOS / Ubuntu
● You have deep knowledge in Networking Layers 1-4
● Cloud / Virtualization (at least two): Helm, Docker, Kubernetes, AWS, Azure, Google Cloud,
OpenStack, OpenShift, VMware vSphere / Tanzu
● You have in-depth knowledge of cloud storage solutions on top of AWS, GCP, Azure and/or
on-prem private cloud, such as Ceph, CephFS, GlusterFS
● DevOps: Jenkins, Git, Azure DevOps, Ansible, Terraform
● Backend Knowledge Bash, Python, Go (other knowledge of Scripting Language is a plus).
● PaaS Level solutions such as Keycloak for IAM, Prometheus, Grafana, ELK, DBaaS (such as MySQL,
Cassandra)
About the Organisation:
The team at Coredge.io is a combination of experienced and young professionals alike having
many years of experience in working with Edge computing, Telecom application development
and Kubernetes. The company has continuously collaborated with the open source community,
universities and major industry players in furthering its goal of providing the industry with an
indispensable tool to offer improved services to its customers. Coredge.io has a global market
presence with its offices in US and New Delhi, India.

What you’ll do

• Develop and Maintain IAC using Terraform and Ansible
• Draft design documents that translate requirements into code.
• Deal with challenges associated with scale.
• Assume responsibilities from technical design through technical client support.
• Manage expectations with internal stakeholders and context-switch in a fast paced environment.
• Thrive in an environment that uses Elasticsearch extensively.
• Keep abreast of technology and contribute to the engineering strategy.
• Champion best development practices and provide mentorship.

What we’re looking for

• An AWS Certified Engineer with strong skills in
o Terraform
o Ansible
o *nix and shell scripting
• Preferably with experience in:
o Elasticsearch
o Circle CI
o CloudFormation
o Python
o Packer
o Docker
o Prometheus and Grafana
o Challenges of scale
o Production support
• Sharp analytical and problem-solving skills.
• Strong sense of ownership.
• Demonstrable desire to learn and grow.
• Excellent written and oral communication skills.
• Mature collaboration and mentoring abilities.

WHAT WILL I DO? You will work as a Site Reliability Engineer responsible for the availability, performance, monitoring, and incident response, among other things, of the platforms and services used and owned by Shuttl. The SRE Team works alongside the Engineering team and owns every aspect of service availability as well as disaster recovery and business continuity plans. You will work with other Site Reliability Engineers and report to the Lead of Site Reliability Engineering Team. HOW DO WE WORK? Our engineering process is a five step process which consists of phases for planning, developing, testing & profiling, releasing and monitoring. The planning phase consists of documenting of the feature/task to be done followed by various discussions. These discussions cover product, delivery estimates, release plan, monitoring plan, test plans, architecture, code design, technology choices and best practice adoption. The development and testing phase coexist and involve writing code, unit tests, performance tests, profiling, stress testing, code reviews and QA testing. This phase is punctuated with daily scrums and standups. The release phase is largely about managing and communicating the release to customers and internal stakeholders and activating features. The last phase is the monitoring phase where relevant metrics and exceptions are tracked and any critical refinement for the delivered feature is undertaken. This phase culminates with a retrospective. SREs get involved in this process as early as possible to provide general guidance, recommendations and help with designing the application to be in compliance with community standards such as CNCF and 12 Factor. SRE involvement and influence tends to increase during mid to final stages of development where the application is primed for beta evaluation and all the tooling and instrumentation is finalized. WHAT SKILLS SHOULD I HAVE? For this role we expect you to have 3+ years of experience working as a DevOps Engineer or SRE. You should have a good grasp of Unix like systems, access control, networking nuances, process isolation by the means of kernel provided features, distributed applications and algorithms, job schedulers and secret management among other things. At Shuttl we are a big proponent of Immutable infrastructure. All our infrastructure is hosted with Amazon Web Services and we use Hashicorp's Terraform to manage the infrastructure as code. A good handle on AWS and Terraform is therefore a definitive plus. Since SREs are expected to write a lot of code, you are also expected to be skillful in a programming language, preferably Python or Go.