Infrastructure Engineer - Database & Storage

Now, more than ever, the Toast team is committed to our customers. We’re taking steps to help restaurants navigate these unprecedented times with technology, resources, and community. Our focus is on building a restaurant platform that helps restaurants adapt, take control, and get back to what they do best: building the businesses they love. And because our technology is purpose-built for restaurants by restaurant people, restaurants can trust that we’ll deliver on their needs for today while investing in experiences that will power their restaurant of the future.

At Toast, our Site Reliability Engineers (SREs) are responsible for keeping all customer-facing services and other Toast production systems running smoothly. SREs are a blend of pragmatic operators and software craftspeople who apply sound software engineering principles, operational discipline, and mature automation to our environments and our codebase. Our decisions are based on instrumentation and continuous observability, as well as predictions and capacity planning.

About this roll* (Responsibilities) 

• Gather and analyze metrics from both operating systems and applications to assist in performance tuning and fault finding
• Partner with development teams to improve services through rigorous testing and release procedures
• Participate in system design consulting, platform management, and capacity planning
• Create sustainable systems and services through automation and uplift
• Balance feature development speed and reliability with well-defined service level objectives

Troubleshooting and Supporting Escalations:

• Gather and analyze metrics from both operating systems and applications to assist in performance tuning and fault finding
• Diagnose performance bottlenecks and implement optimizations across infrastructure, databases, web, and mobile applications
• Implement strategies to increase system reliability and performance through on-call rotation and process optimization
• Perform and run blameless RCAs on incidents and outages aggressively, looking for answers that will prevent the incident from ever happening again

Do you have the right ingredients? (Requirements)

• Extensive industry experience with at least 7+ years in SRE and/or DevOps roles
• Polyglot technologist/generalist with a thirst for learning
• Deep understanding of cloud and microservice architecture and the JVM
• Experience with tools such as APM, Terraform, Ansible, GitHub, Jenkins, and Docker
• Experience developing software or software projects in at least four languages, ideally including two of Go, Python, and Java
• Experience with cloud computing technologies ( AWS cloud provider preferred)

Bread puns are encouraged but not required

About us:

HappyFox is a software-as-a-service (SaaS) support platform. We offer an enterprise-grade help desk ticketing system and intuitively designed live chat software.

We serve over 12,000 companies in 70+ countries. HappyFox is used by companies that span across education, media, e-commerce, retail, information technology, manufacturing, non-profit, government and many other verticals that have an internal or external support function.

To know more, Visit! - https://www.happyfox.com/

Responsibilities

• Build and scale production infrastructure in AWS for the HappyFox platform and its products.
• Research, Build/Implement systems, services and tooling to improve uptime, reliability and maintainability of our backend infrastructure. And to meet our internal SLOs and customer-facing SLAs.
• Implement consistent observability, deployment and IaC setups
• Lead incident management and actively respond to escalations/incidents in the production environment from customers and the support team.
• Hire/Mentor other Infrastructure engineers and review their work to continuously ship improvements to production infrastructure and its tooling.
• Build and manage development infrastructure, and CI/CD pipelines for our teams to ship & test code faster.
• Lead infrastructure security audits

Requirements

• At least 7 years of experience in handling/building Production environments in AWS.
• At least 3 years of programming experience in building API/backend services for customer-facing applications in production.
• Proficient in managing/patching servers with Unix-based operating systems like Ubuntu Linux.
• Proficient in writing automation scripts or building infrastructure tools using Python/Ruby/Bash/Golang
• Experience in deploying and managing production Python/NodeJS/Golang applications to AWS EC2, ECS or EKS.
• Experience in security hardening of infrastructure, systems and services.
• Proficient in containerised environments such as Docker, Docker Compose, Kubernetes
• Experience in setting up and managing test/staging environments, and CI/CD pipelines.
• Experience in IaC tools such as Terraform or AWS CDK
• Exposure/Experience in setting up or managing Cloudflare, Qualys and other related tools
• Passion for making systems reliable, maintainable, scalable and secure.
• Excellent verbal and written communication skills to address, escalate and express technical ideas clearly
• Bonus points – Hands-on experience with Nginx, Postgres, Postfix, Redis or Mongo systems.

Kutumb is the first and largest communities platform for Bharat. We are growing at an exponential trajectory. More than 1 Crore users use Kutumb to connect with their community. We are backed by world-class VCs and angel investors. We are growing and looking for exceptional Infrastructure Engineers to join our Engineering team.

More on this here - https://kutumbapp.com/why-join-us.html">https://kutumbapp.com/why-join-us.html

We’re excited if you have:

• Recent experience designing and building unified observability platforms that enable companies to use the sometimes-overwhelming amount of available data (metrics, logs, and traces) to determine quickly if their application or service is operating as desired
• Expertise in deploying and using open-source observability tools in large-scale environments, including Prometheus, Grafana, ELK (ElasticSearch + Logstash + Kibana), Jaeger, Kiali, and/or Loki
• Familiarity with open standards like OpenTelemetry, OpenTracing, and OpenMetrics
• Familiarity with Kubernetes and Istio as the architecture on which the observability platform runs, and how they integrate and scale. Additionally, the ability to contribute improvements back to the joint platform for the benefit of all teams
• Demonstrated customer engagement and collaboration skills to curate custom dashboards and views, and identify and deploy new tools, to meet their requirements
• The drive and self-motivation to understand the intricate details of a complex infrastructure environment 
• Using CICD tools to automatically perform canary analysis and roll out changes after passing automated gates (think Argo & keptn)
• Hands-on experience working with AWS 
• Bonus points for knowledge of ETL pipelines and Big data architecture
• Great problem-solving skills & takes pride in your work
• Enjoys building scalable and resilient systems, with a focus on systems that are robust by design and suitably monitored
• Abstracting all of the above into as simple of an interface as possible (like Knative) so developers don't need to know about it unless they choose to open the escape hatch

What you’ll be doing:

• Design and build automation around the chosen tools to make onboarding new services easy for developers (dashboards, alerts, traces, etc)
• Demonstrate great communication skills in working with technical and non-technical audiences
• Contribute new open-source tools and/or improvements to existing open-source tools back to the CNCF ecosystem

Tools we use:

Kops, Argo, Prometheus/ Loki/ Grafana, Kubernetes, AWS, MySQL/ PostgreSQL, Apache Druid, Cassandra, Fluentd, Redis, OpenVPN, MongoDB, ELK

What we offer:

• High pace of learning
• Opportunity to build the product from scratch
• High autonomy and ownership
• A great and ambitious team to work with
• Opportunity to work on something that really matters
• Top of the class market salary and meaningful ESOP ownership

• Provision Dev Test Prod Infrastructure as code using IaC (Infrastructure as Code)
• Good knowledge on Terraform
• In-depth knowledge of security and IAM / Role Based Access Controls in Azure, management of Azure Application/Network Security Groups, Azure Policy, and Azure Management Groups and Subscriptions.
• Experience with Azure and GCP compute, storage and networking (we can also look for GCP )
• Experience in working with ADLS Gen2, Databricks and Synapse Workspace
• Experience supporting cloud development pipelines using Git, CI/CD tooling, Terraform and other Infrastructure as Code tooling as appropriate
• Configuration Management (e.g. Jenkins, Ansible, Git, etc...)
• General automation including Azure CLI, or Python, PowerShell and Bash scripting
• Experience with Continuous Integration/Continuous Delivery models
• Knowledge of and experience in resolving configuration issues
• Understanding of software and infrastructure architecture
• Experience in Paas, Terraform and AKS
• Monitoring, alerting and logging tools, and build/release processes Understanding of computing technologies across Windows and Linux

The AWS Cloud/Devops Engineer will be working with the engineering team and focusing on AWS infrastructure and automation.  A key part of the role is championing and leading infrastructure as code.  The Engineer will work closely with the Manager of Operations and Devops to build, manage and automate our AWS infrastructure. 

Duties & Responsibilities:

• Design cloud infrastructure that is secure, scalable, and highly available on AWS
• Work collaboratively with software engineering to define infrastructure and deployment requirements
• Provision, configure and maintain AWS cloud infrastructure defined as code
• Ensure configuration and compliance with configuration management tools
• Administer and troubleshoot Linux based systems
• Troubleshoot problems across a wide array of services and functional areas
• Build and maintain operational tools for deployment, monitoring, and analysis of AWS infrastructure and systems
• Perform infrastructure cost analysis and optimization

Qualifications:

• At least 1-5 years of experience building and maintaining AWS infrastructure (VPC, EC2, Security Groups, IAM, ECS, CodeDeploy, CloudFront, S3)
• Strong understanding of how to secure AWS environments and meet compliance requirements
• Expertise using Chef for configuration management
• Hands-on experience deploying and managing infrastructure with Terraform
• Solid foundation of networking and Linux administration
• Experience with CI-CD, Docker, GitLab, Jenkins, ELK and deploying applications on AWS
• Ability to learn/use a wide variety of open source technologies and tools
• Strong bias for action and ownership

• Work towards improving the following 4 verticals - scalability, availability, security, and cost, for company's workflows and products.
• Help in provisioning, managing, optimizing cloud infrastructure in AWS (IAM, EC2, RDS, CloudFront, S3, ECS, Lambda, ELK etc.)
• Work with the development teams to design scalable, robust systems using cloud architecture for both 0-to-1 and 1-to-100 products.
• Drive technical initiatives and architectural service improvements.
• Be able to predict problems and implement solutions that detect and prevent outages.
• Mentor/manage a team of engineers.
• Design solutions with failure scenarios in mind to ensure reliability.
• Document rigorously to keep track of all changes/upgrades to the infrastructure and as well share knowledge with the rest of the team
• Identify vulnerabilities during development with actionable information to empower developers to remediate vulnerabilities
• Automate the build and testing processes to consistently integrate code
• Manage changes to documents, software, images, large web sites, and other collections of code, configuration, and metadata among disparate teams

About Us

We have grown over 1400% in revenues in the last year.

Interface.ai provides an Intelligent Virtual Assistant (IVA) to FIs to automate calls and customer inquiries across multiple channels and engage their customers with financial insights and upsell/cross-sell.

Our IVA is transforming financial institutions’ call centers from a cost to a revenue center.

Our core technology is built 100% in-house with several breakthroughs in Natural Language Understanding. Our parser is built based on zero-shot learning that helps us to launch industry-specific IVA that can achieve over 90% accuracy on Day-1. 

We are 45 people strong with employees spread across India and US locations. Many of them come from ML teams at Apple, Microsoft, and Salesforce in the US along with enterprise architects with over 20+ years of experience building large-scale systems. Our India team consists of people from ISB, IIMs, and many who have been previously part of early-stage startups. 

We are a fully remote team.

Founders come from Banking and Enterprise Technology backgrounds with previous experience scaling companies from scratch to $50M+ in revenues.

As a Site Reliability Engineer you will be in charge of:

• Designing, analyzing and troubleshooting large-scale distributed systems
• Engaging in cross-functional team discussions on design, deployment, operation, and maintenance,  in a fast-moving, collaborative set up
• Building automation scripts to validate the stability, scalability, and reliability of interface.ai’s products & services as well as enhance interface.ai’s employees’ productivity
• Debugging and optimizing code and automating routine tasks
• Troubleshoot and diagnose issues (hardware or software), propose and implement solutions to ensure they occur with reduced frequency
• Perform the periodic on-call duty to handle security, availability, and reliability of interface.ai’s products 
• You will follow and write good code and solid engineering practices

You can be a great fit if you are :

1. Extremely self motivated
2. Ability to learn quickly
3. Growth Mindset (read this if you don't know what it means - https://www.amazon.com/Mindset-Psychology-Carol-S-Dweck/dp/0345472322" target="_blank">link)
4. Emotional Maturity (read this if you don't know what it means - https://medium.com/@krisgage/15-signs-of-emotional-maturity-38b1a2ab9766" target="_blank">link)
5. Passionate about the possibilities at the intersection of AI + Banking
6. Worked in a startup of 5 to 30 employees
7. Developer with a strong interest in systems Design. You will be building, maintaining, and scaling our cloud infrastructure through software tooling and automation. 
8. 4-8 years of industry experience developing and troubleshooting large-scale infrastructure on the cloud
9. Have a solid understanding of system availability, latency, and performance
10. Strong programming skills in at least one major programming language and the ability to learn new languages as needed  
11. Strong System/network debugging skills
12. Experience with management/automation tools such as Terraform/Puppet/Chef/SALT
13. Experience with setting up production-level monitoring and telemetry
14. Expertise in Container management & AWS
15. Experience with kubernetes is a plus
16. Experience building CI/CD pipelines
17. Experience working with Web sockets, Redis, Postgres, Elastic search, Logstash
18. Experience working in an agile team environment and proficient understanding of code versioning tools, such as Git.
19. Ability to effectively articulate technical challenges and solutions.
20. Proactive outlook for ways to make our systems more reliable

• 5+ years hands-on experience with designing, deploying and managing core AWS services and infrastructure
• Proficiency in scripting using Bash, Python, Ruby, Groovy, or similar languages 
• Experience in source control management, specifically with Git
• Hands-on experience in Unix/Linux and bash scripting
• Experience building, managing Helm-based build and release CI-CD pipelines for Kubernetes platforms (EKS, Openshift, GKE) 
• Strong experience with orchestration and config management tools such as Terraform, Ansible or Cloudformation  
• Ability to debug, analyze issues leveraging tools like App Dynamics, New Relic and Sumologic 
• Knowledge of Agile Methodologies and principles 
• Good writing and documentation skills
• Strong collaborator with the ability to work well with core teammates and our colleagues across STS