Sr. Infrastructure Engineer

Role Overview

We are looking for a skilled Systems Engineer with strong expertise in Ansible automation, Kubernetes, and system-level scripting. This role focuses on building scalable automation and managing GPU-aware infrastructure.

Key Responsibilities

• Develop and maintain automation workflows using Ansible
• Write and optimize Ansible playbooks for infrastructure and application deployment
• Automate system-level tasks using Bash scripting
• Debug and test automation workflows for reliability and scalability
• Manage Kubernetes clusters, including:
• Pod lifecycle management
• Networking and firewall configurations
• GPU resource mapping and scheduling
• Custom Resource Definitions (CRDs)
• Collaborate with engineering teams to integrate automation into CI/CD pipelines
• Ensure secure and scalable infrastructure for AI workloads

Requirements

• Strong hands-on experience with Ansible and automation workflows
• Solid Linux system administration experience
• Proficiency in Bash scripting
• Deep understanding of Kubernetes (pods, networking, CRDs, GPU scheduling)
• Experience in debugging and optimizing automation systems
• Strong problem-solving and ownership mindset

Nice to Have

• Experience with GPU workloads or HPC environments
• Exposure to monitoring tools like Prometheus and Grafana

Position – SRE Engineer

Location – Navi Mumbai

Who are we

Based out of IIT Bombay, HaystackAnalytics is a HealthTech company creating clinical genomics products, which enable diagnostic labs and hospitals to offer accurate and personalized diagnostics. Supported by India's most respected science agencies (DST, BIRAC, DBT), we created and launched a portfolio of products to offer genomics in infectious diseases. Our genomics-based diagnostic solution for Tuberculosis was recognized as one of the top innovations supported by BIRAC in the past 10 years, and was launched by the Prime Minister of India in the BIRAC Showcase event in Delhi, 2022.

About the Role:

We are seeking a highly skilled Site Reliability Engineer (SRE) to join our infrastructure team. The ideal candidate will bring deep expertise in Linux systems, cloud infrastructure automation, and network administration, with a strong focus on reliability, scalability, and performance. ensuring firewall/network security compliance.

Key Responsibilities:

• Develop and maintain automation scripts (Bash, Python, etc.) for system and cloud infrastructure operations.
• Manage, monitor, and troubleshoot Linux servers in production environments
• Familiarity with Network tools in Linus to triage network connectivity and performance issues .
• Configure, maintain, and secure network infrastructure including switches, routers, and firewalls.
• Design and execute Network Continuity Plans (NCP) and disaster recovery strategies.
• Collaborate with cross functional team for triaging and resolving site specific issues in production related to server deployment , SOP adherence , Triage and defect resolution
• Collaborate with developers and DevOps teams to define SLAs, SLOs, and error budgets.
• Implement proactive monitoring and alerting using modern observability tools.
• Participate in on-call rotations and incident response processes.
• 
  

Objectives of this Role:

• Build, automate, and manage scalable infrastructure and deployment pipelines to support development and production environments.
• Enable rapid, secure, and reliable software delivery across engineering teams.
• Ensure system availability, performance, and security in cloud and containerized environments.
• Implement and enforce best practices in CI/CD, observability, and incident response.
• Collaborate with cross-functional teams including software developers, QA, and product managers.
• Proactively identify and automate manual processes to improve engineering efficiency.
• 3–7 years of experience as an SRE, DevOps, or Systems/Network Engineer.
• Strong scripting skills (e.g., Bash, Python, or Go).
• Proficiency in Linux administration and performance tuning.
• Deep understanding of TCP/IP, routing, DNS, firewalls, and networking protocols.
• Hands-on experience managing network infrastructure and firewall rules (e.g., iptables, pfSense, Palo Alto, etc.).
• Docker (multi-stage builds, docker-compose)

Soft Skills

• Proactive problem-solving and ownership mindset
• Strong documentation and communication skills
• Ability to mentor junior engineers
• Curiosity to learn and experiment with emerging DevOps tools

Preferred Qualifications:

• Certifications such as CKA/CKAD, RHCE, AWS Certified SysOps Administrator, or Cisco CCNA/CCNP.
• Experience with service meshes (e.g., Istio), observability stacks (e.g., Prometheus, Grafana), or network policy management (e.g., Calico, Cilium).
• Exposure to secure DevOps practices and compliance standards (e.g., ISO, NIST).

To know more about us – https://haystackanalytics.in

• Enterprise Network Implementation for Global Enterprise customers.
• Extensive experience in a network implementation environment gained in an ISP or telco or enterprise environment.
• Good technical knowledge and practical experience of BGP, OSPF routing protocols & switching technology.
• Conversant in best practices appropriate to network design and security.
• Understanding of hardware and software performance and scaling limitations.
• Network implementation, and management using Cisco Routers & switches ( Nexus & Catalyst), Juniper M and T series routers, and Aruba Wireless.
• Excellent communication and interpersonal skills – confidence and professionalism both in working with multinational project teams and with clients on various levels of the organisation, from technical audiences to senior management
• Analytical and critical thinking; innovative problem-solving capability for complex customer requirements
• Ability to work under pressure from both customers and internal stakeholders and produce solution designs that are deliverable

Experience:
• A minimum of 4 years’ total experience in the areas of Networking and Telecommunications technologies
• At least 2 years’ experience in dealing with large, corporate customers in a technical solution Implementation profile.

We are looking networking professionals with the following skill set,

Experience :6+ years of experience in the networking domain

Key skills:

• Must have 6+ years of experience in C/C++ programming language.
• Knowledge of Go programming language and Python programming language is a big plus.
• Strong background in L4-L7 Internet Protocols TCP, HTTP, HTTP2, GRPC and HTTPS/SSL/TLS.
• Background in Internet security related products such as Web Application Firewalls, API Security Gateways, Reverse Proxies and Forward Proxies
• Proven knowledge of Linux kernel internals (process scheduler, memory management, etc.)
• Experience with eBPF is a plus.
• Hands-on experience in cloud architectures (SaaS, PaaS, IaaS, distributed systems) with continuous delivery
• Familiar with containerization solutions like Docker/Kubernetes etc.
• Familiar with server less technologies such as AWS Lambda.
• Exposure to machine learning technologies and distributed systems is a plus

Installation, Configuration and Troubleshooting of Network Equipment e.g CCTV Camera, Network Switch, Router, Wi-fi, Server and Desktop computer etc. Willing to travel entire India based on project requirement.

• Perform technical feasibility studies of new technologies and architectures, including evaluation of OTS cloud offering.
• Generate entire software image for the target device, including the kernel, device drivers, libraries, and application software, and the bootloader for proprietary IOT connectivity device(s).
• Software packaging with RPM building and management
• Define the process to upgrade the new Linux package to existing hardware at customer premises
• Configuration and Troubleshoot of the proprietary IOT connectivity devices for internal R&D teams during their development and verification
• Automate the creation and distribution of keys and certificates
• Understand, implement, and automate security controls for IoT connectivity devices.
• Tune server and application-level performance monitoring and alerting.
• Help define our roadmap and architecture based on technology and business needs, considering architectural issues and tradeoffs
• Understand and manage integration points with other systems that interface with your applications
• Supports development of project plans, including scope, budget, schedules, and risk management.
• Works closely with the business analysts, software development and verification team, the functional manager, and the program manager.
• Collaborate and work with global teams in multiple locations.
• Interface with Global Privacy and Security team for the IoT Gateway understand security risks and recommendations and provide solutions to mitigate the security risks

• Bachelor’s degree in Computer Networking / Computer Science / Software Engineering or a related field
• 12+ years of hands-on experience in Networking, shell scripting, and Linux internals, with a development background.
• Strong understanding of Networking concepts like VPC, Route tables, Host base router firewall, SSH, NAT, DNS, DHCP, SNMP, Virtual IPs, VPN
• Linux System Administration and Networking work experience
• Configuring Firewalls(IP tables/firewall) and security software
• Able to generate Linux packages, and configure based on business needs.
• Passion for cybersecurity. Ability to build secured Linux packages with antivirus and security patches.
• Shell, Python scripting experience
• Basic SQL skills
• Ability to work with cross-functional and remote teams. Must be able to communicate in English, both written and verbal.
• Interpersonal skills to effectively collaborate with vendors and customers.

• Experience with Agile Scrum
• Development background in Java/C++
• DevOps knowledge
• Knowledge on javascript

As an IT Infrastructure Architects design and implement information systems that support an enterprise infrastructure. You will provide the necessary technical infrastructure for the development of new and existing infrastructure technologies and system requirements. 

Improve efficiency and streamline operations. enhance design specs, create technical documentation, implement control concepts and deliver expected outcomes. Collect performance data to monitor systems resource usage and failures rates and provide solutions and recommend changes. ensure scalability and anticipate capacity growth through careful planning and awareness of industry, business and client’s growth trends. Design activities rely on accurate data, sensible KPIs and performance metrics to improve processes and bridge gaps

Primary Responsibilities:

Conducting research on emerging and existing technologies. Recommend system alternative technologies and infrastructure development efforts that increase infrastructure flexibility, reliability, stability, scalability, resilience, availability, performance and cost effectiveness. All collective research efforts will contribute to the creation of architectural road maps that leverage software and cloud technologies. Research customer interaction, policy adherence, enterprise processes. May act as the subject matter expert of architectural virtualization.

Needs to guide in execution of Incident, Change, Release, Problem, Performance, and Availability Management

Security of all infrastructure is of paramount importance and is periodically audited, monitored and updated in keeping up with latest threats and risks.

Identifying best practices for future implementation. Architects provide feedback to the enterprise and incorporate all gathered information into future integration plans.

Provides DevOps thought leadership and mentoring in both advisory and delivery contexts, focusing on the requirements of Technology and Business and how these are best served by continuous improvements to our delivery approach

Required Technical skills and Experience

• Over 10+ years of experience as IT Infrastructure Architect
• Bachelor / Masters Degree in Computer Science, Information Technology or related field
• Must have experience in Infrastructure architecting on AWS/ Azure/ Google cloud.
• Should have a very good understanding of Cloud Native services (IaaS, PaaS, SaaS) platforms for application deployment and scalability in a cost effective manner, addresses scalability, availability, service continuity (DR), performance and security requirements. auto-scaling and self-healing.
• Has hands on experience with cloud orchestration using Kubernetes or apache Mesos on marathon would be an advantage
• Evangelizing microservices-based architectures using containerized applications; help to drive strategy and implementation of cloud native infrastructure
• Sound Knowledge of RDBMS, preferably with MYSQL Mongo, Elasticsearch, Redis. Working knowledge of, CDN/WAF 
• Proven expertise on Linux, and DevOps tools such as Git, Jenkings, maven, Bamboo Docker, Puppet, Ansible,Kubernetes,terraform. Elastic Beanstalk, Openshift
• Infrastructure security (VPC, tunneling, API management, Governance) and networking security solutions like routing, switching, Firewalls etc.
• Good debugging skills on Linux, Apache, Nginx, PHP, MYSQL and cloud-based application and administration of RHEL, CentOS/Ubuntu
• Experience in Cloud scale APM and Monitoring Tools such as ELK ,Splunk, Nagios, Graffana, XMON Datadog, Dynatrace, Appdynamics, Cloud Monitoring.
• Troubleshoot and debug environment and infrastructure problems found in the production and non-production environments.
• Implements security improvements by assessing current situations; evaluating trends; anticipating requirements.
• Determines security violations and inefficiencies by conducting periodic audits.
• Upgrades system by implementing and maintaining security controls.
• Must have knowledge of leading storage backup solutions.
• Experience with one or more Unix shell scripting languages (Bash, C-Shell)

• Team mentoring and support for ramping up new engineers
• Provide leadership in planning, defining requirements, scoping efforts, and setting appropriate milestones
• Using a data-driven process/mindset, author technical content to support the incident response process (e.g. postmortem/root cause analysis) and develop interim solutions to prevent or quickly resolve issues/problems the next time.
• Experience with networking technologies (routing, switching, IP addressing, DNS, Load balancers, etc.) Knowledge of :  - File systems, NFS, CIFS, iSCSI - IPv4 networking, including TCP/IP, SMTP/POP/ IMAP, HTTP/S, LDAP – DNS
• Ability to work independently while tackling complex problems
• Passionate to palm ownership and responsibility of the systems - 24x7

∙ Computer Science related Bachelor's Degree or equivalent experience 

∙ Min 2 years of experience on GCP / AWS / Azure cloud system ( Overall 5+ years of experience) 

∙ Familiarity with LAMP stack technologies, experience supporting 

∙Must be capable of working on Linux System. 

∙ Familiarity with SQL, Apache, File storage, Load Balancers and Agile methodologies ∙ Knowledge of shell scripts, Linux system administration. 

∙ Strong DNS management and automation background 

∙ Strong scripting (bash, php, perl) skills 

∙ Good understanding of TCP/IP networking and troubleshooting 

∙ Clear communication and documentation of projects and procedures 

∙ Strong problem solving skills 

∙ Demonstrated ability to manage timelines, dependencies, deliverables, milestones and resource allocation and management in projects. 

∙Strong Cloud Architecture experience. 

∙Cloud Security 

∙Added Advantage with knowledge of Microservices/API/ Queue systems 

∙knowledge of cloud computing technologies and current computing trends. ∙Understanding and willingness to embrace CI/CD and automation tooling such as Jenkins and GIT 

Responsibilities: 

∙ Set up technical server infrastructure, providing technical assistance to development teams, monitoring site performance, and troubleshooting issues when they arise.

∙ Set up and maintain a development server environment and a live server environment with a process for testing and deploying changes to live sites. 

∙ Take an active role in designing, implementing and maintaining a scalable and robust enterprise server environment. 

∙ Administer Apache web server, Load balancer and MySQL Server 

∙ Work on System Security and IPTable configuration 

∙ Optimize servers for high traffic, security, and other system issues. ∙ Evaluate and propose new or improved system architecture. 

∙ Document system configuration, processes, and procedures. 

∙ Share responsibility with team members for rotating on-call duties.