Sr. Infrastructure Engineer

Position – SRE Engineer

Location – Navi Mumbai

Who are we

Based out of IIT Bombay, HaystackAnalytics is a HealthTech company creating clinical genomics products, which enable diagnostic labs and hospitals to offer accurate and personalized diagnostics. Supported by India's most respected science agencies (DST, BIRAC, DBT), we created and launched a portfolio of products to offer genomics in infectious diseases. Our genomics-based diagnostic solution for Tuberculosis was recognized as one of the top innovations supported by BIRAC in the past 10 years, and was launched by the Prime Minister of India in the BIRAC Showcase event in Delhi, 2022.

About the Role:

We are seeking a highly skilled Site Reliability Engineer (SRE) to join our infrastructure team. The ideal candidate will bring deep expertise in Linux systems, cloud infrastructure automation, and network administration, with a strong focus on reliability, scalability, and performance. ensuring firewall/network security compliance.

Key Responsibilities:

• Develop and maintain automation scripts (Bash, Python, etc.) for system and cloud infrastructure operations.
• Manage, monitor, and troubleshoot Linux servers  in production environments
• Familiarity with Network tools in Linus to triage  network connectivity  and performance issues .
• Configure, maintain, and secure network infrastructure including switches, routers, and firewalls.
• Design and execute Network Continuity Plans (NCP) and disaster recovery strategies.
• Collaborate with cross functional team for triaging and resolving site specific issues in production  related to  server deployment , SOP adherence , Triage and defect resolution
• Collaborate with developers and DevOps teams to define SLAs, SLOs, and error budgets.
• Implement proactive monitoring and alerting using modern observability tools.
• Participate in on-call rotations and incident response processes.
• 
  

Objectives of this Role:

• Build, automate, and manage scalable infrastructure and deployment pipelines to support development and production environments.
• Enable rapid, secure, and reliable software delivery across engineering teams.
• Ensure system availability, performance, and security in cloud and containerized environments.
• Implement and enforce best practices in CI/CD, observability, and incident response.
• Collaborate with cross-functional teams including software developers, QA, and product managers.
• Proactively identify and automate manual processes to improve engineering efficiency.
• 3–7 years of experience as an SRE, DevOps, or Systems/Network Engineer.
• Strong scripting skills (e.g., Bash, Python, or Go).
• Proficiency in Linux administration and performance tuning.
• Deep understanding of TCP/IP, routing, DNS, firewalls, and networking protocols.
• Hands-on experience managing network infrastructure and firewall rules (e.g., iptables, pfSense, Palo Alto, etc.).
• Docker (multi-stage builds, docker-compose)

Soft Skills

• Proactive problem-solving and ownership mindset
• Strong documentation and communication skills
• Ability to mentor junior engineers
• Curiosity to learn and experiment with emerging DevOps tools

Preferred Qualifications:

• Certifications such as CKA/CKAD, RHCE, AWS Certified SysOps Administrator, or Cisco CCNA/CCNP.
• Experience with service meshes (e.g., Istio), observability stacks (e.g., Prometheus, Grafana), or network policy management (e.g., Calico, Cilium).
• Exposure to secure DevOps practices and compliance standards (e.g., ISO, NIST).

To know more about us – https://haystackanalytics.in

Essential Responsibilities

• Primary responsibility would be overseeing complete Load balancing and Network Packet Broker Operation.
• Load Balancing Engineer with hands-on experience on F5 BIG-IP GTM and LTM devices as well as Citrix NetScaler.
• Hands on experience in migrating other load balancer vendors to F5 Load Balancer
• Must be an expert in F5 and Citrix Load Balancing platforms.

Roles and Responsibilities

• Should analyse, design, implement and maintain the networks F5 and Citrix NetScaler Load Balancer infrastructure.
• Should inspect data packets and TCP, IP flow in network and application flow.
• Should possess a working knowledge of switches, routers, and firewall concepts.
• Should be able to configure and maintain F5 and Citrix Load Balancers, load balancing best practices.
• Should also take the responsibility to upgrade network operating systems software and hardware as per the management requirements.
• Must ensure that the plans are integrated effectively with the other aspects of the technical infrastructure.
• Extensive knowledge of Load balancing technology including algorithms and health check options.
• Knowledge and experience regarding F5 BIG-IP LTM VIP configuration with health check.
• Knowledge and experience with F5 BIG-IP GTM Wide IP configuration.
• F5 BIG-IP iRule programming and troubleshooting experience.
• Extensive knowledge of Citrix NetScaler VIP configuration with Knowledge and experience with Citrix NetScaler Global Load Balancing (Gslb) configuration.

• Enterprise Network Implementation for Global Enterprise customers.
• Extensive experience in a network implementation environment gained in an ISP or telco or enterprise environment.
• Good technical knowledge and practical experience of BGP, OSPF routing protocols & switching technology.
• Conversant in best practices appropriate to network design and security.
• Understanding of hardware and software performance and scaling limitations.
• Network implementation, and management using Cisco Routers & switches ( Nexus & Catalyst), Juniper M and T series routers, and Aruba Wireless.
• Excellent communication and interpersonal skills – confidence and professionalism both in working with multinational project teams and with clients on various levels of the organisation, from technical audiences to senior management
• Analytical and critical thinking; innovative problem-solving capability for complex customer requirements
• Ability to work under pressure from both customers and internal stakeholders and produce solution designs that are deliverable

Experience:
• A minimum of 4 years’ total experience in the areas of Networking and Telecommunications technologies
• At least 2 years’ experience in dealing with large, corporate customers in a technical solution Implementation profile.

Purpose of the Role

Responsible for 100% uptime of Network with efficient and timely first support on a 24x7 basis to meet Business Goals; providing the highest level of Technology Support, Introducing and maintaining the state of the art Technology in line with the Business Strategy.

Desired Skills and Competencies

• Ability to Influence
• Customer Sensitivity
• Execution Excellence
• Functional Expertise
• Situation Handling
• Team Management
• Working Together

Role Description:

1. Work Experience: Should have work experience in Telco / ISP service Provider background
2. Should have experience in Planning and Operations of Broadband network.
3. Should Lead a Team and Manage Day to Day NOC Operation.
4. Manage Outages in the Network and Provide resolution within SLA; Handle Customer Escalation with Minimal Turnaround time.
5. Escalating Issues and Co-ordinating with vendor team on Bug fixes and Resolutions.
6. Maintain the Uptime of the network at 100%.
7. Should Monitor the Network and planning maintenance activities timely.
8. Should work on building redundancy and elimination of Point of Failures.
9. Should work on Bandwidth Management and Traffic Load Balancing Mechanism.
10. Provide backend support to cross functional teams for new provisioning and Fault Repair.
11. Should be available 24*7 for support for responding to emergency situations and planned activities.
12. Should be Responsible for Inventory Management.
13. Manage and Train NOC team, perform evaluations and hiring, and handle disciplinary responsibilities. 
14. Prepare and Maintain SOPs of critical Process; perform Process Correction on requirement basis.
15. Should analyse fault trends and plan preventive actions.
16. Should be Responsible for publishing of daily, weekly, monthly reports and statistics reports.

Technical Requirements:

1. Should have Good Knowledge of Switching and Routing.
2. Hands-on experience of BGP, MPLS, MPLS L2VPN, MPLS L3VPN, ISIS, OSPF, VLAN, DHCP, PPPoE, STP, LAN, WAN, NAT etc
3. Should have worked in Layer-2 and Layer-3 Switches, Edge Routers; preferably on Cisco and Huawei Devices.
4. Should have worked on GPON Technology and have understanding of Operation and Troubleshooting skills, hands on experience on installation and implementation of OLTs and ONTs.
5. Should have worked on NMS Tools and have understanding of SNMP Protocol.
6. Should have understanding of BNG workings principles, RADIUS and Diameter protocols.
7. Should have Good understanding of Fiber Technology.
8. Should have understanding of Wireless Technologies such as 802.1b/g/n, 802.11ac, should be able to configure WIFI routers and debug issues.
9. Must have done BE/B.Tech or equivalent in Computer Engineering/Electronics & Communication Engineering/Electronics & Electrical Engineering
10. CCNA/CCNP Certification is Preferred.

• Perform technical feasibility studies of new technologies and architectures, including evaluation of OTS cloud offering.
• Generate entire software image for the target device, including the kernel, device drivers, libraries, and application software, and the bootloader for proprietary IOT connectivity device(s).
• Software packaging with RPM building and management
• Define the process to upgrade the new Linux package to existing hardware at customer premises
• Configuration and Troubleshoot of the proprietary IOT connectivity devices for internal R&D teams during their development and verification
• Automate the creation and distribution of keys and certificates
• Understand, implement, and automate security controls for IoT connectivity devices.
• Tune server and application-level performance monitoring and alerting.
• Help define our roadmap and architecture based on technology and business needs, considering architectural issues and tradeoffs
• Understand and manage integration points with other systems that interface with your applications
• Supports development of project plans, including scope, budget, schedules, and risk management.
• Works closely with the business analysts, software development and verification team, the functional manager, and the program manager.
• Collaborate and work with global teams in multiple locations.
• Interface with Global Privacy and Security team for the IoT Gateway understand security risks and recommendations and provide solutions to mitigate the security risks

• Bachelor’s degree in Computer Networking / Computer Science / Software Engineering or a related field
• 12+ years of hands-on experience in Networking, shell scripting, and Linux internals, with a development background.
• Strong understanding of Networking concepts like VPC, Route tables, Host base router firewall, SSH, NAT, DNS, DHCP, SNMP, Virtual IPs, VPN
• Linux System Administration and Networking work experience
• Configuring Firewalls(IP tables/firewall) and security software
• Able to generate Linux packages, and configure based on business needs.
• Passion for cybersecurity. Ability to build secured Linux packages with antivirus and security patches.
• Shell, Python scripting experience
• Basic SQL skills
• Ability to work with cross-functional and remote teams. Must be able to communicate in English, both written and verbal.
• Interpersonal skills to effectively collaborate with vendors and customers.

• Experience with Agile Scrum
• Development background in Java/C++
• DevOps knowledge
• Knowledge on javascript

As an IT Infrastructure Architects design and implement information systems that support an enterprise infrastructure. You will provide the necessary technical infrastructure for the development of new and existing infrastructure technologies and system requirements. 

Improve efficiency and streamline operations. enhance design specs, create technical documentation, implement control concepts and deliver expected outcomes. Collect performance data to monitor systems resource usage and failures rates and provide solutions and recommend changes. ensure scalability and anticipate capacity growth through careful planning and awareness of industry, business and client’s growth trends. Design activities rely on accurate data, sensible KPIs and performance metrics to improve processes and bridge gaps

Primary Responsibilities:

Conducting research on emerging and existing technologies. Recommend system alternative technologies and infrastructure development efforts that increase infrastructure flexibility, reliability, stability, scalability, resilience, availability, performance and cost effectiveness. All collective research efforts will contribute to the creation of architectural road maps that leverage software and cloud technologies. Research customer interaction, policy adherence, enterprise processes. May act as the subject matter expert of architectural virtualization.

Needs to guide in execution of Incident, Change, Release, Problem, Performance, and Availability Management

Security of all infrastructure is of paramount importance and is periodically audited, monitored and updated in keeping up with latest threats and risks.

Identifying best practices for future implementation. Architects provide feedback to the enterprise and incorporate all gathered information into future integration plans.

Provides DevOps thought leadership and mentoring in both advisory and delivery contexts, focusing on the requirements of Technology and Business and how these are best served by continuous improvements to our delivery approach

Required Technical skills and Experience

• Over 10+ years of experience as IT Infrastructure Architect
• Bachelor / Masters Degree in Computer Science, Information Technology or related field
• Must have experience in Infrastructure architecting on AWS/ Azure/ Google cloud.
• Should have a very good understanding of Cloud Native services (IaaS, PaaS, SaaS) platforms for application deployment and scalability in a cost effective manner, addresses scalability, availability, service continuity (DR), performance and security requirements. auto-scaling and self-healing.
• Has hands on experience with cloud orchestration using Kubernetes or apache Mesos on marathon would be an advantage
• Evangelizing microservices-based architectures using containerized applications; help to drive strategy and implementation of cloud native infrastructure
• Sound Knowledge of RDBMS, preferably with MYSQL Mongo, Elasticsearch, Redis. Working knowledge of, CDN/WAF 
• Proven expertise on Linux, and DevOps tools such as Git, Jenkings, maven, Bamboo Docker, Puppet, Ansible,Kubernetes,terraform. Elastic Beanstalk, Openshift
• Infrastructure security (VPC, tunneling, API management, Governance) and networking security solutions like routing, switching, Firewalls etc.
• Good debugging skills on Linux, Apache, Nginx, PHP, MYSQL and cloud-based application and administration of RHEL, CentOS/Ubuntu
• Experience in Cloud scale APM and Monitoring Tools such as ELK ,Splunk, Nagios, Graffana, XMON Datadog, Dynatrace, Appdynamics, Cloud Monitoring.
• Troubleshoot and debug environment and infrastructure problems found in the production and non-production environments.
• Implements security improvements by assessing current situations; evaluating trends; anticipating requirements.
• Determines security violations and inefficiencies by conducting periodic audits.
• Upgrades system by implementing and maintaining security controls.
• Must have knowledge of leading storage backup solutions.
• Experience with one or more Unix shell scripting languages (Bash, C-Shell)

• Team mentoring and support for ramping up new engineers
• Provide leadership in planning, defining requirements, scoping efforts, and setting appropriate milestones
• Using a data-driven process/mindset, author technical content to support the incident response process (e.g. postmortem/root cause analysis) and develop interim solutions to prevent or quickly resolve issues/problems the next time.
• Experience with networking technologies (routing, switching, IP addressing, DNS, Load balancers, etc.) Knowledge of :  - File systems, NFS, CIFS, iSCSI - IPv4 networking, including TCP/IP, SMTP/POP/ IMAP, HTTP/S, LDAP – DNS
• Ability to work independently while tackling complex problems
• Passionate to palm ownership and responsibility of the systems - 24x7