Linux Administrator

Location : Mumbai

Big Picture (The Opportunity) :

Are you looking for an opportunity to advance your Career? & If you are able to maintain a positive attitude even when everything goes wrong, if you are detail oriented and self motivated with a passion to learn and improve your skills and knowledge, we have a perfect job for you !

What do we want from you ? (Our Expectations) :

• Zero to 2 years experience in Linux Operating System.
• Flexible working hours - able to support occasional nights, weekends, and call-ins, able to quickly adapt to a constantly changing faced paced environment. Open to travel to sites.
• An ideal person who is excited and motivated about running and supporting a production - grade critical infrastructure and looks for opportunities to improve processes with automation.

What are you required to do ? (Your Responsibilities) :

• Proactively maintain and develop all linux infrastructure technology to maintain a 24*7*365 uptime service.
• Engineering of systems administration-related various solutions for our various SAAS products and projects as well as operational needs.
• Proactively monitoring system performance and capacity planning.
• Providing technical support to customers for Applications, Operating systems, and networking.
• Will also be the first point of contact for our clients, where installations are placed on a permanent basis, for basic troubleshooting and problem solving.
• Fault finding, analysis and logging information for reporting of performance exceptions.
• Maintain best practices on managing systems and services across all environments.

Skills & Qualification Required (Add Value) :

• Graduate - Preferred to have Bachelor‘s Degree in Engineering, Computer Science or related field.
• He / She should be familiar with the installation and configuration of Linux operating systems and setup and operation of TCP/IP networking on Linux systems also familiar with Internet concepts including SMTP, IMAP, POP, HTTP, DNS, LDAP and related protocols.
• You should possess excellent communication skills .
• Knowledge of Email concepts, Helpdesk Concept , VoIP Concept , Cloud computing will be an added advantage.

Job Overview

We are seeking a highly experienced Senior Linux Infrastructure Engineer with deep expertise in Linux administration, bare metal infrastructure, enterprise storage, and next-generation AI Factory / GPU infrastructure platforms. This role is focused on designing, deploying, operating, and troubleshooting large-scale Linux-based infrastructure that powers both traditional enterprise workloads and modern AI/ML environments.

This is not a DevOps-focused role. We already have a dedicated DevOps team and are looking for an engineer with extensive hands-on experience in Bare Metal as a Service (BMaaS), GPU infrastructure, high-performance storage, data center operations, and enterprise Linux platforms.

The ideal candidate will have experience building and managing infrastructure from the hardware layer up, including servers, networking, storage, GPU clusters, and AI-ready platforms. They should be comfortable working with high-performance computing (HPC), AI Factory environments, and large-scale Linux deployments where performance, reliability, and operational excellence are critical.

Key Responsibilities & Required Skills

Linux & Bare Metal Infrastructure

• Expert-level Linux administration (Ubuntu required; Red Hat and SUSE preferred)
• Deep expertise in bare metal server deployment, architecture, provisioning, and lifecycle management
• Experience operating Bare Metal as a Service (BMaaS) platforms and large-scale infrastructure environments
• Strong understanding of server hardware, including:
• BIOS/UEFI
• RAID controllers
• Firmware management
• iLO/iDRAC/IPMI
• NICs and SmartNICs
• HBA cards
• Hardware diagnostics and troubleshooting
• Experience designing, implementing, and supporting enterprise Linux infrastructure at scale

AI Factory & GPU Infrastructure

• Experience deploying and managing GPU-accelerated infrastructure for AI/ML workloads
• Understanding of NVIDIA GPU technologies including:
• A100, H100, H200, B200, or equivalent GPU platforms
• NVIDIA DGX and OEM GPU servers
• GPU provisioning and lifecycle management
• GPU monitoring and performance optimization
• Knowledge of AI Factory architecture and infrastructure requirements
• Experience supporting GPU clusters, AI training environments, and high-performance computing (HPC) workloads
• Understanding of:
• GPU resource allocation and scheduling
• Multi-GPU systems
• GPU networking requirements
• High-bandwidth, low-latency infrastructure design
• Familiarity with NVIDIA ecosystem technologies such as:
• CUDA
• NCCL
• GPUDirect Storage
• NVIDIA Fabric Manager
• NVIDIA Base Command (preferred)

Enterprise Storage & Data Platforms

• Advanced Linux storage administration:
• LVM
• XFS, EXT4
• NFS
• iSCSI
• Fibre Channel SAN
• Multipath I/O
• Strong hands-on experience with Ceph, including:
• Cluster architecture
• MON, OSD, MDS
• RBD, CephFS, RGW
• Capacity planning
• Performance tuning
• Failure recovery
• Experience with high-performance AI storage platforms such as:
• WEKA
• VAST Data
• Dell PowerScale
• Pure Storage FlashBlade
• NetApp
• Understanding of:
• NVMe-over-Fabrics (NVMe-oF)
• RDMA
• GPUDirect Storage
• Parallel file systems
• AI data pipelines

Networking & Infrastructure

• Strong networking knowledge:
• Bonding
• VLANs
• Routing
• MTU optimization
• DNS
• DHCP
• Experience with high-performance data center networking:
• 100G/200G/400G Ethernet
• RoCE
• RDMA
• Spine-Leaf architectures
• Familiarity with NVIDIA Spectrum-X, Mellanox/NVIDIA ConnectX adapters, or equivalent technologies
• Strong understanding of Layer 2 and Layer 3 infrastructure design and troubleshooting

Operations & Reliability

• Experience with high availability, clustering, and disaster recovery
• Strong troubleshooting skills across:
• Linux operating systems
• Hardware platforms
• GPU infrastructure
• Networking
• Enterprise storage
• Experience supporting mission-critical production environments
• Bash and Python scripting for automation and operational efficiency
• Experience creating operational documentation, runbooks, and infrastructure standards

Nice to Have

• Kubernetes infrastructure (especially AI/ML and GPU integration)
• KVM, VMware, OpenShift Virtualization, or similar virtualization platforms
• Ansible automation
• NVIDIA Base Command Manager
• Slurm or HPC workload schedulers
• Observability and monitoring platforms (Prometheus, Grafana, OpenTelemetry)
• Data Center Infrastructure Management (DCIM) tools
• IPAM solutions
• AWS, Azure, or hybrid cloud exposure