Sr. HPC ENGINEER

Role Overview We are seeking seasoned professionals with deep expertise in operating and managing High-Performance Computing (HPC) platforms . The ideal candidate will have hands-on experience in designing, deploying, and maintaining HPC clusters, storage systems, and networking infrastructure, leveraging industry-leading tools and technologies. Key Responsibilities · HPC Infrastructure Management o Operate and maintain HPC clusters based on CentOS, RHEL , and hardware platforms like HPE and NVIDIA DGX . o Ensure optimal performance, scalability, and reliability of compute resources. · Storage Administration o Manage large-scale storage systems including Dell Isilon , VAST Storage , Lustre , and GPFS . o Implement data lifecycle management and optimize storage performance for HPC workloads. · Networking o Configure and maintain InfiniBand-based networking for low-latency, high-bandwidth communication. o Troubleshoot network performance issues and ensure secure connectivity. · Cluster and Job Scheduling o Administer cluster management tools such as Bright Cluster Manager , Altair Grid Manager , and IBM LSF . o Optimize job scheduling and resource allocation for diverse workloads. · Monitoring and Automation o Implement monitoring solutions using Zabbix , Grafana , and ELK Stack . o Automate provisioning and configuration using Cobbler , Chef , Ansible , and AWS ParallelCluster . · Performance Tuning & Troubleshooting o Conduct performance benchmarking and tuning for HPC workloads. o Diagnose and resolve hardware/software issues across compute, storage, and network layers. · Security & Compliance o Ensure HPC environment adheres to security best practices and compliance standards. Required Skills & Qualifications · Technical Expertise o Strong knowledge of Linux OS (CentOS, RHEL) and HPC hardware platforms ( HPE , NVIDIA DGX ). o Hands-on experience with parallel file systems (Lustre, GPFS) and enterprise storage solutions. o Proficiency in InfiniBand networking and high-speed interconnects. o Familiarity with job schedulers and cluster management tools (IBM LSF, Bright Cluster Manager, Altair Grid Manager). · Automation & Scripting o Expertise in Ansible , Chef , Cobbler , and scripting languages (Bash, Python). o Experience with AWS ParallelCluster or similar cloud-based HPC solutions. · Monitoring & Logging o Practical experience with Zabbix , Grafana , and ELK Stack for system health and performance monitoring. · Soft Skills o Strong problem-solving and analytical skills. o Ability to work in a fast-paced environment and lead technical teams. o Excellent communication and documentation skills. Preferred Qualifications · Exposure to AI/ML workloads on HPC clusters. · Experience with containerization (Docker, Singularity) in HPC environments. · Knowledge of security hardening for HPC systems. Education · Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. #LI-LK1