Senior Engineer - HPC Operations
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Lead daily operations of HPC clusters for AI/ML workloads, ensuring performance and reliability. Requires 7+ years of HPC operations experience with Slurm, Kubernetes, GPU management, and automation skills.
Key Skills for This Role
Responsibilities
- Lead the daily operational support of HPC infrastructure including compute, storage, networking, and scheduler components (Slurm, Kubernetes, etc.)
- Lead efforts to maximize the efficiency and performance of HPC systems, ensuring optimal resource utilization and minimal downtime
- Act as the primary technical escalation point for L2 support teams and ensure prompt resolution of incidents and service requests
- Monitor system health, performance, and utilization using advanced tools (e.g., Prometheus, Grafana, DCGM)
- Manage user environments for AI/ML workloads including container orchestration (e.g., Docker, Kubernetes) and workflow tools (e.g., MLflow, Kubeflow)
- Implement and manage job scheduling policies, priorities, and partitions within Slurm and/or Kubernetes environments
- Lead root cause analysis (RCA) of operational issues and contribute to post mortem documentation and continuous improvement efforts
- Provide mentorship and guidance to junior engineers and participate in on call rotation if required
- Ensure compliance with security and operational policies; assist in audits and documentation for change and incident management processes
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related technical field
- 7+ years of experience in HPC operations, systems engineering, or DevOps roles
- Advanced knowledge in configuring, optimizing, and maintaining complex HPC environments
- Hands on experience managing Slurm clusters and/or Kubernetes based environments for AI/ML workloads
- Expert knowledge of GPU resource management, workload schedulers, and performance tuning for AI/ML workloads
- Experience with monitoring and observability frameworks such as Prometheus, Grafana, and DCGM
- Strong scripting and automation skills (Python, Bash, Ansible, Terraform)
- In depth understanding of Linux (RHEL/CentOS/Ubuntu), networking concepts (RDMA, InfiniBand, RoCE), and storage technologies (NFS, Lustre, Ceph)
Full Job Posting
The opportunity
- We are seeking a highly skilled Senior Engineer – HPC Operations to oversee the daily operations and support of high performance computing clusters designed to power large scale AI and ML workloads.
- This role ensures stable, secure, and high performing infrastructure leveraging technologies such as Slurm, Kubernetes, and modern MLOps platforms.
- The ideal candidate will bring deep technical expertise in HPC and a strong operational mindset to drive continuous improvement and automation across globally distributed environments.
Your key responsibilities
- Lead the daily operational support of HPC infrastructure including compute, storage, networking, and scheduler components (Slurm, Kubernetes, etc.).
- Lead efforts to maximize the efficiency and performance of HPC systems, ensuring optimal resource utilization and minimal downtime.
- Act as the primary technical escalation point for L2 support teams and ensure prompt resolution of incidents and service requests.
- Monitor system health, performance, and utilization using advanced tools (e.g., Prometheus, Grafana, DCGM).
- Manage user environments for AI/ML workloads including container orchestration (e.g., Docker, Kubernetes) and workflow tools (e.g., MLflow, Kubeflow).
- Implement and manage job scheduling policies, priorities, and partitions within Slurm and/or Kubernetes environments to ensure fairness and efficiency.
- Lead root cause analysis (RCA) of operational issues and contribute to post mortem documentation and continuous improvement efforts.
- Provide mentorship and guidance to junior engineers and participate in on call rotation if required.
- Ensure compliance with security and operational policies; assist in audits and documentation for change and incident management processes.
Required skills / qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related technical field.
- 7+ years of experience in HPC operations, systems engineering, or DevOps roles.
- Advanced knowledge and expertise in configuring, optimizing, and maintaining complex HPC environments, including hardware, software, and storage systems.
- Hands on experience managing Slurm clusters and/or Kubernetes based environments for AI/ML workloads.
- Expert knowledge of GPU resource management, workload schedulers, and performance tuning for AI/ML workloads.
- Experience with monitoring and observability frameworks such as Prometheus, Grafana, and DCGM.
- Strong scripting and automation skills (Python, Bash, Ansible, Terraform).
- In depth understanding of Linux (RHEL/CentOS/Ubuntu), networking concepts (RDMA, InfiniBand, RoCE), and storage technologies (NFS, Lustre, Ceph).
What Working at Core42 Offers
- With a diverse team of 1,100+ employees from 68 nationalities, we foster an inclusive, innovative, and collaborative environment.
- At Core42, we are grounded in trust, accountability, and high performance. We are united by our values: Grit, Passion, and Impact—driving resilience, excellence, and meaningful progress across everything we do.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Core42
Senior Site Reliability Engineer
Abu Dhabi Emirate, UAE
Core42 seeks a Senior Site Reliability Engineer to design, implement, and operate scalable infrastructure for AI and HPC workloads. The role involves CI/CD pipelines, Kubernetes, observability, and incident management. C
Senior Engineer - DC Network Engineering
Abu Dhabi Emirate, UAE
Core42 seeks a Senior Engineer for Data Centre Network Engineering to design, optimize, and secure network infrastructure supporting cloud and AI workloads. The role requires deep expertise in L2/L3 networking, routing p
Legal Director
Abu Dhabi Emirate, UAE
Core42 seeks a visionary Legal Director to lead commercial contracts and provide legal advice across the organization. The role requires a qualified lawyer with 8+ years of post-qualification experience in commercial law
Analyst - Security Operations
Abu Dhabi Emirate, UAE
Core42 seeks a senior (L3) Incident Analyst for its 24x7 Security Operations Center in Abu Dhabi. The role involves detecting, triaging, investigating, and responding to security incidents across a private-cloud platform
Supply Chain Lead
Abu Dhabi Emirate, UAE
Core42 seeks a hands-on Supply Chain Lead to own end-to-end sourcing execution and delivery assurance for AI infrastructure (GPU, servers, networking, data center components). This role focuses on supplier expediting, or
Specialist - Talent Sourcing
Abu Dhabi, UAE
Core42 is seeking a motivated professional to join their team in Abu Dhabi. The role involves participating in cross-functional projects, providing innovative solutions, and maintaining clear communication. Ideal candida
Program Executive
Abu Dhabi Emirate, UAE
Core42 is seeking a Program Executive to support the Program Management department in Abu Dhabi. The role coordinates day-to-day process, documentation, and reporting activities, supports compliance and governance routin
Senior Software Engineer (Go)
Abu Dhabi Emirate, UAE
Core42 is hiring a Senior Software Engineer (Go) to architect, scale, and maintain backend services for AI-powered cloud infrastructure. The role requires deep expertise in Go, Kubernetes, and cloud-native development, w
Senior Site Reliability Engineer
Abu Dhabi Emirate, UAE
Senior Engineer - DC Network Engineering
Abu Dhabi Emirate, UAE
Legal Director
Abu Dhabi Emirate, UAE
Analyst - Security Operations
Abu Dhabi Emirate, UAE
Supply Chain Lead
Abu Dhabi Emirate, UAE
Specialist - Talent Sourcing
Abu Dhabi, UAE
Program Executive
Abu Dhabi Emirate, UAE
Senior Software Engineer (Go)
Abu Dhabi Emirate, UAE