Lead Engineer - HPC Operations
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Core42 is seeking a Lead Engineer for HPC Operations to oversee daily management of high-performance computing clusters for AI/ML workloads. The role requires deep expertise in Slurm, Kubernetes, and MLOps platforms, with at least 8 years of experience in HPC operations.
Key Skills for This Role
Responsibilities
- Oversee the daily operational management of HPC infrastructure, including compute, storage, networking, and scheduler components (e.g., Slurm, Kubernetes)
- Drive efforts to optimize the efficiency and performance of HPC systems, ensuring maximum resource utilization and minimizing downtime
- Serve as the primary technical escalation point for L2 support teams, ensuring rapid and effective resolution of incidents and service requests
- Continuously monitor system health, performance, and resource utilization using advanced monitoring tools (e.g., Prometheus, Grafana, DCGM)
- Manage user environments for AI/ML workloads, including container orchestration (e.g., Docker, Kubernetes) and workflow tools (e.g., MLflow, Kubeflow)
- Define and enforce job scheduling policies, priorities, and partitions within Slurm and/or Kubernetes environments
- Lead root cause analysis (RCA) of operational issues, contributing to post mortem documentation and driving continuous improvement initiatives
- Provide mentorship and technical guidance to junior engineers, fostering skills development and knowledge sharing across teams
- Ensure adherence to security and operational policies, assisting in audits and maintaining documentation for change and incident management processes
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
- Minimum of 8 years of experience in HPC operations, systems engineering, or DevOps roles
- At least 2 years in a leadership or ownership capacity
- Advanced expertise in configuring, optimizing, and maintaining complex HPC environments
- Hands on experience managing Slurm clusters and/or Kubernetes based environments for AI/ML workloads
- In depth knowledge of GPU resource management, workload schedulers, and performance tuning for AI/ML workloads
- Proficiency with monitoring and observability frameworks such as Prometheus, Grafana, and DCGM
- Strong scripting and automation skills, including Python, Bash, Ansible, and Terraform
- Solid understanding of Linux (RHEL/CentOS/Ubuntu), networking technologies (RDMA, InfiniBand, RoCE), and storage solutions (NFS, Lustre, Ceph)
Full Job Posting
About Us
- Core42 is a leader in AI powered cloud and digital infrastructure, driving transformative technology solutions globally.
- Leverages advanced resources and partnerships to empower clients with sovereign AI infrastructure.
The Role
- We are seeking a highly skilled Lead Engineer – HPC Operations to oversee daily operations and support of HPC clusters for AI/ML workloads.
- This role ensures stable, secure, and high performing infrastructure leveraging Slurm, Kubernetes, and modern MLOps platforms.
Responsibilities
- Oversee the daily operational management of HPC infrastructure, including compute, storage, networking, and scheduler components (e.g., Slurm, Kubernetes, etc.).
- Drive efforts to optimize the efficiency and performance of HPC systems, ensuring maximum resource utilization and minimizing downtime.
- Serve as the primary technical escalation point for L2 support teams, ensuring rapid and effective resolution of incidents and service requests.
- Continuously monitor system health, performance, and resource utilization using advanced monitoring tools (e.g., Prometheus, Grafana, DCGM).
- Manage user environments for AI/ML workloads, including container orchestration (e.g., Docker, Kubernetes) and workflow tools (e.g., MLflow, Kubeflow).
- Define and enforce job scheduling policies, priorities, and partitions within Slurm and/or Kubernetes environments.
- Lead root cause analysis (RCA) of operational issues, contributing to post mortem documentation and driving continuous improvement initiatives.
- Provide mentorship and technical guidance to junior engineers, fostering skills development and knowledge sharing across teams.
- Ensure adherence to security and operational policies, assisting in audits and maintaining documentation for change and incident management processes.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- Minimum of 8 years of experience in HPC operations, systems engineering, or DevOps roles, with at least 2 years in a leadership or ownership capacity.
- Advanced expertise in configuring, optimizing, and maintaining complex HPC environments, including hardware, software, and storage systems.
- Hands on experience managing Slurm clusters and/or Kubernetes based environments for AI/ML workloads.
- In depth knowledge of GPU resource management, workload schedulers, and performance tuning for AI/ML workloads.
- Proficiency with monitoring and observability frameworks such as Prometheus, Grafana, and DCGM.
- Strong scripting and automation skills, including Python, Bash, Ansible, and Terraform.
- Solid understanding of Linux (RHEL/CentOS/Ubuntu), networking technologies (RDMA, InfiniBand, RoCE), and storage solutions (NFS, Lustre, Ceph).
What working at Core42 offers
- Competitive Salary based on skills and experience.
- Yearly Bonus: performance based annual bonus.
- Exclusive Discount Cards with Esaad and Fazaa cards.
- Premium Family Insurance including dental, vision and life insurance.
- Learning & Development: access to top tier learning platforms.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Core42
Senior Architect - DC Network Engineering
Abu Dhabi, UAE
Core42 seeks a Senior Network Architect to lead the design and decision-making for its Data Center Network infrastructure. The role involves defining DCN functionalities, approving complex solutions, and ensuring scalabi
Senior Site Reliability Engineer
Abu Dhabi Emirate, UAE
Core42 seeks a Senior Site Reliability Engineer to design, implement, and operate scalable infrastructure for AI and HPC workloads. The role involves CI/CD pipelines, Kubernetes, observability, and incident management. C
Senior Engineer - DC Network Engineering
Abu Dhabi Emirate, UAE
Core42 seeks a Senior Engineer for Data Centre Network Engineering to design, optimize, and secure network infrastructure supporting cloud and AI workloads. The role requires deep expertise in L2/L3 networking, routing p
Legal Director
Abu Dhabi Emirate, UAE
Core42 seeks a visionary Legal Director to lead commercial contracts and provide legal advice across the organization. The role requires a qualified lawyer with 8+ years of post-qualification experience in commercial law
Senior Engineer - HPC Operations
Abu Dhabi Emirate, UAE
Lead daily operations of HPC clusters for AI/ML workloads, ensuring performance and reliability. Requires 7+ years of HPC operations experience with Slurm, Kubernetes, GPU management, and automation skills.
Analyst - Security Operations
Abu Dhabi Emirate, UAE
Core42 seeks a senior (L3) Incident Analyst for its 24x7 Security Operations Center in Abu Dhabi. The role involves detecting, triaging, investigating, and responding to security incidents across a private-cloud platform
Supply Chain Lead
Abu Dhabi Emirate, UAE
Core42 seeks a hands-on Supply Chain Lead to own end-to-end sourcing execution and delivery assurance for AI infrastructure (GPU, servers, networking, data center components). This role focuses on supplier expediting, or
Specialist - Talent Sourcing
Abu Dhabi, UAE
Core42 is seeking a motivated professional to join their team in Abu Dhabi. The role involves participating in cross-functional projects, providing innovative solutions, and maintaining clear communication. Ideal candida
Senior Architect - DC Network Engineering
Abu Dhabi, UAE
Senior Site Reliability Engineer
Abu Dhabi Emirate, UAE
Senior Engineer - DC Network Engineering
Abu Dhabi Emirate, UAE
Legal Director
Abu Dhabi Emirate, UAE
Senior Engineer - HPC Operations
Abu Dhabi Emirate, UAE
Analyst - Security Operations
Abu Dhabi Emirate, UAE
Supply Chain Lead
Abu Dhabi Emirate, UAE
Specialist - Talent Sourcing
Abu Dhabi, UAE