Software Engineer, Production Engineering

Being a member of the 24/7 Production engineering team to support Production Kubernetes Services, with a focus on automation and on reducing manual tasks. Flexibility to work on split-weekend shifts.

Perform large scale K8s administration, systems administration, and security monitoring tasks to maintain service SLAs,integrity and reliability.

Utilize alerts, alarms, and observability tools to proactively monitor, detect, prevent, and respond to incidents.

Apply deep systems knowledge to analyze logs, metrics, and system behavior to troubleshoot issues, lead root cause analysis, and implement effective resolutions.

Initiate and lead incident management calls, ensuring timely detection, escalation, and resolution of issues by engaging subject matter experts and service owners as needed to resolve complex incidents efficiently.

7+ years of demonstrated experience administering large-scale production Kubernetes systems in high-availability Internet, Cloud, or Data Center environments. Strong preference for on-prem expertise.

BS in Computer Science, Engineering, Mathematics, or equivalent experience.

Advanced hands-on experience with Kubernetes, SLURM, and large-scale cluster management.

Familiarity with GPU / DPU hardware and high-performance computing Cluster environments.

Strong Linux system administration, DNS, DHCP and core linux networking (IP Tables, routing, firewalls) experience with skills to troubleshoot and maintain Services on large-scale bare-metal infrastructure.

Experience working with CI/CD tools like Jenkins, ArgoCD.

Experience in scripting, Programming in Python or Golang or Rust preferred, but not required.

Strong communication and soft skills, able to present to cross-functional group members in a persuasive manner.