ashby
Software Engineer – Cloud Infrastructure
FriendliAI
San Francisco, USA
Full-time
Senior · 5+ years experience
Hybrid
Discovered 1 weeks ago
KubernetesetcdCNIIPAMDNSTerraform
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
KubernetesetcdCNI
Role Overview
FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud.
As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built and connected, extend Kubernetes where its defaults fall short, and own the network path that inference traffic depends on.
Inference is an unforgiving workload for Kubernetes.
Traffic is bursty and latency-sensitive, GPU capacity is scarce and inelastic, tenants must stay isolated, and multi-node serving depends on the network holding up under sustained load.
This is a hands-on architecture role for an engineer who has already run large clusters in production and wants to push them further.
Key Skills for This Role
KubernetesetcdCNIIPAMDNSTerraform
Full Job Posting
About the job
FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud. As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built and connected, extend Kubernetes where its defaults fall short, and own the network path that inference traffic depends on.
Inference is an unforgiving workload for Kubernetes. Traffic is bursty and latency-sensitive, GPU capacity is scarce and inelastic, tenants must stay isolated, and multi-node serving depends on the network holding up under sustained load. This is a hands-on architecture role for an engineer who has already run large clusters in production and wants to push them further.
Key Responsibilities
- Cluster Architecture
- Own the architecture of our multi-cluster, multi-tenant Kubernetes fleet across both managed and self-managed clusters: cluster topology, control plane and etcd lifecycle, and zero-downtime upgrades.
- Extend Kubernetes with custom controllers, operators, and CRDs so platform behavior is encoded in software rather than runbooks.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at FriendliAI
Solutions Architect - AI Inference Specialist
San Francisco, USA
MidFull-time
Discovered 1 weeks agoView →
Software Engineer – GPU Kernel
San Francisco, USA
Discovered 1 weeks agoFull-time
Solutions Architect - AI Inference Specialist
San Francisco, USA
Discovered 1 weeks agoFull-time
Software Engineer – AI Inference Engine
San Francisco, USA
Discovered 1 weeks agoFull-time
Solutions Architect - AI Model Specialist
San Francisco, USA
Discovered 1 weeks agoFull-time
Software Engineer – Platform Security
San Francisco, USA
Discovered 1 weeks agoFull-time
Software Engineer - Full Stack
San Francisco, USA
Discovered 1 weeks agoFull-time
Software Engineer – AI Agents
San Francisco, USA
Discovered 1 weeks agoFull-time
Director of Product Management
San Francisco, USA
Discovered 1 weeks agoFull-time