Engineering Manager, Runtime Fabric

RESPONSIBILITIES

• Team Leadership & Culture
• Recruit, hire, and develop a high-performing team of systems engineers with deep container and Linux expertise.
• Foster a culture of technical rigor, open-source contribution, and continuous improvement.
• Provide regular coaching, feedback, and career development support to your direct reports.
• Partner with engineering leadership to define the long-term vision and roadmap for container runtime and storage infrastructure.
• Technical Direction
• Guide the team in extending and hardening containerd, runc, and related OCI ecosystem projects to meet the GPU-specific requirements of production AI inference, including startup performance, GPU device access, and multi-tenant isolation.
• Oversee the architecture and evolution of the Baseten Delivery Network: the tiered caching and weight delivery system that makes cold starts 2–3x faster and eliminates thundering herd failures during burst scaling events.
• Drive the expansion of BDN's architecture, currently focused on model weights, to container images, training checkpoints, and deployment artifacts.
• Provide technical oversight on GPU-aware isolation mechanisms for multi-tenant inference, including secure container runtimes, Linux namespace hardening, and longer-term micro-VM integration.
• Ensure the team maintains end-to-end ownership of the container startup performance path, from snapshotter initialization through weight delivery to first inference request.
• Champion the team's contributions back to the open-source containerd ecosystem alongside a team of core maintainers.
• Cross-Functional Partnership
• Act as the primary advocate for Runtime Fabric across the organization, ensuring upstream and downstream teams have the integration support they need.
• Collaborate with product and engineering stakeholders to prioritize investments based on business impact and infrastructure reliability.
• Communicate team progress, technical trade-offs, and architectural decisions clearly to leadership.