Staff Software Engineer, Inference Cloud

Skills & Qualifications

• 8+ years of experience in software engineering, with substantial individual contributor experience building and operating large-scale distributed systems or cloud infrastructure.
• Deep expertise in distributed systems architecture in cloud environments, including networking, compute orchestration, container platforms, and multi-region production services.
• Strong track record of making sound architectural decisions for highly available, latency-sensitive systems at scale.
• Experience optimizing latency, throughput, and efficiency in high-QPS systems. Experience with TTFT and tail-latency reduction is a strong plus.
• Strong proficiency in backend or systems languages such as Go, C++, or Python, with the expectation that you can contribute production code directly.
• Experience designing observability and reliability practices, including metrics, logging, tracing, alerting, incident response, and SLO-driven operations.
• Ability to influence senior engineers and cross-functional partners through technical credibility, communication, and judgment, especially within your domain and adjacent systems.

Preferred Skills & Qualifications

• Experience with ML inference infrastructure, model serving systems, or GPU-accelerated workloads.

Why Join Cerebras

Apply today and become part of the forefront of groundbreaking advancements in AI!