ashby
Staff Engineer
LiteLLM
San Francisco, USA
Full-time
Senior
Onsite
USD 240000-270000 yearly / year
Discovered 1 weeks ago
PythonGitHub
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonGitHub
Role Overview
You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
Key Skills for This Role
PythonGitHub
Full Job Posting
Staff Software Engineer, Product Quality
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Staff Software Engineer to own product quality across our testing, CI, and release systems.
About The Role
You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
Responsibilities
- Own product quality end to end and drive regressions toward zero
- Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
- Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
- Build canary and synthetic traffic detection to catch upstream provider drift before customers do
- Own release channels so we ship daily at the edge while enterprise stays stable
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at LiteLLM
Business Manager
, USA
Discovered 2 days agoFull-time
Backend Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Rust Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Account Executive
, USA
Discovered 1 weeks agoFull-time
Founding Developer Relations
San Francisco, USA
Discovered 1 weeks agoFull-time
Forward Deployed Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Technical Account Manager
San Francisco, USA
Discovered 1 weeks agoFull-time
Forward Deployed Engineer (New Grad)
, USA
Discovered 3 weeks agoFull-time