ashby
Rust Engineer
LiteLLM
San Francisco, USA
Full-time
Senior
Onsite
USD 200000-260000 yearly / year
Discovered 1 weeks ago
RustPythonPostgreSQLRedisOpenAIGitHub
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
RustPythonPostgreSQL
Role Overview
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Key Skills for This Role
RustPythonPostgreSQLRedisOpenAIGitHub
Full Job Posting
Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
- Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
- Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at LiteLLM
Business Manager
, USA
Discovered 2 days agoFull-time
Backend Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Account Executive
, USA
Discovered 1 weeks agoFull-time
Staff Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Founding Developer Relations
San Francisco, USA
Discovered 1 weeks agoFull-time
Forward Deployed Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time
Technical Account Manager
San Francisco, USA
Discovered 1 weeks agoFull-time
Forward Deployed Engineer (New Grad)
, USA
Discovered 3 weeks agoFull-time