ashby
INFERENCE ENGINEER
MakerMaker
San Francisco, USA
Full-time
Senior · 3+ years experience
Onsite
Discovered 2 days ago
PythonC++CUDAROCmTriton
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonC++CUDA
Role Overview
You build and operate the inference systems that serve our models in production. The work spans serving infrastructure, runtime optimization, and the long tail of production infrastructure that come with running real workloads.
This is an engineering role, not a research role. You'll measure, profile, debug, and ship. You'll work alongside researchers, but your job is to make their work fast and reliable in production. Real ownership, real autonomy.
Key Skills for This Role
PythonC++CUDAROCmTriton
Full Job Posting
ABOUT THE COMPANY
We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small team based in San Francisco, on-site
ABOUT THE ROLE
You build and operate the inference systems that serve our models in production. The work spans serving infrastructure, runtime optimization, and the long tail of production infrastructure that come with running real workloads.
This is an engineering role, not a research role. You'll measure, profile, debug, and ship. You'll work alongside researchers, but your job is to make their work fast and reliable in production. Real ownership, real autonomy.
WHAT YOU'LL DO
- Build, operate, and harden production inference systems serving large models at high throughput
- Own the performance characteristics of those systems end-to-end: throughput, latency, cost-per-token, reliability under load
- Profile real workloads to identify bottlenecks; ship fixes that move the metric you set out to improve
- Implement and integrate inference optimizations from the research team (quantization, custom kernels, scheduling improvements, memory management) into production
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at MakerMaker
RESEARCHER, AGENTS FOR AUTOMATED DISCOVERY
San Francisco, USA
SeniorFull-time
Discovered 1 weeks agoView →
RESEARCHER (GENERAL)
San Francisco, USA
Discovered 2 days agoFull-time
RESEARCHER, EFFICIENT INFERENCE
San Francisco, USA
Discovered 1 weeks agoFull-time
RESEARCHER, POST-TRAINING
San Francisco, USA
Discovered 1 weeks agoFull-time
ML ENGINEER (GENERAL)
San Francisco, USA
Discovered 1 weeks agoFull-time
RESEARCHER, AGENTS FOR AUTOMATED DISCOVERY
San Francisco, USA
Discovered 1 weeks agoFull-time