ashby
Founding ML infrastructure Engineer
Ashby
Remote, USA
Full-time
Senior
Remote
USD 200000-350000 yearly / year
Discovered 1 weeks ago
KubernetesSlurmSchedulingTensorRT-LLMNCCLInfiniBand
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
KubernetesSlurmScheduling
Key Skills for This Role
KubernetesSlurmSchedulingTensorRT-LLMNCCLInfiniBand
Full Job Posting
The problem we saw
Most AI infrastructure is built for batch: send a query, wait, get a response, reset. Powerful, but transactional. AI is becoming interactive — sessions that hold state, models that stay alive between turns, generation that responds as it runs — and the infrastructure to deliver that at scale doesn't really exist yet.
The bottleneck isn't the models anymore. It's the infrastructure underneath them.
What we're building to fix it
uRun is the inference cloud for interactive AI: the compute layer that makes real-time, stateful inference possible at scale. We came out of stealth in April 2026, are backed by top-tier investors, and are founded by Keegan McCallum, who scaled inference infrastructure for some of the most demanding generative AI workloads in production.
We're an infrastructure company. We build the layer that model labs, builders, and research teams ship on top of.
Where you come in
We are building the next generation of AI inference infrastructure. As our ML Infrastructure and Platform Engineer, you will own the architecture and scaling of our GPU compute platform from the ground up.
This is a founding technical hire with end-to-end ownership across the full infrastructure stack, from bare metal to model serving. You will work directly with the founding team and define how we build.
What you'll actually be doing day-to-day
Design and scale our GPU compute platform to support 1,000+ GPU clusters, ensuring high availability and low-latency inference across the fleet
Build and maintain the infrastructure layer for our compute marketplace, including multi-tenant scheduling, isolation, and billing-aware resource allocation
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Ashby
Licensed Vocational Nurse (LVN)
Detroit, USA
Discovered 2 days agoFull-time
Robotics navigation engineer
Santa Clara, USA
Discovered 2 days agoFull-time
Forward Deployed Engineer
San Francisco, USA
Discovered 2 days agoFull-time
Open Resume Submission
San Francisco, USA
Discovered 2 days agoFull-time
Product Manager, Onboarding and Growth
, USA
Discovered 5 days agoFull-time
Senior Software Engineer
, USA
Discovered 1 weeks agoFull-time
Rails / React Lead Engineer
, USA
Discovered 1 weeks agoFull-time
Forward Deployed Robotics Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time