"Software Engineer, Inference" Jobs in United States

Software Engineer, Inference Systems

River AI Inc. · Palo Alto

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu

Software Engineer, Inference

Luma · Redwood City

You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs. Thi

Staff Software Engineer, Inference Cloud

Cerebras Systems · Sunnyvale

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale

Software Engineer, Inference

Pulse · San Francisco

Overview Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understan

Software Engineer, Inference AI/ML

CoreWeave · Sunnyvale

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilie

Staff Software Engineer, Inference

CoreWeave · Sunnyvale

What You’ll Do: Inference Platform Team The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsib

Senior Software Engineer, Inference

Pika · Palo Alto

About the Role We are seeking a Senior Inference Engineer to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceler

Software Engineer, Inference Runtime

LM Studio · New York City

LM Studio is used by millions of people around the world to run AI on their own computers, and now with Bionic - also in the cloud. Our values prioritize putting the human in the center, and creating tools that we want t

Senior Software Engineer, Inference

AssemblyAI ·

Why AssemblyAI AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billio

Senior Software Engineer, Inference

AssemblyAI ·

Why AssemblyAI AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billio

Software Engineer, Inference (AI Data Engineering)

SpaceX · Palo Alto

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this poss

Staff + Senior Software Engineer, Inference

Anthropic · New York City

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co

Software Engineer, Inference AI/ML

CoreWeave · Bellevue

What You’ll Do: Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operationa

Staff Software Engineer, Inference

CoreWeave · Bellevue

What You’ll Do: Inference Platform Team The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsibl

Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI · Amsterdam

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f