"Inference Infrastructure Engineer" Jobs in United States

Inference Infrastructure Engineer

Rhoda AI · Palo Alto

At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation worl

Inference Infrastructure Engineer, Serving

Elorian AI · Palo Alto

About Us We are a well-funded, early-stage AI lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers, including Andrew Dai, who was previously a leader on Ge

Research Engineer, Infrastructure, Inference

Thinking Machines · San Francisco

The mission of Thinking Machines is to build AI that extends human will and judgment. About the Role We’re looking for an infrastructure research engineer to design, optimize, and scale the systems that power large AI

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Internship 2027 Onboard Infrastructure Engineer, ML Inference

Bedrock Robotics · San Francisco

Join the team bringing advanced autonomy to the built world At Bedrock, we're moving AI out of the lab and into the real world. Our team includes veterans who helped launch Waymo, scaled Segment to a $3.2B acquisition, a

Staff Software Engineer, ML Training and Inference Infrastructure

Rivian · Palo Alto

About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI · Seattle

Location: Seattle, WA (Hybrid - 3 days/week in office) About ElastixAI: ElastixAI is an early-stage Software startup on a mission to reinvent AI inference infrastructure from the ground up. We're building a next-genera

Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization

DiDi Labs · San Jose

About the Company DiDi's autonomous driving unit was established in 2016 with the mission of developing Level 4 autonomous driving (AD) technology to make transportation safer and more efficient. In August 2019, the uni

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD)

ByteDance · Seattle

About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance’s Core Compute Infrastructur

Machine Learning Infrastructure Engineer, Model Inference

Abridge · San Francisco

About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencie

Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AI · Amsterdam

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f

Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Engineering Manager, Inference Infrastructure

Anthropic · San Francisco

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of c

Staff Software Engineer, Inference Infrastructure

Cohere · San Francisco

Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content gener

AI Inference Core - Infrastructure SW Engineer

Cerebras Systems ·

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale