"Software Engineer, Inference Systems" Jobs in United States

Software Engineer, Inference Systems

River AI Inc. · Palo Alto

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu

Principal System Software Engineer, AI Inference Execution

D Matrix · Santa Clara

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible.

"Required qualifications: 5+ years OOP in Python/Scala/Java programming experience with expert level development skills Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. -Hands on experi

Staff+ Software Engineer, ML Inference Path

Anthropic · San Francisco

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co

Staff + Sr. Software Engineer, Scaling

Anthropic ·

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co

AI Systems Engineer (OCI/AI Infrastructure)

CLBPTS - All Lines of Business · Nashville

Oracle Hardware Platform Development Engineering is seeking a highly driven AI Systems Engineer to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure (OCI). This is

"Required qualifications: 5+ years OOP in Python/Scala/Java programming experience with expert level development skills Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. -Hands on experi

Software Engineer, Distributed Training

River AI Inc. · Palo Alto

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu

Software Engineer, GPU Kernels

River AI Inc. · Palo Alto

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu

AI Systems Engineer (OCI/AI Infrastructure)

Oracle · Nashville

Oracle Hardware Platform Development Engineering is seeking a highly driven AI Systems Engineer to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure (OCI). This is

Software Engineer III, Copilot Models Inference

GitHub, Inc. ·

As a software engineer at GitHub, you will enhance the collaboration experience at GitHub by working closely with a community of engineers and designers with a distributed, diverse and passionate team delivering the serv

Software Engineer, Inference

Luma · Redwood City

You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs. Thi

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Staff Software Engineer, Inference Cloud

Cerebras Systems · Sunnyvale

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale

Staff Software Engineer, ML Training and Inference Infrastructure

Rivian · Palo Alto

About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con