"Inference Software Engineer" Jobs in United States

Inference Software Engineer

Etched · San Jose

About Etched Etched is building AI chips that are hard-coded for individual model architectures. Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower latency than

Principal Software Engineer, Inference

Hewlett Packard Enterprise ·

Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, f

Senior Software Engineer, Inference

Hewlett Packard Enterprise ·

Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, f

Staff+ Software Engineer, ML Inference Path

Anthropic · San Francisco

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co

Software Engineer, Inference Systems

River AI Inc. · Palo Alto

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu

Software Engineer III, Copilot Models Inference

GitHub, Inc. ·

As a software engineer at GitHub, you will enhance the collaboration experience at GitHub by working closely with a community of engineers and designers with a distributed, diverse and passionate team delivering the serv

Software Engineer, Inference

Luma · Redwood City

You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs. Thi

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Staff Software Engineer, Inference Cloud

Cerebras Systems · Sunnyvale

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale

Staff Software Engineer, ML Training and Inference Infrastructure

Rivian · Palo Alto

About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we con

Software Engineer, Inference

Pulse · San Francisco

Overview Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understan

Senior Software Engineer II, Inference

CoreWeave · Sunnyvale

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilie

Software Engineer, Inference AI/ML

CoreWeave · Sunnyvale

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilie

Senior Software Engineer I, Inference

CoreWeave · Sunnyvale

What You’ll Do: Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You’ll partner with p

Software Engineer (AI Infrastructure / Training / Inference)

SpreeAI · San Francisco

About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative an