"Software Engineer, Inference Systems" Jobs in United States

Inference Software Engineer

Etched · San Jose

About Etched Etched is building AI chips that are hard-coded for individual model architectures. Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower latency than

Software Engineer, Inference

Pulse · San Francisco

Overview Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understan

Senior Software Engineer II, Inference

CoreWeave · Sunnyvale

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilie

Software Engineer, Inference AI/ML

CoreWeave · Sunnyvale

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilie

Senior Software Engineer I, Inference

CoreWeave · Sunnyvale

What You’ll Do: Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You’ll partner with p

Software Engineer, AI Inference / HPC

Topazlabs · Dallas

Hands-on experience with performance optimization, e.g. concurrency, multithreading, memory, speed, benchmarking, reliability Experience architecting APIs for internal development Hands-on experience implementing image p

Software Engineer – AI Inference Engine

FriendliAI · San Francisco

About the Job We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing

Senior Software Engineer - AI Inference

Bloomberg · New York City

Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine l

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI · Seattle

Location: Seattle, WA (Hybrid - 3 days/week in office) About ElastixAI: ElastixAI is an early-stage Software startup on a mission to reinvent AI inference infrastructure from the ground up. We're building a next-genera

Staff Software Engineer, Inference

CoreWeave · Sunnyvale

What You’ll Do: Inference Platform Team The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsib

Senior Software Engineer, Inference

Pika · Palo Alto

About the Role We are seeking a Senior Inference Engineer to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceler

Forward Deployed Engineer (Inference & Post-Training)

Together AI · San Francisco

About the role As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most strategic customers — production AI teams looking to leverage high quality mo

Senior Software Engineer - Inference

Visionist, Inc. · Laurel

Active Top Secret (TS/SCI) clearance with polygraph is required. Visionist has an exciting new, fully FUNDED opportunity for a Senior Software Engineer - Inference on our largest PRIME contract. Our team of Analysts and

Software Engineer - Inference

Visionist, Inc. · Laurel

Active Top Secret (TS/SCI) clearance with polygraph is required. Visionist has an exciting new, fully FUNDED opportunity for a Software Engineer - Inference on our largest PRIME contract. Our team of Analysts and Engine

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

Together AI · San Francisco

About the role As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most strategic customers — production AI teams looking to leverage high quality m