"Software Engineer – AI Inference Engine" Jobs in United States

Software Engineer – AI Inference Engine

FriendliAI · San Francisco

About the Job We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Software Engineer, AI Inference / HPC

Topazlabs · Dallas

Hands-on experience with performance optimization, e.g. concurrency, multithreading, memory, speed, benchmarking, reliability Experience architecting APIs for internal development Hands-on experience implementing image p

Senior Software Engineer - AI Inference

Bloomberg · New York City

Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine l

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI · Seattle

Location: Seattle, WA (Hybrid - 3 days/week in office) About ElastixAI: ElastixAI is an early-stage Software startup on a mission to reinvent AI inference infrastructure from the ground up. We're building a next-genera

Senior Software Engineer - AI Inference Performance

NVIDIA · Santa Clara

NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a Senior Software Engineer – AI Inference Performance to advance innovative LLM and VLM inference. You will push workloads towar

Senior Software Engineer - AI Inference Performance

NVIDIA · Santa Clara

NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a Senior Software Engineer – AI Inference Performance to advance innovative LLM and VLM inference. You will push workloads towar

Software Engineer - Voice AI (Inference Runtime)

Baseten · San Francisco

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastruct

Software Engineer, Inference (AI Data Engineering)

SpaceX · Palo Alto

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this poss

Principal System Software Engineer, AI Inference Execution

D Matrix · Santa Clara

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible.

Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.ai · Redwood City

Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for phy

Senior Software Engineer (AI Inference & Runtime Platform)

AZX ·

About AZX Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability

"Required qualifications: 5+ years OOP in Python/Scala/Java programming experience with expert level development skills Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. -Hands on experi

Staff+ Software Engineer, ML Inference Path

Anthropic · San Francisco

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co

Staff + Sr. Software Engineer, Scaling

Anthropic ·

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co