{bc}
Live Jobs · Updated Daily

"LLM Inference Engineer" Jobs in United States

Get matched with opportunities that fit your skills, experience, and career goals.

Jobs found — scroll to load more

Clear filters

LLM Inference Engineer

Hippocratic AI · Palo Alto

MidFull-timeOnsite

About Us Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world b

Skills

PythonC++CUDA

Discovered 1 weeks ago

Apply

Distributed LLM Inference Engineer

Anyscale · San Francisco

MidFull-timeHybrid

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creat

Skills

openaipytorchtensorflow

Discovered 1 weeks ago

Apply

Senior Staff LLM Inference Engineer

D Matrix · Santa Clara

SeniorFull-timeHybrid

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible.

Skills

cplusplusjaxpython

Discovered 1 weeks ago

Apply

AI Systems Research and Development Engineer – LLM Inference Systems & Optimization

Snowflake · Bellevue

MidFull-time

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just u

Skills

snowflaketensorflow

Discovered 6 days ago

Apply

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco

Plaud Inc. · San Francisco

USD 180000-270000 yearly / yearMidFull-timeHybrid

About Plaud Inc. Plaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note-taking solutions, loved by over 1,500,000 users worldwide since 2023.

Skills

vLLMTensorRT-LLMSGLangNVIDIA Triton Inference Server

Discovered 1 weeks ago

Apply

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 229900-286200 yearly / yearSeniorFull-timeOnsite

Overview Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, perso

Skills

AWS UltraclustersVectorDBsPyTorchPython

Discovered 1 weeks ago

Apply

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 197300-245600 yearly / yearSeniorFull-timeOnsite

Overview Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, person

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 197300-245600 yearly / yearSeniorFull-timeOnsite

Overview Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, person

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Sr. Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 229900-286200 yearly / yearSeniorFull-timeOnsite

Overview Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, perso

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 229900-286200 yearly / yearSeniorFull-timeOnsite

Overview Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, perso

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

USD 197300-245600 yearly / yearSeniorFull-timeOnsite

Overview Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, person

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · McLean

USD 229900-286200 yearly / yearSeniorFull-timeOnsite

Overview Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, perso

Skills

AWS UltraclustersVectorDBsNemo GuardrailsPyTorch

Discovered 1 weeks ago

Apply

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · McLean

SeniorFull-time

Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized cus

Skills

awsazurecpluspluscsharp

Discovered 1 weeks ago

Apply

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

LeadFull-time

Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized cust

Skills

awsazurecpluspluscsharp

Discovered 1 weeks ago

Apply

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One · New York City

SeniorFull-time

Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized cus

Skills

awsazurecpluspluscsharp

Discovered 1 weeks ago

Apply

Showing 15 jobs

Your Career Platform

Launch Your Career Today

Browse thousands of jobs, tailor your resume in 60 seconds, and start applying with confidence.

Start Free Now

Free plan available · No credit card required