Software Engineering Intern, Dynamo - Fall 2026

Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing.

An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world.

Doing what’s never been done before takes vision, innovation, and the world’s best talent.

As an NVIDIAN, you’ll be immersed in an inclusive, encouraging environment where everyone is inspired to do their best work.

Come join the team and see how we can make a lasting impact on the world.

NVIDIA Dynamo is an innovative, open-source platform focused on efficient, scalable inference for large language and reasoning models in distributed GPU environments. By bringing to bear sophisticated techniques in serving architecture, GPU resource management, and intelligent request handling, Dynamo achieves high-performance AI inference for demanding applications. Our team is addressing the most challenging issues in distributed AI infrastructure, and we’re searching for engineers enthusiastic about building the next generation of scalable AI systems. As an Applied AI Research Software Engineering intern on the Dynamo project, you will address some of the most sophisticated and high-impact challenges in distributed inference, including: Dynamo k8s serving platform, disaggregated serving, dynamic GPU scheduling, intelligent routing, and distributed KV cache management.

What you'll be doing:

• Collaborate on the design and development of the Dynamo Kubernetes stack.
• Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library; design, implement, and optimize distributed inference components in Rust and Python.
• Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs).
• Improve intelligent routing and KV-cache management subsystems.
• Contribute to open-source repositories, participate in code reviews, assist with issue triage on GitHub, work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture.

• Pursuing BS, MS or PhD in Computer Science or equivalent program area
• Excellent Golang, Rust and/or Python programming and software design skills, including debugging, performance and service health analysis, and test design