Senior Software Engineer (vLLM)

We are seeking a Senior Software Engineer with a passion for open-source AI infrastructure to work on deploying, extending and optimising vLLM (and potentially other inference serving engines) to support our projects. You will play a crucial, high-impact role across both our key programmes, the Scaling Inference Lab ( https://scalinginferece.org and the High Assurance programme.

As an AI-first company, we strongly believe in collaborative engineering powered by the tools we are helping to build. This role places a major emphasis on using LLMs, AI coding assistants, and autonomous agents for software development.

Deploy, instrument and monitor open weight models served using vLLM.

Implement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab.

Work with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy, explainability, and accountability when using it to serve models in regulated environments.

Actively collaborate with the open-source vLLM community to propose, review, and upstream core changes.

Troubleshoot, profile, and optimise inference performance, focusing on latency, throughput, and hardware utilisation.