teamtailor
Platform Engineer - LLM Inference Infrastructure
Verda
London, GBR
Full-time
Mid · 4+ years experience
Hybrid
Discovered 1 weeks ago
GoKubernetesHelmGitOpsPostgreSQLOpenAI
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
GoKubernetesHelm
Role Overview
We run a multi-tenant LLM inference platform: customers send requests to an OpenAI-compatible gateway, and we handle routing, tenancy, access control, usage metering and billing on top of our own GPU fleet.
You would own backend services and the Kubernetes platform they run on. This is not a role where infrastructure is someone else’s problem, you write the Go service, the Helm chart, the network policy and the runbook, and you are the one who verifies it in production.
We are moving deliberately toward a Kubernetes-native architecture : less imperative tooling and hand-run scripts, more declarative APIs, custom resources and controllers that reconcile state. If you have wanted to build operators and control planes rather than consume them, that is the direction of this role.
Key Skills for This Role
GoKubernetesHelmGitOpsPostgreSQLOpenAI
Full Job Posting
About the role
We run a multi-tenant LLM inference platform: customers send requests to an OpenAI-compatible gateway, and we handle routing, tenancy, access control, usage metering and billing on top of our own GPU fleet.
You would own backend services and the Kubernetes platform they run on. This is not a role where infrastructure is someone else’s problem, you write the Go service, the Helm chart, the network policy and the runbook, and you are the one who verifies it in production.
We are moving deliberately toward a Kubernetes-native architecture : less imperative tooling and hand-run scripts, more declarative APIs, custom resources and controllers that reconcile state. If you have wanted to build operators and control planes rather than consume them, that is the direction of this role.
Your responsibilities
- Backend services in Go - the platform API, the customer-facing usage API, the metering and billing pipeline. Small, focused services with real correctness requirements.
- Kubernetes-native platform work - GitOps deployment, custom resources and controllers, progressive rollout, network policy, secret and certificate management. Moving what is currently scripted into something that reconciles.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Verda
Engineering Manager, Cloud
London, GBR
Discovered YesterdayFull-time
Security Triage Analyst
London, GBR
Discovered 2 days agoFull-time
Kubernetes and Container Platform Security Specialist
London, GBR
Discovered 2 days agoFull-time
Content Marketing Lead
London, GBR
Discovered 3 days agoFull-time
Senior Procurement Specialist, UK
London, GBR
Discovered 3 days agoFull-time
IT Procurement Specialist
London, GBR
Discovered 3 days agoFull-time
Legal Counsel - Banking and Finance
London, GBR
Discovered 3 days agoFull-time
Senior Product Marketing Manager - Platform and Developer
London, GBR
Discovered 1 weeks agoFull-time