greenhouse
Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AI
IND
Senior
Discovered 1 weeks ago
ansiblekafkakubernetespythonrustsqs
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
ansiblekafkakubernetes
Role Overview
REMOTE IN INDIA
A product mindset - you've built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship. You build it, you own it. You are not only responsible for delivering the software but also for operating and supporting it in production.
Key Skills for This Role
ansiblekafkakubernetespythonrustsqs
Full Job Posting
About the Role
REMOTE IN INDIA
A product mindset - you've built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship. You build it, you own it. You are not only responsible for delivering the software but also for operating and supporting it in production.
Responsibilities
- Build the provisioning state machine: design and implement the software that models the full lifecycle of a physical host from discovery, inference bring-up to GPU driver/CUDA stack, health validation, and decommission/RMA — as explicit, versioned states and transitions.
- Build the self-service API: design declarative APIs and a control plane so the inference team can request, scale, and tear down inference clusters with one API call — no ticket, no human in the loop.
- Automate self-healing: detect degraded or failed nodes, drain them safely, trigger repair or replacement, and reintroduce healthy capacity into the pool automatically.
- Own reliability of the pipeline: idempotency, retries, rollback, and drift detection so the provisioning system is as dependable as any other production service.
- Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect, scheduling constraints — and encode them as first-class abstractions in the platform.
- Engineer it like software: strong typing, automated tests, code review, versioning, and CI/CD for infrastructure code — this is a product, not a collection of Ansible playbooks.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Together AI
Technical Community Manager
San Francisco, USA
Discovered Today
Director of Brand
San Francisco, USA
Discovered Today
Strategic Account Executive Inference EMEA
London, GBR
Discovered Yesterday
Technical Support Engineer - India
, IND
Discovered 3 days agoFull-time
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Bengaluru, IND
Discovered 5 days ago
Senior Software Engineer — Infra Agent Systems
San Francisco, USA
Discovered 5 days ago
Program Manager, Data Center Delivery
San Francisco, USA
Discovered 1 weeks agoFull-time
Staff Machine Learning Engineer, Voice AI
San Francisco, USA
Discovered 1 weeks agoFull-time
