Base Career helps you apply smarter for this job.
Key skills for this role
We are looking for a Senior SRE/DevOps Engineer to join the team.
Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.
The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.
You need a control plane that handles:
Intelligent routing with observability, cost policies, and fallback logic
Centralized tool and MCP server management with security and lifecycle controls
Agent orchestration with governance and guardrails
A unified compute layer to run self-hosted models, custom tools, and agents
AI Gateway is the control plane: five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.
We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
San Francisco, USA
San Mateo, USA
San Mateo, USA
San Mateo, USA
New York City, USA
New York City, USA
New York City, USA
New York City, USA
4-8 years of work experience writing clean production code
Well-versed in maintaining infrastructure as code (Terraform, CloudFormation, etc). High proficiency with Terraform / Terragrunt is absolutely critical
Experience in setting up CI/CD pipelines from scratch
Experience with ETL pipelines, Bigdata infra
Understanding of common security issues
TrueFoundry is a private enterprise AI platform helping companies build, observe, and govern agentic applications.
Visit company websiteJobs and hiring trendsFull-time
Senior · 4+ years experience
Hybrid
Apply faster on company sites with our extension.