Base Career helps you apply smarter for this job.
About TrueFoundry Every production AI system, whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models.
A way to manage tools and integrate them securely.
A way to orchestrate agents and enforce governance.
A unified compute layer to run it all.
That infrastructure layer is being built right now.
We're TrueFoundry, and we're building it.
We're looking for a Staff Engineer – Core Engineering to join the team.
Companies are moving beyond simple chatbots to production agentic systems.
These systems route between OpenAI, Anthropic, Google, and self-hosted models.
They integrate dozens of tools via protocols like MCP.
They orchestrate multi-agent workflows where agents coordinate with other agents.
The infrastructure to support this doesn't exist yet.
You can't just duct-tape together a few API calls and call it production-ready.
You need a control plane that handles:
We've built two products to solve this:
AI Gateway is the control plane, five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.
AI Deploy is the compute layer, a Kubernetes-based platform that abstracts ML workloads as standard software primitives, so everything runs on unified infrastructure.
We're Series A, backed by Intel Capital and Sequoia.
Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.
The Role: We are seeking a Staff / Principal Engineer to join our Core Engineering team as a senior technical leader based in the United States.
You will:
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
San Mateo, USA
San Mateo, USA
San Mateo, USA
New York City, USA
New York City, USA
New York City, USA
New York City, USA
New York City, USA
This is a high-ownership , high-impact role designed for an engineer who loves combining world-class systems thinking with real-world execution .
Bonus: Experience supporting enterprise deployments of AI/ML infrastructure , model training , or inference systems
Flexible hours, learning credits, and the opportunity to work shoulder-to-shoulder with the co-founders (Abhishek & Nikunj).
TrueFoundry is a private enterprise AI platform helping companies build, observe, and govern agentic applications.
Visit company websiteJobs and hiring trendsFull-time
Senior Level
Hybrid
Apply faster on company sites with our extension.