Base Career helps you apply smarter for this job.
Key skills for this role
As a Backend Engineer, you'll work on the core infrastructure that makes our AI platform fast, reliable, and scalable.
You'll be joining the Core AI team, responsible for the foundational layer of our AI product, covering orchestration, memory, low-level security, and system harness.
This is a role for someone who thrives at the intersection of backend engineering and applied AI, thinking about latency, reliability, and model behavior all at once.
What you'll do
You'll be tackling challenges across:
AI orchestration: owning the core layer that coordinates AI workflows, model calls, multi-step reasoning, and multi-agent delegation, including RAG pipelines and knowledge bases
LLM integration: integrating and tuning new LLMs into a production-grade backend, with a focus on security, guardrails, and evaluation (latency, response quality)
Data ingestion & export: building robust pipelines and services to handle a variety of file formats reliably and at scale
Context & token optimization: designing strategies to maximize LLM efficiency, manage context windows, and keep costs in check
Infrastructure & observability: designing scalable APIs, automating deployment pipelines, monitoring, and testing to keep the platform reliable and performant
Architecture & engineering culture: participating in tech stack decisions, documenting technical knowledge, and continuously driving innovation across the AI platform
As a Backend Engineer, you'll work on the core infrastructure that makes our AI platform fast, reliable, and scalable.
You'll be joining the Core AI team, responsible for the foundational layer of our AI product, covering orchestration, memory, low-level security, and system harness.
This is a role for someone who thrives at the intersection of backend engineering and applied AI, thinking about latency, reliability, and model behavior all at once.
What you'll do
You'll be tackling challenges across:
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
, GBR
, USA
, USA
, GBR
, USA
AI orchestration: owning the core layer that coordinates AI workflows, model calls, multi-step reasoning, and multi-agent delegation, including RAG pipelines and knowledge bases
LLM integration: integrating and tuning new LLMs into a production-grade backend, with a focus on security, guardrails, and evaluation (latency, response quality)
Data ingestion & export: building robust pipelines and services to handle a variety of file formats reliably and at scale
Context & token optimization: designing strategies to maximize LLM efficiency, manage context windows, and keep costs in check
Infrastructure & observability: designing scalable APIs, automating deployment pipelines, monitoring, and testing to keep the platform reliable and performant
Architecture & engineering culture: participating in tech stack decisions, documenting technical knowledge, and continuously driving innovation across the AI platform
5+ years of experience with Node.js + TypeScript stack
NestJS/React and PostgreSQL are a plus
Hands-on experience (or strong familiarity) with AI/ML integration (LLMs, RAG, or similar)
Solid understanding of backend architecture, scalability, and security best practices
Experience with databases, authentication, and cloud platforms (AWS)
Familiar with CI/CD, Git workflows, and agile methodologies
Bonus: familiarity with other backend programming languages applied to AI (Python, Go...)
AI management platform for businesses and MSPs, centralizing governed access to multiple AI models.
Visit company websiteJobs and hiring trendsFull-time
Senior · 5+ years experience
Hybrid
Apply faster on company sites with our extension.