{bc}
Apply
lever

Senior Software Engineer - Systems

Bosonai
Santa Clara, USA
Full-time
Mid Level
Onsite
USD 150000-400000 yearly
Discovered 1 weeks ago
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan
Smart Apply

Full Job Posting

  • Own and evolve the core platform infrastructure: API serving layer, state management, policy enforcement engine, and execution runtime for agentic workflows.
  • Design and operate high-throughput, low-latency distributed services that back our model API products — including request routing, load management, rate limiting, and multi-tenant isolation.
  • Build and maintain downstream data pipelines (ETL/ELT) for API logs, usage analytics, and billing — ensuring data correctness, freshness, and queryability at scale.
  • Develop production-grade internal SDKs and libraries with clean APIs, strong type safety, and clear contracts that product teams can build on confidently.
  • Architect context and memory systems for conversational workloads — low-latency retrieval, caching, and integration with vector stores and retrieval pipelines.
  • Instrument end-to-end observability: define SLIs/SLOs, build structured logging and tracing, and drive reliability improvements across the platform.
  • Collaborate closely with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure under tight latency and quality constraints.
  • 3+ years building and operating backend systems at scale — you've owned services that other teams depend on in production.
  • Strong distributed systems fundamentals: concurrency, fault tolerance, consistency tradeoffs, capacity planning.
  • Hands-on experience with data pipeline infrastructure (Kafka/Kinesis, Spark/Flink, Airflow, or similar) for log processing, analytics, or ETL workloads.
  • Track record of designing APIs and frameworks adopted by other engineering teams — you care about developer experience and long-term maintainability.
  • Proficiency in at least one systems language (Go, Rust, Java, C++) or Python in a performance-sensitive context.
  • Comfortable working across the stack: cloud infrastructure (AWS/GCP), containerized deployments (K8s), CI/CD, and production oncall.
  • Experience with LLM serving, agentic orchestration patterns (ReAct, planner-executor), or RAG pipelines.
  • Familiarity with emerging agent integration protocols (MCP, A2A) or orchestration frameworks (LangChain, LlamaIndex).
  • Background in real-time media systems (audio/video streaming, low-latency signaling).
  • Experience building high-stakes platform services (payments, identity, core data) where correctness and auditability are non-negotiable.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Bosonai

Senior Software Engineer - Agentic Systems and Platform

Santa Clara, USA

Discovered 1 weeks agoFull-time

Senior Full Stack Engineer - Agentic Systems and Platform

Santa Clara, USA

Discovered 1 weeks agoFull-time

Software Engineer - Platform & Application

Santa Clara, USA

Discovered 1 weeks agoFull-time

Datacenter Technician

Barrie, CAN

Discovered 2 weeks agoFull-time

Machine Learning Engineer - Enterprise

Toronto, CAN

Discovered 3 weeks agoFull-time