Senior Software Engineer AI Infrastructure
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
The team The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the foundation of the agent platform, en.
Key Skills for This Role
Full Job Posting
Overview
- The team
- The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale.
- This team sits at the foundation of the agent platform, ensuring that model inference, orchestration, and execution layers are reliable, observable, and performant under real-world load.
- Working closely with the Agent Systems team and broader infrastructure partners, this group owns the core primitives that enable agents to safely operate across internal systems.
- The environment is high-scale and high-stakes systems serve millions of users and must meet strict reliability, latency, and correctness standards.
- This is a deeply production-oriented team.
- Engineers here combine strong systems thinking with applied ML infrastructure experience, building in Rust and operating services where performance and failure modes matter.
- The opportunity
- Design and build the infrastructure layer powering AI agent systems in production
- Develop high-performance Rust services that handle model inference, orchestration, and execution
- Architect scalable systems capable of supporting millions of users and high request throughput
- Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
- Define guardrails, observability, and failure handling for agent-driven workflows
- Optimize latency, throughput, and cost across inference and orchestration layers
- Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems
- Contribute to foundational infrastructure decisions in a high-scale, high-impact environment
Skills You Should Hodl
- 5+ years of experience building and operating high-scale production systems
- Strong proficiency in Rust and systems-level programming
- Deep understanding of distributed systems, reliability engineering, and performance optimization
- Experience operating services serving millions of users or high-throughput workloads
- Familiarity with ML infrastructure, model serving, or MLOps in production environments
- Experience designing observability, monitoring, and failure recovery systems
- Strong collaboration skills working across infrastructure and applied engineering teams
- High ownership mindset in high-stakes production environment
- Nice to haves
- Experience building infrastructure for agent-based or LLM-powered systems
- Background in high-performance networking, async systems, or low-latency architectures
- Experience with container orchestration and cloud-native infrastructure
- Familiarity with evaluation frameworks and model performance monitoring at scale
- Experience working in fast-moving 0 1 or platform-building teams
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Kraken
M&A Collaboration & Security Platforms Engineer
Abu Dhabi, UAE
Payward (parent of Kraken) seeks an M&A Collaboration & Security Platforms Engineer to own productivity platforms (Google Workspace, Slack, Zoom) and drive M&A integration. The role involves migrating acquired companies'
Senior Product Manager - Trading-as-a-service
Abu Dhabi, UAE
Kraken is hiring a Senior Product Manager for Trading-as-a-Service to drive the product roadmap and execution for trading infrastructure used by fintechs, banks, and brokerages. The role involves owning API products, wor
Web and Brand Designer
United Arab Emirates, UAE
Kraken is seeking a Web and Brand Designer for Breakout in the UAE. You will own web design, build AI-driven design systems, and evolve the brand. Requires strong UX and conversion instincts, fluency in AI design tools,
Web and Brand Designer - Breakout Prop
Abu Dhabi, UAE
Kraken is looking for a Web and Brand Designer to own design for Breakout Prop across web, lifecycle, and brand. This hands-on role involves designing the website and conversion flows, building AI-powered design systems
Senior Data Engineer - Agents Systems
Abu Dhabi, UAE
Kraken is looking for a Senior Data Engineer to join the Agent Systems team, building streaming data pipelines and feature stores for AI-powered agents. The role requires 5+ years in data engineering with at least 2 year
Senior Data Engineer - AI Infrastructure
Abu Dhabi, UAE
Kraken seeks a Senior Data Engineer for its AI Infrastructure team to own and evolve streaming data pipelines, design feature stores, and implement streaming systems using RisingWave, Apache Flink, or Kafka Streams. The
Backend Crypto Engineer - L1
Abu Dhabi, UAE
Kraken is hiring a Backend Crypto Engineer to integrate systems with blockchains and support crypto operations like deposits, withdrawals, and staking. The role requires backend development experience with TypeScript or
Site Reliability Engineer
United Arab Emirates, UAE
Building the Future of Open Finance Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years ...
M&A Collaboration & Security Platforms Engineer
Abu Dhabi, UAE
Senior Product Manager - Trading-as-a-service
Abu Dhabi, UAE
Web and Brand Designer
United Arab Emirates, UAE
Web and Brand Designer - Breakout Prop
Abu Dhabi, UAE
Senior Data Engineer - Agents Systems
Abu Dhabi, UAE
Senior Data Engineer - AI Infrastructure
Abu Dhabi, UAE
Backend Crypto Engineer - L1
Abu Dhabi, UAE
Site Reliability Engineer
United Arab Emirates, UAE