Senior Software Engineer - LLM Inference
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Nutanix seeks a Senior Software Engineer to architect and develop scalable, containerized services for LLM inference and AI platforms. You will work on high-performance distributed systems, optimize low-level performance, and contribute to open-source cloud-native projects.
Key Skills for This Role
Responsibilities
- Architect, design, and develop horizontally scalable, containerized, fault tolerant services on Kubernetes
- Improve the performance of systems to deliver for low latency and high throughput use cases
- Optimize any part of the stack, including low level systems
- Leverage and contribute to relevant open source cloud native projects
- Develop scalable, efficient, and fault tolerant observability architectures for collecting, analyzing, and reporting metrics
- Collaborate closely with globally located product management and backend development teams
- Contribute to all stages of the product development cycle: technical design, development, test, experimentation, analysis, and launch
- Review code and design docs, give feedback on product specs and mocks, and documentation
- Participate in ongoing process definition and technology selection
Requirements
- 8+ years of experience developing maintainable, modular, resilient code from a Product Development company
- Strong programming fundamentals, data structures, and algorithms
- Strong experience in Docker, Kubernetes, and Cloud native technologies
- Experience building applications with Go and Python
- Experience building and managing CI/CD pipelines
- Strong understanding of datacenter design, including computing, storage, and networking
- Familiarity with on prem, cloud, and hybrid software deployment architectures
- Good experience in designing and tuning high performance system software
- Strong understanding of distributed computing and storage architectures
- Strong knowledge of OS internals, virtualization, application performance monitoring, compute storage, and networking management
- Bachelor's/Master's in Computer Science or equivalent work experience
Full Job Posting
The Opportunity
- Nutanix is simplifying AI with the Nutanix Cloud Platform for AI, enabling organizations to build, fine tune, and run Generative AI, LLMs, and Agentic AI applications.
- The Enterprise AI team drives strategic products such as LLM Inference, the AI Gateway, and the Agentic AI Platform.
About the Team
- Fast paced, globally distributed team building foundational layers of the enterprise AI stack.
- Opportunity to solve complex technical challenges and influence key AI technologies.
Your Role
- Architect, design, and develop horizontally scalable, containerized, fault tolerant services on Kubernetes.
- Improve system performance for low latency and high throughput use cases.
- Optimize any part of the stack, including low level systems.
- Leverage and contribute to relevant open source cloud native projects.
- Develop scalable, efficient, and fault tolerant observability architectures.
- Collaborate with globally located product management and backend development teams.
- Contribute to all stages of the product development cycle.
- Review code and design docs, give feedback on product specs and mocks.
- Participate in ongoing process definition and technology selection.
What You Will Bring
- 8+ years of experience developing maintainable, modular, resilient code from a Product Development company.
- Strong programming fundamentals, data structures, and algorithms.
- Strong experience in Docker, Kubernetes, and Cloud native technologies.
- Experience building applications with Go and Python.
- Experience building and managing CI/CD pipelines.
- Strong understanding of datacenter design, including computing, storage, and networking.
- Familiarity with on prem, cloud, and hybrid software deployment architectures.
- Good experience in designing and tuning high performance system software.
- Strong understanding of distributed computing and storage architectures.
- Strong knowledge of OS internals, virtualization, application performance monitoring, compute storage, and networking management.
- Familiarity with machine learning concepts and frameworks (TensorFlow, PyTorch) is a strong plus.
- Experience with hardware accelerators, such as GPUs, is a strong plus.
Highlighted Benefits (Vancouver, Canada)
- RRSP with dollar for dollar matching up to 7% of base salary.
- Dedicated mental health coverage plus top tier paramedical benefits.
- Fully paid maternity and parental leave and generous bereavement leave.
- RSUs and Employee Stock Purchase Plan at a 15% discount.
- Company holidays, sick days, company wellness days, and vacation starting at 10 days.
- Hybrid work arrangement: onsite minimum 3 days per week.
Pay Transparency
- Pay range for this position is expected to be between CAD 171,200 and CAD 256,800 per annual.
Work Arrangement
- Hybrid role: employees expected to work onsite a minimum of 3 days per week.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Nutanix
Member of Technical Staff 2
Vancouver, CAN
Nutanix is looking for a Software Engineer to design, develop, and scale their next-generation Kubernetes platform for enterprise AI/ML workloads and GPU infrastructure. The role requires 3-6 years of experience, strong
Member of Technical Staff 3
Vancouver, CAN
Nutanix is seeking a Software Engineer to design, develop, and scale their next-generation Kubernetes platform for enterprise AI/ML workloads. The role involves owning end-to-end delivery of platform capabilities, collab
Member of Technical Staff 4
Vancouver, CAN
Nutanix seeks a Software Engineer to design, develop, and scale their next-generation Kubernetes platform for enterprise AI/ML workloads and GPU infrastructure. You will own end-to-end delivery of platform capabilities i
Member of Technical Staff 2
Vancouver, CAN
Nutanix is looking for a Software Engineer to design, develop, and scale their next-generation Kubernetes platform for enterprise AI/ML workloads and GPU infrastructure. The role requires 3-6 years of software developmen
Backend Engineer (3-15years of experience)
Vancouver, CAN
Nutanix is seeking a Backend Engineer to join the Enterprise AI team, building scalable services on Kubernetes for AI infrastructure. The role involves architecting, designing, and developing containerized, fault-toleran
Member of Technical Staff 3
Vancouver, CAN
Nutanix is looking for a Software Engineer to design, develop, and scale their next-generation Kubernetes platform for enterprise AI/ML workloads. You will own end-to-end delivery of key platform capabilities, collaborat
Senior Member of Technical Staff
Vancouver, CAN
Nutanix is seeking a Senior Engineer to join the NKP AI Platform team, architecting and scaling infrastructure for enterprise AI/ML workloads on Kubernetes. You will develop CRDs, Operators, and Controllers in Golang, in
Senior Member of Technical Staff
Vancouver, CAN
Nutanix is seeking a Senior/Staff Software Engineer to join the NKP AI Platform team, designing and scaling infrastructure for enterprise AI/ML workloads. You will build Kubernetes CRDs, controllers, and operators in Gol
Member of Technical Staff 2
Vancouver, CAN
Member of Technical Staff 3
Vancouver, CAN
Member of Technical Staff 4
Vancouver, CAN
Member of Technical Staff 2
Vancouver, CAN
Backend Engineer (3-15years of experience)
Vancouver, CAN
Member of Technical Staff 3
Vancouver, CAN
Senior Member of Technical Staff
Vancouver, CAN
Senior Member of Technical Staff
Vancouver, CAN