ashby
Principal System Software Engineer, AI Inference Execution
D Matrix
Santa Clara, USA
Full-time
Senior · 12+ years experience
Hybrid
Discovered 1 weeks ago
cpluspluskuberneteslinuxpythonpytorchtensorflow
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
cpluspluskuberneteslinux
Key Skills for This Role
cpluspluskuberneteslinuxpythonpytorchtensorflow
Full Job Posting
Location:
- Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week.
- The role: Principal System Software Engineer, AI Inference Execution
What you will do:
- The role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will be responsible for the development, enhancement, and maintenance of the next-generation AI deployment software. You have had past experience working across all aspects of the full-stack toolchain and understand the nuances of what it takes to optimize and trade-off various aspects of hardware-software co-design. You are able to build and scale software deliverables in a tight development window. You will work with a team of system software experts to build out the deployment infrastructure, working closely with other software (ML and compilers) and hardware experts in the company.
- What you will bring:
- Minimum:
- BS in Computer Science, Engineering, Math, Physics, or related degree with 12+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics, or related degree preferred with 6+ years
- Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
- Proficient in C/C++/Python development in Linux environment and using standard development tools
- Experience with distributed, high-performance software design and implementation
- Self-motivated team player with a strong sense of ownership and leadership.
- Preferred:
- MS or PhD in Computer Science, Electrical Engineering, or related fields
- Experience with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
- Experience with deep learning frameworks (such as PyTorch and TensorFlow)
- Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.).
- Experience with distributed systems collectives such as NCCL and OpenMPI
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at D Matrix
Director, Site Reliability Engineering - AI Accelerator Infrastructure - Contract
Santa Clara, USA
DirectorFull-time
Discovered 1 weeks agoView →
Senior HR Generalist
Santa Clara, USA
Discovered 4 days agoFull-time
HR Technology & Analytics Manager
Santa Clara, USA
Discovered 6 days agoFull-time
Staff Technical Recruiter - Contract
Bengaluru, IND
Discovered 1 weeks agoContract
Principal Hardware Systems Engineer
Santa Clara, USA
Discovered 1 weeks agoFull-time
Director, Site Reliability Engineering - AI Accelerator Infrastructure - Contract
Santa Clara, USA
Discovered 1 weeks agoFull-time
Senior Manager, Public Relations
Santa Clara, USA
Discovered 1 weeks agoFull-time
Business Planner - Systems and Racks
Santa Clara, USA
Discovered 1 weeks agoFull-time
Senior Staff Software Engineer - Kernels
Belgrade, USA
Discovered 1 weeks agoFull-time