linkedin
System Software Engineer - Local AI
NVIDIA
Maharashtra, IND
Full-time
Entry
Onsite
Discovered 1 weeks ago
C++AI inference pipelinesMachine learningLlama.cppvLLMPyTorch
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
C++AI inference pipelinesMachine learning
Role Overview
The LocalAI team builds efficient on-device AI software for RTX and DGX-class systems.
The role focuses on high-performance local inference, low latency, efficient memory use, infrastructure, and deployment on resource-constrained platforms.
Local AI can reduce latency, improve real-time processing, and address privacy concerns by minimizing data transfer to centralized servers.
Key Skills for This Role
C++AI inference pipelinesMachine learningLlama.cppvLLMPyTorch
Full Job Posting
About NVIDIA
NVIDIA develops accelerated computing technologies, including GPU platforms that support modern graphics, parallel computing, and artificial intelligence.
About the Local AI Role
The LocalAI team builds efficient on-device AI software for RTX and DGX-class systems.
The role focuses on high-performance local inference, low latency, efficient memory use, infrastructure, and deployment on resource-constrained platforms.
Local AI can reduce latency, improve real-time processing, and address privacy concerns by minimizing data transfer to centralized servers.
What You Will Be Doing
- Partner with software, research, architecture, and product teams to align strategies and technical needs for AI on RTX and DGX PCs.
- Build and optimize local AI inference stacks for RTX, RTX Pro, and DGX GPUs across hardware architectures.
- Architect and develop inference runtimes and execution stacks using Llama.cpp, vLLM, PyTorch, WinML, DXCGC, and TensorRT-RTX.
- Optimize AI models, data pipelines, and inference runtimes across current and next-generation GPU architectures.
- Apply quantization, pruning, sparsity, and distillation for efficient deployment on local and edge devices.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at NVIDIA
Senior System Software Engineer - Halos Core and Robotics Platform
Bengaluru, IND
SeniorFull-time
Discovered TodayView →
Software Security Compiler Engineer
Bengaluru, IND
Discovered TodayFull-time
Senior System Software Engineer - Halos Core and Robotics Platform
Bengaluru, IND
Discovered TodayFull-time
Software Security Compiler Engineer
Bengaluru, IND
Discovered TodayFull-time
Accounts Payable Accountant
Bengaluru, IND
Discovered 2 days agoFull-time
Accounts Payable Accountant
Bengaluru, IND
Discovered 2 days agoFull-time
Architect - GPU Performance
Bengaluru, IND
Discovered 2 days agoFull-time
Software Platform Support Engineer - GPU Cloud
, USA
Discovered 2 days agoFull-time
Senior Solution Architect, AI Infrastructure
, USA
Discovered 2 days agoFull-time