greenhouse
AI Runtime Engineer
EnCharge AI
USA
Full-time
Mid · 3+ years experience
Hybrid
Discovered 3 weeks ago
C/C++Low-level systems programmingLLVMMLIRXLATVM
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
C/C++Low-level systems programmingLLVM
Role Overview
EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments.
Key Skills for This Role
C/C++Low-level systems programmingLLVMMLIRXLATVM
Full Job Posting
About the Role
EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments.
Responsibilities
- Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
- Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
- Optimize data movement between host and device using PCIe, DMA, shared memory.
- Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
- Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
- Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
- Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.
Qualifications
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EnCharge AI
Staff / Senior Staff CAD & Methodology Engineer (Digital Implementation & Signoff)
Bengaluru, IND
SeniorFull-time
Discovered 3 weeks agoView →
AI Software Engineer, Agent Harness
, IND
Discovered TodayFull-time
Senior Physical Design Engineer
Santa Clara, USA
Discovered 1 weeks agoFull-time
Senior HRIS Analyst
Santa Clara, USA
Discovered 1 weeks agoFull-time
Staff Physical Design Engineer
, USA
Discovered 1 weeks agoFull-time
Research Engineer, AI Models
San Francisco, USA
Discovered 1 weeks agoFull-time
Principal Solutions Engineer
, USA
Discovered 1 weeks agoFull-time
Technical Program Manager - Embedded Software
, USA
Discovered 1 weeks agoFull-time
Staff / Senior Staff CAD & Methodology Engineer (Digital Implementation & Signoff)
Bengaluru, IND
Discovered 3 weeks agoFull-time