GPU Kernel Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
We are seeking a highly skilled GPU Kernel Engineer who is passionate about pushing the limits of performance on modern accelerators. In this role, you will design and optimize custom GPU kernels that power next-generation large-scale AI systems. You will work across the hardware–software stack, from low-level kernel development to integrating optimized ops into high-level ML frameworks used for large-scale training and inference.
This role is ideal for someone who thrives at the intersection of GPU programming, systems engineering, and cutting-edge AI workloads, and who wants to make meaningful contributions to the efficiency and scalability of our ML platform.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking a highly skilled GPU Kernel Engineer who is passionate about pushing the limits of performance on modern accelerators. In this role, you will design and optimize custom GPU kernels that power next-generation large-scale AI systems. You will work across the hardware–software stack, from low-level kernel development to integrating optimized ops into high-level ML frameworks used for large-scale training and inference.
This role is ideal for someone who thrives at the intersection of GPU programming, systems engineering, and cutting-edge AI workloads, and who wants to make meaningful contributions to the efficiency and scalability of our ML platform.
Key Responsibilities
- Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.
- Profile and optimize end-to-end performance of ML operations, with a focus on large-scale LLM training and inference.
- Integrate low-level GPU kernels into frameworks such as PyTorch, JAX, and custom internal runtimes.
- Develop performance models, identify bottlenecks, and deliver kernel-level improvements that significantly accelerate AI workloads.
- Collaborate with ML researchers, distributed systems engineers, and model-serving teams to optimize compute performance across the stack.
- Work closely with hardware vendors (NVIDIA/AMD) and stay current on the latest GPU architecture capabilities and compiler/toolchain improvements.
- Contribute to tooling, documentation, benchmarking suites, and testing frameworks to ensure correctness and performance reproducibility.
Must-Haves
- 5+ years of industry or research experience in GPU kernel development or high-performance computing.
- Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related field.
- Strong programming skills in C++, Python, and familiarity with ML frameworks.
- Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization strategies.
- Hands-on experience with Triton and/or JAX Pallas for custom kernel development.
- Strong understanding of PTX, GPU ASM, and low-level GPU execution.
- Extensive experience writing and optimizing custom GPU kernels in C++ and PTX.
- Proven ability to integrate low-level kernels into PyTorch, JAX, or similar frameworks.
- Experience working with large-scale LLM workloads (training or inference).
Nice-to-Haves
Experience with AMD GPUs and ROCm optimization.
Familiarity with JAX FFI and custom ML operator development.
Experience with efficient model serving frameworks (e.g., vLLM, TensorRT).
Experience with TPUs, XLA, or similar accelerator programming environments.
Contributions to open-source ML systems, compilers, or GPU kernels.
Why Join Us
Opportunity to build frontier-scale AI infrastructure powering next-generation LLMs and multimodal models.
Work with top-tier engineers and researchers across systems, GPUs, and ML frameworks.
Tackle high-impact performance and scalability challenges in training and inference.
Access state-of-the-art GPU clusters, datasets, and tooling.
Opportunity to publish, patent, and push the boundaries of modern AI
Join a culture of innovation, ownership, and fast execution in a rapidly scaling AI organization.
Benefits include
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
About Sciforium
AI infrastructure company building multimodal models and high-efficiency serving software for developers and teams.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Sciforium
GPU Kernel Engineer
San Francisco, USA
Data Center Real Estate & Development Specialist
San Francisco, USA
Software Engineer, Fullstack
San Francisco, USA
Senior Research Scientist
San Francisco, USA
Software Engineer, Backend
San Francisco, USA
Lead Software Engineer, Model Serving Platform
San Francisco, USA
Distributed Training Engineer
San Francisco, USA
Data Scientist
San Francisco, USA