AI Systems Engineer – AI Model (Training & Inference)

• Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul , GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
• Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
• Optimize inference serving frameworks ( vLLM , SGLang , TorchServe ) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
• Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
• Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.

• Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
• Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
• Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.

• Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
• Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
• Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
• Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
• Contributions to open-source AI frameworks (PyTorch, vLLM , SGLang , DeepSpeed , Megatron-LM).
• Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
• Experience with pre-silicon software validation or hardware-software co-verification workflows.
• Publications or patents in HPC, ML systems, or GPU kernel optimization.

• Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline

This role is not eligible for visa sponsorship.

#LI-G11

#LI-HYBRID

Benefits offered are described: AMD benefits at a glance .

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.

AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.