Senior Modeling Architect, Performance Benchmarking

Position Overview

Key Responsibilities

• Own the performance and energy metrics that architecture, product, and leadership rely on, and keep them consistent across modeling fidelities and measured hardware.
• Produce numbers for the same workloads across all fidelities we use internally: roofline and limiter models, architecture performance models, in-house RTL simulation, and measured competitor hardware. Work with the modeling team to keep the simulated and measured workload sets aligned.
• Hold workload definitions constant across fidelities, including model or application, sequence length, batch, precision, prefill versus decode, and tensor, pipeline, and sequence parallelism.
• Bring up inference workloads from Hugging Face, PyTorch, published papers, and vendor stacks such as vLLM, SGLang, TensorRT-LLM, and Triton Inference Server. These include dense and Mixture-of-Experts (MoE) transformers, attention and KV-cache reduction strategies, and hybrid/SSM models, as well as retrieval, speech, vision, and recommendation workloads that map onto the accelerator.
• Measure competing GPUs and accelerators end-to-end, owning the cloud or lab account, image, drivers, and run recipe.
• Report time to first token (TTFT), inter-token latency (ITL), tokens per second, tokens per second per watt, and energy, using nvidia-smi, DCGM, power capping, or equivalent instrumentation.
• Document where RTL simulation, the performance model, and measured competitor results disagree, and attach the configs and logs behind each.
• Maintain a reviewed internal benchmark suite. Keep internal-only results clearly separate from anything cleared for customer or public use, and route external claims through the designated approver before they ship.

Qualifications

• BS or MS in Computer Engineering, Electrical Engineering, Computer Science, or equivalent practical experience.
• 5+ years of experience in GPU performance engineering, accelerator benchmarking, HPC performance measurement, or ML systems measurement.
• Track record of building or operating benchmark harnesses that produced measured results on real GPUs or accelerators, including turning a Hugging Face model card, paper, or application description into a runnable benchmark.
• Hands-on experience with roofline analysis, limiter analysis, or analytical performance modeling.
• GPU performance analysis with NVIDIA Nsight Systems and Nsight Compute, or an equivalent profiler, covering HBM-bound versus compute-bound analysis, precision (FP16, BF16, FP8, INT8), and batching.
• Working knowledge of LLM inference stacks such as Hugging Face, vLLM, SGLang, or TensorRT-LLM, including prefill versus decode, continuous batching, and MoE.
• Proficiency in Python for harnesses, parsing, and plots, and comfort working in Linux.
• Cloud GPU operations on AWS, GCP, or Azure, including containers, instance types, drivers, quotas, and cost.

Preferred Skills

• Experience correlating a performance model or RTL/Verilator simulation against measured silicon or GPUs.
• GPU kernel work in CUDA, CUTLASS, or Triton, or familiarity with PyTorch internals.
• Familiarity with current inference-serving internals such as PagedAttention, FlashAttention, speculative decoding, and disaggregated prefill.
• Distributed inference experience covering collectives, all-reduce, NCCL, NVLink, and InfiniBand, or work with MLPerf or production inference benchmarking pipelines.
• Background at a hyperscaler, GPU vendor, accelerator company, or inference lab.

What We Offer

• This is an opportunity to play a pivotal role in an innovative startup redefining the future of AI hardware. Work on game-changing technology at the intersection of photonics and AI as part of a collaborative, brilliant team. You’ll contribute to a platform that redefines computational performance and accelerates the future of artificial intelligence. Come help us bring this transformative technology to the world.

Benefits

• Join a team that invests in your future and your well-being. At Neurophos, we offer:
• 100% coverage of base health plan premiums for you and your dependents, plus HSA contributions.
• Unlimited PTO. No rigid vacation banks, just a focus on delivery.
• 401(k) matching and stock option opportunities to ensure our success is your success.
• Full suite of voluntary benefits, including Dental, Vision, Life, Hospital, Critical Illness, and Accident insurance.
• Personalized Benefits. Choose the plans that fit your life and take the cash back for those that don’t.