Sr. ML Inference Engineer

Remote US Company: Pictor Labs Employment Type: Full-time

• Design, development, and optimization of production ML inference systems for virtual staining models (Deepstain, Restain, ClearStain) serving clinical and pharmaceutical customers
• Architect and implement high-performance inference pipelines capable of processing gigapixel pathology images with sub-2-minute latency requirements
• Work with ML Research and Engineering teams to optimize model architectures and deployment strategies for both cloud-based APIs and edge devices (NVIDIA DGX Sparc, Grace Blackwell superchips)
• Evaluate, implement, and maintain state-of-the-art inference frameworks (TensorRT, Triton Inference Server, ONNX Runtime) to maximize GPU utilization and throughput
• Profile and optimize deep neural networks on NVIDIA GPUs using tools such as NVIDIA Nsight, PyTorch Profiler, and custom instrumentation
• Design and implement efficient model serving architectures that support both synchronous REST APIs and asynchronous batch processing workflows
• Collaborate with Platform and Edge Device teams to containerize inference systems (Docker, Kubernetes) for deployment across cloud and on-premise environments
• Partner with cloud providers (AWS, GCP, Azure) to optimize hosted inference solutions and leverage latest hardware accelerators
• Ensure inference systems meet regulatory requirements (FDA 510(k), SOC2) with comprehensive monitoring, logging, and audit capabilities
• Prototype and productionize new inference optimization techniques, including quantization, pruning, distillation, and dynamic batching strategies
• Build robust telemetry and monitoring systems to track model performance, latency, throughput, and resource utilization in production