Staff Software Engineer, Perception (R5421)

Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems.

Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks.

Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks.

Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments.

Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability.

Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems.

Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements.

Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery.

• Typically requires a minimum of 7 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or 4 years with a PhD; or equivalent work experience.
• Expertise of machine learning fundamentals.
• Experience training an deploying ML models for computer vision in a production setting.
• Strong understanding of 3D vision problems/algorithms.
• Experience with machine learning frameworks such as PyTorch and TensorFlow.
• Demonstrated expertise in deploying models using TensorRT and ONNX.
• Proficiency in C++ and Python.
• Strong analytical and problem-solving skills, with the ability to translate research into practical applications.
• Ability to obtain a SECRET clearance
• Experience with developing autonomous systems for defense customers.
• Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.