Base Career helps you apply smarter for this job.
Key skills for this role
As a Research Engineer focused on Model Evaluation & MLOps, you will build the tools and infrastructure needed to evaluate, deploy, and operate multimodal foundation models reliably. You will rapidly enable Sciforium’s models and the latest open-weight models on GPUs, automate quality and performance benchmarking, and improve the MLOps workflows that connect research experiments to reliable releases.
As a Research Engineer focused on Model Evaluation & MLOps, you will build the tools and infrastructure needed to evaluate, deploy, and operate multimodal foundation models reliably. You will rapidly enable Sciforium’s models and the latest open-weight models on GPUs, automate quality and performance benchmarking, and improve the MLOps workflows that connect research experiments to reliable releases.
Rapidly integrate new internal and open-weight language and multimodal models into our GPU evaluation and inference environments.
Build automated benchmarks for model quality and systems performance, including latency, throughput, and memory usage.
Create standardized, reproducible comparisons across Sciforium models, external baselines, and runtime configurations.
Build and maintain experiment tracking, model registry, and versioning for models, datasets, and evaluation configurations.
Automate the path from research checkpoints to validated deployments through CI/CD and reproducible workflows.
Monitor model quality and systems performance, and diagnose failures or regressions across model and deployment pipelines.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
San Francisco, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
Build reusable tools that help researchers launch evaluations, compare experiments, and reproduce results.
Profile end-to-end model workloads and collaborate with distributed systems, inference, and GPU kernel engineers on deeper performance issues.
Familiarity with Hugging Face Transformers or similar model libraries.
Experience enabling models on AMD GPUs and ROCm.
Contributions to open-source evaluation, model, or ML infrastructure projects.
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
AI infrastructure company building multimodal models and high-efficiency serving software for developers and teams.
Visit company websiteJobs and hiring trendsUSD 155000-200000 yearly / year
Full-time
Entry · 2+ years experience
Onsite
Apply faster on company sites with our extension.