Base Career helps you apply smarter for this job.
Key skills for this role
Participate in shaping the roadmap and research questions for SRE Skills Bench.
Help build an active community around the benchmark and encourage outside contributions.
Create realistic evaluation tasks based on incident response, infrastructure, debugging, observability, and production operations.
Help develop reliable and reproducible methods for evaluating frontier and open-source models.
Analyze results and turn them into reports, technical articles, and public datasets.
Collaborate with SREs, researchers, model providers, and open-source contributors.
Evaluate how new models, agents, and coding environments perform on operational work.
Help establish SRE Skills Bench as the industry standard for evaluating AI on reliability engineering.
Hands-on experience or a strong interest in SRE, infrastructure, platform engineering, DevOps, or production operations.
Familiarity with LLM evaluations, benchmarks, agents, or applied AI research.
An experimental mindset, with an interest in designing reproducible tests, examining imperfect results, and learning quickly.
A self-driven approach, with the initiative to make sound decisions and move ambitious projects forward with minimal guidance.
The ability to explain technical work clearly and enthusiasm for sharing it through articles, social media, and talks at meetups or conferences.
Comfort working in a hybrid environment and collaborating asynchronously with a curious, distributed team.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Toronto, CAN
Toronto, CAN
, USA
, AUS
Toronto, CAN
Toronto, CAN
Toronto, CAN
, CAN
AI-native incident management platform for engineering teams that detects, resolves, and helps them learn from operational incidents.
Full Time, Internship
Entry
Hybrid
Apply faster on company sites with our extension.