gem
LLM Red Team Intern (Evaluation Systems)
Elloe
Remote, USA
Internship
Entry
Remote
Discovered 1 weeks ago
GPT-4ClaudeGeminiOpen models
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
GPT-4ClaudeGemini
Key Skills for This Role
GPT-4ClaudeGeminiOpen models
Full Job Posting
- Create prompts to trigger hallucinations, policy violations, or failure scenarios
- Stress test Elloe-protected deployments using open and proprietary models
- Document behavioral exploits across use cases (healthcare, compliance, gov)
- Build truthsets and scoring rubrics tied to factuality, policy, or ethical standards
- Benchmark Elloe’s modules across model types (Claude, GPT-4, Gemini, open models)
- Collaborate with product to refine and expand our eval harnesses
- Identify blind spots in current detection logic
- Recommend scoring methods or red flag thresholds for deployment
- Support internal model comparison reports or customer safety audits
- ML/AI researcher or engineer (undergrad, grad, or early career)
- Experience working with LLMs, eval sets, and prompt design
- Strong attention to detail, grounded in safety and adversarial thinking
- Bonus: exposure to safety benchmarks like TruthfulQA, MMLU, or red teaming tools
- Exposure to high-stakes LLM safety deployments
- Published frameworks or scoring methods used by enterprises
- Mentorship from technical founders operating at the bleeding edge of AI safety
• Start Date: Rolling
- Duration: 12–16 weeks
- Compensation: Research stipend
- Location: Remote-first; flexible for global candidates
- To Apply: Share a jailbreak or eval idea you’d love to run against GPT-4.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Elloe
Sales Ops & Revenue Intern (Pilot GTM x Signal Ops)
, USA
EntryInternship, Full Time
Discovered 1 weeks agoView →
Member of Technical Staff – ML Security Engineer (Red Teaming + Patch Risk Forecasting)
, USA
SeniorFull-time
Discovered 1 weeks agoView →
Principal Engineer – Distributed Systems (GPU Edge + Inference)
, USA
SeniorFull-time
Discovered 1 weeks agoView →
Product Manager – Enforcement Infrastructure (LLM + Vault)
, USA
MidFull-time
Discovered 1 weeks agoView →
Member of Technical Staff – AGI Governance Researcher (Constitutional Safety)
, USA
SeniorFull-time
Discovered 2 weeks agoView →
Sales Ops & Revenue Intern (Pilot GTM x Signal Ops)
, USA
Discovered 1 weeks agoInternship, Full Time
Design Intern (Narrative + Interface Systems)
, USA
Discovered 1 weeks agoInternship
Member of Technical Staff – ML Security Engineer (Red Teaming + Patch Risk Forecasting)
, USA
Discovered 1 weeks agoFull-time
Technical Product Intern (Compliance x LLM Ops)
, USA
Discovered 1 weeks agoInternship
Principal Engineer – Distributed Systems (GPU Edge + Inference)
, USA
Discovered 1 weeks agoFull-time
Product Manager – Enforcement Infrastructure (LLM + Vault)
, USA
Discovered 1 weeks agoFull-time
Member of Technical Staff – AGI Governance Researcher (Constitutional Safety)
, USA
Discovered 2 weeks agoFull-time