gem
Principal Engineer – Distributed Systems (GPU Edge + Inference)
Elloe
Remote, USA
Full-time
Senior
Remote
Discovered 1 weeks ago
KubeRayIstioEnvoyVaultChainSHAP
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
KubeRayIstioEnvoy
Key Skills for This Role
KubeRayIstioEnvoyVaultChainSHAP
Full Job Posting
- Design zone-routing that ensures <50ms SLA in 10+ regions
- Build fallback orchestration to handle compliance-aware rollbacks
- Maximize utilization across 100K+ GPUs via mesh & load prediction
- Integrate compliance overlays with VaultChain and SHAP triggers
- Ship
/vault/audit,/inference/predict,/compliance/logendpoints - Trace every edge request across governance and model layers
- Senior systems engineer with GPU fleet experience (KubeRay, Istio, Envoy)
- Operated real-time AI infra with 10M+ QPS loads
- Comfortable with compliance observability and infra governance
- Referenceable contributions to enforcement infra that’s live in EU and US institutions
- First-hand product work across legal, engineering, and GTM teams
- Influence over how regulatory primitives become systems people trust
- Start Date: Flexible (Q3–Q4 ideal)
- Location: Remote-first; timezone overlap with NY or EU preferred
- Compensation: Top of market salary + equity
- To Apply: Send your resume and a sentence on the hardest infra problem you'd want to own at scale.
About Elloe
Verified company details for this employer are not available yet.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Elloe
Sales Ops & Revenue Intern (Pilot GTM x Signal Ops)
, USA
EntryInternship, Full Time
Discovered 1 weeks agoView →
Member of Technical Staff – ML Security Engineer (Red Teaming + Patch Risk Forecasting)
, USA
SeniorFull-time
Discovered 1 weeks agoView →
Product Manager – Enforcement Infrastructure (LLM + Vault)
, USA
MidFull-time
Discovered 1 weeks agoView →
Member of Technical Staff – AGI Governance Researcher (Constitutional Safety)
, USA
SeniorFull-time
Discovered 2 weeks agoView →
Sales Ops & Revenue Intern (Pilot GTM x Signal Ops)
, USA
Discovered 1 weeks agoInternship, Full Time
Design Intern (Narrative + Interface Systems)
, USA
Discovered 1 weeks agoInternship
Member of Technical Staff – ML Security Engineer (Red Teaming + Patch Risk Forecasting)
, USA
Discovered 1 weeks agoFull-time
Technical Product Intern (Compliance x LLM Ops)
, USA
Discovered 1 weeks agoInternship
LLM Red Team Intern (Evaluation Systems)
, USA
Discovered 1 weeks agoInternship
Product Manager – Enforcement Infrastructure (LLM + Vault)
, USA
Discovered 1 weeks agoFull-time
Member of Technical Staff – AGI Governance Researcher (Constitutional Safety)
, USA
Discovered 2 weeks agoFull-time