ashby
Senior Backend Engineer (Python)
Ellipsis Health
Remote, USA
Full-time
Senior · 4+ years experience
Remote
USD 175000-250000 yearly / year
Discovered 1 weeks ago
PythonFastAPIasyncioWebRTCWebSocketsgRPC
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonFastAPIasyncio
Key Skills for This Role
PythonFastAPIasyncioWebRTCWebSocketsgRPC
Full Job Posting
Responsibilities
- Expand and maintain our real-time voice pipeline: design, implement, and maintain Python micro-services for conversational AI orchestration—audio capture, streaming transcription, prompt/LLM logic, synthesis, and playback.
- Integrate new providers & transports: add plug-ins for emerging ASR, TTS, LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build adapters that allow hot-swapping components without downtime. Build API endpoints.
- Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio, FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling.
- Instrument & observe every hop: emit structured traces (OpenTelemetry), metrics, and logs for each pipeline stage; define SLOs for first-token latency, end-to-end latency, and streaming reliability.
- Harden for production: implement graceful retries, idempotent message passing, circuit breakers, and HIPAA-compliant security (encryption in transit, per-tenant isolation, secrets rotation).
- Collaborate cross-functionally with ML, product, data engineering, and client-SDK teams to deliver features such as voice cloning, multimodal hand-offs, and domain-specific memory retrieval.
Qualifications
- 4+ years building production back-ends in modern Python.
- Proven experience with real-time streaming systems—WebRTC, WebSockets, or gRPC streaming—and proficiency with asyncio, FastAPI, or similar async frameworks.
- Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and distributed tracing.
- Solid understanding of AWS/GCP/Azure, including container orchestration (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC (Terraform).
- Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores; able to model and persist conversational state.
- Excellent communication skills and a bias for measured, observable, and continuously deployable software. Bonus Points If You Have:
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Ellipsis Health
Senior Software Development Engineer in Test (SDET), Salesforce
San Francisco, USA
SeniorFull-time
Discovered 1 weeks agoView →
Senior Backend Engineer, Core Services
San Francisco, USA
Discovered YesterdayFull-time
Senior Full Stack Engineer
, USA
Discovered 1 weeks agoFull-time
Forward Deployed Product Manager, AI Assistant
, USA
Discovered 1 weeks agoFull-time
Senior Backend Developer
, USA
Discovered 1 weeks agoFull-time
AI Evaluations Engineer
, USA
Discovered 1 weeks agoFull-time
Senior Software Development Engineer in Test (SDET), Salesforce
San Francisco, USA
Discovered 1 weeks agoFull-time
Senior QA Engineer, Forward Deployed
San Francisco, USA
Discovered 1 weeks agoFull-time
Senior Data Platform Engineer
San Francisco, USA
Discovered 1 weeks agoFull-time