greenhouse
Senior Software Engineer, Observability
Together AI
San Francisco, USA
Senior
USD 200000-280000 / year
Discovered 1 weeks ago
ansibleawsazuredockergcpgrafana
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
ansibleawsazure
Role Overview
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.
The AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.
Key Skills for This Role
ansibleawsazuredockergcpgrafana
Full Job Posting
About the Role
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.
The AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.
Responsibilities
- Design and implement a scalable observability platform (metrics, logs, traces) using tools like Prometheus, Grafana, ClickHouse, ClickStack, and OpenTelemetry, including telemetry data pipelines and log aggregation workflows.
- Develop automated monitoring, alerting, and anomaly detection systems, including SLIs/SLOs, runbooks, and predictive analytics for critical services.
- Build and deploy custom observability tools and infrastructure-as-code using Go, Python, Terraform, Ansible, and Helm.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Together AI
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Bengaluru, IND
Senior
Discovered 5 days agoView →
Head of Distribution Partnerships
San Francisco, USA
Discovered Today
Technical Community Manager
San Francisco, USA
Discovered Today
Director of Brand
San Francisco, USA
Discovered Yesterday
Strategic Account Executive Inference EMEA
London, GBR
Discovered 2 days ago
Technical Support Engineer - India
, IND
Discovered 3 days agoFull-time
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Bengaluru, IND
Discovered 5 days ago
Senior Software Engineer — Infra Agent Systems
San Francisco, USA
Discovered 5 days ago
Program Manager, Data Center Delivery
San Francisco, USA
Discovered 1 weeks agoFull-time
