Senior Software Engineer, AI Operations, GPS

Role Overview

Key Responsibilities

• Act as the technical gatekeeper during the transition from delivery to maintenance and review code, prompts, architecture, and documentation before sign-off.
• Own tiered SLA response and resolution targets, incident governance, root cause analysis, and P1/P2 mitigations.
• Monitor production model performance, latency, and data drift, and manage prompt configuration repositories.
• Perform regression testing when LLM providers update underlying endpoints.
• Classify routine maintenance and system evolution requests and benchmark new AI models.
• Build self-healing data pipelines, automated RAG indexing synchronization, and telemetry tooling.
• Influence delivery teams to adopt architectures that simplify ongoing maintenance.
• Serve as the senior technical contact for government and enterprise IT leads and explain AI concepts in business terms.

Qualifications

• At least 5 years of experience in software engineering, MLOps, SRE, or forward deployed engineering in heavy-data or production-AI environments.
• Advanced proficiency in Python, SQL, REST or gRPC APIs, and cloud architecture.
• Hands-on experience with MLOps tooling, vector databases, and LLM orchestration frameworks such as LangChain or LlamaIndex.
• Practical understanding of prompt version control, model benchmarking, RAG pipelines, and data drift detection.
• Strong understanding of CI/CD for machine learning pipelines.
• Strong technical communication and client expectation-management skills.

About Scale AI