Base Career helps you apply smarter for this job.
Key skills for this role
Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
8 years of experience coding in one or more general-purpose programming languages (e.g., Python, Java, C++, or Go) focused on backend system architecture.
Experience building automated LLM evaluation pipelines, automated rating systems (AutoRaters), or defining LLM-specific reliability metrics (e.g., measuring grounding, helpfulness, safety, and hallucination/error reduction).
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
London, GBR
Sunnyvale, USA
Mountain View, USA
Sunnyvale, USA
London, GBR
Bengaluru, IND
London, GBR
San Bruno, USA
Sunnyvale, USA
Mountain View, USA
Sunnyvale, USA
Mountain View, USA
Experience with backend, distributed systems, or AI/ML systems infrastructure.
Experience managing software engineers, including performance management, mentoring, and team growth.
Master's degree or PhD in Computer Science or related technical field.
3 years of experience working in a complex, matrixed organization.
Experience developing, calibrating, and productionizing LLM-based AutoRater frameworks or automated regression testing.
Experience designing agentic tooling and integrating agents with commerce platforms.
Expertise in conversational AI architectures, agent orchestration harnesses, and Retrieval-Augmented Generation (RAG) for knowledge libraries.
Track record of technical leadership partnering with Product Management, Data Science, and UX to build "Ground Truth" datasets and performance-tracking dashboards.
Technology company specializing in search, advertising, cloud computing, and AI
Visit company websiteJobs and hiring trendsUSD 207000-300000 / year
Manager · 8+ years experience
Apply faster on company sites with our extension.