AI Product Manager, AI Platform - Quality and Evaluation

The impact you will have

What we look for

• 5+ years of product management experience building highly technical platform, infrastructure, or developer-focused products
• Demonstrated experience shipping production AI products powered by large language models
• Experience defining products that incorporate LLM evaluation frameworks, AI quality measurement, and continuous model evaluation
• Deep understanding of offline and online evaluation methodologies, model benchmarking, regression testing, and AI quality metrics
• Experience with LLM observability platforms such as Datadog LLM Observability, Langfuse, LangSmith, Arize AI, Braintrust, Galileo, or similar AI quality and evaluation solutions
• Familiarity with prompt engineering, experimentation frameworks, evaluation datasets, and LLM-as-a-judge techniques for generative AI applications
• Experience partnering effectively with software engineers, ML engineers, AI researchers, and cross-functional stakeholders
• Strong analytical skills with the ability to translate AI performance signals into product decisions
• Excellent written and verbal communication skills
• Willingness to learn about cutting-edge technologies while cultivating expertise in investment management workflows and enterprise AI
• An aptitude for problem solving
• Ability to communicate effectively
• Serious interest in having fun at work

Bonus

About Ridgeline

Compensation and Benefits

• The typical starting salary range for new hires in this role is listed below. In select locations (including, the San Francisco Bay Area, CA, and the New York City Metro Area), an alternate range may apply as specified below.
• The typical starting salary range for this role is: $136,000-$170,000.
• The typical starting salary range for this role in the select locations listed above is: $149,500-$187,000.
• Final compensation amounts are determined by multiple factors, including candidate experience and expertise, and may vary from the amount listed above.
• As an employee at Ridgeline, you’ll have many opportunities for advancement in your career and can make a true impact on the product.
• In addition to the base salary, Ridgeline employees can participate in our Company Stock Plan subject to the applicable Stock Option Agreement. We also offer rich benefits that reflect the kind of organization we want to be: one in which our employees feel valued and are inspired to bring their best selves to work. These include unlimited vacation, educational and wellness reimbursements, and $0 cost employee insurance plans. Please check out our Careers page for a more comprehensive overview of our perks and benefits.