Base Career helps you apply smarter for this job.
Key skills for this role
Your primary focus will be relevance evaluation and quality improvements:
• LLM-based evaluation. We fine-tune our own models to assess relevance. This involves teaching the model to understand query intent, represent items from messy catalog data, and align model judgments with real user behavior.
• Real-time quality in production. Reranking, filtering, signal computation. Latency is a strict requirement, so quality vs speed tradeoff is constant.
• Automated quality monitoring and agentic insights. Pipelines to detect degradations and find underperforming patterns. Agent-based systems that generate actionable recommendations for the product data and search configurations.
What makes this interesting
• Multi-domain, multi-language, at scale - 40+ languages, 20+ domains. The models need to generalize across all of them - without per-customer rules or overrides.
• No universal ground truth. A grocery retailer and a fashion retailer may have different perceptions on what "relevant" means.
• Efficiency at scale. Optimizing and scaling LLM inference across our entire customer base.
Launched in 2019, Constructor is an AI-first ecommerce search and discovery platform that helps shoppers find the right products at the right time and enables leading global e-commerce brands to drive meaningful revenue and conversion gains.
As a Senior Machine Learning Engineer in the Search Quality team, you will improve the e-commerce experience for hundreds of millions of users across the world by building the systems that power relevance for global retailers - from fashion and grocery to electronics and hardware.
The mission is to measure search quality, push it higher, and catch degradations before the user does. You will achieve this through a blend of fine-tuned LLMs for relevance judgment, real-time models, and deep offline analysis of query logs.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
, GBR
, USA
, USA
, USA
, USA
, GBR
, GBR
, USA
Your primary focus will be relevance evaluation and quality improvements:
LLM-based evaluation. We fine-tune our own models to assess relevance. This involves teaching the model to understand query intent, represent items from messy catalog data, and align model judgments with real user behavior.
Real-time quality in production. Reranking, filtering, signal computation. Latency is a strict requirement, so quality vs speed tradeoff is constant.
Automated quality monitoring and agentic insights. Pipelines to detect degradations and find underperforming patterns. Agent-based systems that generate actionable recommendations for the product data and search configurations.
Multi-domain, multi-language, at scale - 40+ languages, 20+ domains. The models need to generalize across all of them - without per-customer rules or overrides.
No universal ground truth. A grocery retailer and a fashion retailer may have different perceptions on what "relevant" means.
Efficiency at scale. Optimizing and scaling LLM inference across our entire customer base.
At Constructor.io we are committed to cultivating a work environment that is diverse, equitable, and inclusive. As an equal opportunity employer, we welcome individuals of all backgrounds and provide equal opportunities to all applicants regardless of their education, diversity of opinion, race, color, religion, gender, gender expression, sexual orientation, national origin, genetics, disability, age, veteran status or affiliation in any other protected group.
Studies have shown that women and people of color may be less likely to apply for jobs unless they meet every one of the qualifications listed. Our primary interest is in finding the best candidate for the job. We encourage you to apply even if you don’t meet all of our listed qualifications.
AI-powered ecommerce product search and discovery platform serving enterprise retailers, brands, distributors, and marketplaces.
Visit company websiteJobs and hiring trendsUSD 80000-120000 yearly / year
Full-time
Senior · 4+ years experience
Remote
Apply faster on company sites with our extension.