Quality Analyst (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Hire Feed is seeking an AI Quality Analyst to evaluate a personalization feature for an AI model. The role involves designing prompts, assessing response quality, and providing feedback.
Key Skills for This Role
Responsibilities
- Evaluate the quality of personalized responses from an AI model using personal experiences as context
- Design creative, multi turn prompts that test the model’s ability to integrate personal data sources accurately
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections
- Review side by side comparisons of AI responses to detect subtle differences in relevance and accuracy
- Provide detailed feedback on model behavior to improve personalization performance
Requirements
- English proficiency with high competence in reading and writing
- Experience in prompt engineering or designing test cases for AI models
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor
- Familiarity with personalization concepts and evaluation metrics in AI systems
- Attention to detail to identify subtle discrepancies in model outputs
- Willingness to use personal Google account and enable personal data sources for assessment
- Full time availability in local time zone to support global 24 hour operations
Full Job Posting
Role Overview
- Role: Quality Analyst (Remote)
- Location: Remote (Work from Anywhere)
- Job Type: Full Time
- Payout: Competitive, based on experience
- We are hiring for one of our clients, seeking an AI Quality Analyst English to work on a full time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant respons
Key Responsibilities
- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
- Design creative, multi turn prompts that test the model’s ability to integrate personal data sources accurately.
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
- Review side by side comparisons of AI responses to detect subtle differences in relevance and accuracy.
- Provide detailed feedback on model behavior to improve personalization performance.
Required Skills & Qualifications
- English proficiency with a high degree of competence in reading and writing.
- Experience in prompt engineering or designing test cases for AI models.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with personalization concepts and evaluation metrics in AI systems.
- Attention to detail to identify subtle discrepancies in model outputs.
- Willingness to use your primary personal Google account and enable personal data sources for assessment.
- Full time availability in your local time zone to support a global, 24 hour operations team.
More About the Opportunity
- This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact.
Equal Opportunity Employer
- We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
English Specialist (Remote)
Abu Dhabi, UAE
Role: English Specialist (Remote) Location: Remote (Work from Anywhere) Job Type: Part-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking an English Specialist t
Electrical Engineering Professor (Remote)
Abu Dhabi, UAE
Role: Electrical Engineering Professor (Remote) Location: Remote (Work from Anywhere) Job Type: Contract Payout: $40 - $130/hour Role Overview: We are hiring for one of our clients, seeking an Electrical Engineering P
Design Expert (Remote)
Abu Dhabi, UAE
Role : Design Expert (Remote) Location : Remote (Work from Anywhere) Job Type : Contract Payout : $15 - $40/hour Role Overview: We are hiring for one of our clients, seeking a Design Expert (Multidisciplinary) to work
Image/Video Annotator (Remote)
Abu Dhabi, UAE
Role : Image/Video Annotator (Remote) Location : Remote (Work from Anywhere) Job Type : Part-Time Payout : Competitive, based on experience Role Overview: We are hiring for one of our clients to assist in advancing la
Electrical Systems Specialist (Remote)
Abu Dhabi, UAE
Hire Feed seeks an Electrical Systems Specialist for a contract role involving on-site inspections, diagnostics, and field operations of electrical systems across multiple locations. Requires experience with electrical s
Network Security Engineer (Hybrid)
Abu Dhabi, UAE
We are hiring a Network Security Engineer for a contract role. You will design, deploy, and maintain secure network infrastructure, monitor traffic, and respond to incidents. Requires 3+ years of experience and proficien
Mathematics Expert (Remote)
Abu Dhabi, UAE
We are hiring a Mathematics Expert (Master's/Ph.D.) to work part-time on projects that improve and evaluate large language models by applying advanced mathematical reasoning, problem-solving, and clear written communicat
Math Specialist (Remote)
Abu Dhabi, UAE
We are hiring a Math Expert (PhD) to develop and optimize mathematical models for AI-driven platforms on a contract basis. The role involves designing algorithms, analyzing datasets, collaborating with cross-functional t
English Specialist (Remote)
Abu Dhabi, UAE
Electrical Engineering Professor (Remote)
Abu Dhabi, UAE
Design Expert (Remote)
Abu Dhabi, UAE
Image/Video Annotator (Remote)
Abu Dhabi, UAE
Electrical Systems Specialist (Remote)
Abu Dhabi, UAE
Network Security Engineer (Hybrid)
Abu Dhabi, UAE
Mathematics Expert (Remote)
Abu Dhabi, UAE
Math Specialist (Remote)
Abu Dhabi, UAE