Quality Analyst (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
The client is seeking a full-time AI Quality Analyst - English to evaluate a personalization feature for an AI model.
The role assesses how the model integrates information from conversations, email, search, and activity to produce relevant responses.
The work combines creative prompt design with analytical evaluation of AI-generated content.
Key Skills for This Role
Full Job Posting
Role Overview
The client is seeking a full-time AI Quality Analyst - English to evaluate a personalization feature for an AI model.
The role assesses how the model integrates information from conversations, email, search, and activity to produce relevant responses.
The work combines creative prompt design with analytical evaluation of AI-generated content.
Job Type and Payout
- The role is full-time.
- Compensation is competitive and based on experience.
Location
- The role is remote and can be performed from anywhere.
Key Responsibilities
- Evaluate the quality of personalized AI responses using personal experiences as context.
- Design creative, multi-turn prompts to test accurate integration of personal data sources.
- Assess responses for grounding, integration, and helpfulness.
- Identify incorrect personalization and forced connections.
- Review side-by-side comparisons to detect subtle differences in relevance and accuracy.
- Provide detailed feedback to improve personalization performance.
Required Skills and Qualifications
- High competence in reading and writing English.
- Experience in prompt engineering or designing test cases for AI models.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with personalization concepts and AI evaluation metrics.
- Attention to detail when identifying subtle discrepancies in model outputs.
- Willingness to use a primary personal Google account and enable personal data sources for assessment.
- Full-time availability in the local time zone for a global 24-hour operations team.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Corporate Attorney - M&A (Remote)
, UAE
The employer is seeking a Corporate/M&A Attorney to advise on corporate transactions, mergers, acquisitions, and strategic partnerships. The role covers transaction drafting and negotiation, legal due diligence, governan
Senior Full Stack Developer (Remote)
, UAE
Hire Feed is seeking a Senior Full Stack Developer on a contract basis to build and maintain scalable web applications and APIs. The role covers architecture, frontend and backend development, troubleshooting, performanc
Biologist (Remote)
, UAE
The employer is seeking a Biology Expert with advanced academic training to design and solve biology problems for large language model evaluation. The role requires strong biology research, analytical reasoning, communic
Product Specialist (Remote)
, UAE
The employer is seeking a Product Specialist to manage product lifecycle activities from ideation through launch. The role prioritizes features, coordinates product roadmaps, analyzes performance, conducts competitive re
UI Designer (Remote)
, UAE
The employer is seeking a UI and Visual Designer Specialist to create intuitive interfaces and visual elements for web and mobile products. The role requires proficiency with Figma, Sketch, or Adobe XD, a strong digital
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
The employer is seeking a full-time Software Engineer to develop and maintain desktop applications with ElectronJS and JavaScript or TypeScript. The role requires experience with Node.js, front-end frameworks, asynchrono
UX Designer (Remote)
, UAE
The employer is seeking a UX Designer to improve user experiences for a global digital platform. The role includes user research, interface design, prototyping, usability testing, design systems, and cross-functional col
Frontend Engineer - Web Applications (Remote)
, UAE
The employer is seeking a Frontend Engineer to build and maintain responsive, scalable web applications for a high-traffic platform. The role focuses on React or comparable frontend frameworks, reusable components, perfo
Corporate Attorney - M&A (Remote)
, UAE
Senior Full Stack Developer (Remote)
, UAE
Biologist (Remote)
, UAE
Product Specialist (Remote)
, UAE
UI Designer (Remote)
, UAE
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
UX Designer (Remote)
, UAE
Frontend Engineer - Web Applications (Remote)
, UAE