Quality Analyst (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
Evaluate a new personalization feature for an AI model using English-language analysis.
Assess how the model integrates information from conversations, email, search, and other activity to deliver relevant responses.
The role combines creative prompt design with analytical evaluation of AI-generated content.
Key Skills for This Role
Full Job Posting
Role Overview
Evaluate a new personalization feature for an AI model using English-language analysis.
Assess how the model integrates information from conversations, email, search, and other activity to deliver relevant responses.
The role combines creative prompt design with analytical evaluation of AI-generated content.
Key Responsibilities
- Evaluate personalized AI responses using personal experiences as context.
- Design creative, multi-turn prompts to test integration of personal data sources.
- Assess responses for grounding, integration, and helpfulness, including incorrect personalization and forced connections.
- Review side-by-side response comparisons for subtle differences in relevance and accuracy.
- Provide detailed feedback to improve personalization performance.
Required Skills and Qualifications
- English proficiency with a high degree of competence in reading and writing.
- Experience in prompt engineering or designing AI model test cases.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with AI personalization concepts and evaluation metrics.
- Attention to detail when identifying subtle discrepancies in model outputs.
- Willingness to use a primary personal Google account with enabled personal data sources for assessment.
- Full-time availability in the local time zone to support a global, 24-hour operations team.
Workplace and Job Type
- The role is remote and can be performed from anywhere.
- The position is full-time.
Compensation
- Payout is described as competitive and based on experience.
Opportunity
The role contributes to the development of advanced AI systems intended to deliver measurable business impact.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Corporate Attorney - M&A (Remote)
, UAE
The employer is seeking a Corporate/M&A Attorney to advise on corporate transactions, mergers, acquisitions, and strategic partnerships. The role covers transaction drafting and negotiation, legal due diligence, governan
Senior Full Stack Developer (Remote)
, UAE
Hire Feed is seeking a Senior Full Stack Developer on a contract basis to build and maintain scalable web applications and APIs. The role covers architecture, frontend and backend development, troubleshooting, performanc
Biologist (Remote)
, UAE
The employer is seeking a Biology Expert with advanced academic training to design and solve biology problems for large language model evaluation. The role requires strong biology research, analytical reasoning, communic
Product Specialist (Remote)
, UAE
The employer is seeking a Product Specialist to manage product lifecycle activities from ideation through launch. The role prioritizes features, coordinates product roadmaps, analyzes performance, conducts competitive re
UI Designer (Remote)
, UAE
The employer is seeking a UI and Visual Designer Specialist to create intuitive interfaces and visual elements for web and mobile products. The role requires proficiency with Figma, Sketch, or Adobe XD, a strong digital
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
The employer is seeking a full-time Software Engineer to develop and maintain desktop applications with ElectronJS and JavaScript or TypeScript. The role requires experience with Node.js, front-end frameworks, asynchrono
UX Designer (Remote)
, UAE
The employer is seeking a UX Designer to improve user experiences for a global digital platform. The role includes user research, interface design, prototyping, usability testing, design systems, and cross-functional col
Frontend Engineer - Web Applications (Remote)
, UAE
The employer is seeking a Frontend Engineer to build and maintain responsive, scalable web applications for a high-traffic platform. The role focuses on React or comparable frontend frameworks, reusable components, perfo
Corporate Attorney - M&A (Remote)
, UAE
Senior Full Stack Developer (Remote)
, UAE
Biologist (Remote)
, UAE
Product Specialist (Remote)
, UAE
UI Designer (Remote)
, UAE
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
UX Designer (Remote)
, UAE
Frontend Engineer - Web Applications (Remote)
, UAE