AI Quality Analyst - Personalization (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
Evaluate a new personalization feature for an advanced AI model, with a focus on Hindi-language assessment.
Assess how effectively the model uses personal data to generate relevant and contextually appropriate responses.
Analyze integration of information from past conversations, email, search, and video activity.
Key Skills for This Role
Full Job Posting
Role Overview
Evaluate a new personalization feature for an advanced AI model, with a focus on Hindi-language assessment.
Assess how effectively the model uses personal data to generate relevant and contextually appropriate responses.
Analyze integration of information from past conversations, email, search, and video activity.
Key Responsibilities
- Design and refine multi-turn prompts based on personal experiences to test AI personalization.
- Evaluate AI-generated responses for grounding, integration, and helpfulness.
- Identify incorrect personalization, flawed inferences, and forced connections in model outputs.
- Compare model responses side by side to detect subtle differences and assess consistency.
- Provide detailed feedback on alignment with user-specific context and intent.
Required Skills and Qualifications
- Proficiency in Hindi with a high degree of competency in reading and writing.
- Experience evaluating AI-generated content, particularly in personalization contexts.
- Ability to design creative and contextually relevant prompts for testing AI models.
- Strong attention to detail when assessing nuanced and ambiguous AI responses.
- Willingness to use a personal Google account with enabled data sources for genuine evaluation.
- Familiarity with AI personalization, grounding, and user intent alignment.
- Experience in multi-turn conversation analysis and response evaluation.
- Comfort with data privacy considerations when handling personal user information.
- Ability to work full-time with flexibility for a global, 24-hour operations team.
Work Arrangement
- The role is remote and can be performed from anywhere.
- The role requires flexibility to support a global, 24-hour operations team.
Opportunity Context
The role contributes to the development of an AI system intended to deliver reliable personalization for enterprise users.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Corporate Attorney - M&A (Remote)
, UAE
The employer is seeking a Corporate/M&A Attorney to advise on corporate transactions, mergers, acquisitions, and strategic partnerships. The role covers transaction drafting and negotiation, legal due diligence, governan
Senior Full Stack Developer (Remote)
, UAE
Hire Feed is seeking a Senior Full Stack Developer on a contract basis to build and maintain scalable web applications and APIs. The role covers architecture, frontend and backend development, troubleshooting, performanc
Biologist (Remote)
, UAE
The employer is seeking a Biology Expert with advanced academic training to design and solve biology problems for large language model evaluation. The role requires strong biology research, analytical reasoning, communic
Product Specialist (Remote)
, UAE
The employer is seeking a Product Specialist to manage product lifecycle activities from ideation through launch. The role prioritizes features, coordinates product roadmaps, analyzes performance, conducts competitive re
UI Designer (Remote)
, UAE
The employer is seeking a UI and Visual Designer Specialist to create intuitive interfaces and visual elements for web and mobile products. The role requires proficiency with Figma, Sketch, or Adobe XD, a strong digital
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
The employer is seeking a full-time Software Engineer to develop and maintain desktop applications with ElectronJS and JavaScript or TypeScript. The role requires experience with Node.js, front-end frameworks, asynchrono
UX Designer (Remote)
, UAE
The employer is seeking a UX Designer to improve user experiences for a global digital platform. The role includes user research, interface design, prototyping, usability testing, design systems, and cross-functional col
Frontend Engineer - Web Applications (Remote)
, UAE
The employer is seeking a Frontend Engineer to build and maintain responsive, scalable web applications for a high-traffic platform. The role focuses on React or comparable frontend frameworks, reusable components, perfo
Corporate Attorney - M&A (Remote)
, UAE
Senior Full Stack Developer (Remote)
, UAE
Biologist (Remote)
, UAE
Product Specialist (Remote)
, UAE
UI Designer (Remote)
, UAE
Software Engineer - ElectronJS, Desktop (Remote)
, UAE
UX Designer (Remote)
, UAE
Frontend Engineer - Web Applications (Remote)
, UAE