Assessment Framework Expert (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Hire Feed is hiring a Rubrics Expert on a contract basis to design and refine rubrics for AI training and assessment. The role involves analyzing task performance, establishing scoring methodologies, and validating outputs.
Key Skills for This Role
Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs
- Analyze task performance and provide structured, actionable feedback
- Establish and document effective scoring methodologies
- Lead calibration sessions to align evaluators and maintain rubric integrity
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives
Requirements
- Performance analysis and feedback structuring expertise
- Rubric design and development skills
- Scoring methodology and calibration expertise
- Assessment validation and quality control skills
- Domain expertise in a relevant field (e.g., finance, healthcare, engineering)
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Rubrics Expert to work on a contract basis.
- You'll apply your expertise to help train next generation AI systems by designing, developing, and refining comprehensive rubrics.
- This is a unique opportunity to contribute to the development of frontier AI models.
Key Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
- Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
- Establish and document effective scoring methodologies that ensure consistency, fairness, and high quality outcomes.
- Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
Required Skills & Qualifications
- Performance analysis and feedback structuring expertise.
- Rubric design and development skills.
- Scoring methodology and calibration expertise.
- Assessment validation and quality control skills.
- Domain expertise in a relevant field, such as finance, healthcare, or engineering.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Customer Support Specialist (Remote)
Abu Dhabi, UAE
We are hiring an AI Customer Support Specialist to work remotely on a contract basis. You will address customer inquiries about AI technologies, troubleshoot technical issues, and document resolutions. Requires experienc
E-commerce Specialist - Data & Catalog (Remote)
Abu Dhabi, UAE
Hire Feed is hiring an E-commerce Data & Catalog Specialist on a contract basis to manage and optimize product data for e-commerce platforms. Responsibilities include data cleansing, catalog structuring, and ensuring dat
Chemistry Expert (Remote)
Abu Dhabi, UAE
We are hiring a Chemistry Expert (PhD) for a contract role with a global leader in pharmaceutical manufacturing. The role involves designing and executing chemical experiments, analyzing data, and developing new chemical
SQL Developer (Remote)
Abu Dhabi, UAE
A client is seeking a SQL Developer on a contract basis to design, develop, and maintain SQL-based solutions. The role involves writing complex queries, developing stored procedures, and optimizing database performance.
Senior Full Stack Developer (Remote)
Abu Dhabi, UAE
Hire Feed is seeking a Senior Full Stack Developer for a contract role to build and maintain scalable web applications and APIs. The role requires proficiency in JavaScript, TypeScript, Node.js, and modern frontend frame
UI Engineer (Remote)
Abu Dhabi, UAE
Hire Feed is seeking a UI Engineer for a contract role. The position involves building responsive UI components using modern frameworks like React or Vue.js. The role is remote, pays $30-$70/hour, and requires proficienc
Data Analyst - Business (Remote)
Abu Dhabi, UAE
We are hiring a Data Analyst for a contract role with a global leader. You will analyze complex datasets, develop dashboards, and provide actionable insights. Requires proficiency in SQL, data visualization tools, and Py
English Specialist (Remote)
Abu Dhabi, UAE
We are seeking an English Specialist to evaluate and grade English language proficiency assessments for non-native speakers on a part-time basis. The role involves reviewing written and spoken responses, providing feedba
Customer Support Specialist (Remote)
Abu Dhabi, UAE
E-commerce Specialist - Data & Catalog (Remote)
Abu Dhabi, UAE
Chemistry Expert (Remote)
Abu Dhabi, UAE
SQL Developer (Remote)
Abu Dhabi, UAE
Senior Full Stack Developer (Remote)
Abu Dhabi, UAE
UI Engineer (Remote)
Abu Dhabi, UAE
Data Analyst - Business (Remote)
Abu Dhabi, UAE
English Specialist (Remote)
Abu Dhabi, UAE