Rubrics Specialist (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
We are hiring a Rubrics Expert to work on a contract basis, applying expertise to help train next-generation AI systems by designing, developing, and refining comprehensive rubrics tailored to AI training and assessment needs.
Key Skills for This Role
Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs
- Analyze task performance and provide structured, actionable feedback
- Establish and document effective scoring methodologies
- Lead calibration sessions to align evaluators and maintain rubric integrity
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives
Requirements
- Performance analysis and feedback structuring expertise
- Rubric design and development skills
- Scoring methodology and calibration expertise
- Assessment validation and quality control skills
- Domain expertise in a relevant field such as finance, healthcare, or engineering
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Rubrics Expert to work on a contract basis. In this role, you'll apply your expertise to help train next generation AI systems by designing, developing, and refining comprehensive rubrics tailored to AI training and assessment needs.
Key Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
- Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
- Establish and document effective scoring methodologies that ensure consistency, fairness, and high quality outcomes.
- Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
Required Skills & Qualifications
- Performance analysis and feedback structuring expertise
- Rubric design and development skills
- Scoring methodology and calibration expertise
- Assessment validation and quality control skills
- Domain expertise in a relevant field, such as finance, healthcare, or engineering
More About the Opportunity
- This role offers a unique opportunity to work with a global leader in the AI industry, contributing to the development of frontier AI models.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hired
Financial Investment Analyst (Remote)
Abu Dhabi, UAE
We are hiring a Financial Investment Analyst for a contract role with a global financial services client. You will analyze financial data, evaluate investment opportunities, and support strategic decisions. Requires expe
Enterprise Account Manager (Government) (Remote)
Abu Dhabi, UAE
We are hiring an Enterprise Account Manager to secure government contracts for enterprise software solutions. The role involves managing relationships with federal, state, and local government agencies, driving adoption
Audio Engineer (Remote)
Abu Dhabi, UAE
A global leader in Media Production is hiring a contract Audio Engineer for remote work. The role involves recording, editing, and mixing audio content using industry-standard software. Candidates should have proficiency
Software Engineer - E-Commerce (Remote)
Abu Dhabi, UAE
We are hiring a Software Engineer, New Grad to develop scalable backend systems and optimize algorithms for a global e-commerce platform. You will work remotely on mission-critical infrastructure serving millions of user
Journalist (Remote)
Abu Dhabi, UAE
We are hiring a Journalist on a contract basis for a digital platform. The role involves researching, writing, and producing high-quality content. Candidates should have proven experience in journalism or content writing
Sales/Account Executive (Remote)
Abu Dhabi, UAE
A client in the technology sector is seeking a Sales Specialist on a contract basis to drive revenue growth through strategic sales initiatives and client engagement. The role requires 2+ years of sales experience, stron
Strategy Consultant (Remote)
Abu Dhabi, UAE
We are hiring a Strategy Consultant for a contract role with a global technology client. You will develop strategic recommendations, analyze data, and lead workshops to improve business performance. Requires management c
Data Partnerships Lead (Remote)
Abu Dhabi, UAE
We are seeking a Data Partnerships Lead to develop and manage strategic data partnerships that enhance product offerings and drive revenue growth through data monetization. The role requires strong background in data str
Financial Investment Analyst (Remote)
Abu Dhabi, UAE
Enterprise Account Manager (Government) (Remote)
Abu Dhabi, UAE
Audio Engineer (Remote)
Abu Dhabi, UAE
Software Engineer - E-Commerce (Remote)
Abu Dhabi, UAE
Journalist (Remote)
Abu Dhabi, UAE
Sales/Account Executive (Remote)
Abu Dhabi, UAE
Strategy Consultant (Remote)
Abu Dhabi, UAE
Data Partnerships Lead (Remote)
Abu Dhabi, UAE