Rubrics Specialist (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
We are hiring a Rubrics Expert to design, develop, and refine comprehensive rubrics for AI training and assessment. You will analyze task performance, establish scoring methodologies, and validate assessment outputs.
Key Skills for This Role
Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs
- Analyze task performance and provide structured, actionable feedback
- Establish and document effective scoring methodologies
- Lead calibration sessions to align evaluators and maintain rubric integrity
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives
Requirements
- Performance analysis and feedback structuring expertise
- Rubric design and development skills
- Scoring methodology and calibration expertise
- Assessment validation and quality control skills
- Domain expertise in a relevant field (e.g., finance, healthcare, engineering)
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Rubrics Expert to work on a contract basis.
- You'll apply your expertise to help train next generation AI systems by designing, developing, and refining comprehensive rubrics tailored to AI training and assessment needs.
- This is a unique opportunity to contribute to the development of frontier AI models.
Key Responsibilities
- Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
- Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
- Establish and document effective scoring methodologies that ensure consistency, fairness, and high quality outcomes.
- Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
- Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
Required Skills & Qualifications
- Performance analysis and feedback structuring expertise
- Rubric design and development skills
- Scoring methodology and calibration expertise
- Assessment validation and quality control skills
- Domain expertise in a relevant field, such as finance, healthcare, or engineering
More About the Opportunity
- Work with a global leader in the AI industry
- Contribute to the development of frontier AI models
- Work with a global network of experts
Equal Opportunity Employer
- We hire based on skills and expertise.
- All qualified candidates are welcome regardless of background, experience, or prior employment history.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Quik Hire Staffing
Cybersecurity Consultant (Remote)
Abu Dhabi, UAE
We are seeking a Cybersecurity Consultant specializing in LLM red-teaming to work on a contract basis. The role involves identifying vulnerabilities in large language models through adversarial testing, designing red-tea
Finance Expert - Corporate (Remote)
Abu Dhabi, UAE
We are seeking a Finance Expert to work on a contract basis for a global leader in the Technology, Information and Internet industry. The role involves providing financial guidance, preparing and analyzing financial stat
Health Consultant (Remote)
Abu Dhabi, UAE
We are hiring a Healthcare Expert on a contract basis to evaluate and validate AI models and data sets for healthcare applications. The role involves ensuring compliance with healthcare regulations and standards in AI-dr
AI Analyst (Remote)
Abu Dhabi, UAE
Quik Hire Staffing is hiring an AI Evaluation Analyst for a remote contract role. The position involves designing evaluation frameworks, analyzing AI model outputs, and collaborating with teams to improve model performan
Business Intelligence Consultant (Remote)
Abu Dhabi, UAE
A client is seeking a Business Intelligence Consultant (Excel) on a contract basis to design, develop, and maintain Excel-based dashboards and reports. The role requires translating business requirements into functional
Excel Analyst (Remote)
Abu Dhabi, UAE
Quik Hire Staffing is hiring a contract Excel Analyst for a client in the Information Services industry. You will extract, clean, and analyze data using Excel, create pivot tables and dashboards, and support business dec
Java Backend Developer (Remote)
Abu Dhabi, UAE
We are seeking a Java Developer for a contract role to build and maintain scalable Java applications. The role involves designing, developing, and deploying Java-based services, collaborating with cross-functional teams,
CAD Expert
Abu Dhabi, UAE
We are hiring a CAD Expert on a contract basis to create and modify detailed 2D and 3D CAD models. You will collaborate with engineers and designers to ensure accurate and efficient design execution. Proficiency in AutoC
Cybersecurity Consultant (Remote)
Abu Dhabi, UAE
Finance Expert - Corporate (Remote)
Abu Dhabi, UAE
Health Consultant (Remote)
Abu Dhabi, UAE
AI Analyst (Remote)
Abu Dhabi, UAE
Business Intelligence Consultant (Remote)
Abu Dhabi, UAE
Excel Analyst (Remote)
Abu Dhabi, UAE
Java Backend Developer (Remote)
Abu Dhabi, UAE
CAD Expert
Abu Dhabi, UAE