ashby
Data Annotator
Mind Moves
Remote, USA
Contract
Entry
Remote
USD 30-30 hourly / hour
Discovered 1 weeks ago
PubMedPubMed Central (PMC)EndNoteZoteroChatGPTClaude
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PubMedPubMed Central (PMC)EndNote
Role Overview
Mind Moves is seeking 20+ independent Data Annotators to develop a benchmark evaluation dataset for AI systems operating over the biomedical literature. As these systems become integrated into research and clinical workflows, rigorous assessment of their safety, factual accuracy, and scientific reliability requires expert-authored ground truth.
SMEs will independently create authentic biomedical information needs and reference responses grounded exclusively in evidence from scientific literature resources PubMed and PubMed Central (PMC), following standardized annotation guidelines. The resulting benchmark will provide a transparent, reproducible resource for evaluating AI systems’ ability to retrieve, synthesize, and accurately communicate biomedical evidence.
Key Skills for This Role
PubMedPubMed Central (PMC)EndNoteZoteroChatGPTClaude
Full Job Posting
At a Glance
We need human curators to develop a range of biomedical question and answer datasets for AI research. Learn how trustworthy AI systems are built and contribute your scientific expertise to the National Library of Medicine (NLM) at the National Institutes of Health (NIH).
About Mind Moves
Mind Moves is a women-owned Washington, D.C.-based firm that helps government and business partners navigate digital transformation using "human-in-the-loop" AI. Our expert team has delivered responsibly developed AI products that drive millions in impact across agencies like the National Institutes of Health (NIH).
About the Role
Mind Moves is seeking 20+ independent Data Annotators to develop a benchmark evaluation dataset for AI systems operating over the biomedical literature. As these systems become integrated into research and clinical workflows, rigorous assessment of their safety, factual accuracy, and scientific reliability requires expert-authored ground truth.
SMEs will independently create authentic biomedical information needs and reference responses grounded exclusively in evidence from scientific literature resources PubMed and PubMed Central (PMC), following standardized annotation guidelines. The resulting benchmark will provide a transparent, reproducible resource for evaluating AI systems’ ability to retrieve, synthesize, and accurately communicate biomedical evidence.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer