Arabic/English Bilingual AI Data Annotator & Evaluator (Remote, Hourly Contractor)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
CNTXT AI is seeking a bilingual Arabic/English AI Data Annotator & Evaluator for a remote, hourly contractor role. You will perform data annotation, LLM evaluation, content generation, and localization QA to support AI training datasets.
Key Skills for This Role
Responsibilities
- Label, classify, and structure documents, tables, and other content to support AI training datasets
- Review AI generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness
- Write high quality prompts and model responses to guide AI learning across diverse topics
- Ensure terminology, tone, cultural nuance, and locale specific details are consistently accurate across outputs
Requirements
- Bachelor's degree or higher in Translation, Linguistics, Localization, Communications, or a related field
- Native or near native Arabic proficiency with strong writing and editing skills across Modern Standard Arabic and at least one dialect
- Minimum C1 English proficiency (reading/writing)
- Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance
- Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors
- Ability to rigorously fact check localized content using reliable sources
- Ability to identify reasoning gaps, methodological errors, and unclear explanations
- Reliable, self directed, and able to deliver consistent quality with clear communication across time zones
Full Job Posting
Position Summary
- This is a fully remote, hourly contractor role supporting AI data and language projects on a project based, flexible hour basis.
- Project scopes vary and may include data annotation, LLM evaluation, content generation, and localization QA.
Responsibilities
- Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
- LLM evaluation: reviewing AI generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
- Content generation: writing high quality prompts and model responses to guide AI learning across diverse topics.
- Localization QA: ensuring terminology, tone, cultural nuance, and locale specific details are consistently accurate across outputs.
Profile Requirements
- Bachelor's degree or higher in Translation, Linguistics, Localization, Communications, or a related field.
- Native or near native Arabic proficiency with strong writing and editing skills across Modern Standard Arabic and at least one dialect.
- Minimum C1 English proficiency (reading/writing) for interpreting prompts, source materials, and evaluation guidelines.
- Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
- Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
- Ability to rigorously fact check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
- Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
- Reliable, self directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.
Preferred Experience
- Professional localization or translation experience.
- Familiarity with MQM/LQA concepts (severity, category, and root cause thinking) for consistent quality decisions.
- Proficiency with CAT tools and QA workflows (translation memory, termbases, automated checks).
- Previous experience with AI data training, annotation, or evaluation.
About CNTXT AI
- CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact.
- Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic native and secure, sovereign solutions.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at CNTXT AI
Sales Development Representative
Abu Dhabi Emirate, UAE
CNTXT AI is hiring a Sales Development Representative in Abu Dhabi to generate qualified opportunities and build an enterprise sales pipeline for AI solutions. The role requires 1-3 years of experience in sales developme
Senior QA Engineer
Abu Dhabi, UAE
CNTXT AI seeks a Senior QA Engineer to design test plans, perform manual and automated testing for web/mobile applications, and validate Arabic content quality in AI outputs. Requires 5+ years QA experience, native Arabi
Computer Vision Engineer - Egocentric & Robotics Data Pipelines
Abu Dhabi Emirate, UAE
CNTXT AI is hiring a Computer Vision Engineer to build and operate data infrastructure for large-scale robotics and egocentric AI datasets. You will design distributed data-processing pipelines, process multimodal sensor
Commercial Executive
Abu Dhabi Emirate, UAE
CNTXT AI seeks a Commercial Executive to identify new business opportunities, generate qualified sales opportunities, and support the commercial team in achieving revenue objectives. The ideal candidate has 2+ years of e
Data Engineer — Egocentric & Robotics Data Pipelines
Abu Dhabi Emirate, UAE
CNTXT AI is building data infrastructure for AI and robotics. As a Data Engineer, you will design and maintain distributed data-processing pipelines for large-scale egocentric and robotics datasets. You'll work with Pyth
AI Engineer — Speech & Voice Intelligence
Abu Dhabi, UAE
CNTXT is building voice AI infrastructure for the Arabic-speaking world and is looking for an AI engineer or researcher passionate about voice and speech technology. You will work on speech synthesis, recognition, and sp
Lead FullStack Engineer
Abu Dhabi, UAE
CNTXT AI is seeking a seasoned AI Full Stack Tech Lead to own the technical direction of the product engineering team. The role involves architecting backend systems in Node.js, shipping full-stack features with React/Ne
Robotics Data Collector (Qatar)
Doha, QAT
CNTXT AI is seeking a detail-oriented Robotics Data Collector to support the collection of high-quality robotics and egocentric data for training AI models. The role involves hands-on work with robotic systems, sensors,
Sales Development Representative
Abu Dhabi Emirate, UAE
Senior QA Engineer
Abu Dhabi, UAE
Computer Vision Engineer - Egocentric & Robotics Data Pipelines
Abu Dhabi Emirate, UAE
Commercial Executive
Abu Dhabi Emirate, UAE
Data Engineer — Egocentric & Robotics Data Pipelines
Abu Dhabi Emirate, UAE
AI Engineer — Speech & Voice Intelligence
Abu Dhabi, UAE
Lead FullStack Engineer
Abu Dhabi, UAE
Robotics Data Collector (Qatar)
Doha, QAT