QA Software Test Engineer Code Review - Remote
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
Key Skills for This Role
Full Job Posting
Overview
hiring experienced Software Engineers
to support high-impact research collaborations with leading AI labs.
Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems.
About The Project
This evaluation dataset is code question and answer data.
This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness.
Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements)
Key Responsibilities
- Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
- Source and adapt content from real PRs to create authentic scenarios
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
Ideal Qualifications
- 2+ years of experience in software engineering, technical research, or educational content development
- Degree in Software Engineering, Computer Science, or a related field (Bachelor’s minimum; advanced degree preferred)
- Strong proficiency in languages like Python, JavaScript, Java, or C++
- Experience with debugging, testing, and validating code
- Comfortable with technical writing and attention to detail
• Start Date: Immediate
- Duration: 1-2 months
- Commitment: Part-time (15-25 hours/week, with flexibility up to 40 hours/week)
Application & Onboarding Process
- Upload your resume
- AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role
- Follow-up communication within a few days with next steps and onboarding details
- Apply today
- and leverage your software engineering expertise to help build the future of AI-driven systems!
- We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request
Contract And Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at YO IT Consulting
Ubuntu User - Remote
Dubai, UAE
YO IT Consulting is looking for a remote Ubuntu User to support AI data training projects on an hourly paid contract basis. The role involves installing apps and recording actions on an Ubuntu/Linux computer. Ideal for t
Ubuntu User - Remote
Abu Dhabi, UAE
Work remotely on an hourly paid basis to support AI data training projects. Install apps and record actions on your own Ubuntu/Linux computer. Ideal for tech-savvy, detail-oriented individuals including students and juni
AI Trainer & Evaluator - Remote
Jeddah, KSA
In this contract role, you will apply your expertise to help train next-generation AI systems by evaluating and scoring AI-generated responses, annotating data sets, and providing feedback. Requires strong attention to d
Python QA Lead - Remote
Riyadh, KSA
We are seeking a Python Quality Assurance Lead to oversee quality and trainer performance across Python AI training projects in a remote contract role. You will review AI-generated Python code, provide feedback, and ensu
Python QA Lead - Remote
Abu Dhabi, UAE
This remote contract role is for a Python QA Lead to oversee quality and trainer performance on AI training projects. Responsibilities include reviewing AI-generated Python code, providing feedback, and maintaining docum
AI Engineer - Remote
Abu Dhabi, UAE
YO IT Consulting is hiring an AI Engineer to design, build, and optimize machine learning models for production. The role involves implementing ML pipelines, leveraging AWS and Kubernetes, and collaborating with cross-fu
AI Engineer - Remote
Riyadh, KSA
YO IT Consulting is seeking an AI Engineer to design, build, and optimize machine learning models for production environments. The role involves implementing end-to-end ML pipelines, leveraging AWS and Kubernetes, and co
Python QA Lead - Remote
Jeddah, KSA
YO IT Consulting is seeking a Python Quality Assurance Lead for a remote contract role. You will oversee quality and trainer performance across Python AI training projects, review AI-generated Python code, provide feedba
Ubuntu User - Remote
Dubai, UAE
Ubuntu User - Remote
Abu Dhabi, UAE
AI Trainer & Evaluator - Remote
Jeddah, KSA
Python QA Lead - Remote
Riyadh, KSA
Python QA Lead - Remote
Abu Dhabi, UAE
AI Engineer - Remote
Abu Dhabi, UAE
AI Engineer - Remote
Riyadh, KSA
Python QA Lead - Remote
Jeddah, KSA