bayt
AI Evaluation Engineer (Python, QA or Security)
Unknown
Baladiyat ad Dawhah, QAT
Senior
Onsite
$50 per hour
Discovered 2 weeks ago
PythonFastAPIJavaScriptTypeScriptReactDocker
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonFastAPIJavaScript
Role Overview
Mindrift connects specialists with project-based AI opportunities focused on testing, evaluating, and improving AI systems.
This opportunity involves building a dataset to evaluate how well AI coding agents handle real-world developer tasks.
Participation is project-based and is not permanent employment.
Key Skills for This Role
PythonFastAPIJavaScriptTypeScriptReactDocker
Full Job Posting
Opportunity Overview
Mindrift connects specialists with project-based AI opportunities focused on testing, evaluating, and improving AI systems.
This opportunity involves building a dataset to evaluate how well AI coding agents handle real-world developer tasks.
Participation is project-based and is not permanent employment.
Responsibilities
- Build realistic simulated developer environments with codebases, infrastructure, tickets, documentation, conversations, and development history.
- Design tasks from intermediate environment states, write prompts, and define what constitutes a solved task.
- Write tests that accept valid agent solutions and reject incorrect ones.
- Review agent solutions, analyze failures, and refine tasks and tests based on QA feedback.
Requirements
- At least 5 years of software development experience.
- Core stack experience with Python, FastAPI, JavaScript or TypeScript, React, Docker, Postgres, Kafka, and Redis.
- Experience writing functional and integration tests.
- English proficiency at B2 level or higher.
Role Clarifications
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Unknown
Operations Manager - Vehicle Distribution | Al-Futtaim Automotive | Logistics | Riyadh
, KSA
Senior
Drive operational excellence as an Operations Manager in Vehicle Distribution at Al-Futtaim Automotive. This role demands compliance with customs and port authorities while ensuring timely deliveries across KSA. Your exp
Discovered TodayView →
Financial Controller
, KSA
Executive
As a leading agriculture company specializing in premium dates, we seek an experienced Financial Controller to oversee our financial operations. This role is crucial for ensuring financial governance, accurate reporting,
Discovered TodayView →
GSN Sales Excellence & Training Manager – Fitness & Wellness
, KSA
Manager
The employer is seeking a senior Sales Excellence and Training Manager to build a high-performance sales organization in the fitness and wellness sector. The role leads sales process rollout, CRM optimization, performanc
Discovered TodayView →
Marketing Manager
, KSA
Manager
The employer is seeking a Marketing Manager to lead hotel communications, public relations, media relations, and promotional activity. The role develops PR and advertising plans, manages press materials and events, and r
Discovered TodayView →
Business Development Manager
, KSA
Manager
The employer is seeking a Business Development Manager to own revenue growth, market expansion, client acquisition, proposals, negotiations, and strategic partnerships. The role also supervises junior business developmen
Discovered TodayView →
Community & Brand Manager
, KSA
Manager
The employer is seeking a Community & Brand Manager to grow community engagement, brand awareness, event presence, and strategic partnerships for an AI startup. The role manages exhibitions and conferences, coordinates v
Discovered TodayView →
Sales Manager
, KSA
ManagerContract
The employer is seeking a Sales Manager to drive revenue growth, lead a high-performing sales team, and expand client relationships. The role requires sales management experience, target achievement, CRM and Microsoft Of
Discovered TodayView →
Cluster Public Relations Manager - Raffles & Fairmont The Red Sea (Saudi National)
, KSA
Manager
The employer is seeking a Public Relations Manager to lead the hotel’s PR strategy, media relationships, events, brand activation, and crisis communication. Candidates need public relations experience in Saudi Arabia, st
Discovered TodayView →
Operations Manager - Vehicle Distribution | Al-Futtaim Automotive | Logistics | Riyadh
, KSA
Discovered Today
Financial Controller
, KSA
Discovered Today
GSN Sales Excellence & Training Manager – Fitness & Wellness
, KSA
Discovered Today
Marketing Manager
, KSA
Discovered Today
Business Development Manager
, KSA
Discovered Today
Community & Brand Manager
, KSA
Discovered Today
Sales Manager
, KSA
Discovered TodayContract
Cluster Public Relations Manager - Raffles & Fairmont The Red Sea (Saudi National)
, KSA
Discovered Today