Senior Python Engineer - AI Coding Agent Evaluation
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
Mindrift is building a dataset to evaluate AI coding agents.
You will create challenging tasks and evaluation criteria within realistic simulated environments.
Key Skills for This Role
Full Job Posting
Overview
Mindrift is building a dataset to evaluate AI coding agents.
You will create challenging tasks and evaluation criteria within realistic simulated environments.
Responsibilities
- Build realistic developer environments with codebase, infrastructure, and context.
- Design tasks from intermediate states of these environments.
- Write tests that verify agent solutions.
- Iterate on tasks and tests based on QA feedback.
Requirements
- 5+ years of experience in software development.
- Proven ability to create challenging tasks for AI coding agents.
- Experience in writing tests that verify agent solutions.
- Ability to iterate on tasks and tests based on QA feedback.
- Deep understanding of AI model failures.
Qualifications
- Strong technical foundation and practical experience with scripting, automation, and data extraction workflows.
- Methodical, detail-oriented approach and the ability to work independently.
Benefits
- Paid per accepted task.
- Your rate depends on the qualification tier you reach and how efficiently you complete tasks up to the equivalent of $200/hr.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Mindrift
Freelance Graphic Designer
, QAT
Mindrift is seeking a freelance Graphic Designer for the Tendem project to create polished layouts, infographics, social media templates, and marketing assets. The work is project-based and remote, with tasks available d
Freelance Brand Designer
, QAT
Mindrift is seeking a Freelance Brand Designer for the Tendem project to build visual identities, brand assets, and scalable design systems for real-world brands and products. The role requires a strong branding portfoli
Senior Python Data Scraping Engineer (Freelance)
, QAT
Mindrift is seeking a Senior Python Data Scraping Engineer for the Tendem project to build and operate reliable web extraction workflows. The role requires 5+ years of relevant experience, strong Python scraping and data
Senior Python Data Scraping Engineer (Freelance)
, UAE
Mindrift is seeking a Senior Python Data Scraping Engineer for the Tendem project to build and operate reliable web extraction workflows. The role requires 5+ years of relevant experience, strong Python scraping and data
Freelance Web Designer
, GBR
Mindrift is seeking a freelance Web Designer for the Tendem project to create polished, conversion-focused marketing pages, landing experiences, and web layouts. Candidates need strong Figma and web/UI design skills, a r
Freelance Graphic Designer
, GBR
Mindrift is seeking a freelance Graphic Designer to create polished layouts, infographics, social media templates, one-pagers, and other marketing and communication assets. The role requires strong typography, compositio
Freelance Brand Designer
, IND
Mindrift is seeking a freelance Brand Designer to build visual identities, brand assets, and scalable design systems for real-world brands and products. The role requires a strong branding portfolio, proficiency with Ado
Freelance Web Designer
, AUS
Mindrift is seeking a freelance Web Designer for the Tendem project to create polished, implementation-ready marketing pages, landing experiences, and web layouts. The role requires strong Figma, responsive UI design, de
Freelance Graphic Designer
, QAT
Freelance Brand Designer
, QAT
Senior Python Data Scraping Engineer (Freelance)
, QAT
Senior Python Data Scraping Engineer (Freelance)
, UAE
Freelance Web Designer
, GBR
Freelance Graphic Designer
, GBR
Freelance Brand Designer
, IND
Freelance Web Designer
, AUS