Freelance Data Scraping Engineer (Python)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Mindrift is looking for a Freelance Data Scraping Engineer to drive specialized data scraping workflows within a hybrid AI + human system. You will own end-to-end data extraction, use tools like Apify and OpenRouter, and ensure data quality.
Key Skills for This Role
Responsibilities
- Own end to end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution.
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed for JavaScript rendered content.
- Enforce data quality standards through validation checks, cross source consistency controls, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Requirements
- Hands on experience in web scraping, data extraction and processing
- Proficiency in Python
- Experience with dynamic and interactive web sources
- Ability to scale scraping operations for large datasets
Full Job Posting
Overview
- Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system.
- In this role, as an AI Pilot, you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control.
- This part time remote opportunity is ideal for technical professionals with hands on experience in web scraping, data extraction and processing.
Key Responsibilities
- Own end to end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements.
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript rendered content and changing site behavior.
- Enforce data quality standards through validation checks, cross source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Compensation
- On this project, contributors can earn up to $37 per hour equivalent, depending on their level and pace of contribution.
- Compensation varies across projects depending on scope, complexity, and required expertise.
How it works
- Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule.
- Work fully remote on your own schedule with just a laptop and stable internet connection.
- Gain hands on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly.
- Participate in performance based bonus programs that reward high quality work and consistent delivery.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Mindrift
Ex-MBB Strategy Consultant - AI Training (Remote)
Abu Dhabi, UAE
Mindrift is seeking ex-MBB strategy consultants to build realistic consulting project environments for AI training. You will design structured tasks, evaluation criteria, and grading frameworks to teach AI agents high-le
Ex-MBB Strategy Consultant - AI Training (Remote)
Doha, QAT
Mindrift is seeking ex-MBB strategy consultants to build realistic consulting project environments and design structured tasks for AI training. This remote, project-based role involves creating detailed project scenarios
Senior Python Data Scraping Engineer (Freelance)
Saudi Arabia, KSA
Mindrift is seeking a Senior Python Data Scraping Engineer for a freelance role on the Tendem project. You will collaborate with AI agents, providing critical thinking and domain expertise for web scraping and data extra
Senior Python Engineer - AI Coding Agent Evaluation
Saudi Arabia, KSA
Develop realistic developer environments, design tasks for AI evaluation, write tests, and iterate based on feedback using Python, JavaScript, and Docker.
Freelance Presentation Designer
Doha, QAT
Mindrift is looking for a Presentation Designer to create high-stakes pitch decks and professional one-pagers for the Tendem project. Requires 2+ years of experience in graphic or presentation design, expertise in PowerP
Freelance Presentation Designer
Abu Dhabi, UAE
Please submit your resume in English and indicate your level of English. Mindrift is looking for a highly skilled Presentation Designer to join the Tendem project (\https://tendem.ai/\) and drive specialized storytelling
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
Abu Dhabi, UAE
Mindrift is seeking a Senior Python Engineer to create challenging tasks and evaluation criteria for AI coding agents. You will build realistic developer environments, design tasks, and write tests to evaluate AI agent s
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
Doha, QAT
Mindrift is building a dataset to evaluate AI coding agents. You will create challenging tasks and evaluation criteria within simulated developer environments. Requires 8+ years in software development with Python, JavaS
Ex-MBB Strategy Consultant - AI Training (Remote)
Abu Dhabi, UAE
Ex-MBB Strategy Consultant - AI Training (Remote)
Doha, QAT
Senior Python Data Scraping Engineer (Freelance)
Saudi Arabia, KSA
Senior Python Engineer - AI Coding Agent Evaluation
Saudi Arabia, KSA
Freelance Presentation Designer
Doha, QAT
Freelance Presentation Designer
Abu Dhabi, UAE
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
Abu Dhabi, UAE
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
Doha, QAT