Base Career helps you apply smarter for this job.
Key skills for this role
End-to-End Delivery: Manage the full lifecycle of AI data projects, from scoping and guidelines creation to data delivery and post-mortem analysis.
Pipeline Management: Oversee large-scale data pipelines for multilingual data collection (audio, text, image) and LLM evaluation (RLHF, SFT, ranking, and safety testing).
KPI Tracking: rigorously monitor and report on key performance indicators, including: Throughput: Volume of data processed per hour/day. Quality: Accuracy scores, Inter-Annotator Agreement (IAA), and gold-set performance. Productivity: Cost-per-task and worker efficiency rates.
Throughput: Volume of data processed per hour/day.
Quality: Accuracy scores, Inter-Annotator Agreement (IAA), and gold-set performance.
Productivity: Cost-per-task and worker efficiency rates.
Quality Control: Run QA loops, root-cause analysis for quality dips, and corrective training for annotator pools.
Dashboards: Maintain dashboards to visualize project health and flag bottlenecks in real-time.
Global Coordination: Manage relationships with data experts and crowd pools, ensuring adherence to SLAs regarding localized nuances and linguistic accuracy.
Cross-Functional Collaboration: Liaise with Applied AI Technical Ops teams. Translate technical requirements into clear, actionable guidelines for non-technical annotators.
Feedback Loops: Facilitate continuous feedback loops where data insights drive updates to annotation guidelines and model fine-tuning strategies.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
, USA
, USA
, USA
, USA
, USA
, USA
, USA
, USA
, USA
, USA
, USA
Verified company details for this employer are not available yet.
USD 20-20 hourly / hour
Contract
Mid · 3+ years experience
Remote
Apply faster on company sites with our extension.