Project Manager, Applied AI

Stakeholder Management

• Manage relationships with data experts and crowd pools while ensuring localization and linguistic accuracy SLAs.
• Collaborate with Applied AI Technical Operations teams.
• Translate technical requirements into actionable guidelines for non-technical annotators.
• Use feedback loops to update annotation guidelines and model fine-tuning strategies.

Essential Qualifications

• 3-5 or more years of project management experience in AI/ML data operations.
• Strong understanding of LLM training processes, including pre-training, SFT, and RLHF.
• Knowledge of LLM evaluation methods including human-in-the-loop evaluation and red teaming.
• Advanced Excel or Google Sheets proficiency and the ability to write SQL queries.
• Experience with Agile, Scrum, or Kanban methodologies.
• Ability to write clear guidelines for multilingual audiences.

Preferred Qualifications

• Fluency in a second language is highly desirable.
• Experience with data annotation platforms such as Scale AI or SuperAnnotate is preferred.
• Experience with project management tools such as Jira is preferred.
• Background in ML Engineering, Computer Science, Data Science, or Project Management training is preferred.

About LILT