Senior+ Data Scientist - ML & Image Generation

- Optimize our transcription pipeline for accuracy and latency

- Improve image generation quality, prompt adherence, and consistency

- Identify bottlenecks and failure modes across the pipeline

- Run experiments and A/B tests to measure improvements

- Refine content safety systems for child-appropriate outputs, and develop new ones

- Build on our evaluation datasets for safety edge cases

- Analyze moderation performance and reduce false positives/negatives

- Stay current on best practices for AI safety in generative systems

- Build evaluation frameworks to measure model performance at scale

- Define metrics that correlate with user satisfaction (aesthetic quality, relevance, safety)

- Develop automated evaluation pipelines (LLM-as-judge, CLIP scores, human eval)

- Track experiments and communicate findings to the team

- Optimize prompts for transcription accuracy and image generation quality

- Develop systematic approaches to prompt testing and iteration

- Build prompt templates and guidelines for different use cases

- 5+ years in data science or applied ML

- Experience optimizing production ML systems

- Strong statistical and analytical skills

- Familiarity with LLMs and image generation models

- Python proficiency; comfortable with PyTorch

- Experience building evaluation frameworks

- Track record of improving ML system performance through data and experimentation

- Experience with content moderation or trust & safety

- Background in speech/audio ML or computer vision

- Experience with human annotation pipelines (Label Studio, Scale AI)

- Familiarity with prompt engineering techniques and LLM-based evaluation

Location: NYC only, On-site (flexible on WFH but we like to be in office the majority of the week) in our Brooklyn based office, close to most major train lines.

Salary Range: $150k - $250k base + equity and benefits