Senior Data Scientist - GenAI
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Cover Genius cherche un Senior Data Scientist pour diriger la stratégie LLM au sein de son Central AI Hub. Le rôle implique l'évaluation et le fine-tuning de modèles, la conception d'architectures RAG, et l'établissement de meilleures pratiques pour l'intégration de l'IA générative.
Key Skills for This Role
Responsibilities
- Design and implement robust frameworks to quantitatively evaluate LLM performance (accuracy, repeatability, hallucination rates)
- Lead fine tuning and optimization of Core Policy Models
- Act as central GenAI expert for product engineering teams; guide on JSON payload structures, prompt engineering, RAG architectures, and evaluation pipelines
- Establish best practices, playbooks, and standardized pipelines for all AI/LLM integrations across Cover Genius
- Stay at cutting edge of Generative AI research, identifying new models, tools, and methodologies
Requirements
- Master's or PhD in Physics, Statistics, Mathematics, Computer Science, or other Quantitative fields
- 5+ years of practical ML/Data Science experience with heavy emphasis on NLP
- At least 1 2 years dedicated to deep Generative AI/LLM applications
- Hands on experience with LLM orchestration frameworks, RAG architectures, and model fine tuning
- Deep understanding of generative text performance measurement (LLM as a judge, BLEU/ROUGE, custom evaluators)
- Strong foundation in validating AI driven features and integrating human in the loop feedback
- Advanced proficiency in Python and SQL
- Experience working with major LLM APIs and open weights models
- Ability to collaborate with software engineers to optimize data structures for LLM parsing
Full Job Posting
About The Role
- As Senior Data Scientist for Generative AI within our Central AI Hub, you will be the foundational scientific owner of our LLM strategy.
- You are deeply involved in evaluating model performance, fine tuning models, and ensuring AI products behave predictably at scale.
Key Responsibilities
- Design and implement robust frameworks to quantitatively evaluate LLM performance.
- Lead fine tuning and optimization of our Core Policy Models.
- Act as central GenAI expert for product engineering teams.
- Establish best practices, playbooks, and standardized pipelines for all AI/LLM integrations.
- Stay at cutting edge of Generative AI research.
What You Will Bring
- Master's or PhD in Physics, Statistics, Mathematics, Computer Science, or other Quantitative fields.
- 5+ years of practical ML/Data Science experience with heavy emphasis on NLP.
- At least 1 2 years dedicated to deep Generative AI/LLM applications.
- Hands on experience with LLM orchestration frameworks, RAG architectures, and model fine tuning.
- Deep understanding of generative text performance measurement.
- Strong foundation in validating AI driven features.
- Advanced proficiency in Python and SQL.
- Experience with major LLM APIs and open weights models.
- Ability to collaborate with software engineers to optimize data structures for LLM parsing.
Proficiencies And Attributes
- Exceptional problem solving skills with high tolerance for ambiguity.
- Outstanding communication skills.
- Proactive mindset in identifying areas for standardization.
Why Cover Genius?
- Flexible PTO.
- Employee Stock Options.
- Work with like minded people.
- Social Initiatives.
Salary Range
- Base salary range of CAD 135,000 to CAD 220,000 annually.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Cover Genius
Travel Insurance Partnership Manager
Dubai, UAE
The Company Cover Genius is a Series E insurtech that protects the global customers of the world’s largest digital companies including Booking Holdings, owner of Priceline, Kayak and Booking.com, Intuit, Uber, Ryanair, T
Travel Insurance Partnership Manager
Dubai, UAE
Manage key insurance relationships, lead travel initiatives, ensure project execution, and possess strong relationship management and commercial acumen skills.
Insurance Relationship Manager
Dubai, UAE
Job type: Full Time · Department: Insurance Partnerships - 324 · Work type: Remote Dubai, Dubai, United Arab Emirates Job details The Company Cover Genius is a Series E insurtech that protects the global customers of the