workable
Senior Model Evaluation Analyst
Ignite IT
Suitland, USA
Full-time
Senior · 8+ years experience
Hybrid
Discovered Yesterday
PythonSQLLLMMLNLP
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonSQLLLM
Key Skills for This Role
PythonSQLLLMMLNLP
Full Job Posting
Requirements
- Required qualifications
- Bachelor's degree in statistics, data science, mathematics, computer science, or a related field, or equivalent relevant professional experience.
- 8+ years in quantitative analysis, data quality, or model validation, including 3+ years evaluating ML, NLP, or automated classification systems.
- Strong Python and SQL skills for preparing datasets, automating analyses, calculating metrics, and producing reproducible reports.
- Practical understanding of sampling, class imbalance, reference-label quality, data leakage, confusion matrices, and uncertainty in performance estimates.
- Ability to investigate discrepancies independently, document evidence precisely, and explain findings to technical staff and business or domain experts.
- Preferred qualifications
- Experience evaluating LLM outputs, survey write-in coding, or detailed industry, occupation, and demographic classifications.
- Experience with annotation or adjudication workflows, federal statistical data, and controlled environments for sensitive information.
- Conditions of employment. Position contingent on contract award. Must be able to obtain and maintain applicable Census Special Sworn Status and Personal Identity Verification (PIV) credentials, follow confidentiality requirements, and support Census core business hours and coordinated critical processing runs.
Benefits
- Benefits
- 401(k)
- 401(k) matching
- Dental insurance
- Flexible spending account
- Health insurance
- Life insurance
- Paid time off
- Professional development assistance
- Referral program
- Tuition reimbursement
- Vision insurance
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Ignite IT
Senior Technical Lead
Suitland, USA
Discovered YesterdayFull Time, Contract
Senior AI/ML Engineer
Suitland, USA
Discovered YesterdayFull-time
Senior Data Scientist
Suitland, USA
Discovered YesterdayFull-time
Deputy Administrative Officer
, USA
Discovered 3 days agoFull-time
Full Stack Developer (Python, Java, Docker, Kubernetes)
, USA
Discovered 1 weeks agoFull-time
Jr. AI Prompt Engineer
Ashburn, USA
Discovered 1 weeks agoFull-time
Full Stack Developer (Python / Java / Angular / AWS)
, USA
Discovered 1 weeks agoFull-time
Staff Accountant
, USA
Discovered 1 weeks agoFull-time