ashby
AI Evaluation Engineer - Proofline
Meraki Labs
Bengaluru, IND
Full-time
Senior · 5+ years experience
Onsite
Discovered 2 weeks ago
PythonTypeScriptPlaywrightCypressClaudeChatGPT
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonTypeScriptPlaywright
Role Overview
Proofline is live in production with institutional pilots underway. Building with AI is easy to prototype, but proving reliability in production is a major challenge. In AI-native codebases, verification is the key bottleneck for scaling capabilities. As an AI Evaluation Engineer, you will take ownership of the evaluation scaffolding and quality layer, including eval harnesses for AI-facing features, test infrastructure, and release gates. You’ll play a critical role in monitoring how our product behaves across AI assistants (e.g., Claude, ChatGPT), accounting for differences by host and continual changes.
AI Evaluation Engineer — Evals & Systems Verification
Location: HSR, Bengaluru (On-site)
Experience: 5+ years
Key Skills for This Role
PythonTypeScriptPlaywrightCypressClaudeChatGPT
Full Job Posting
About Us
Meraki Labs (founded by Mukesh Bansal & Peeyush Ranjan) builds and rapidly scales AI-first, "moonshot" startups. We're looking for a high-velocity, production-grade engineer to build 0-to-1 products alongside founders.
About the Role
Proofline is live in production with institutional pilots underway. Building with AI is easy to prototype, but proving reliability in production is a major challenge. In AI-native codebases, verification is the key bottleneck for scaling capabilities. As an AI Evaluation Engineer, you will take ownership of the evaluation scaffolding and quality layer, including eval harnesses for AI-facing features, test infrastructure, and release gates. You’ll play a critical role in monitoring how our product behaves across AI assistants (e.g., Claude, ChatGPT), accounting for differences by host and continual changes.
AI Evaluation Engineer — Evals & Systems Verification
Location: HSR, Bengaluru (On-site)
Experience: 5+ years
Responsibilities
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Meraki Labs
AI/ML Engineer - NuPlay (Nurix AI)
Bengaluru, IND
SeniorFull-time
Nurix AI is seeking an AI/ML Engineer to develop multilingual speech, voice, and agentic AI systems for real-time production use. The role requires four or more years of hands-on ML engineering experience, strong ASR/TTS
Discovered 1 weeks agoView →
AI Engineer Intern
Bengaluru, IND
Discovered 1 weeks agoInternship, Full Time
AI/ML Engineer - NuPlay (Nurix AI)
Bengaluru, IND
Discovered 1 weeks agoFull-time
Co-Founder - DreamBook
Bengaluru, IND
Discovered 2 weeks agoFull-time
Founding Frontend Engineer - Proofline
Bengaluru, IND
Discovered 2 weeks agoFull-time
Strategy & Operations Associate
Bengaluru, IND
Discovered 2 weeks agoFull-time
Chief Technology Officer - Proofline
Bengaluru, IND
Discovered 2 weeks agoFull-time
Founding AI Engineer - Proofline
Bengaluru, IND
Discovered 2 weeks agoFull-time
Physics Specialist
Bengaluru, IND
Discovered 2 weeks agoFull-time