Senior Manager of AI Safety and Validation Engineering
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
A leading bank in Abu Dhabi is hiring a Senior Manager of AI Safety and Validation Engineering to design and implement technical measures for AI reliability and security.
Key Skills for This Role
Responsibilities
- Define standardised evaluation rubrics and scoring systems for system performance and safety across AI archetypes including RAG and agentic workflows
- Design comprehensive test cases covering deterministic logic and adversarial scenarios to stress test AI outputs
- Implement automated evaluators such as LLM as a judge and targeted small language models
- Deploy explainability techniques like Shapley Values and Integrated Gradients for model transparency and bias detection
- Partner with platform teams to build telemetry pipelines that capture embeddings and inputs while maintaining data privacy
- Establish golden signals such as hallucination rates and semantic similarity to trigger automated circuit breakers
- Analyse guardrail violations to identify emerging attack patterns and integrate human in the loop corrections
- Translate technical telemetry into actionable model health reports for second line risk functions
- Work with specialist software vendors to bring advanced safety capabilities into the internal AI ecosystem
Requirements
- 7+ years of experience in Machine Learning Engineering, Data Science, or AI Safety and Testing
- Bachelor's Degree in Computer Science, Information Technology, or a related engineering discipline
- Expert proficiency in Python and deep knowledge of statistical testing and XAI libraries
- Hands on experience with LLM evaluation frameworks such as Ragas, Giskard, or Arize
- Proven ability to design observability and monitoring systems at scale
- Prior experience in the financial sector is highly preferred
- Strong leadership skills with the ability to act as a technical mentor
Full Job Posting
Discover the Opportunity
- Hiring a Senior Manager of AI Safety and Validation Engineering to join a leading bank in their Group Business Services division.
- Primarily a technical practitioner role focused on design and implementation of technical measures for AI reliability and security.
- Bridge the gap between cutting edge AI development and rigorous risk standards.
Discover the Role
- Lead the creation of evaluation frameworks for both predictive Machine Learning and Generative AI.
- Define standardised monitoring protocols and automated guardrails.
- Work as an individual contributor providing hands on execution support to product teams.
Discover the Responsibilities
- Define standardised evaluation rubrics and scoring systems for system performance and safety across various AI archetypes including RAG and agentic workflows.
- Design comprehensive test cases covering deterministic logic and adversarial scenarios to stress test AI outputs.
- Implement automated evaluators such as LLM as a judge and targeted small language models.
- Deploy explainability techniques like Shapley Values and Integrated Gradients to ensure model transparency and unfair bias detection.
- Partner with platform teams to build telemetry pipelines that capture embeddings and inputs while maintaining strict data privacy standards.
- Establish golden signals such as hallucination rates and semantic similarity to trigger automated circuit breakers.
- Analyse guardrail violations to identify emerging attack patterns and integrate human in the loop corrections.
- Translate technical telemetry into actionable model health reports for second line risk functions.
- Work with specialist software vendors to bring advanced safety capabilities into the internal AI ecosystem.
Discover the Requirements
- 7+ years of experience in Machine Learning Engineering, Data Science, or AI Safety and Testing.
- Bachelor's Degree in Computer Science, Information Technology, or a related engineering discipline.
- Expert proficiency in Python and deep knowledge of statistical testing and XAI libraries.
- Hands on experience with LLM evaluation frameworks such as Ragas, Giskard, or Arize.
- Proven ability to design observability and monitoring systems at scale.
- Prior experience in the financial sector is highly preferred.
- Strong leadership skills with the ability to act as a technical mentor across cross functional initiatives.
Package
- 45k 50k AED per month, TAX FREE + Relocation & benefits.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Discovered MENA
AI Software & Platform Architect
Dubai, UAE
Discovered MENA partners with an AI technology company seeking a Software & Platform Architect in Dubai. The role involves designing scalable cloud-native platforms, integrating AI models into production, and leading arc
Staff Software Engineer
Abu Dhabi, UAE
We are hiring a Staff Software Engineer to shape the technical foundation of a modern digital platform within a regulated environment. You will work across backend services, frontend applications, APIs, workflows, and pl
Platform Engineer
Abu Dhabi, UAE
A premier enterprise technology provider seeks a Senior Platform Engineer to drive deployment, automation, and operational lifecycle of Kubernetes and OpenShift environments. The role involves IaC, troubleshooting, and m
Platform Engineer
Abu Dhabi, UAE
Our client, a premier enterprise cloud infrastructure provider, seeks an experienced Senior Cloud Platform Engineer to lead the technical implementation of a massive customer-facing cloud platform. You will design and en
Director of Software Engineering
Dubai, UAE
A venture-backed cybersecurity pioneer seeks a Director of Software Engineering to own the entire engineering organization, including architecture, delivery, quality, and team scaling. The role involves leading the AI pl
AI Frontend Engineer
Abu Dhabi, UAE
An industry-leading company in Abu Dhabi is hiring an AI Frontend Engineer to build and optimize user interfaces for AI-powered web applications. Requires 3+ years of software engineering experience with React and JavaSc
Manager - Investors & Market Engagement
Abu Dhabi, UAE
A leading UAE capital markets organization seeks a Manager for Investors & Market Engagement to drive investor participation and build strategic relationships. The role involves business development, client management, a
Growth and Accounts Lead
Abu Dhabi Emirate, UAE
We are hiring a Founding Growth and Accounts Lead for an enterprise software firm building agentic AI for industrial sectors. You will own the organic growth engine and support strategic enterprise accounts, reporting to
AI Software & Platform Architect
Dubai, UAE
Staff Software Engineer
Abu Dhabi, UAE
Platform Engineer
Abu Dhabi, UAE
Platform Engineer
Abu Dhabi, UAE
Director of Software Engineering
Dubai, UAE
AI Frontend Engineer
Abu Dhabi, UAE
Manager - Investors & Market Engagement
Abu Dhabi, UAE
Growth and Accounts Lead
Abu Dhabi Emirate, UAE