AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Halian is seeking an AI Tester for a large enterprise environment in Abu Dhabi to validate AI-powered applications, focusing on AI model behavior, response accuracy, and risk identification.
Key Skills for This Role
Responsibilities
- Work closely with application teams to test and validate AI driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Requirements
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem solving skills
- Ability to work in cross functional Agile teams
Full Job Posting
Role Overview
- We are seeking an AI Tester to support the validation and quality assurance of AI powered applications within a large enterprise environment.
- You will focus on evaluating AI model behaviour, ensuring response accuracy, and identifying risks such as hallucinations and model drift.
- This role is critical in ensuring that AI systems are reliable, scalable, and fit for production use across multiple use cases.
Key Responsibilities
- Work closely with application teams to test and validate AI driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Required Skills & Qualifications
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem solving skills
- Ability to work in cross functional Agile teams
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
A six-month, full-time project assignment for a hands-on Finance Data Analytics & Automation Consultant in Dubai. You will partner with the Group Finance Director to build an automated, data-led, AI-enabled reporting env
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
A leading organization is seeking a Technical Business Systems Analyst to bridge business and technology. The role involves translating stakeholder requirements into technical deliverables, working with development and Q
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a Senior Frontend Designer to design, build, and maintain modern, responsive web applications. The role combines deep frontend expertise with backend contributions using Node.js and Python. Requires 6+ yea
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Halian is hiring a Conversational AI Engineer for a 1-year extendable contract in Abu Dhabi. The role requires 5+ years of Python experience, expertise in Prompt Engineering and RAG, and experience with Azure OpenAI Serv
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs). The role involves designing planning and control algorithms, mathematical modeling, and integrati
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Document Controller for a sustainable urban development project in Abu Dhabi. The role involves managing document control systems, ensuring compliance with standards, and supporting project teams. Can
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Our client is seeking a Finance Manager to lead the finance function of the UAE entity, ensuring accurate financial reporting, statutory compliance, and effective treasury management. The role requires 8-12 years of expe
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs) in Abu Dhabi. The role involves designing planning and control algorithms, mathematical modeling,
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE