Senior Quality Assurance Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
A leading AI company in Abu Dhabi is seeking a Senior QA Automation Engineer to own quality strategy for generative AI and conversational agent products. You will design AI test scenarios, build LLM evaluation frameworks, and run safety checks for hallucination, bias, and PII.
Key Skills for This Role
Responsibilities
- Design and execute generative AI test scenarios, including exploratory testing for chatbot interactions, intent recognition, tone and edge case behaviour
- Build LLM test designs, prompt and grounding validation, golden sets and non deterministic assertions
- Run safety and quality checks for hallucination, bias, toxicity and PII leakage
- Validate structured and unstructured data outputs for consistency, accuracy and compliance
- Establish real time testing approaches including streaming data validation and API monitoring
- Collaborate with ML and NLP teams to define evaluation metrics for agent performance
- Integrate AI tools such as Copilot and Claude into the QA lifecycle to accelerate test design, documentation and defect analysis
Requirements
- 8 or more years in QA engineering with proven automation testing experience
- 5 or more years testing data systems
- Strong experience using AI applications and LLM based assistants in testing
- In depth automation skills in JavaScript and Python
- API testing experience, manual and automated
- Familiarity with chatbot frameworks, LLMs and conversational testing
- Exposure to QA automation tools such as PyTest, Postman and dbt tests
- Arabic speaker
- Eligible to be employed full time in the UAE
Full Job Posting
About the Role
- Senior QA Automation Engineer (AI, LLM, Conversational Agents) at a leading AI company in Abu Dhabi.
- Hybrid work: 2 to 3 days a week onsite.
- Own quality across cutting edge generative AI and conversational agent products.
- Real LLM testing, hallucination, bias, toxicity and PII checks, golden sets, non deterministic assertions.
- Senior role, 8 or more years in QA automation with genuine AI testing depth.
- Arabic speaker essential.
- Salary around 30,000 AED per month, with room for exceptional candidates.
Key Responsibilities
- Design and execute generative AI test scenarios, including exploratory testing for chatbot interactions, intent recognition, tone and edge case behaviour.
- Build LLM test designs, prompt and grounding validation, golden sets and non deterministic assertions.
- Run safety and quality checks for hallucination, bias, toxicity and PII leakage.
- Validate structured and unstructured data outputs for consistency, accuracy and compliance.
- Establish real time testing approaches including streaming data validation and API monitoring.
- Collaborate with ML and NLP teams to define evaluation metrics for agent performance.
- Integrate AI tools such as Copilot and Claude into the QA lifecycle to accelerate test design, documentation and defect analysis.
Essential Experience
- 8 or more years in QA engineering, with proven automation testing experience.
- 5 or more years testing data systems.
- Strong experience using AI applications and LLM based assistants in testing.
- In depth automation skills in JavaScript and Python.
- API testing experience, manual and automated.
- Familiarity with chatbot frameworks, LLMs and conversational testing.
- Exposure to QA automation tools such as PyTest, Postman and dbt tests.
- Strong analytical skills and attention to detail across data and agent behaviour.
- Arabic speaker, this is essential given the team and the work.
- Eligible to be employed full time in the UAE.
- Nice to have: experience defining quality standards for generative AI in a regulated or high compliance environment.
What's on Offer
- Salary around 30,000 AED per month, with flexibility for exceptional candidates.
- The chance to own quality engineering for frontier AI products at a serious AI organisation.
- Work at the edge of LLM and conversational AI testing, where the discipline is still being defined.
- Hybrid working, 2 to 3 days onsite in Abu Dhabi.
- Genuine influence over how responsible, reliable AI gets shipped.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Searchability®
Senior Quality Assurance Engineer
Dubai, UAE
Searchability is seeking a Senior QA Engineer for an AI-driven technology business in Dubai. The role involves leading quality assurance for AI-powered products, building automated testing frameworks, and ensuring reliab
Data Engineer
Abu Dhabi Emirate, UAE
DATA ENGINEER – AI & INVESTMENT PLATFORM – ABU DHABI (HYBRID) KEY POINTS AI-focused Data Engineering role within a growing investment technology environment 2 days per week onsite in Abu Dhabi Salary up to 35,000 AED
Senior Data Engineer
Dubai, UAE
💻 Senior Data Engineer 💻 📍 Based in Dubai 📍 \Please note – this opportunity is only open to candidates already residing in Dubai \ 💰 Salary on offer Dh30,000–35,000 per month 💰 Searchability MENA are partnered with
Product Manager
Dubai, UAE
💻 Product Manager 💻 📍Based in Dubai! 📍 Please note - the opportunity is only open to those who already reside in Dubai. 💰 Salary on offer is between Dh25,000-28,000 p/m 💰 Searchability MENA are partnered with a Saa
Senior Talent Acquisition Specialist - Tech
Dubai, UAE
💥Senior Talent Acquisition Specialist - Tech💥 📍Dubai📍 💰 Salary on offer - Dh20,000-25,000 p/m 💰 Searchability MENA is partnered with a Global Tech Consultancy. They are looking for a Senior Talent Acquisition Speci