Senior Quality Assurance Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Searchability is seeking a Senior QA Engineer for an AI-driven technology business in Dubai. The role involves leading quality assurance for AI-powered products, building automated testing frameworks, and ensuring reliable AI systems.
Key Skills for This Role
Responsibilities
- Design and execute testing strategies for conversational AI and generative AI products
- Develop and maintain automated testing frameworks using JavaScript and Python
- Create and execute chatbot testing scenarios covering user intent, conversation flows, and edge cases
- Design LLM testing approaches including prompt validation, grounding validation, and non deterministic testing
- Perform AI safety and quality testing including hallucination detection, bias assessment, and PII leakage validation
- Validate structured and unstructured data outputs for accuracy and compliance
- Conduct API testing using manual and automated techniques
- Collaborate with ML and NLP teams to define evaluation frameworks and performance metrics
- Drive QA best practices across automation, data quality, and AI product validation
Requirements
- 8+ years experience in QA Engineering with strong automation focus
- 5+ years experience testing data platforms or data intensive systems
- Strong automation experience using JavaScript and/or Python
- Proven experience testing AI powered applications
- Strong understanding of API testing methodologies
- Excellent analytical and problem solving skills
Full Job Posting
About the Opportunity
- Searchability is supporting an innovative AI driven technology business in the search for a Senior QA Engineer.
- The role involves joining a team building sophisticated data products and conversational AI systems.
- Looking for a highly analytical QA professional with strong automation experience.
Key Responsibilities
- Design and execute testing strategies for conversational AI and generative AI products.
- Develop and maintain automated testing frameworks using JavaScript and Python.
- Create and execute chatbot testing scenarios covering user intent, conversation flows, edge cases and behavioural consistency.
- Design LLM testing approaches including prompt validation, grounding validation, golden datasets and non deterministic testing methodologies.
- Perform AI safety and quality testing, including hallucination detection, bias assessment, toxicity testing and PII leakage validation.
- Validate structured and unstructured data outputs to ensure accuracy, consistency and compliance.
- Establish testing approaches for real time and streaming data systems.
- Conduct API testing using both manual and automated techniques.
- Collaborate with Machine Learning and NLP teams to define evaluation frameworks and performance metrics.
- Leverage AI assisted development tools such as GitHub Copilot, Claude and ChatGPT to enhance testing, documentation and defect analysis processes.
- Drive QA best practices across automation, data quality and AI product validation.
Required Experience
- 8+ years' experience in QA Engineering with a strong focus on automation testing.
- 5+ years' experience testing data platforms, data products or data intensive systems.
- Strong automation experience using JavaScript and/or Python.
- Proven experience testing AI powered applications and leveraging AI tools within QA workflows.
- Strong understanding of API testing methodologies and tooling.
- Excellent analytical and problem solving skills with exceptional attention to detail.
- Experience identifying subtle inconsistencies in data quality, system behaviour and AI outputs.
Desirable Experience
- Experience testing conversational AI, chatbots or virtual assistants.
- Familiarity with Large Language Models (LLMs) and Generative AI systems.
- Experience with prompt engineering validation, grounding techniques and AI evaluation frameworks.
- Knowledge of AI safety testing, including hallucination detection, bias testing and PII validation.
- Experience with tools such as PyTest, Postman, dbt Tests and modern automation frameworks.
- Exposure to machine learning, NLP or data science environments.
Technology & Tools
- JavaScript
- Python
- PyTest
- Postman
- API Testing
- dbt Tests
- LLMs & Generative AI
- Conversational AI Platforms
- AI Assisted Development Tools (Copilot, Claude, ChatGPT)
What's on Offer?
- Opportunity to work on cutting edge AI and conversational agent technologies.
- Exposure to modern LLM evaluation and AI testing frameworks.
- Collaborative environment working alongside ML, NLP and Data Engineering specialists.
- Significant influence over QA strategy and testing standards.
- Career growth within a rapidly evolving AI focused organisation.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Searchability®
Senior Quality Assurance Engineer
Abu Dhabi Emirate, UAE
A leading AI company in Abu Dhabi is seeking a Senior QA Automation Engineer to own quality strategy for generative AI and conversational agent products. You will design AI test scenarios, build LLM evaluation frameworks
Data Engineer
Abu Dhabi Emirate, UAE
DATA ENGINEER – AI & INVESTMENT PLATFORM – ABU DHABI (HYBRID) KEY POINTS AI-focused Data Engineering role within a growing investment technology environment 2 days per week onsite in Abu Dhabi Salary up to 35,000 AED
Senior Data Engineer
Dubai, UAE
💻 Senior Data Engineer 💻 📍 Based in Dubai 📍 \Please note – this opportunity is only open to candidates already residing in Dubai \ 💰 Salary on offer Dh30,000–35,000 per month 💰 Searchability MENA are partnered with
Product Manager
Dubai, UAE
💻 Product Manager 💻 📍Based in Dubai! 📍 Please note - the opportunity is only open to those who already reside in Dubai. 💰 Salary on offer is between Dh25,000-28,000 p/m 💰 Searchability MENA are partnered with a Saa
Senior Talent Acquisition Specialist - Tech
Dubai, UAE
💥Senior Talent Acquisition Specialist - Tech💥 📍Dubai📍 💰 Salary on offer - Dh20,000-25,000 p/m 💰 Searchability MENA is partnered with a Global Tech Consultancy. They are looking for a Senior Talent Acquisition Speci