AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Halian is seeking a hands-on AI Tester to ensure the quality, reliability, and performance of a customer-facing AI chatbot. The role involves designing test plans, performing black-box testing, and using Azure-based tools and Python scripting.
Key Skills for This Role
Responsibilities
- Design, develop, and execute comprehensive test plans and test cases covering functional, non functional, integration, performance, and security testing across an AI chatbot platform
- Perform black box testing from the customer's perspective, evaluating chatbot behaviour, conversational accuracy, response quality, and user experience
- Apply understanding of AI and machine learning principles to assess chatbot outputs
- Conduct integration testing to validate seamless interaction between the chatbot and connected systems and APIs
- Carry out performance testing to assess chatbot responsiveness, scalability, and stability
- Support security testing activities to identify vulnerabilities and ensure compliance
- Utilise Azure based testing tools and Python scripting to automate and enhance testing processes
- Log, track, and communicate defects and test outcomes, working closely with the Test Lead and development teams
Requirements
- Up to 9 years of hands on testing experience, with a strong focus on functional and non functional testing
- Proven experience designing test cases and test plans across multiple testing types
- Black box testing experience, ideally within a customer facing digital or conversational AI product environment
- Solid understanding of AI concepts and what constitutes quality in an AI chatbot
- Hands on experience with Azure based testing environments
- Python scripting skills to support test automation and data validation
Full Job Posting
Role Overview
- A forward thinking organisation is investing in the development of intelligent conversational AI solutions and is seeking a hands on AI Tester to ensure the quality, reliability, and performance of a customer facing AI chatbot.
Responsibilities
- Design, develop, and execute comprehensive test plans and test cases covering functional, non functional, integration, performance, and security testing across an AI chatbot platform.
- Perform black box testing from the customer's perspective, evaluating chatbot behaviour, conversational accuracy, response quality, and user experience.
- Apply an understanding of AI and machine learning principles to assess chatbot outputs against expected behaviours and real world customer expectations.
- Execute the full range of testing activities with a primary focus on functional and non functional testing (approximately 75%), complemented by performance and security testing (approximately 25%).
- Conduct integration testing to validate seamless interaction between the chatbot and connected systems and APIs.
- Carry out performance testing to assess chatbot responsiveness, scalability, and stability under varied load conditions.
- Support security testing activities to identify vulnerabilities and ensure the platform meets required compliance and data protection standards.
- Utilise Azure based testing tools and Python scripting to automate and enhance testing processes.
- Log, track, and clearly communicate defects and test outcomes, working closely with the Test Lead and development teams to drive resolution.
- Contribute technical analysis and insights to support continuous improvement of the chatbot's quality and performance.
Qualifications and Skills
- Up to 9 years of hands on testing experience, with a strong focus on functional and non functional testing.
- Proven experience designing test cases and test plans across multiple testing types — integration, performance, security, and functional.
- Black box testing experience, ideally within a customer facing digital or conversational AI product environment.
- Solid understanding of AI concepts and what constitutes quality, accuracy, and appropriate behaviour in an AI chatbot — practical development of AI is not required, but familiarity with AI capabilities and customer expectations is essential.
- Hands on experience with Azure based testing environments.
- Python scripting skills to support test automation and data validation.
- Strong analytical skills with the ability to interpret technical outputs and translate findings into clear, actionable reporting.
- Collaborative team player, comfortable operating within a structured team reporting to a Test Lead.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
A six-month, full-time project assignment for a hands-on Finance Data Analytics & Automation Consultant in Dubai. You will partner with the Group Finance Director to build an automated, data-led, AI-enabled reporting env
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
A leading organization is seeking a Technical Business Systems Analyst to bridge business and technology. The role involves translating stakeholder requirements into technical deliverables, working with development and Q
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a Senior Frontend Designer to design, build, and maintain modern, responsive web applications. The role combines deep frontend expertise with backend contributions using Node.js and Python. Requires 6+ yea
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Halian is hiring a Conversational AI Engineer for a 1-year extendable contract in Abu Dhabi. The role requires 5+ years of Python experience, expertise in Prompt Engineering and RAG, and experience with Azure OpenAI Serv
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs). The role involves designing planning and control algorithms, mathematical modeling, and integrati
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Document Controller for a sustainable urban development project in Abu Dhabi. The role involves managing document control systems, ensuring compliance with standards, and supporting project teams. Can
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Our client is seeking a Finance Manager to lead the finance function of the UAE entity, ensuring accurate financial reporting, statutory compliance, and effective treasury management. The role requires 8-12 years of expe
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs) in Abu Dhabi. The role involves designing planning and control algorithms, mathematical modeling,
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE