Senior Quality Automation Engineer (Playwright) -AI
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
We are seeking a Senior Quality Automation Engineer to drive end-to-end quality assurance across UI, APIs, and AI-driven systems for banking clients in Abu Dhabi. The role requires deep expertise in Playwright, backend validation, AI/LLM testing, and strong collaboration skills.
Key Skills for This Role
Responsibilities
- Build and maintain scalable automation frameworks using Playwright
- Validate microservices, APIs, and event driven workflows
- Ensure data integrity across Kafka based and microservice architectures
- Test and benchmark AI/LLM responses for accuracy, relevance, and safety
- Develop and manage datasets for prompt testing and validation
- Leverage Ragas, LangSmith, and other frameworks for systematic AI evaluation
- Partner with engineering and product teams to embed quality into every stage of development
- Integrate automated tests into CI/CD pipelines for continuous delivery
- Utilize Docker and Kubernetes for scalable test environments
Requirements
- Bachelor's or Master's in Computer Science, Engineering, or related field
- Strong hands on experience with TypeScript, JavaScript, or Python
- Proven expertise with Playwright (mandatory)
- Experience validating Kafka based workflows and microservices
- Demonstrated ability to test GenAI outputs and manage prompt datasets
- Familiarity with CI/CD pipelines, Docker, Kubernetes
- Excellent communication, problem solving, and collaboration abilities
Full Job Posting
Position Overview
- We are seeking a highly skilled Senior Quality Automation Engineer to drive end to end quality assurance across UI, APIs, and AI driven systems.
- This role is pivotal in ensuring reliability, scalability, and accuracy across distributed microservices and modern event driven architectures.
- The ideal candidate will combine deep expertise in automation frameworks (Playwright), backend validation, and AI/LLM testing with strong collaboration skills.
Key Responsibilities
- UI/API Test Automation: Build and maintain scalable automation frameworks using Playwright.
- Backend Validation: Validate microservices, APIs, and event driven workflows.
- Distributed System Testing: Ensure data integrity across Kafka based and microservice architectures.
- GenAI Output Evaluation: Test and benchmark AI/LLM responses for accuracy, relevance, and safety.
- Prompt Validation: Develop and manage datasets for prompt testing and validation.
- AI Testing Tools: Leverage Ragas, LangSmith, and other frameworks for systematic AI evaluation.
- Cross Team Collaboration: Partner with engineering and product teams to embed quality into every stage of development.
- CI/CD Practices: Integrate automated tests into pipelines for continuous delivery.
- Modern DevOps: Utilize Docker and Kubernetes for scalable test environments.
Required Qualifications & Skills
- Education: Bachelor’s or Master’s in Computer Science, Engineering, or related field.
- Programming Expertise: Strong hands on experience with TypeScript, JavaScript, or Python.
- Automation Tools: Proven expertise with Playwright (mandatory).
- Distributed Systems: Experience validating Kafka based workflows and microservices.
- AI/LLM Testing: Demonstrated ability to test GenAI outputs and manage prompt datasets.
- DevOps: Familiarity with CI/CD pipelines, Docker, Kubernetes.
- Soft Skills: Excellent communication, problem solving, and collaboration abilities.
Core Competencies
- Automation Proficiency: Ability to design and scale test frameworks.
- AI/LLM Testing: Deep understanding of GenAI evaluation methodologies.
- System Validation: Strong grasp of distributed architectures and event driven systems.
- DevOps Mindset: Skilled in integrating QA into modern development workflows.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at TAT IT Technolgies
Oracle Fusion HCM Consultant
Abu Dhabi, UAE
TAT IT Technologies seeks an Oracle Fusion HCM Consultant for a client in Abu Dhabi. The role requires strong end-to-end implementation experience across Oracle Fusion HCM modules including Global HR, Talent Management,
Senior Backend Engineer – Java SpringBoot Microservices
Abu Dhabi, UAE
TAT IT Technologies is urgently seeking a Senior Backend Engineer with strong Java SpringBoot Microservices and AWS cloud native development experience for a banking client in Abu Dhabi/Dubai. The role involves developin
Senior Backend Engineer – Java SpringBoot Microservices
Dubai, UAE
TAT IT Technologies is urgently seeking a Senior Backend Engineer with strong Java SpringBoot Microservices and AWS cloud native development experience for a banking client in Abu Dhabi/Dubai. The role involves developin
Network and Desktop support
Dubai, UAE
TAT IT Technologies is seeking a Network and Desktop Support specialist for a client in Dubai. The role involves providing end-user IT support for over 1,500 users, troubleshooting hardware and software, and managing Mic
SAP Ariba L3 Consultant
Riyadh, KSA
KOV Medical seeks a Biomedical Engineer with 1-2 years of industry experience to provide clinical and technical support for medical devices in surgical settings. The role involves promoting products, supporting surgeons,
SAP PM(Plant Maintenance L2) – Enterprise Asset Management Consultant-
Riyadh, KSA
TAT IT Technologies seeks an SAP PM L2 Consultant for a manufacturing client in Alkhobar, Saudi Arabia. The role involves supporting SAP Plant Maintenance / EAM solutions, including configuration, day-to-day operations,
Sales & Estimation Engineer in Oil & GasDomain
Dubai, UAE
We are seeking a Sales & Estimation Engineer to drive business growth in the Oil & Gas domain, focusing on surface wellhead systems and API 6A valve products. The role involves managing the complete sales cycle, preparin
Sales Manager / Sales Engineer
Dubai, UAE
TAT IT Technologies is seeking a Sales Manager / Sales Engineer for a client in Dubai to drive revenue through specification and sale of UPVC, PP-R, CPVC, and HDPE piping systems. Requires a Bachelor's degree in Mechanic
Oracle Fusion HCM Consultant
Abu Dhabi, UAE
Senior Backend Engineer – Java SpringBoot Microservices
Abu Dhabi, UAE
Senior Backend Engineer – Java SpringBoot Microservices
Dubai, UAE
Network and Desktop support
Dubai, UAE
SAP Ariba L3 Consultant
Riyadh, KSA
SAP PM(Plant Maintenance L2) – Enterprise Asset Management Consultant-
Riyadh, KSA
Sales & Estimation Engineer in Oil & GasDomain
Dubai, UAE
Sales Manager / Sales Engineer
Dubai, UAE