{bc}
linkedin

Senior Quality Engineer

Vistas Global
Doha, QAT
Full Time
Senior
2 days ago
Test AutomationAPI TestingSeleniumPlaywrightCypressPython
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

Test AutomationAPI TestingSelenium
Smart Apply

Full Job Posting

About the Role

  • We are seeking a highly motivated IT Senior Quality Engineer to ensure the quality, reliability, and security of next generation AI powered applications.
  • You will be responsible for validating both traditional software solutions and AI first applications, including Large Language Models (LLMs), Retrieval Augmented Generation (RAG) systems, and AI agents.
  • You will collaborate closely with software engineers, AI developers, product owners, and business stakeholders to establish robust quality assurance practices across the SDLC.

Key Responsibilities Quality Assurance & Testing

  • Design, develop, and execute comprehensive test strategies, test plans, and test cases.
  • Perform functional, regression, integration, system, and user acceptance testing.
  • Develop and maintain automated test suites for web applications, APIs, and backend services.
  • Execute API testing using Postman, REST Assured, or equivalent tools.
  • Validate data integrity, backend workflows, and system integrations.
  • Track, prioritize, and manage defects throughout the testing lifecycle.
  • Collaborate with development teams to resolve issues and ensure timely delivery.

Key Responsibilities AI Application Testing

  • Validate AI powered applications including LLMs, RAG pipelines, and AI Agents.
  • Design and execute prompt validation and prompt robustness testing.
  • Perform hallucination detection and factual accuracy validation.
  • Conduct bias, fairness, toxicity, and safety testing.
  • Validate AI guardrails, content moderation, and policy compliance.
  • Build AI evaluation datasets and perform ground truth comparisons.
  • Measure AI quality using automated evaluation frameworks and benchmarking techniques.
  • Validate end to end AI workflows, orchestration, and agent interactions.

Key Responsibilities Collaboration & Process Improvement

  • Work closely with developers, AI engineers, product owners, and business stakeholders to define quality objectives.
  • Participate in Agile/Scrum ceremonies including sprint planning, reviews, and retrospectives.
  • Contribute to continuous improvement of QA processes, automation frameworks, and AI testing methodologies.
  • Support CI/CD pipelines by integrating automated testing into deployment workflows.

Mandatory Skills & Qualifications Experience

  • 3–5 years of experience in Software Quality Assurance and Testing.
  • Hands on experience testing enterprise web applications and APIs.
  • Experience testing AI powered applications or Generative AI solutions.

Mandatory Skills & Qualifications Technical Skills

  • Functional Testing: Test Planning, Test Design, Test Execution, Regression Testing, Defect Management.
  • Test Automation: Experience with Selenium, Playwright, or Cypress.
  • Programming/Scripting: Proficiency in Python, JavaScript/TypeScript, or Java.
  • API & Integration Testing: Experience with Postman, REST Assured, Swagger/OpenAPI, API automation frameworks.
  • AI Testing: Hands on experience with AI Agent Validation, LLM Testing, RAG Pipeline Validation, Prompt Engineering Validation, Hallucination Detection, Bias & Fairness Testing, Guardrail Verification, AI Workflow Validation, AI Evaluation Frameworks, Ground Truth Validation.

Preferred Skills

  • Experience with CI/CD pipelines and automated testing integration.
  • Knowledge of Agile and Scrum methodologies.
  • Familiarity with cloud native applications and microservices architecture.
  • Experience with performance testing tools (e.g., JMeter, LoadRunner, k6).
  • Knowledge of security testing concepts and vulnerability assessment.
  • Understanding of containerization technologies such as Docker and Kubernetes.
  • Experience with Azure, AWS, or Google Cloud platforms.

Preferred Certifications

  • ISTQB Certified Tester (CTFL/CTAL)
  • Certified Selenium Professional
  • Microsoft Certified: Azure AI Fundamentals (AI 900)
  • AWS Certified AI Practitioner
  • Equivalent AI or Generative AI certifications

Key Competencies

  • Strong analytical and problem solving skills.
  • Excellent attention to detail and quality mindset.
  • Ability to work collaboratively in cross functional teams.
  • Effective communication and stakeholder management skills.
  • Continuous learning mindset with a passion for AI and emerging technologies.
  • Ability to manage multiple priorities in a fast paced environment.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Vistas Global