Senior Quality Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Vistas Global seeks a Senior Quality Engineer to ensure quality, reliability, and security of AI-powered applications. The role involves testing traditional software and AI systems including LLMs and RAG pipelines.
Key Skills for This Role
Responsibilities
- Design, develop, and execute comprehensive test strategies, test plans, and test cases
- Perform functional, regression, integration, system, and user acceptance testing
- Develop and maintain automated test suites for web applications, APIs, and backend services
- Execute API testing using Postman, REST Assured, or equivalent tools
- Validate data integrity, backend workflows, and system integrations
- Track, prioritize, and manage defects throughout the testing lifecycle
- Validate AI powered applications including LLMs, RAG pipelines, and AI agents
- Design and execute prompt validation and prompt robustness testing
- Perform hallucination detection and factual accuracy validation
- Conduct bias, fairness, toxicity, and safety testing
- Validate AI guardrails, content moderation, and policy compliance
- Build AI evaluation datasets and perform ground truth comparisons
Requirements
- 3–5 years of experience in Software Quality Assurance and Testing
- Hands on experience testing enterprise web applications and APIs
- Experience testing AI powered applications or Generative AI solutions
- Proficiency in test automation tools (Selenium, Playwright, or Cypress)
- Proficiency in Python, JavaScript/TypeScript, or Java
- Experience with API testing tools (Postman, REST Assured, Swagger/OpenAPI)
- Hands on experience with AI testing including LLM, RAG, and AI agent validation
Full Job Posting
About the Role
- We are seeking a highly motivated IT Senior Quality Engineer to ensure the quality, reliability, and security of next generation AI powered applications.
- You will be responsible for validating both traditional software solutions and AI first applications, including Large Language Models (LLMs), Retrieval Augmented Generation (RAG) systems, and AI agents.
- You will collaborate closely with software engineers, AI developers, product owners, and business stakeholders to establish robust quality assurance practices across the SDLC.
Key Responsibilities Quality Assurance & Testing
- Design, develop, and execute comprehensive test strategies, test plans, and test cases.
- Perform functional, regression, integration, system, and user acceptance testing.
- Develop and maintain automated test suites for web applications, APIs, and backend services.
- Execute API testing using Postman, REST Assured, or equivalent tools.
- Validate data integrity, backend workflows, and system integrations.
- Track, prioritize, and manage defects throughout the testing lifecycle.
- Collaborate with development teams to resolve issues and ensure timely delivery.
Key Responsibilities AI Application Testing
- Validate AI powered applications including LLMs, RAG pipelines, and AI Agents.
- Design and execute prompt validation and prompt robustness testing.
- Perform hallucination detection and factual accuracy validation.
- Conduct bias, fairness, toxicity, and safety testing.
- Validate AI guardrails, content moderation, and policy compliance.
- Build AI evaluation datasets and perform ground truth comparisons.
- Measure AI quality using automated evaluation frameworks and benchmarking techniques.
- Validate end to end AI workflows, orchestration, and agent interactions.
Key Responsibilities Collaboration & Process Improvement
- Work closely with developers, AI engineers, product owners, and business stakeholders to define quality objectives.
- Participate in Agile/Scrum ceremonies including sprint planning, reviews, and retrospectives.
- Contribute to continuous improvement of QA processes, automation frameworks, and AI testing methodologies.
- Support CI/CD pipelines by integrating automated testing into deployment workflows.
Mandatory Skills & Qualifications Experience
- 3–5 years of experience in Software Quality Assurance and Testing.
- Hands on experience testing enterprise web applications and APIs.
- Experience testing AI powered applications or Generative AI solutions.
Mandatory Skills & Qualifications Technical Skills
- Functional Testing: Test Planning, Test Design, Test Execution, Regression Testing, Defect Management.
- Test Automation: Experience with Selenium, Playwright, or Cypress.
- Programming/Scripting: Proficiency in Python, JavaScript/TypeScript, or Java.
- API & Integration Testing: Experience with Postman, REST Assured, Swagger/OpenAPI, API automation frameworks.
- AI Testing: Hands on experience with AI Agent Validation, LLM Testing, RAG Pipeline Validation, Prompt Engineering Validation, Hallucination Detection, Bias & Fairness Testing, Guardrail Verification, AI Workflow Validation, AI Evaluation Frameworks, Ground Truth Validation.
Preferred Skills
- Experience with CI/CD pipelines and automated testing integration.
- Knowledge of Agile and Scrum methodologies.
- Familiarity with cloud native applications and microservices architecture.
- Experience with performance testing tools (e.g., JMeter, LoadRunner, k6).
- Knowledge of security testing concepts and vulnerability assessment.
- Understanding of containerization technologies such as Docker and Kubernetes.
- Experience with Azure, AWS, or Google Cloud platforms.
Preferred Certifications
- ISTQB Certified Tester (CTFL/CTAL)
- Certified Selenium Professional
- Microsoft Certified: Azure AI Fundamentals (AI 900)
- AWS Certified AI Practitioner
- Equivalent AI or Generative AI certifications
Key Competencies
- Strong analytical and problem solving skills.
- Excellent attention to detail and quality mindset.
- Ability to work collaboratively in cross functional teams.
- Effective communication and stakeholder management skills.
- Continuous learning mindset with a passion for AI and emerging technologies.
- Ability to manage multiple priorities in a fast paced environment.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Vistas Global
Business System Analyst
Doha, QAT
Vistas Global is seeking a detail-oriented Business System Analyst to bridge business stakeholders and technology teams in Doha, Qatar. The role involves gathering and documenting requirements, analyzing business process
Senior Business Analyst
Doha, QAT
Vistas Global seeks a Senior Business Analyst to support Domestic Wholesale Banking and Global Transaction Banking teams. The role involves analyzing client transaction flows, identifying revenue opportunities, gathering
Payment Specialist
Doha, QAT
Vistas Global is seeking an experienced E-Commerce Specialist to manage e-commerce operations, support payment gateway integrations, and optimize online payment performance. The role requires hands-on experience with Cyb
Trade Finance Specialist
Doha, QAT
Vistas Global seeks a Trade Finance Specialist with 12+ years of banking experience to drive trade revenue expansion for MNC clients. The role requires deep expertise in trade finance, supply chain finance, and working c
Lead Business Analyst
Doha, QAT
Vistas Global seeks a Lead Business Analyst to support FDI growth, co-lending initiatives, and sector-based financing solutions across the Middle East. The role involves analyzing investment opportunities, documenting bu
Full Stack Engineer
Doha, QAT
Vistas Global is seeking an AI Native Engineer to design, build, and operate solutions end-to-end using an agentic IDE. The role requires full-stack engineering experience with modern React/Next.js, TypeScript, and produ
Ecommerce Specialist
Doha, QAT
Vistas Global is seeking an experienced E-Commerce Specialist to manage e-commerce operations, support payment gateway integrations (CyberSource, MPGS), and optimize online payment performance. The role requires hands-on
Developer
Doha, QAT
Vistas Global is seeking a Full Stack Developer with expertise in modern front-end architecture, high-performance UI, and state management. The role requires deep knowledge of React, TypeScript, and state management libr
Business System Analyst
Doha, QAT
Senior Business Analyst
Doha, QAT
Payment Specialist
Doha, QAT
Trade Finance Specialist
Doha, QAT
Lead Business Analyst
Doha, QAT
Full Stack Engineer
Doha, QAT
Ecommerce Specialist
Doha, QAT
Developer
Doha, QAT