Principal Test Engineer - AI

Significant experience defining and leading test strategies for complex software systems, with strong depth in software quality engineering, automation, and system integration testing.

Experience testing AI/ML-enabled products, data-driven systems, or advanced analytics platforms in production-like or regulated environments, with a strong understanding of AI quality considerations such as model performance validation, bias and fairness assessment, explainability, robustness, data quality, and monitoring.

Strong experience validating data pipelines, APIs, backend services, and end-to-end workflows across distributed or cloud-based architectures, with the ability to investigate and troubleshoot complex defects through analysis of logs, datasets, model outputs, APIs, and overall platform behaviour.

Technical background in automation and test tooling, such as Python, Playwright, Cucumber, BDD or similar frameworks, along with strong SQL and data validation skills.

Experience creating and overseeing high-quality test documentation, including test strategies, test plans, test cases, validation summaries, defect reporting, and execution metrics, with the ability to communicate technical findings, risks, and recommendations clearly to both technical and non-technical stakeholders.

Ability to influence technical direction across engineering and product teams and advocate effectively for quality, testability, and risk-based decision-making.

Strong analytical, planning, and organisational skills, with the ability to manage competing priorities, lead complex test efforts with minimal supervision, and embed quality practices within Agile development environments.

Bachelor’s degree or equivalent qualification in Computer Science, Computer Engineering, Software Engineering, or a related technical discipline required.

Significant experience in Software Quality Assurance, Software Testing, or Quality Engineering.

A background leading complex test programmes, test strategy, or quality engineering initiatives.

Experience in healthcare software, digital health, regulated software environments, or other highly controlled industries preferred.

EOE/M/F/Vet/Disability