Base Career helps you apply smarter for this job.
Key skills for this role
To support the Development team through manual and automated QA testing of enhanced software through AI-augmented testing practices, including agentic coding tools, evaluations, and spec-driven development.
To support the Development team through manual and automated QA testing of enhanced software through AI-augmented testing practices, including agentic coding tools, evaluations, and spec-driven development.
Review requirements specifications and technical design documents to provide timely and meaningful feedback.
Create detailed, comprehensive, and well-structured test plans and test cases and analyze and update existing test cases.
Lead and assist more junior QA Analysts.
Estimate, prioritize, plan and coordinate testing activities.
Design, develop and execute automation scripts using open-source tools, TypeScript, Playwright, or similar automation frameworks (e.g., Cypress, Selenium).
Use AI coding assistants and agentic tools, such as Claude Code, to accelerate test authoring, maintain automation scripts, and triage defects.
Build, customize, and maintain reusable AI skills and agentic workflows that streamline repeatable QA tasks (test generation, regression checks, defect documentation).
Apply spec-driven development practices, for example the AI-Driven Development Lifecycle (AI-DLC), to translate requirements into structured specifications that guide AI-assisted test generation and validation.
Design and run evaluations ("evals") for AI-powered features to measure accuracy, relevance, hallucination rate, and other quality metrics against defined test datasets.
Apply non-deterministic testing approaches for AI/LLM-based features, using statistical thresholds, sampling, and repeated-run analysis rather than fixed pass/fail assertions.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
, CAN
, USA
, CAN
, CAN
, USA
, USA
, USA
, USA
Configure and monitor AI observability and evaluation tooling (e.g., Arize AX/Phoenix, LangSmith, or similar) to track model/agent performance, detect drift, and flag regressions in production.
Identify, record, document, track, and close bugs.
Perform thorough regression testing when bugs are resolved.
Actively transfer knowledge to other QA Team members via documentation and QA presentations, including AI-assisted testing practices and tooling.
Ad hoc duties as required.
Proven experience in manual and automated QA testing of web applications.
Proficiency in TypeScript/JavaScript with hands-on experience in Playwright or a comparable automation framework (Cypress, Selenium, WebdriverIO).
Practical experience using AI coding assistants and agentic tools (e.g., Claude Code, GitHub Copilot) for writing, maintaining, or reviewing test automation.
Working understanding of spec-driven development methodologies (e.g., AI-DLC / AI-Driven Development Lifecycle) and how structured specifications drive AI-assisted planning, execution, and validation.
Ability to build and maintain custom AI skills, prompts, or agent workflows to streamline QA processes.
Understanding of non-deterministic testing: recognizing that AI/LLM outputs vary between runs and require different validation strategies than deterministic UI/API testing.
Experience designing evaluation ("eval") datasets and metrics (accuracy, relevance, hallucination, toxicity, latency) for AI-powered features.
Familiarity with AI observability and evaluation-monitoring platforms such as Arize (AX/Phoenix), LangSmith, or Braintrust for tracking model/agent quality in production.
Solid grounding in QA methodologies, the SDLC, and test planning/estimation.
Strong analytical, written, and verbal communication skills, with the ability to mentor junior QA Analysts.
Absorb Software is the leading global AI-driven learning platform provider, helping organizations unlock the full potential of their workforce. With its innovative Strategic Learning Systems (SLS) approach, Absorb empowers businesses to align learning with strategic goals, driving measurable impact and workforce agility. The Absorb LMS platform delivers personalized, scalable, and engaging learning experiences for employees, customers, and partners worldwide. Trusted by over 3,300 organizations and 34 million users, Absorb is redefining the future of workplace learning through cutting-edge AI, seamless integrations, and an unwavering commitment to innovation. We empower learners to enrich their lives, workplaces and communities.
We achieve exceptional results by genuinely caring about each other and the work we do
We’re united, and we grow through our commitment to elevating continual learning!
We believe in the power of AI and technology to make learning accessible to everyone. By exploring new tools and constantly experimenting, we’re redefining what’s possible. We take an AI‑first approach to unlock human potential, drive impact, and scale better outcomes. As the world evolves, Absorb is committed to growing with you. Investing in your skills every step of the way.
We use AI tools to support our recruitment process, such as organizing applications and highlighting potential matches based on role requirements. While these tools help streamline our review, all screening and final hiring decisions are made by our recruitment team. We encourage candidates to apply authentically and not rely solely on AI-generated responses in their applications.
Absorb is proud to be an equal opportunity employer, we celebrate diversity and are committed to creating a safe and inclusive environment for all our people. All employment decisions are based on business needs, job requirements and individual qualifications. Should you require any accommodation during the recruitment process, please indicate this on your application and we will work with you to meet your accessibility needs. For any questions, please contact us at accessiblecareers@absorblms.com
Successful candidates for this position will be subject to pre-employment background screening, including a criminal record check and must be able to show proof of legal eligibility to work in the country they have applied to without sponsorship.
Canadian private learning-technology company providing AI-powered learning management software to businesses, higher education, governments, and nonprofits.
Visit company websiteJobs and hiring trendsFull-time
Senior · 5+ years experience
Remote
Apply faster on company sites with our extension.