indeed
Sr Software Quality Engineer (AI Focused)-2
Realign
Toronto, CAN
Full-time
Senior
Onsite
Discovered Today
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanFull Job Posting
Toronto, Ontario M5V 3L9 Posted September 16th, 2026
Sr Software Quality Engineer (Ai Focused)
=============================================
Work Model:** Onsite
Roles and Responsibilities
- Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
- Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
- Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
- Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
- Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
- Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
- Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
- Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
- Identify, document, prioritize, and track defects through resolution.
- Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
- Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
- Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.
Required Skills
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Realign
Product Owner (Technical)-2
Montréal, CAN
Full-time
Montréal, Quebec H1A 0A1 Posted September 16th, 2026 ##### Job Type: Full Time ##### Job Category: IT #### Job Description Job Title: Product Owner - Technical Job Type: Full Time (FTE) Location: Montreal, QC (Hybrid) ##
Discovered TodayView →
Project Lead – Wealth Management-6
Toronto, CAN
LeadFull-time
Realign is seeking a Project Lead – Wealth Management to lead end-to-end project delivery across cross-functional teams. The role manages planning, risks, dependencies, budgets, milestones, reporting, stakeholder alignme
Discovered YesterdayView →
Senior Program Manager-6
Toronto, CAN
SeniorFull-time
Realign is seeking a Senior Program Manager to lead a global Voice of Customer measurement transformation across Canada, the United States, and Asia. The role covers governance, measurement frameworks, data integration,
Discovered YesterdayView →
Reconciliation Support Analyst-6
Toronto, CAN
Full-time
Toronto, Ontario M5V 3L9 Posted September 14th, 2026 ##### Job Type: Full Time ##### Job Category: IT #### Job Description Job Title: Reconciliation Support Analyst Location: Toronto, Ontario (ON) Work Arrangement: Onsit
Discovered YesterdayView →
Technology Solutions Lead / Senior Amazon Connect Engineer-6
Toronto, CAN
LeadFull-time
Realign is seeking a Technology Solutions Lead / Senior Amazon Connect Engineer to design, develop, and support enterprise-scale Amazon Connect contact center solutions. The role requires hands-on Amazon Connect, AWS, Ja
Discovered YesterdayView →
Senior Software Engineer (IBM SFG)-6
Toronto, CAN
SeniorFull-time
Realign is seeking a Senior Software Engineer with hands-on IBM Sterling File Gateway expertise to design, maintain, and support secure file transfer solutions for banking and financial services environments. The role re
Discovered YesterdayView →
GuidewireClaimCenter(GWCC) Business System Analyst-1
Toronto, CAN
Full-time
The employer is seeking a Business System Analyst to support Guidewire ClaimCenter work in the insurance domain. The role requires business systems analysis knowledge and is a full-time hybrid position in Toronto.
Discovered YesterdayView →
Core Network SME-1
Toronto, CAN
SeniorFull-time
Realign is seeking an experienced Core Network SME to support wireless packet core design, integration, validation, operations, troubleshooting, performance analysis, and automation across 5G, LTE, and 3G environments. C
Discovered YesterdayView →
Product Owner (Technical)-2
Montréal, CAN
Discovered TodayFull-time
Project Lead – Wealth Management-6
Toronto, CAN
Discovered YesterdayFull-time
Senior Program Manager-6
Toronto, CAN
Discovered YesterdayFull-time
Reconciliation Support Analyst-6
Toronto, CAN
Discovered YesterdayFull-time
Technology Solutions Lead / Senior Amazon Connect Engineer-6
Toronto, CAN
Discovered YesterdayFull-time
Senior Software Engineer (IBM SFG)-6
Toronto, CAN
Discovered YesterdayFull-time
GuidewireClaimCenter(GWCC) Business System Analyst-1
Toronto, CAN
Discovered YesterdayFull-time
Core Network SME-1
Toronto, CAN
Discovered YesterdayFull-time