GenAI QE Strategy Lead
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
RBC is seeking a GenAI QE Strategy Lead to design and implement testing strategy and automation tools for a GenAI-based development project. The role requires expertise in GenAI testing, Python, CI/CD, and test automation frameworks.
Key Skills for This Role
Responsibilities
- Work with Dev and BA leads to understand QE scope in an agile sprint approach
- Create a testing framework to be used in CI/CD pipeline
- Design and code application programs; perform testing for developed applications
- Review, analyze, and modify programming systems, including encoding, testing, debugging and installing for a large scale system
- Ensure operating efficiency of existing application systems; maintain records for documentation
- Conduct analyses of organizational needs and goals for development and implementation of application systems
Requirements
- Undergraduate degree coupled with change management experience in complex programs
- End to end test architecture / test integration for GenAI development project
- Strong experience in testing and evaluating GenAI models, prompt engineering frameworks, and RAG systems
- Proficiency in Python and AI evaluation tools like LangChain
- Ability to design scalable testing frameworks within cloud environments (AWS, Azure, GCP)
- Deep knowledge of Software Testing Life Cycle (STLC), CI/CD pipelines, and API testing
- Hands on Automation Experience in python and LLMs
- Hands on DB experience SQL/Snowflake
- CI/CD with test automation
Full Job Posting
WHAT IS THE OPPORTUNITY?
- Lead QE to design, develop and implement testing strategy and automation tools for a GenAI based development project.
- Design the testing framework to be implemented in a CI/CD pipeline.
- Work with BA and Dev leads in Vancouver, plus team members in Toronto, Halifax, and Offshore.
- Focus on LLM integration and testing along with QA automation.
WHAT WILL YOU DO?
- Work with Dev and BA leads to understand QE scope in an agile sprint approach.
- Create a testing framework to be used in CI/CD pipeline.
- Design and code application programs; perform testing for developed applications.
- Review, analyze, and modify programming systems, including encoding, testing, debugging and installing for a large scale system.
- Ensure operating efficiency of existing application systems; maintain records for documentation.
- Conduct analyses of organizational needs and goals for development and implementation of application systems.
WHAT DO YOU NEED TO SUCCEED?
- Undergraduate degree coupled with change management experience in complex programs.
- Demonstrated written and oral communication skills along with strong presentation skills.
- Strong organizational and time management capabilities.
- Deadline driven and results oriented.
- End to end test architecture / test integration for GenAI development project.
- Strong experience in testing and evaluating GenAI models, prompt engineering frameworks, and RAG systems.
- Proficiency in Python and AI evaluation tools like LangChain.
- Ability to design scalable testing frameworks within cloud environments (AWS, Azure, GCP).
- Deep knowledge of Software Testing Life Cycle (STLC), CI/CD pipelines, and API testing.
- Hands on Automation Experience in python and LLMs.
- Hands on DB experience SQL/Snowflake.
- CI/CD with test automation.
WHAT’S IN IT FOR YOU?
- Comprehensive Total Rewards Program including bonuses and flexible benefits.
- Leaders who support your development through coaching and managing opportunities.
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive, and high performing team.
- World class training program in financial services.
- Flexible work/life balance options.
- Opportunities to do challenging work.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at RBC
Principal AI Engineer, Agentic Models and Data Platforms
Calgary, CAN
RBC is seeking a Principal AI Engineer to drive the development of scalable data pipelines and agentic AI systems on enterprise hybrid multi-cloud platforms. The role involves architecting RAG solutions, building evaluat
Senior IAM Systems Support Analyst (Global security)
Calgary, CAN
RBC is seeking a Senior IAM Systems Support Analyst to provide technical support, troubleshooting, and operational management of Identity Access and Authorization services. The role involves supporting identity provision
Analyst, Source Data & Document Traceability- EN
Montreal, CAN
RBC seeks an Analyst for Source Data & Document Traceability to participate in Transaction Testing by requesting and validating source documents. The role involves maintaining the SDDT Directory, collaborating with stake
Director, AI Business Enablement
Toronto, CAN
RBC seeks a Director for AI Business Enablement to drive AI transformation opportunities within a Line of Business. You will engage VP/SVP-level stakeholders, develop AI solution concepts, and partner with technical team
Senior Business Analyst
Toronto, CAN
RBC seeks an experienced Senior Business Analyst to support and enhance the Mortgage Hub vendor application. You will bridge business requirements and technology solutions, driving operational excellence in mortgage serv
Senior Manager, AI Product
Toronto, CAN
RBC is looking for a Senior Manager, AI Product to lead AI product initiatives within the AI & Conversational Banking team. The role involves product ownership, cross-functional leadership, and strategy execution for Adv
Senior Director, Change Management & Enablement
Toronto, CAN
RBC seeks a Senior Director to lead organizational change management for large-scale technology transformations, with an immediate focus on AI SDLC transformation. The role designs OCM strategies, training programs, and
Senior Director, Change Management & Enablement
Toronto, CAN
RBC seeks a Senior Director to lead organizational change management for large-scale technology transformations, including AI SDLC adoption. The role designs OCM strategies, manages training, communications, and workforc
Principal AI Engineer, Agentic Models and Data Platforms
Calgary, CAN
Senior IAM Systems Support Analyst (Global security)
Calgary, CAN
Analyst, Source Data & Document Traceability- EN
Montreal, CAN
Director, AI Business Enablement
Toronto, CAN
Senior Business Analyst
Toronto, CAN
Senior Manager, AI Product
Toronto, CAN
Senior Director, Change Management & Enablement
Toronto, CAN
Senior Director, Change Management & Enablement
Toronto, CAN