Subcontractor- Gen AI QA

Area(s) of responsibility

• AI QA Engineer – Agentic AI / GenAI Role Overview QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise. Key Responsibilities • Develop Python-based automation frameworks (Pytest) • Test LLM outputs (accuracy, hallucination, relevance) • Validate multi-agent workflows and pipelines • Build evaluation metrics (F1, precision, recall) • Perform API and integration testing • Ensure high test coverage and CI/CD integration Required Skills • Strong Python programming • Automation frameworks (Pytest/unittest) • Understanding of GenAI/LLMs • API testing and debugging • CI/CD and version control Experience 7 years or more in QA experience, exposure to GenAI/ML systems