Content Adversarial Red Team Analyst - English(India)

Job Overview

Project Details

Responsibilities

• Design and execute authorized adversarial test scenarios to evaluate AI systems against content safety policies and compliance requirements.
• Develop diverse and challenging prompts, inputs, and scenarios to test system behaviour.
• Explore edge cases, unusual inputs, and complex situations that may reveal gaps in safety controls or policy enforcement.
• Evaluate AI responses and identify potential weaknesses, inconsistencies, or policy-related concerns.
• Test how systems respond to different forms of language, context, intent, and user behaviour.
• Identify recurring patterns or scenarios that may require further testing or improvement.
• Document test scenarios, system responses, findings, and supporting evidence clearly.
• Apply defined testing guidelines and project requirements consistently.
• Review complex cases and use sound judgment when assessing system behaviour.
• Maintain high levels of quality, accuracy, and attention to detail while completing assigned tasks.

Required Qualifications

• Educational background or equivalent experience in Trust & Safety, Content Safety, Policy, Linguistics, Communications, Journalism, Research, AI Evaluation, or a related field.
• Experience in content safety, trust and safety, AI evaluation, content moderation, policy enforcement, quality assurance, or related areas.
• Strong understanding of content safety policies, policy enforcement, and common safety risks.
• Strong understanding of written language, context, intent, and different ways users may communicate.
• Ability to think creatively and develop challenging, unusual, or unexpected test scenarios.
• Strong analytical and critical-thinking skills.
• Ability to identify patterns, weaknesses, inconsistencies, and gaps in system behaviour.
• Comfortable working with complex or ambiguous situations and making informed decisions based on defined requirements.
• Ability to understand and consistently apply detailed testing guidelines and policies.
• Strong written English comprehension and communication skills.
• Strong documentation skills and attention to detail.
• Familiarity with AI systems, large language models, adversarial testing, red teaming, or AI safety is preferred.