Inverting the Shield: Systematically Generating Safety Tests from Policy Specifications
Xiaoyue Lu · XIANGLIN YANG · Haijun Liu · Jiahao Liu · Kuntai Cai · Yan Xiao · Jin Song Dong
摘要
The widespread integration of Large Language Models (LLMs) necessitates rigorous and systematic safety evaluation. Existing paradigms either rely on constructed benchmarks to assess safety from predefined perspectives, or employ dynamic red-teaming to probe potential vulnerabilities. While effect...