Safety-Utility Conflicts Are Not Global: Surgical Alignment via Head-Level Diagnosis
Wang Cai · Yilin Wen · Jinchang Hou · Du Su · Guoqiu Wang · Zhonghou Lv · Chenfu Bao · Yunfang Wu
摘要
Safety alignment in Large Language Models (LLMs) inherently presents a multi-objective optimization conflict, often accompanied by an unintended degradation of general capabilities. Existing mitigation strategies typically rely on global gradient geometry to resolve these conflicts, yet they over...