作者位次 #3/6ACL 2026Findings· Findings of ACL
A uto M onitor-Bench: Evaluating the Reliability of LLM -Based Misbehavior Monitor
Shu Yang · Jingyu Hu · Tong Li · Hanqi Yan · Wenxuan Wang · Di Wang
摘要
We introduce AutoMonitor-Bench, the first benchmark designed to systematically evaluate the reliability of LLM-based misbehavior monitors across diverse tasks and failure modes. AutoMonitor-Bench consists of 3,010 carefully annotated test samples spanning question answering, code generation, and...