一作ACL 2026Poster· Natural Language Processing
Revisiting Non-Verbatim Memorization in Large Language Models: The Role of Entity Surface Forms
Yuto Nishida · Naoki Shikoda · Yosuke Kishinami · Ryo Fujii · Makoto Morishita · Hidetaka Kamigaito · Taro Watanabe
摘要
Understanding what kinds of factual knowledge large language models (LLMs) memorize is essential for evaluating their reliability and limitations.Entity-based QA is a common framework for analyzing non-verbatim memorization, but typical evaluations query each entity using a single canonical surfa...