Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinations
Wen Luo · Guangyue Peng · Wei Li · Shaohang Wei · Feifan Song · Liang Wang · Nan Yang · Xingxing Zhang · Jing Jin · Furu Wei · Houfeng Wang
摘要
Despite their impressive capabilities, large language models (LLMs) frequently generate hallucinations. Previous work shows that their internal states encode rich signals of truthfulness, yet the origins and mechanisms of these signals remain unclear. In this paper, we demonstrate that truthfulne...