Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization
Mingkuan Zhao · Wentao Hu · Tianchen Huang · Yuheng Min · Suquan Chen · Yide Gao · Yanbo Zhai · Shuangyong Song · Xuelong Li
摘要
Hallucination in Large Language Models (LLMs)—characterized by the generation of content inconsistent with contextual facts or logical constraints—remains a persistent challenge for reliable deployment. In this work, we address this issue through a geometric framework rooted in the linear represe...