一作ACL 2026Findings· Findings of ACL
Lost in Decomposition: Analyzing and Mitigating the Limitations of Long Context Methods via Context Dependency
Jiayuan Guo · Yueyang Su · Yuyao Ge · Saiping Guan · Lei Yu · Jiafeng Guo · Xueqi Cheng
摘要
Long context large language models exhibit the “lost in the middle” problem, where models struggle to effectively utilize information located in the middle of long contexts. Although existing workflow-based long context methods (e.g., RAG) alleviate this problem and perform well on specific datas...