作者位次 #2/3ACL 2026Poster· Natural Language Processing
K o C o: Conditioning Language Model Pre-training on Knowledge Coordinates
Yudong Li · Jiawei Cai · Linlin Shen
摘要
Standard Large Language Model (LLM) pre-training typically treats corpora as flattened token sequences, often overlooking the real-world context that humans naturally rely on to contextualize information. To bridge this gap, we introduce Knowledge Coordinate Conditioning (KoCo), a simple method t...