一作ACL 2026Poster· Natural Language Processing
MATCH : Modulating Attention via In-Context Retrieval for Long-Context Transformers
Linrui Ma · Chun Hei Lo · Xinyu Wang · Peng Lu · Xihao Yuan · Hanting Chen · Kai Han · Xinghao Chen · Chengjun Zhan · Hanlin xu · Yichun Yin · Lifeng Shang · Feng Wen · Boxing Chen · Yufei Cui
摘要
The quadratic computational cost of traditional attention mechanisms poses a major bottleneck to the scalability and practical deployment of large language models (LLMs), particularly in long-context scenarios. To improve efficiency, existing approaches often enforce rigid structural constraints...