作者位次 #6/8ACL 2026Findings· Findings of ACL
Optimizing Native Sparse Attention with Latent Attention and Local Global Alternating Strategies
Yuxuan Hu · Jianchao Tan · Jiaqi Zhang · Wen Zan · Pingwei Sun · Yifan Lu · Xunliang Cai · Jing Zhang
摘要
In this work, we conduct a systematic analysis of Native Sparse Attention (NSA) and propose targeted improvements that enhance long-context modeling. A key insight is that alternating between local (sliding-window) and global (compression/selective) attention across layers, rather than using fixe...