作者位次 #3/5ACL 2026Findings· Findings of ACL
One Token Is Enough: Improving Diffusion Language Models with a Sink Token
Zihou Zhang · Zheyong Xie · Li Zhong · Haifeng Liu · Shaosheng Cao
摘要
Diffusion Language Models (DLMs) have emerged as a compelling alternative to autoregressive approaches, enabling parallel text generation with competitive performance. Despite these advantages, there is a critical instability in DLMs: the moving sink phenomenon. Our analysis indicates that sink t...