作者位次 #4/6ACL 2026Findings· Findings of ACL
L ogit S pec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation
Tianyu Liu · Qitan Lv · Hao Li · Xing Gao · Xiao Sun · Xiaoyan Sun
摘要
Speculative decoding (SD), where a small draft model is employed to propose draft tokens in advance and then the target model validates them in parallel, has emerged as a promising technique for LLM inference acceleration. Many endeavors to improve SD are to eliminate the need for a draft model a...