SpecBranch: Speculative Decoding via Hybrid Drafting and Rollback-Aware Branch Parallelism
Yuhao Shen · Junyi Shen · Quan Kong · Tianyu Liu · Yao Lu · Cong Wang
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yuhao Shen · Junyi Shen · Quan Kong · Tianyu Liu · Yao Lu · Cong Wang
Quan Kong · Yuhao Shen · Yicheng Ji · Huan Li · Cong Wang
Yuhao Shen · Tianyu Liu · Junyi Shen · Jinyang Wu · Quan Kong · Huan Li · Cong Wang
Parallel Speculative Decoding (PSD) accelerates traditional Speculative Decoding (SD) by overlapping draft generation with verification. However, it remains hampered by two fundamental challenges: (1) a theoretical speedup ceiling dictated by the speed ratio between the draft and target models, a...
Yicheng Ji · Jun Zhang · Jinpeng Chen · Cong Wang · Lidan Shou · Gang Chen · Huan Li
Video Large Language Models (Video-LLMs) excel in video understanding but suffer from high inference latency due to autoregressive generation. Speculative Decoding (SD) mitigates this by applying a draft-and-verify paradigm, yet existing methods are constrained by rigid exact-match rules, severel...