LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding
Gang Lin · dongfang li · Zhuoen Chen · Yukun Shi · Xuhui Chen · Baotian Hu · Min Zhang
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Gang Lin · dongfang li · Zhuoen Chen · Yukun Shi · Xuhui Chen · Baotian Hu · Min Zhang
Zetian Sun · dongfang li · Xuhui Chen · Baotian Hu · Min Zhang
Xinping Zhao · Xinshuo Hu · Zifei Shan · Shouzheng Huang · Yao Zhou · Xin Zhang · Zetian Sun · zhenyu liu · dongfang li · Xinyuan Wei · Youcheng Pan · Yang Xiang · Meishan Zhang · Haofen Wang · Jun Yu · Baotian Hu · Min Zhang
Zhengxuan Lu · dongfang li · Yukun Shi · Beilun Wang · Longyue Wang · Baotian Hu
Current approaches to memory in Large Language Models (LLMs) predominantly rely on static Retrieval-Augmented Generation (RAG), which often results in scattered retrieval and fails to capture the structural dependencies required for complex reasoning. For autonomous agents, these passive and flat...
Zhuoen Chen · dongfang li · Meishan Zhang · Baotian Hu · Min Zhang
Large Language Models (LLMs) face severe challenges in long-context processing, including quadratic computational costs, information forgetting, and the context fragmentation inherent in Retrieval-Augmented Generation (RAG). We introduce LycheeMemory, a cognitively inspired framework that enables...
dongfang li · Zixuan Liu · Gang Lin · Baotian Hu · Min Zhang
The quadratic complexity of the attention mechanism and the substantial memory footprint of the Key-Value (KV) cache present severe computational and memory challenges for Large Language Models (LLMs) processing long contexts. Existing retrieval-based methods often compromise semantic integrity t...
Zetian Sun · dongfang li · Baotian Hu · Min Zhang