作者位次 #2/5ACL 2026Findings· Findings of ACL
L ychee C luster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing
dongfang li · Zixuan Liu · Gang Lin · Baotian Hu · Min Zhang
摘要
The quadratic complexity of the attention mechanism and the substantial memory footprint of the Key-Value (KV) cache present severe computational and memory challenges for Large Language Models (LLMs) processing long contexts. Existing retrieval-based methods often compromise semantic integrity t...