作者位次 #3/9FAST 2026Oral· Storage & File Systems
CacheSlide: Unlocking Cross Position-Aware KV Cache Reuse for Accelerating LLM Serving
Yang Liu · Yunfei Gu · Liqiang Zhang · Chentao Wu · Guangtao Xue · Jie Li · Minyi Guo · Junhao Hu · Jie Meng
摘要
Large Language Models (LLMs) are increasingly deployed in agent-based applications with complex prompt structures comprising both invariant and dynamic segments. Existing KV cache reuse strategies—PositionDependent Caching (PDC) and Position-Independent Caching (PIC)—inadequately address these s...