Frozen LLM s are Native Decoders for High-Norm Semantic Vectors
Yunsheng Zeng · Yongmei Tan
摘要
Large language models (LLMs) are designed for discrete tokens, yet they operate in a continuous embedding space. Recent context compression methods exploit this property by encoding text into dense vectors for frozen LLM decoding. However, a key question remains unanswered: how does a frozen LLM...