IMPACT : Importance-Aware Activation Space Reconstruction
Md Mokarram Chowdhury · Daniel Agyei Asante · Ernie Chang · Yang Li
摘要
Large language models (LLMs) achieve strong performance across diverse domains but remain difficult to deploy in resource-constrained environments due to their size. Low-rank compression is a common remedy, typically minimizing weight reconstruction error under the assumption that weights are low...