Dual Activation-Weight Sparsity: A Training-Free Framework for Efficient Large Language Model Compression
Luoyang Sun · Guangyan Li · Cheng Deng · Haifeng Zhang · Jian Zhao · Yongqiang Tang · Wensheng Zhang · Jun Wang
摘要
Large language models (LLMs) excel at natural language tasks but face deployment challenges due to computational demands. We introduce Dual Activation-Weight Sparsity (DAWS) , a training-free framework that jointly exploits activation and weight sparsity through magnitude-based routing. Systemati...