一作ACL 2026Findings· Findings of ACL
Beyond Uniform SVD : Dual-Level Optimization across Columns and Modules for LLM Compression
Lin Xv · Xian Gao · Ting Liu · Yuzhuo fu
摘要
Low-rank decomposition, particularly Singular Value Decomposition (SVD), is a pivotal technique for mitigating the storage and computational demands of Large Language Models (LLMs). However, prevalent SVD-based approaches overlook the critical phenomenon that decomposition errors exhibit signific...