作者位次 #6/7ACL 2026Poster· Natural Language Processing
H i SVD : Principled Low-Rank Approximation of LLM s via Hierarchical Modeling of Information Capacity and Spectral Structure
Zhuo Chen · Minghao Li · Xiaoqian Ma · Siqi Fan · Xiusheng Huang · Zhang Liujie · Weihang Chen
摘要
Singular Value Decomposition (SVD) enables hardware-agnostic LLM compression via low-rank approximation, yet optimal rank allocation remains a bottleneck. Existing methods predominantly derive layer importance from performance-oriented proxies. Yet, these metrics fail to distinguish between repre...