作者位次 #5/5ACL 2026Findings· Findings of ACL
Hebbian-Guided Bi-Directional Rank Adaptation for Parameter-Efficient Fine-Tuning
Xing Zhao · Liu Yang · Xi-Le Zhao · Yueqi Yang · Tianqi Jiang
摘要
Low-Rank Adaptation (LoRA) is a widely used method to fine-tune large language models, extremely reducing computational and storage costs. But its fixed-rank design cannot well capture the varying importance across different layers, limiting its flexibility. Dynamic rank allocation methods mitiga...