作者位次 #5/10ACL 2026Poster· Natural Language Processing
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation
Xi Xiao · Chenrui Ma · Yunbei Zhang · Chen Liu · Zhuxuanzi Wang · Yanshu Li · Lin Zhao · Guosheng Hu · Tianyang Wang · Hao Xu
摘要
Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT). Yet, its efficacy is hampered by two fundamental limitations: \textit{semantic drift} , arising from treating all update directions with equal importance, and \textit{structural incoherence} , due to ad...