一作ACL 2026Findings· Findings of ACL
R an L o RA : Residual-aware Nonlinear Low-Rank Adaptation
Xu Luo · Yongbin Liu · Chunping Ouyang · Ying Yu
摘要
Low-Rank Adaptation (LoRA) is a widely adopted approach for parameter-efficient fine-tuning of large language models, enabling effective adaptation with a small number of trainable parameters. However, its reliance on linear low-rank projections restricts adaptation to linear subspaces, which can...