From Weights to Activations: Is Steering the Next Frontier of Adaptation?
Simon Ostermann · Daniil Gurgurov · Tanja Baeumel · Michael A. Hedderich · Sebastian Lapuschkin · Wojciech Samek · Vera Schmitt
摘要
Post-training adaptation of large language models is commonly achieved through parameter updates or input based methods such as fine-tuning, parameter-efficient adaptation, and prompting. In parallel, a growing body of work modifies internal activations at inference time to influence model behavi...