Compositional Steering of Large Language Models with Steering Tokens
Gorjan Radevski · Kiril Gashteovski · Giwon Hong · Carolin Lawrence · Goran Glavaš
摘要
Deploying LLMs in real-world applications requires controllable output that satisfies multiple desiderata at the same time. While existing work extensively addresses LLM steering for a single behavior, compositional steering—i.e., steering LLMs simultaneously towards multiple behaviors—remains an...