The Mechanics of Interference: Defusing Distractors in RAG via Sparse Autoencoder Interventions
Christian Giannetti · Giovanni Trappolini · Nicola Tonellotto · Fabrizio Silvestri · Pietro Lió
摘要
Large language models exhibit a critical vulnerability to distractor interference in retrieval-augmented contexts: they fail to prioritize relevant, factually correct documents over topically similar but misleading content. We introduce Lat-Defuse, a mechanistic framework that corrects this failu...