From Tokens to Concepts: Leveraging SAE for SPLADE
Yuxuan Zong · Mathias Vast · Basile Van Cooten · Laure Soulier · Benjamin Piwowarski
摘要
Learned Sparse IR models, such as SPLADE, offer an excellent efficiency-effectiveness tradeoff. However, they rely on the underlying backbone vocabulary, which might hinder performance (polysemicity and synonymy) and pose a challenge for multi-lingual and multi-modal usages. To solve this limitat...