Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?
Anton Korznikov · Andrey V. Galichin · Alexey Dontsov · Oleg Rogov · Ivan Oseledets · Elena Tutubalina
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Anton Korznikov · Andrey V. Galichin · Alexey Dontsov · Oleg Rogov · Ivan Oseledets · Elena Tutubalina
Shirin Alanova · Kristina Kazistova · Ekaterina Galaeva · Alina Kostromina · Vladimir Smirnov · Redko Dmitry · Alexey Dontsov · Maxim Zhelnin · Evgeny Burnaev · Egor Shvetsov
The demand for efficient large language model inference has spurred interest in sparsification, yet current hardware support remains narrowly focused on 2:4 weight sparsity. In this work, we argue that activation sparsity despite being overlooked in hardware design offers a promising path for dyn...
Andrey V. Galichin · Alexey Dontsov · Polina Druzhinina · Anton Razzhigaev · Oleg Rogov · Elena Tutubalina · Ivan V. Oseledets