From Insight to Action: A Novel Framework for Interpretability-Guided Data Selection in Large Language Models
Ling Shi · Xinwei Wu · Xiaohu Zhao · Hao Wang · Heng Liu · Yangyang Liu · Linlong Xu · Longyue Wang · Deyi Xiong · Weihua Luo
摘要
While mechanistic interpretability tools like Sparse Autoencoders (SAEs) can uncover meaningful features within Large Language Models (LLMs), a critical gap remains in transforming these insights into practical actions for model optimization. We bridge this gap with the hypothesis that data selec...