Crafting Reversible SFT Behaviors in Large Language Models
Yuping Lin · Pengfei He · Yue XING · Yingqian Cui · Jiayuan Ding · Subhabrata Mukherjee · Hui Liu · Zhen Xiang
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yuping Lin · Pengfei He · Yue XING · Yingqian Cui · Jiayuan Ding · Subhabrata Mukherjee · Hui Liu · Zhen Xiang
Yuping Lin · Zitao Li · Yue Xing · Pengfei He · Yingqian Cui · Yaliang Li · Bolin Ding · Jingren Zhou · Jiliang Tang
Recent studies have identified “retrieval heads” in Large Language Models (LLMs) responsible for extracting information from input contexts. However, prior works largely rely on static statistics aggregated across datasets, identifying heads that perform retrieval on average. This perspective ove...
Yingqian Cui · Zhenwei Dai · Pengfei He · Bing He · Hui Liu · Zhan Shi · Xianfeng Tang · Jingying Zeng · Suhang Wang · Yue Xing · Jiliang Tang · Benoit Dumoulin
Large Language Models (LLMs) have made strong progress in reasoning. To enhance the reasoning performance, a common inference-time approach is tree-based search, which decomposes the reasoning process into multiple steps, expands multiple reasoning paths, and uses reward models to prune and selec...