Reward Modeling from Natural Language Human Feedback
Zongqi Wang · Rui Wang · Yuchuan Wu · Yiyao Yu · Pinyi Zhang · Shaoning Sun · Yujiu Yang · Yongbin Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Zongqi Wang · Rui Wang · Yuchuan Wu · Yiyao Yu · Pinyi Zhang · Shaoning Sun · Yujiu Yang · Yongbin Li
Shaoning Sun · Mingzhu Cai · Huang He · Bingjin Chen · Siqi Bao · Yujiu Yang · hua wu · Haifeng Wang
Language model families exhibit striking disparity in their capacity to benefit from reinforcement learning: under identical training, models like Qwen achieve substantial gains, while others like Llama yield limited improvements. Complementing data-centric approaches, we reveal that this dispari...
Tao Liu · Taiqiang Wu · Runming Yang · Shaoning Sun · Junjie Wang · Yujiu Yang
Supervised fine-tuning (SFT) is a fundamental post-training strategy to align Large Language Models (LLMs) with human intent. However, traditional SFT often ignores the \textit{one-to-many} nature of language by forcing alignment with a single reference answer, leading to the model overfitting to...