P a T a RM : Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling
Ai Jian · Jingqing Ruan · Xing Ma · Dailin Li · Weipeng Zhang · Ke Zeng · Xunliang Cai
摘要
Reward models (RMs) are central to reinforcement learning from human feedback (RLHF), providing the critical supervision signals that align large language models (LLMs) with human preferences.Generative reward models (GRMs) provide greater interpretability than traditional scalar RMs, but they co...