MMCompass: Diagnosing Position Bias in Generative Multimodal Reward Models
Hongbo Zhao · Mingkun Yang · Yantao Liu · Yichang Zhang · Fei Huang · Zhibo Yang · Dayiheng Liu · Shuai Bai
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Hongbo Zhao · Mingkun Yang · Yantao Liu · Yichang Zhang · Fei Huang · Zhibo Yang · Dayiheng Liu · Shuai Bai
Xiaoyuan Li · Yuzhe Wang · Moxin Li · Keqin Bao · Rui Men · Yichang Zhang · Dayiheng Liu · Wenjie Wang · Fuli Feng
Xiaoyuan Li · Keqin Bao · Yubo Ma · Moxin Li · Wenjie Wang · Rui Men · Yichang Zhang · Fuli Feng · Dayiheng Liu
Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks. However, current evaluations predominantly focus on single-turn reasoning scenarios, leaving interactive tasks largely unexplored. We attribute it to the absence of comprehensive datasets and...
Binghai Wang · Yantao Liu · Yuxuan Liu · Tianyi Tang · Shenzhi Wang · Chang Gao · Chujie Zheng · Yichang Zhang · Le Yu · Shixuan Liu · Tao Gui · Qi Zhang · Xuanjing Huang · Bowen Yu · Fei Huang · Junyang Lin
Generative Reward Models (GenRMs) and LLM-as-a-Judge exhibit deceptive alignment by producing correct judgments for incorrect reasons, as they are trained and evaluated to prioritize Outcome Accuracy , which undermines their ability to generalize during RLHF. We introduce Rationale Consistency ,...