Chasing the Tail: Effective Rubric-based Reward Modeling for Large Language Model Post-Training
Junkai Zhang · Zihao Wang · Lin Gui · Swarnashree Mysore Sathyendra · Jaehwan Jeong · Victor Veitch · Wei Wang · Yunzhong He · Bing Liu · Lifeng Jin
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Junkai Zhang · Zihao Wang · Lin Gui · Swarnashree Mysore Sathyendra · Jaehwan Jeong · Victor Veitch · Wei Wang · Yunzhong He · Bing Liu · Lifeng Jin
Anisha Gunjal · Anthony Wang · Elaine Lau · Vaskar Nath · Yunzhong He · Bing Liu · Sean Hendryx
Mohit Raghavendra · Anisha Gunjal · Bing Liu · Yunzhong He
Verification is critical for improving agents: it provides the reward signal for Reinforcement Learning and enables inference-time gains through Test-Time Scaling (TTS). Despite its importance, verification in software engineering (SWE) agent settings often relies on code execution, which can be...
Advait Gosai · Tyler Vuong · Utkarsh Tyagi · Steven Li · Wenjia You · Miheer Bavare · Arda Uçar · Zhongwang Fang · Brian Jang · Bing Liu · Yunzhong He
End-to-end (E2E) spoken dialogue systems are replacing cascaded pipelines for voice-based human-AI interaction. Existing benchmarks primarily evaluate these systems on synthetic speech and single-turn tasks, leaving multi-turn conversational ability underexplored. We introduce Audio MultiChalleng...
Afra Feyza Akyürek · Advait Gosai · Chen Bo Calvin Zhang · Vipul Gupta · Jaehwan Jeong · Anisha Gunjal · Tahseen Rabbani · Maria Mazzone · David Randolph IV · Mohammad Mahmoudi Meymand · Gurshaan Chattha · Paula Rodriguez · Diego A. Mares Buendia · Pavit Singh · Michael Liu · Subodh Chawla · Peter Cline · Lucy Ogaz · Ernesto Gabriel Hernández Montoya · Zihao Wang · Pavi Bhatter · Marcos Ayestaran · Bing Liu · Yunzhong He
Frontier model progress is often measured using academic benchmarks that provide a limited view of performance on open-ended, economically consequential tasks in high-stakes professional domains where practical returns matter most. We introduce Professional Reasoning Bench (PRBench), a realistic,...