FRABench and UFEval: Unified Fine-grained Evaluation with Task and Aspect Generalization
Shibo Hong · jiahao ying · Haiyuan Liang · Mengdi Zhang · Jun Kuang · Jiazheng Zhang · Yixin Cao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Shibo Hong · jiahao ying · Haiyuan Liang · Mengdi Zhang · Jun Kuang · Jiazheng Zhang · Yixin Cao
Yuhang Zhou · Xutian Chen · Yixin Cao · Yuchen Ni · Yu He · Siyu Tian · Xiang Liu · Yunwen Chen · Guangnan Ye · Xipeng Qiu · Hongfeng Chai
Kai Xiong · Xiao Ding · Yixin Cao · Li Du · jiahao ying · yang zhao · Bing Qin · Ting Liu
Tao He · Rongchuan Mu · Lizi Liao · Yixin Cao · Yang Li · Yijia Luo · Weixun Wang · Ming Liu · Bing Qin
Zhongyuan Peng · Yifan Yao · Kaijing Ma · Shuyue Guo · Yizhe Li · Yichi Zhang · Chenchen Zhang · Yifan Zhang · Zhouliang Yu · Luming Li · Minghao Liu · Yihang Xia · JIAWEI SHEN · Yuchen Wu · Yixin Cao · Zhaoxiang Zhang · Wenhao Huang · JIAHENG LIU · Ge Zhang
Translating natural language mathematical statements into formal, executable code is a fundamental challenge in automated theorem proving. While prior work has focused on generation and compilation success, little attention has been paid to the critic phase—the evaluation of whether generated for...
Yuhang Zhou · Yixin Cao · Yuchen Ni · Shihan Dou · Xutian Chen · Ge Zhang · Xiang Liu · Guangnan Ye
Standard evaluators, such as reward models, compress diverse human judgments into a single scalar, conflating valid Subjective Preference with Cognitive Uncertainty. This structural mismatch often leads to brittle alignment and reward hacking. To address this, we propose PRISM which reinterprets...
Zeping Li · Hongru WANG · Yiwen Zhao · Guanhua Chen · Yixia Li · Keyang Chen · Yixin Cao · Guangnan Ye · Hongfeng Chai · Zhenfei Yin
Tool-using agents based on Large Language Models (LLMs) excel in tasks such as mathematical reasoning and multi-hop question answering. However, in long trajectories, agents often trigger excessive and low-quality tool calls, increasing latency and degrading inference performance, making managing...
Caijun Xu · Changyi Xiao · Zhongyuan Peng · Xinrun Wang · Yixin Cao
Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often slows when task difficulty becomes poorly aligned with mode...
Chenkang · Fan Yu · Junjie Nian · Sihan Zhao · Zhuoka Feng · Zijun Yao · Wang Heng · Yu Minshen · Yixin Cao
Scaling test-time compute via Long Chain-of-Thought (Long-CoT) significantly enhances reasoning capabilities, yet extended generation does not guarantee correctness: after an early wrong commitment, models may keep elaborating a self-consistent but incorrect prefix. Through fine-grained trajector...