Selective Expert Guidance for Effective and Diverse Exploration in Reinforcement Learning of LLMs
Zishang Jiang · Jinyi Han · tingyun li · Xinyi Wang · Sihang Jiang · Zhaoqian Dai · Ma Shuguang · F. Richard Yu · Jiaqing Liang · Yanghua Xiao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Zishang Jiang · Jinyi Han · tingyun li · Xinyi Wang · Sihang Jiang · Zhaoqian Dai · Ma Shuguang · F. Richard Yu · Jiaqing Liang · Yanghua Xiao
Jinyi Han · Xinyi Wang · Haiquan Zhao · tingyun li · Zishang Jiang · Sihang Jiang · Jiaqing Liang · Xin Lin · Weikang Zhou · Zeye Sun · F. Richard Yu · Yanghua Xiao
Jinyi Han · Ying Huang · Ying Liao · Haiquan Zhao · Zishang Jiang · Xinyi Wang · Xikun Lu · Guanghao Zhou · Sihang Jiang · Jiaqing Liang · Weikang Zhou · Zeye Sun · F. Richard Yu · Yanghua Xiao
Sirui Xia · Aili Chen · Xintao Wang · Tinghui Zhu · Yikai Zhang · Jiangjie Chen · Yanghua Xiao
Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code generation and mathematical reasoning. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates whether LLMs, grounded in locally...
Qingyu Ren · Qianyu He · Powei Chang · Jie Zeng · Zeye Sun · F. Richard Yu · Jiaqing Liang · Yanghua Xiao
Language models often struggle to follow multi-constraint instructions that are crucial for real-world applications. Existing reinforcement learning (RL) approaches suffer from dependency on external supervision and sparse reward signals from multi-constraint tasks. We propose a label-free self-s...
Qianyu He · Junting Lu · Yikai Zhang · Siyu Yuan · Xiaojun Meng · Jiansheng Wei · Jiaqing Liang · Yanghua Xiao
Metaphor reasoning is an essential cognitive ability that maps knowledge from familiar domains to more abstract domains. This ability functions as a meta-ability underlying many types of reasoning. However, existing work rarely investigates how metaphor reasoning affects other reasoning abilities...
Powei Chang · Jin Xiao · Guanglei Yue · Qianyu He · Yanghua Xiao · Deqing Yang · Jiaqing Liang
Quotation recommendation enriches writing by suggesting quotations that fit a given context, but prior systems largely focus on topical relevance and overlook what makes quotes memorable. Based on a user study, we find that preferred quotations are often unexpected yet rational, motivating the go...
Sihang Jiang · Zhiyu Lu · Keyi Wang · Jiaqing Liang · Yanghua Xiao · Xiaojun Meng · Jiansheng Wei
While extensive research has evaluated LLMs on complex reasoning tasks, the foundational building blocks of logical reasoning remain underexplored. We introduce IIBench, a benchmark evaluating immediate inference (elementary operations over categorical propositions). Our evaluation reveals that e...
Yilun Liu · Chunguang Zhao · Mengyao Piao · Lingqi Miao · Shimin Tao · Minggui HE · Chenxin Liu · Li Zhang · Mahongxia · Jiaxin Guo · Chen Liu · Liqun Deng · Jiansheng Wei · Xiaojun Meng · Fanyi Du · Daimeng Wei · Yanghua Xiao
Evaluating the multilingual and multicultural capabilities of Large Language Models (LLMs) is essential for their global utility. However, current benchmarks face three critical limitations: (1) fragmented evaluation dimensions that often neglect deep cultural nuances; (2) insufficient language c...
Jin Liu · Yunpeng Liu · Keyi Wang · Jie Shi · Xiao Xu · Wenkang Huang · Xingzhong Xu · Xin Liang · Yanghua Xiao
Insurance claims adjudication demands not only accurate decisions but also interpretable reasoning grounded in policy clauses. However, existing benchmarks are limited to information retrieval or simple multiple-choice setups, which fail to require step-by-step inferences from facts to conclusion...
Ziheng Li · Liu Kang · Feng Xiao · Luxi Xing · Qingyi Si · Zhuoran Li · Weikang Gong · Deqing Yang · Yanghua Xiao · Hongcheng Guo
Group Relative Policy Optimization (GRPO) has emerged as a promising critic-free reinforcement learning paradigm for reasoning tasks. However, standard GRPO employs a coarse-grained credit assignment mechanism that propagates group-level rewards uniformly to to every token in a sequence, neglecti...
Ying He · Sihang Jiang · Xingzhou Chen · Zhouhong Gu · Yiwei Gu · Minggui HE · Shimin Tao · Mahongxia · Yanghua Xiao
Cultural taboo safety is essential for deploying large language models (LLMs), as culturally insensitive outputs may cause offense or even social harm. However, existing cultural benchmarks primarily assess cultural knowledge or values biases, while overlooking whether LLMs can recognize and resp...
Xintao Wang · Jian Yang · Weiyuan Li · Rui Xie · Jen-Tse Huang · Jun Gao · Shuai Huang · Yueping Kang · Yuanli Guo · Hongwei Feng · Yanghua Xiao
Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment with human cognitive and behavioral patterns remains a cri...
tingyun li · Zishang Jiang · Jinyi Han · Xinyi Wang · Sihang Jiang · Han Xia · Zhaoqian Dai · Ma Shuguang · F. Richard Yu · Jiaqing Liang · Yanghua Xiao
Large reasoning models rely on long chain-of-thought to achieve strong performance, but applying such reasoning uniformly incurs high computational cost. Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability. We identify the ro...
Xinyi Wang · Jinyi Han · Zishang Jiang · tingyun li · Jiaqing Liang · Sihang Jiang · Zhaoqian Dai · Ma Shuguang · F. Richard Yu · Yanghua Xiao
Reinforcement learning (RL) has emerged as a key approach for improving long chain-of-thought (CoT) reasoning in large language models (LLMs). However, existing methods such as GRPO often break down when task difficulty exceeds the model’s capacity, resulting in sparse rewards and inefficient tra...
Xinyu Liu · Kai fu · Yinghan Shi · Quanyou Chu · Ming Du · Hongya Wang · Xiaojun Meng · Jiansheng Wei · Yanghua Xiao · Bo Xu
Multimodal Named Entity Recognition relies on visual context to resolve textual ambiguities. To mitigate data scarcity, Data Augmentation (DA) has become a standard practice; however, existing methods predominantly adopt a one-size-fits-all and random perturbation paradigm, ignoring the internal...
Chengyu Du · Xintao Wang · Aili Chen · Weiyuan Li · Rui Xu · Junteng Liu · Zishan Huang · Rong Tian · Zijun Sun · Yuhao Li · Liheng Feng · Deming Ding · Pengyu Zhao · Yanghua Xiao
LLM role-playing, i.e., using large language models (LLMs) to simulate specific personas, has emerged as a key capability in various applications, such as companionship, content creation, and digital games. While current models effectively capture character tones and knowledge, simulating the inn...
Ying He · Zhouhong Gu · Zhecheng Hu · Yubo Zhou · Hao Shen · Jiaqing Liang · Zhaoqian Dai · Ma Shuguang · F. Richard Yu · Yanghua Xiao · Zhixu Li
Ensuring the accuracy of financial documents is critical for economic analysis, regulatory compliance, and corporate decision-making. Several studies have shown that Large Language Models (LLMs) perform well in many financial tasks, such as stock price movements and financial analytics. However,...
Haoyu Wang · Sihang Jiang · Yuyan Chen · Yitong Wang · Xiaojun Meng · Jiansheng Wei · Yanghua Xiao
Curiosity serves as a fundamental construct in human cognition.Inspired by curiosity, reinforcement learning with intrinsic rewards for large language models (LLMs) has shown substantial potential.However, it remains unclear whether existing curiosity-driven methods genuinely reflect curiosity-li...
Haoyu Wang · Sihang Jiang · Xiangru Zhu · Yuyan Chen · Xiaojun Meng · Jiansheng Wei · Yitong Wang · Yanghua Xiao
Yuanyi Xu · Xiangru Zhu · Sihang Jiang · Zhixu Li · Bei Yang · Xiaoxiao Xu · Yanghua Xiao · Wei Wang
Cui Danxin · Sihang Jiang · Keyi Wang · Zhiyi Duan · Yanghua Xiao · Bi Yude · Jiaqing Liang · Minggui HE · Shimin Tao · Yilun Liu
Zishang Jiang · Jinyi Han · tingyun li · Xinyi Wang · Sihang Jiang · Xiaojun Meng · Jiansheng Wei · Jiaqing Liang · Yanghua Xiao