Student-Centered Distillation Narrows the Agentic Gap Between Small and Large LLMs
Yuanjie Lyu · Chengyu Wang · Jun Huang · an Jiaotong University)
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yuanjie Lyu · Chengyu Wang · Jun Huang · an Jiaotong University)
Taolin Zhang · Dongyang Li · Chen Chen · Qizhou Chen · Jiuheng Wan · Xiaofeng He · Chengyu Wang · Richang Hong
Despite substantial advances in large language models (LLMs), producing factually consistent responses for knowledge-intensive question answering remains challenging. These difficulties are primarily due to hallucination and the limitations of LLMs in bridging long-tail knowledge gaps. To address...
Taolin Zhang · Pukun Zhao · Qizhou Chen · Jiuheng Wan · Chen Chen · Xiaofeng He · Chengyu Wang · Richang Hong
Recent advancements in LLM-based multi-agent systems have demonstrated remarkable collaborative capabilities across complex tasks. To enhance the overall efficiency, existing methods often rely on aggressive graph topology evolution for agents (e.g., node or edge pruning), which risks prematurely...
Wenrui Cai · Chengyu Wang · Junbing Yan · Jun Huang · Xiangzhong Fang
Tasks such as mathematical problem solving and coding require models to leverage chain-of-thought (CoT) processes, enabling human-like reasoning strategies. However, the advancement of large reasoning models (LRMs) is hindered by the lack of comprehensive CoT datasets. Existing resources often fa...
Yuanjie Lyu · Chengyu Wang · Lei Shen · Jun Huang · an Jiaotong University)
Small LLMs often struggle to match the agentic capabilities of large, costly models. While reinforcement learning can help, progress has been limited by two structural bottlenecks: existing open-source agentic training data are narrow in task variety and easily solved; real-world APIs lack divers...
Yuanjie Lyu · Chengyu Wang · Haonan Zheng · Yuanhao Yue · Junbing Yan · Ming Wang · Jun Huang
Modern industrial applications increasingly demand language models that act as agents, capable of multi-step reasoning and tool use in real-world settings. These tasks are typically performed under strict cost and latency constraints, making small agentic models highly desirable. In this paper, w...
Taolin Zhang · Haidong Kang · Dongyang Li · Qizhou Chen · Xiaofeng He · Chengyu Wang · Richang Hong
Recently, large language models (LLMs) have demonstrated impressive performance but still suffer from hallucinations. Model editing has been proposed as a means to correct factual inaccuracies. A challenging scenario is sequential model editing (SME), which aims to rectify errors continuously, ra...
Chuan Li · Ye Lyu · Chengyu Wang · Mingyuan Fan · Cen Chen
Despite the advanced capabilities of Large Language Models (LLMs), training specialized reasoning models for the medical domain remains a significant challenge due to the scarcity of high-quality, large-scale Chain-of-Thought (CoT) data. Moreover, the intermediate reasoning steps in teacher-gener...
Lei Shen · Chengyu Wang · Yuanjie Lyu · Yuanhao Yue · Jun Huang · Zhongmin Cai
Tongtong Su · Chengyu Wang · Haipeng Liao · Jun Huang · Dongming Lu