Attend to the Active: Structure-Aware Dynamic Attention in LLMs for Compositional Instruction Following
Fangrui Lv · Yulei Qin · Ruixin Hong · Jian Liang · Jinyang Wu · Ke Li · Xing Sun · Changshui Zhang

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Fangrui Lv · Yulei Qin · Ruixin Hong · Jian Liang · Jinyang Wu · Ke Li · Xing Sun · Changshui Zhang
Ruihan Jin · Pengpeng Shao · Zhengqi Wen · Jinyang Wu · Mingkuan Feng · Shuo Yang · Chu Yuan Zhang · Jianhua Tao
Yang Li · Yuchen Liu · Haoyu Lu · Zhiqiang Xia · Hongzhen Wang · Kaiyang Han · Changpeng Yang · Jinyang Wu · Jiaming Xu · Runyu Shi · Ying Huang
Jinyang Wu · Mingkuan Feng · Shuai Zhang · Feihu Che · Zhengqi Wen · Chonghua Liao · Ling Yang · Haoran Luo · Zheng Lian · Jianhua Tao
In-context learning (ICL) leverages demonstrations to enhance the performance of large language models (LLMs). However, traditional ICL struggles with complex reasoning mainly due to superficial, example-level implicit imitation. To address these limitations, we introduce ThoughtICR , an automate...
Mingkuan Feng · Jinyang Wu · Siyuan Liu · Shuai Zhang · Hongjian Fang · Ruihan Jin · Feihu Che · Pengpeng Shao · Zhengqi Wen · Jianhua Tao
The deployment of large language models (LLMs) is largely hindered by their large number of parameters. Structural pruning has emerged as a promising solution. Prior structured pruning methods directly remove unimportant parameters based on certain metrics, which often causes knowledge loss and n...
Yuhao Shen · Tianyu Liu · Junyi Shen · Jinyang Wu · Quan Kong · Huan Li · Cong Wang
Parallel Speculative Decoding (PSD) accelerates traditional Speculative Decoding (SD) by overlapping draft generation with verification. However, it remains hampered by two fundamental challenges: (1) a theoretical speedup ceiling dictated by the speed ratio between the draft and target models, a...
Jinyang Wu · Shuo Yang · Yuhao Shen · Shuai Zhang · Zhengqi Wen · Jianhua Tao
Reinforcement learning has empowered large language models to act as intelligent agents, yet training them for long-horizon tasks remains challenging due to the scarcity of high-quality trajectories, especially under limited resources. Existing methods typically scale up rollout sizes and indiscr...
Jinyang Wu · Chonghua Liao · Mingkuan Feng · Shuai Zhang · Zhengqi Wen · Haoran Luo · Ling Yang · Huazhe Xu · Jianhua Tao
Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO often rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts that fail to capture transferable problem-solving strategies....
Jinyang Wu · Guocheng Zhai · Ruihan Jin · Jiahao Yuan · Yuhao Shen · Shuai Zhang · Zhengqi Wen · Jianhua Tao
The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a high-dimensional optimization challenge. Existing approa...
Jinyang Wu · Mingkuan Feng · Guocheng Zhai · Shuai Zhang · Zheng Lian · Fangrui Lv · Pengpeng Shao · Ruihan Jin · Zhengqi Wen · Jianhua Tao
Changpeng Yang · Jinyang Wu · Yuchen Liu · Shuai Zhang · Yang Li · Qiliang Liang · Hongzhen Wang · Shuai Nie · Jiaming Xu · Runyu Shi · Ying Huang · Guoquan Zhang