Intrinsic Entropy of Context Length Scaling in LLMs
Jingzhe Shi · Qinwei (Martin) Ma · Hongyi Liu · Hang Zhao · Jenq-Neng Hwang · Lei Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Jingzhe Shi · Qinwei (Martin) Ma · Hongyi Liu · Hang Zhao · Jenq-Neng Hwang · Lei Li
Sen Jia · Huayu Wang · Hsiang-Wei Huang · Zhaochong An · Jenq-Neng Hwang · Zhang Huaping · Lei Li
Sen Jia · Ning Zhu · Jinqin Zhong · Jiale Zhou · Zhang Huaping · Jenq-Neng Hwang · Lei Li
Yunchuan Guan · Yu Liu · Ke Zhou · Zhiqi Shen · Jenq-Neng Hwang · Lei Li
Hao Yang · Qinghua Zhao · Lei Li · Lingyi Meng · Mengda Yu
Chain-of-Thought (CoT) prompting significantly enhances model reasoning, yet its internal mechanisms remain poorly understood. We analyze CoT’s operational principles by reversely tracing information flow across decoding, projection, and activation phases. Our quantitative analysis suggests that...
Haoliang Liu · Chengkun Cai · Xu Zhao · Han Zhu · Shizhou Huang · Xinglin Zhang · Tao Chen · Jenq-Neng Hwang · Zhang Huaping · Lei Li
Existing information extraction (IE) tasks increasingly adopt in-context learning (ICL) with large language models. However, current approaches either show inconsistent performance across model scales or lack systematic optimization and generalizability. Building on this, we propose BCL-IE (Bayes...
Lei Li · Sen Jia · Jenq-Neng Hwang