InfLLM-V2: Dense-Sparse Switchable Attention for Seamless Short-to-Long Adaptation
Weilin Zhao · Zihan Zhou · Zhou su · Chaojun Xiao · Yuxuan Li · Yanghao Li · Yudi Zhang · Weilun Zhao · Zhen Li · Yuxiang Huang · Ao Sun · Xu Han · Zhiyuan Liu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Weilin Zhao · Zihan Zhou · Zhou su · Chaojun Xiao · Yuxuan Li · Yanghao Li · Yudi Zhang · Weilun Zhao · Zhen Li · Yuxiang Huang · Ao Sun · Xu Han · Zhiyuan Liu
Tianyu Yu · Zefan Wang · Chongyi Wang · Fuwei Huang · Wenshuo Ma · Zhihui He · Tianchi Cai · Weize Chen · Yuxiang Huang · Ranchi Zhao · Bokai Xu · Junbo Cui · Yingjing Xu · Liqing Ruan · Luoyuan Zhang · Hanyu Liu · Jingkun Tang · Hongyuan Liu · Qining Guo · Wenhao Hu · Bingxiang He · Jie Zhou · Jie Cai · Ji Qi · Zonghao Guo · Chi Chen · Guoyang Zeng · Yuxuan Li · Ganqu Cui · Ning Ding · Xu Han · Yuan Yao · Zhiyuan Liu · Maosong Sun
Yuxiang Huang · Mingye Li · Xu Han · Chaojun Xiao · Weilin Zhao · Ao Sun · Ziqi Yuan · Hao Zhou · Fandong Meng · Zhiyuan Liu
The efficiency of long-video inference remains a critical bottleneck, mainly due to the dense computation in the prefill stage of Large Multimodal Models (LMMs). Existing methods either compress visual embeddings or apply sparse attention on a single GPU, yielding limited acceleration or degraded...
Xuanle Zhao · Zilin Sang · Yuxuan Li · Qi Shi · Weilun Zhao · Shuo Wang · Duzhen Zhang · Xu Han · Zhiyuan Liu · Maosong Sun
Efficient reproduction of research papers is pivotal to accelerating scientific progress. However, the increasing complexity of proposed methods often renders reproduction a labor-intensive endeavor, necessitating profound domain expertise.To address this, we introduce the paper lineage, which sy...
Dingling Xu · Ruobing Wang · Qingfei Zhao · Yukun Yan · Zhichun Wang · Daren Zha · Shi Yu · Zhenghao Liu · Shuo Wang · Xu Han · Maosong Sun
Reasoning Language Models (RLMs) have significantly improved performance on complex tasks by extending the reasoning chain. However, these chains are prone to containing factual errors, particularly in knowledge-intensive tasks. To address this issue, we propose CheckRLM , a framework that improv...
Yuzhuang Xu · Xu Han · Yuxuan Li · Wanxiang Che
Although existing frameworks for large language model (LLM) inference on CPUs are mature, they fail to fully exploit the computational potential of many-core CPU platforms. Many-core CPUs are widely deployed in web servers and high-end networking devices, and are typically organized into multiple...
Xingyu Shen · Yingfa Chen · Zhen Leng Thai · Xu Han · Zhiyuan Liu · Maosong Sun
Recurrent neural networks (RNNs), such as linear attention and state-space models, have gained popularity due to their constant per-token complexity when processing long contexts. However, these recurrent models struggle with tasks that require accurate recall of contextual information from long...
ShangZhan Li · Xinyu Yin · Xuanyu Jin · Ye He · Yuxin Zhou · Yuxuan Li · Xu Han · Wanxiang Che · Qi Shi · Ting Liu · Maosong Sun
Vectorization via Single Instruction, Multiple Data (SIMD) architectures is a cornerstone of high-performance computing. To fully exploit hardware potential, developers often resort to explicit vectorization using intrinsics, as compiler-based auto-vectorization frequently yields suboptimal resul...
Tao Wen · Shuai Shao · Pei Ke · Xu Han · Jie Zou · Guannan Li · Tao Tian · Jinjie Qiu · Lan Wang · KE QIN
Event analysis is an essential and fundamental direction of information extraction, involving various event-centric tasks at different granularity of documents. While large language models (LLMs) have preliminarily achieved promising performance in part of these tasks individually, their capabili...
Yuzhuang Xu · Xu Han · Yuanchi Zhang · Yixuan Wang · Yijun Liu · Shiyu Ji · Qingfu Zhu · Wanxiang Che