Smooth Reading: Bridging the Gap of Recurrent LLM to Self-Attention LLM on Long-Context Understanding
Kai Liu · Zhan Su · Peijie Dong · Fengran Mo · Jianfei Gao · Shaoting Zhang · Kai Chen
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Kai Liu · Zhan Su · Peijie Dong · Fengran Mo · Jianfei Gao · Shaoting Zhang · Kai Chen
Zhaoxuan Tan · Zixuan Zhang · Haoyang Wen · Zheng Li · Rongzhi Zhang · Pei Chen · Fengran Mo · Zheyuan Liu · Qingkai Zeng · Qingyu Yin · Meng Jiang
Personalized large language models (LLMs) tailor content to individual preferences using user profiles or histories. However, existing parameter-efficient fine-tuning (PEFT) methods, such as the “One-PEFT-Per-User” (OPPU) paradigm, require training a separate adapter for each user, making them co...
Zheyuan Liu · Dongwhi Kim · Yixin Wan · Xiangchi Yuan · Zhaoxuan Tan · Fengran Mo · Meng Jiang
Multimodal large language models (MLLMs) are increasingly deployed as assistants that interact through text and images, making it crucial to evaluate contextual safety when risk depends on both the visual scene and the evolving dialogue. Existing contextual safety benchmarks are mostly single-tur...
Fengran Mo · Yifan Gao · Sha Li · Hansi Zeng · Xin Liu · Zhaoxuan Tan · Xian Li · Jianshu Chen · Dakuo Wang · Meng Jiang
Large Language Models (LLMs) have become a popular interface for human–AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the context-dependent user intent evolves across interactions, requiring...
Rui Qi · Fengran Mo · Yufeng Chen · Xue Zhang · Shuo Wang · Hongliang Li · Xu Jinan · Meng Jiang · Jian-Yun Nie · Kaiyu Huang
Multilingual retrieval-augmented generation (MRAG) requires models to effectively acquire and integrate beneficial external knowledge from multilingual collections. However, most existing studies employ a unitive process where queries of equivalent semantics across different languages are process...
Zhan Su · Xiaoya Chen · Fengran Mo · Ida L. Vos · Prayag Tiwari · Yazhou Zhang · Qian Zheng · Natália da Silva Perez
Historical newspapers from the colonial period offer valuable evidence of how racializing language evolved over time. However, there are challenges in studying this type of historical data: 1) Data scarcity: acquiring large, annotated historical datasets is difficult, hindering the possibility of...
Xinyue Lou · Xu Jinan · Jingyi Yin · Xiaolong Wang · Zhaolu Kang · Liaoyouwei · Yixuan Wang · Xiangyu Shi · Fengran Mo · SU Yao · Kaiyu Huang
As Multimodal Large Language Models (MLLMs) become an indispensable assistant in human life, the unsafe content generated by MLLMs poses a danger to human behavior, perpetually overhanging human society like a sword of Damocles. To investigate and evaluate the safety impact of MLLMs responses on...
Chen Xu · Wei Chu · Wenyu Hu · Fengran Mo · Jun Xu · Sebastian Schelter
Fair re-ranking aims to promote long-tail items and enhance diversity within groups in information retrieval. While previous research on online fairness-aware re-ranking has shown promising outcomes, our comprehensive evaluation of online fair re-ranking methods over 20 settings reveals significa...
Yan Wang · Keyi Wang · Shanshan Yang · Jaisal Patel · Jeff Zhao · Fengran Mo · Xueqing Peng · Lingfei Qian · Yankai Chen · Víctor Gutiérrez-Basulto · Jimin Huang · GUOJUN XIONG · Xiao-Yang Liu · Jian-Yun Nie
Going beyond simple text processing, financial auditing requires detecting semantic, structural, and numerical inconsistencies across large-scale disclosures. As financial reports are filed in XBRL, a structured XML format governed by accounting standards, auditing becomes a structured informatio...
Yongan Yu · Xianda Du · Qingchen Hu · Jiahao Liang · Jingwei Ni · Dan Qiang · Kaiyu Huang · Grant Mckenzie · Renée Sieber · Fengran Mo
Historical news segments on weather events are collections of enduring primary source records that offer rich, untapped narratives of how societies have experienced and responded to extreme weather events. These qualitative accounts provide insights into societal vulnerability and resilience that...
Rui Qi · Fengran Mo · Sijin Lu · Yufeng Chen · Jian-Yun Nie · Kaiyu Huang
A multilingual collection may contain useful knowledge in other languages to supplement and correct the facts in the original language for Retrieval-Augmented Generation (RAG). However, the vanilla approach that simply concatenates multiple pieces of knowledge from different languages into the co...
Yan Wang · Yi Han · Lingfei Qian · Yueru He · Xueqing Peng · Dongji Feng · Zhuohan Xie · Vincent Jim Zhang · Yuqing Guo · Fengran Mo · Jimin Huang · Yankai Chen · Jian-Yun Nie
Most recommendation benchmarks evaluate how well a model imitates user behavior. In financial advisory, however, observed actions can be noisy or short-sighted under market volatility and may conflict with a user's long-term goals. Treating what users chose as the sole ground truth, therefore, co...
Yuxing Tian · Fengran Mo · Zhiqi Huang · Weixu Zhang · Jian-Yun Nie
Large Language Models (LLMs) have recently been explored as fine-grained zero-shot re-rankers by leveraging attention signals to estimate document relevance. However, existing methods either aggregate attention signals across all heads or rely on a statically selected subset identified by heurist...
Jia Ao Sun · Hao Yu · Fabrizio Gotti · Fengran Mo · Yihong Wu · Yuchen Hui · Zhan Su · Lingfeng Xiao · Jian-Yun Nie
Fengran Mo · Jinghan Zhang · Yuchen Hui · Jia Ao Sun · Zhichao Xu · Zhan Su · Jian-Yun Nie