OmniFit: Bridging Modalities via Layer-Adaptive Token Compression for Omnimodal Large Language Models
Zining Wang · Zhihang Yuan · Yingjie Zhai · Wenshuo Li · Han Shu · Ruihao Gong · Jinyang Guo · Xianglong Liu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Zining Wang · Zhihang Yuan · Yingjie Zhai · Wenshuo Li · Han Shu · Ruihao Gong · Jinyang Guo · Xianglong Liu
Yushi Huang · Zining Wang · Zhihang Yuan · Yifu Ding · Ruihao Gong · Jinyang Guo · Xianglong Liu · Jun Zhang
Jinyang Du · Ruihao Gong · Linghan Ai · Zining Wang · Yunke Peng · Yao Wang · Lei YAN · wxuefei · Yaoyuan Wang · Jinyang Guo · Dahua Lin · Xianglong Liu
Training large language models (LLMs) at 4-bit precision offers substantial efficiency gains but remains challenging due to the limited dynamic range and coarse numerical resolution. Existing 4-bit training pipelines typically rely on max-scaling, which is ill-suited for heavy-tailed LLM tensor d...