Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts
Shwai He · Weilin Cai · Jiayi Huang · Ang Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Shwai He · Weilin Cai · Jiayi Huang · Ang Li
Yibin Lei · Shwai He · Ang Li · Andrew Yates
Recent work has shown that directly fine-tuning large language models (LLMs) for dense retrieval yields strong performance, but their substantial parameter counts make them computationally inefficient. While prior studies have revealed significant layer redundancy in LLMs for generative tasks, it...
Xinyu Zhao · Kangqi Ni · Jie Peng · Ang Li · Tianlong Chen
Multimodal Large Language Models (MLLMs) show strong potential for cross-modal understanding by integrating powerful language models with multimodal encoders. However, extending MLLMs to handle a diverse range of modalities introduces two critical and intertwined challenges: (1) the reliance on f...
Zhewei Yao · Guoheng Sun · Łukasz Borchmann · Zheyu Shen · Minghang Deng · Bohan Zhai · Hao Zhang · Ang Li · Yuxiong He
Translating natural language into SQL (Text2SQL) is a longstanding challenge at the intersection of natural language understanding and structured data access. While large language models (LLMs) have significantly improved fluency in SQL generation, producing correct and executable SQL, particular...