PuzzleMoE: Efficient Compression of Large Mixture-of-Experts Models via Sparse Expert Merging and Bit-packed inference
Yushu Zhao · Zheng Wang · Minjia Zhang
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yushu Zhao · Zheng Wang · Minjia Zhang
Shuzheng Si · Haozhe Zhao · Kangyang Luo · Gang Chen · Fanchao Qi · Minjia Zhang · Baobao Chang · Maosong Sun
Agents based on large language models (LLMs) struggle with brainless trial-and-error and generating hallucinatory actions due to a lack of global planning in long-horizon tasks. In this paper, we introduce a plan-and-execute framework and propose EAGLET, an efficient and effective planner trainin...
Shuzheng Si · Qingyi Wang · Haozhe Zhao · Yuzhuo Bai · Guanqiao Chen · Kangyang Luo · Gang Chen · Fanchao Qi · Minjia Zhang · Baobao Chang · Maosong Sun
Recognizing whether outputs from large language models (LLMs) contain faithfulness hallucination is crucial for real-world applications, e.g., retrieval-augmented generation and summarization. In this paper, we introduce FaithLens, a cost-efficient and effective faithfulness hallucination detecti...
Zhixiang Liang · Beichen Huang · Zheng Wang · Minjia Zhang
Large Language Models (LLMs) can enhance reasoning capabilities through test-time scaling by generating multiple traces. However, the combination of lengthy reasoning traces with multiple sampling introduces substantial computation and high end-to-end latency. Prior work on accelerating this proc...
Haozhe Zhao · Zefan Cai · Shuzheng Si · Liang Chen · Jiuxiang Gu · Wen Xiao · Minjia Zhang · Junjie Hu
Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation. To address these limitations, we propose MENTOR, an autoregressive (AR) framework with a two-sta...
Yixiang Yao · Yuhang Yao · Xinyi Fan · Jiechao Gao · Jie Wang · Minjia Zhang · Srivatsan Ravi · Carlee Joe-Wong
Shuzheng Si · Haozhe Zhao · Cheng Gao · Yuzhuo Bai · Zhitong Wang · Bofei Gao · Kangyang Luo · Wenhao Li · Yufei Huang · Gang Chen · Fanchao Qi · Minjia Zhang · Baobao Chang · Maosong Sun