作者位次 #7/11ACL 2026Poster· ACL Industry Track
Unleashing Low-Bit Inference on Ascend NPU s: A Comprehensive Evaluation of H i F loat Formats
Pengxiang Zhao · Hui-Ling Zhen · Xing Li · Han Bao · Weizhe Lin · Zhiyuan Yang · Yu Zi Wei · Xin Wang · Mingxuan Yuan · Xianzhi Yu · Zhenhua Dong
摘要
As LLMs scale, low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency. In this work, we evaluate HiFloat (HiF8 and HiF4), a family of formats tailored for Ascend NPUs. Through rigorous comparison across weight-activation and KV-cache tasks, we prov...