作者位次 #4/9ACL 2026Poster· Natural Language Processing
E fficient LLM : Unified Pruning-Aware Pretraining for Auto-Designed Compact Language Models
Xingrun Xing · Zheng Liu · Shitao Xiao · Boyan Gao · Yiming Liang · Haokun Lin · Xianlin Zeng · Guoqi Li · Jiajun Zhang
摘要
Modern large language models (LLMs) driven by scaling laws achieve emergent intelligence in large model sizes. Recently, the increasing concerns about cloud costs, latency and privacy make it an urgent requirement to develop compact edge language models. Distinguished from direct pretraining that...