作者位次 #3/8FAST 2026Oral· Storage & File Systems
AdaCheck: An Adaptive Checkpointing System for Efficient LLM Training with Redundancy Utilization
Weijie Liu · Shengwei Li · Zhiquan Lai · Keshi Ge · Qiaoling Chen · Peng Sun · Dongsheng Li · Kai Lu
摘要
The development of large language models (LLMs) relies on sophisticated parallel training techniques, involving prolonged training runs with thousands of workers. Checkpointing systems are essential for handling failures in large-scale training. However, existing checkpointing systems are almost...