作者位次 #5/6OSDI 2026Oral· Operating Systems & Distributed Systems
Syncopate: Efficient Multi-GPU AI Kernels via Automatic Chunk-Centric Compute-Communication Overlap
Xinwei Qiang · Yue Guan · Zhengding Hu · Keren Zhou · Yufei Ding · Adnan Aziz
摘要
Communication has become a first-order bottleneck in large-scale GPU workloads, and existing distributed compilers address it mainly by overlapping whole compute and communication kernels at the stream level. This coarse granularity incurs extra kernel launches, forces device-wide synchronization...