作者位次 #6/9OSDI 2026Oral· Operating Systems & Distributed Systems
OpenTela: Unifying Decentralized Computing Resources for Heterogeneous LLM Serving (Operational Systems)
Xiaozhe Yao · Youhe Jiang · Ilia Badanin · Qinghao Hu · Robert Matthew Smith · Binhang Yuan · Imanol Schlag · Eiko Yoneki · Ana Klimovic
摘要
Large language models (LLMs) are becoming critical to a variety of public services, motivating sovereign AI initiatives that seek to serve models on infrastructure they control. Yet much of this infrastructure is built as HPC clusters optimized for batch jobs rather than interactive, always-on in...