DuetServe: Harmonizing Prefill and Decode for LLM Serving via Adaptive GPU Multiplexing
Lei Gao · Chaoyi Jiang · Hossein Entezari Zarch · Daniel Wong · Mark D. HIll · Murali Annavaram
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Lei Gao · Chaoyi Jiang · Hossein Entezari Zarch · Daniel Wong · Mark D. HIll · Murali Annavaram
Hossein Entezari Zarch · Lei Gao · Chaoyi Jiang · Murali Annavaram
Large reasoning models (LRMs) achieve state-of-the-art performance on challenging benchmarks by generating long chains of intermediate steps, but their inference cost is dominated by decoding, where each new token must attend to the entire growing sequence. One approach to reduce this latency is...
Chaoyi Jiang · Abdulla Alshabanah · Hossein Entezari Zarch · Keshav Balasubramanian · Murali Annavaram
Deep Learning Recommendation Models (DLRMs) have become widely popular for click-through rate (CTR) prediction tasks. These models often rely on embedding tables to enhance their predictive performance. Each row in these tables represents a trainable weight vector associated with a specific featu...