paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
BX

Bokai Xu

COLM 2026CVPR 2026多模态推理数据与预训练效率与系统长上下文与架构
新星分贡献者
51
一作贡献0
核心/参与17
方向广度13
合作网络9
0 一作 · 2 篇 · COLM 2026 / CVPR 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
作者位次 #2/7COLM 2026Poster· Poster Session 3· Imperial Ballroom· #44

Liberating LLM Capabilities in Full-Duplex Speech Models

Luoyuan Zhang · Bokai Xu · Junbo Cui · Weiyue Sun · Yingjing Xu · Hanyu Liu · Yuan Yao

LWS: a tri-channel full-duplex speech LLM that listens, writes visible text, and speaks simultaneously

摘要

Speech-based large language models are typically constrained to spoken replies, which limits their user-facing outputs to what can be verbalized and suppresses text-native capabilities such as code generation, structured analysis, and multi-step reasoning in realtime interaction, for tasks that require persistent, structured, and inspectable intermediate outputs. Existing work improves spoken reasoning or full-duplex turn-taking, but still treats text as a hidden intermediate state or a subordinate modality rather than a first-class output channel. We propose Listen-Write-Speak (LWS), a text-first tri-channel paradigm in which a single autoregressive LLM continuously listens to user audio, writes visible free-form text as its primary output, and speaks a realtime oral response in parallel under a shared causal attention context. This behavior is implemented entirely through a Token Schema, requiring no architectural modifications, and trained with a two-stage data pipeline that synthesizes per-second cognitive annotations consistent with the revealed input timeline. Empirically, LWS demonstrates strong full-duplex interaction on Full-Duplex-Bench, reaches 4.72 on VoiceBench AlpacaEval, achieves 92.6\% writing--speaking consistency, and consistently outperforms its internal ablations on URO-Bench. These results suggest that visible writing can serve as a first-class output channel for speech interaction without sacrificing realtime responsiveness. The code, dataset, and demo are available on the project page: https://royalzhang.com/project/lws-page/.

多模态推理数据与预训练speech language modelfull-duplex interactionmultimodal LLMOpenReview
作者位次 #11/34CVPR 2026Poster· Computer Vision & Pattern Recognition

MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe

Tianyu Yu · Zefan Wang · Chongyi Wang · Fuwei Huang · Wenshuo Ma · Zhihui He · Tianchi Cai · Weize Chen · Yuxiang Huang · Ranchi Zhao · Bokai Xu · Junbo Cui · Yingjing Xu · Liqing Ruan · Luoyuan Zhang · Hanyu Liu · Jingkun Tang · Hongyuan Liu · Qining Guo · Wenhao Hu · Bingxiang He · Jie Zhou · Jie Cai · Ji Qi · Zonghao Guo · Chi Chen · Guoyang Zeng · Yuxuan Li · Ganqu Cui · Ning Ding · Xu Han · Yuan Yao · Zhiyuan Liu · Maosong Sun

多模态效率与系统长上下文与架构OpenReview 项目页

常见合作者