paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
AS

Ahmad Salimi

COLM 2026NeurIPS 2026评测与基准多模态社会与人本
新星分贡献者
44
一作贡献0
核心/参与17
方向广度9
合作网络6
0 一作 · 2 篇 · COLM 2026 / NeurIPS 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
作者位次 #4/20COLM 2026Poster· Poster Session 4· Franciscan C· #94

Instruct-FD: Can Your Full-Duplex Speech System Follow Turn-Taking Instructions?

Yuzhi Tang · Wentao Ma · Xiling Zhao · Ahmad Salimi · Sepehr Harfi Moridani · Dongming Shen · Jixuan Wang · Abdulrahman Abdulrazzag · Murdock Aubry · Yu-Hua Chen · Daniel Lee · Jaewon Lee · Jonah Mackey · Silin Meng · Nicholas Stranges · Chenxu Xiong · Hao Yu · Yi Zhu · Mu Li · Alex Smola

We introduce Instruct-FD, a benchmark for testing whether full-duplex speech systems can follow explicit turn-taking instructions, and show that even top models (best: 64.4% adherence) still struggle to controllably manage turn-taking behavior.

摘要

Current full-duplex (FD) spoken dialogue systems can produce fluid interactions, yet it remains unclear whether they can adapt their turn-taking behavior when explicitly instructed. This is critical for real-world deployment, where conversational policies vary across applications (e.g., proactive tutoring vs. passive counseling). We introduce Instruct-FD, an instruction-conditioned benchmark for evaluating controllable turn management in FD systems. To enable this, we develop a human-validated, scalable synthetic pipeline that generates instruction-conditioned conversations, along with a deployment-agnostic multi-turn evaluation protocol and an LLM-based judge. Benchmarking six state-of-the-art full-duplex systems reveals a substantial gap in instruction-following turn management: the best model achieves only 64.4\% adherence. Performance is highly uneven across behaviors and scenarios, with proactive behaviors such as model backchanneling and interruption remaining particularly challenging. These findings establish instruction-following turn management as a crucial direction for building adaptable and deployable full-duplex dialogue systems.

评测与基准多模态社会与人本Full-duplex spoken dialogueEvaluationAudioBenchmarkOpenReview

常见合作者