作者位次 #2/4ACL 2026Poster· Natural Language Processing
AV -Dialog: Spoken Dialogue Models with Audio-Visual Input
Tuochao Chen · Bandhav Veluri · Hongyu Gong · Shyamnath Gollakota
摘要
Dialogue models falter in noisy, multi-speaker environments, often producing irrelevant responses and awkward turn-taking. We present AV-Dialog, the first multimodal dialog framework that uses both audio and visual cues to track the target speaker, predict turn-taking, and generate coherent respo...