作者位次 #5/18ACL 2026Poster· Natural Language Processing
Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception
Zhen Wan · Chao-Han Huck Yang · Jinchuan Tian · Hanrong Ye · Ankita Pasad · Szu-Wei Fu · Arushi Goel · Ryo Hachiuma · Shizhe Diao · Kunal Dhawan · Sreyan Ghosh · Yusuke Hirota · Zhehuai Chen · Rafael Valle · Chenhui Chu · Shinji Watanabe · Boris Ginsburg · Yu-Chiang Frank Wang
摘要
We introduce a voice-agentic framework that learns one critical omni-understanding skill: knowing when to trust itself versus when to consult external audio perception. Our work is motivated by a crucial yet counterintuitive finding: naively fine-tuning an omni-model on both speech recognition an...