M o E Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Free
Yishu Lei · Shuwei He · Hu Jing · Dan Zhang · Xianlong Luo · Danxiang Zhu · Shikun Feng · Rui Liu · Jingzhou HE · YU SUN · hua wu · Haifeng Wang
摘要
Extending the input modality of Large Language Models (LLMs) to the audio domain is essential for achieving comprehensive multimodal perception. However, it is well-known that acoustic information is intrinsically heterogeneous, entangling attributes such as speech, music, and environmental conte...