Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions
Yongqi Li · Hao Lang · Tieyun Qian · Yongbin Li
摘要
Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinforcement learning (RL) has been widely explored for adapting MCAs to various human-AI interaction scenarios. Despite showing great enhancement in generaliza...