Tokenisation over Bounded Alphabets is Hard
Violeta Kastreva · Philip Whittington · Dennis Komm · Tiago Pimentel
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Violeta Kastreva · Philip Whittington · Dennis Komm · Tiago Pimentel
Aditya Yadavalli · Tiago Pimentel · Tamar I Regev · Ethan Gotlieb Wilcox · Alex Warstadt
Prosody—the melody of speech—conveys critical information often not captured by the words or text of a message.In this paper, we propose an information-theoretic approach to quantify how much is conveyed by prosody that is not recoverable from text alone, and, crucially, what prosody conveys.Our...
Matteo Boglioni · Andrea Sgobbi · Gabriel Tavernini · Francesco Rita · Marius Mosbach · Tiago Pimentel
A large language model’s (LLM’s) out-of-distribution (OOD) generalisation is crucial to its deployment. Previous work assessing LLMs’ generalisation performance, however, typically focuses on a single out-of-distribution dataset. This approach may fail to precisely evaluate the capabilities of th...