LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
Xu Ouyang · Deyi Liu · Yuhang Cai · Jing Liu · Yuan Yang · Chen Zheng · Thomas Hartvigsen · Yiyuan Ma
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Xu Ouyang · Deyi Liu · Yuhang Cai · Jing Liu · Yuan Yang · Chen Zheng · Thomas Hartvigsen · Yiyuan Ma
Medhasweta Sen · Zachary Gottesman · Jiaxing Qiu · C. Bayan Bruss · Nam Nguyen · Thomas Hartvigsen
Jiaxing Qiu · Kaihua Hou · Roxana Daneshjou · Ahmed Alaa · Thomas Hartvigsen
Mingtian Tan · Mike A Merrill · Zachary Gottesman · Tim Althoff · David Evans · Thomas Hartvigsen
A common goal in analyzing time series data is to understand how events cause observed variations. We study whether Large Language Models (LLMs) can infer natural language events associated with time series data.We introduce an automated method for generating tasks that test a model’s ability to...
Bryan R Christ · Penelope Molitz · Beau LeBlond · Zachary Gottesman · Jonathan Kropko · Thomas Hartvigsen
Math word problems (MWPs) are critical K-12 educational tools, and customizing them to students’ interests and ability levels can enhance learning. However, teachers struggle to find time to customize MWPs for students given large class sizes and increasing burnout. We propose that LLMs can suppo...
Yash Kumar Atri · Steven L. Johnson · Thomas Hartvigsen
Language models are increasingly deployed in interactive settings where users reason about facts over time rather than in isolation.In such scenarios, correct behavior requires models to maintain and update implicit temporal assumptions established earlier in a conversation. We study this challen...
Soham Dan · Himanshu Beniwal · Thomas Hartvigsen
Large language models (LLMs) are transforming natural language processing across diverse linguistic communities. However, they can reproduce and amplify toxic content, including hate speech, harassment, and bias, posing significant risks to multilingual applications. We provide the first comprehe...
Jiaxing Qiu · Dongliang Guo · Brynne Sullivan · Teague R. Henry · Thomas Hartvigsen