paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
JH

Jing Huang

COLM 2026对齐与偏好可解释性推理
新星分资深
9
一作贡献0
核心/参与0
方向广度6
合作网络3
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #5/5COLM 2026Poster· Poster Session 1· Franciscan C· #97

Do Language Models Consistently Encode the Current Year?

Suze van Adrichem · Aditi Bhaskar · Diyi Yang · Christopher Potts · Jing Huang

We identify two notions of the current year in language models, and find that existing methods fail to refresh both concurrently.

摘要

A consistent concept of the current time is important for temporal reasoning, yet how language models represent the current time is not well understood. We contribute two tasks that probe the current year in conceptually distinct ways: an *associative* task, which infers the current year from verb tense, and a *declarative* task, which directly queries for the current year. Both tasks estimate current years within one year of the post-training data cutoff of instruction-tuned language models. For base models, predictions on the associative task serve as a strong proxy for the pre-training data cutoff, with an average error of only 10 months across 13 models. However, their internal mechanisms diverge: the associative task uses mechanisms similar to factual recall, while the declarative task lacks consistent causal pathways. This divergence poses a challenge for updating the current year in language models. None of prompting, SFT, or weight editing succeed in shifting the associative and declarative years simultaneously. Prompting updates the declarative year (94.6% success across 351 target years) but leaves the associative year nearly unchanged (1.7% success). Year-shifted SFT also fails to shift the associative year, matching the target year in only one of eight models. Weight editing, while effective for both tasks individually, does not generalize across both. Overall, our results show that the current year is not consistently encoded in language models: The associative notion, deeply ingrained in linguistic structures learned in pre-training, uses different causal mechanisms and resists the same modifications that easily shift the declarative notion learned in post-training.

对齐与偏好可解释性推理causal interventionstraining data cutoffrefreshing language modelstemporal alignmentOpenReview

常见合作者