Compositional-ARC: Assessing Systematic Generalization in Abstract Spatial Reasoning
Philipp Mondorf · Shijia Zhou · Monica Riedler · Barbara Plank
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Philipp Mondorf · Shijia Zhou · Monica Riedler · Barbara Plank
Xinpeng Wang · Nitish Joshi · Barbara Plank · Rico Angell · He He
Verena Blaschke · Miriam Winkler · Barbara Plank
Research on cross-dialectal transfer from a standard to a non-standard dialect variety has typically focused on text data. However, dialects are primarily spoken, and non-standard spellings cause issues in text processing. We compare standard-to-dialect transfer in three settings: text models, sp...
Georg Ahnert · Anna-Carolina Haensch · Barbara Plank · Markus Strohmaier
Many in-silico simulations of human survey responses with large language models (LLMs) focus on generating closed-ended survey responses, whereas LLMs are typically trained to generate open-ended text instead. Previous research has used a diverse range of methods for generating closed-ended surve...
Longfei Zuo · Barbara Plank · Siyao Peng
High-quality datasets are critical for training and evaluating reliable NLP models. In tasks like natural language inference (NLI), human label variation (HLV) arises when multiple labels are valid for the same instance, making it difficult to separate annotation errors from plausible variation....
Ryan Soh-Eun Shim · Kwanghee Choi · Kalvin Chang · Ming-Hao Hsu · Florian Eichin · Zhizheng Wu · Alane Suhr · Michael A. Hedderich · David Harwath · David R. Mortensen · Barbara Plank
Multilingual speech foundation models such as Whisper are trained on web-scale data, where data for each language consists of a myriad of regional varieties. However, different regional varieties often employ different scripts to write the same language, rendering speech recognition output also s...
Alistair Plum · Felicia Körner · Anne-Marie Lutgen · Laura Bernardy · Fred Philippy · Emilia Milano · Nils Rehlinger · Cedric Lothritz · Tharindu Ranasinghe · Barbara Plank · Christoph Purschke
This paper presents ltzGLUE, the first Natural Language Understanding (NLU) benchmark for Luxembourgish (LTZ) based on the popular GLUE benchmark for English. Although NLU tasks are available for many european languages nowadays, LTZ is one of the official national languages that is often overloo...
Beiduo Chen · Tiancheng Hu · Caiqi Zhang · Robert Litschko · Anna Korhonen · Barbara Plank
Reasoning-tuned LLMs utilizing long Chain-of-Thought (CoT) excel at single-answer tasks, yet their ability to model Human Label Variation—which requires capturing probabilistic ambiguity rather than resolving it—remains underexplored. We investigate this through systematic disentanglement experim...
Shanshan Xu · Santosh T.Y.S.S · Barbara Plank
Human Label Variation (HLV) refers to legitimate disagreement in annotation that reflects the diversity of human perspectives rather than mere error. Long treated in NLP as \textit{noise} to be eliminated, HLV has only recently been reframed as a \textit{signal} for improving model robustness. Wi...
Pingjun Hong · Beiduo Chen · Siyao Peng · Marie-Catherine de Marneffe · Benjamin Roth · Barbara Plank
Natural Language Inference (NLI) datasets often exhibit human label variation. To better understand these variations, explanation-based approaches analyze the underlying reasoning behind annotators’ decisions. One such approach is the LiTEx taxonomy, which categorizes free-text explanations in En...