paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
TA

Tal August

COLM 2026社会与人本可解释性评测与基准
新星分贡献者
22
一作贡献0
核心/参与5
方向广度6
合作网络3
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #5/6COLM 2026Poster· Poster Session 5· Grand Ballroom· #140

SocialVeil: Probing Social Intelligence of Language Agents under Communication Barriers

Keyang Xuan · Pengda Wang · Chongrui Ye · Haofei Yu · Tal August · Jiaxuan You

We propose a social learning environment that can probe agent social interaction performance under communication barrier scenarios

摘要

Large language models (LLMs) are increasingly evaluated in interactive environments to test their social intelligence. However, existing benchmarks often assume idealized communication, limiting our ability to diagnose whether LLMs can maintain and repair interactions under non-idealized communication conditions. To close this gap, we present a controlled interactive environment that can simulate social interaction under cognitive-difference-induced communication barriers. Grounded in a systematic literature review, \socialveil introduces three representative types of disruption, \emph{semantic vagueness}, \emph{sociocultural mismatch}, and \emph{emotional interference}. We also introduce two barrier-aware evaluation metrics, \emph{confusion resolution} and \emph{mutual understanding}, to evaluate interaction quality under impaired communication. Experiments across 720 scenarios and four frontier LLMs show that barriers consistently impair performance, with mutual understanding reduced by over 45\% on average, and confusion resolution reduced by nearly 50\%. Human evaluations validate the fidelity of these simulated barriers (ICC$\approx$0.78, Pearson r$\approx$0.80). We further demonstrate that adaptation strategies (Repair Instruction and Interactive learning) only have a modest effect far from barrier-free performance. This work takes a step toward bringing social interaction environments closer to real-world communication, opening opportunities for exploring the social intelligence of LLM agents.

社会与人本可解释性评测与基准Social InteractionAgentSocial intelligenceAlignmentOpenReview

常见合作者