paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
ZZ

Zihao Zhu

COLM 2026×2ICML 2026推理评测与基准理论与学习动力学检索与知识社会与人本
新星分新星
73
一作贡献30
核心/参与17
方向广度13
合作网络12
1 一作 · 3 篇 · COLM 2026 / ICML 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

3
作者位次 #3/11COLM 2026Poster· Poster Session 1· Grand Ballroom· #112

A Statistical Framework for Auditing Behavioral Dependence and Induced Bias in LLM Judges

Chenchen Kuai · Jiwan Jiang · Zihao Zhu · Hao Wang · Keshu Wu · Zihao Li · Yunlong Zhang · Chenxi Liu · Zhengzhong Tu · Zhiwen Fan · Yang Zhou

Agreement among LLMs is often driven by latent behavioral entanglement, leading to systematic bias in multi-LLM-as-a-judge evaluation.

摘要

The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral dependencies, latent entanglement, that undermine multi-model systems such as LLM-as-a-judge pipelines and ensemble verification, which implicitly assume independent signals. In practice, this manifests as correlated reasoning patterns and synchronized failures, where apparent agreement reflects shared error modes rather than independent validation. To address this, we develop a statistical framework for auditing behavioral entanglement among black-box LLMs. Our approach introduces a multi-resolution hierarchy that characterizes the joint failure manifold through two information-theoretic metrics: (i) a Difficulty-Weighted Behavioral Entanglement Index (BEI), which amplifies synchronized failures on easy tasks, and (ii) a Cumulative Information Gain (CIG) metric, which captures directional alignment in erroneous responses. Through experiments on 18 LLMs from six model families, we identify statistically significant behavioral entanglement. Such behavioral dependence is associated with judge over-endorsement bias on a disjoint MMLU-Pro evaluation set ($\rho=0.508$ for BEI and $\rho=0.520$ for CIG; $p<0.01$). The association further transfers to the MATH-500 benchmark ($\rho=0.441$ for BEI and $\rho=0.457$ for CIG; $p<0.05$), providing cross-benchmark evidence that the identified dependency structure generalizes beyond the data and response format used for its estimation. Finally, we demonstrate a practical use case of entanglement through de-entangled verifier ensemble reweighting, achieving 3.5 and 2.6 percentage-point gains in accuracy and precision, respectively, over majority voting.

评测与基准推理理论与学习动力学LLM-as-a-JudgeEvaluation BiasBehavioral EntanglementModel IndependenceOpenReview
作者位次 #2/7COLM 2026Poster· Poster Session 6· Imperial Ballroom· #35

Can Induced Emotion Bias LLM Behaviors in Sequential Decision Making?

Minh Khoi Ho · Zihao Zhu · Runchuan Zhu · Levina Li · Zhiwen Fan · Zhangyang Wang · Junyuan Hong

We show that non-adversarial emotion induction does not stop LLM Agents from learning in the Iowa Gambling Task, but can change early decisions under biased information.

摘要

As Large Language Models (LLMs) are increasingly deployed as autonomous agents in high-stakes domains, understanding contextual factors that may modulate their decision-making becomes critical. While LLMs are trained to perceive and resonate with users' emotions, it remains unclear whether induced emotion can influence their sequential decision-making. We investigate this question using the Iowa Gambling Task (IGT), a classic psychological paradigm for studying decision-making under uncertainty, combined with an imagination-based emotion induction procedure. We first validate the feasibility of this paradigm by confirming that LLMs can sense strong, distinguishable emotions from context and that LLM agents can learn from sequential interactions in a human-like pace. With the validated setup, we find that, different from humans, induced emotion does not significantly bias the decision dynamics of LLM agents on average. However, the effects of anger are conditioned: inducing anger makes LLM agents less sensitive to penalties for bad decisions, and in early stages of the game, anger can lower exploration, locking decisions into a few choices early. These findings reveal the subtle yet distinct effects of induced emotion on LLM decision-making compared to human behavior, and provide a tool for future research on affective modulation of LLM agents.

检索与知识社会与人本推理large language modelssequential decision-makingemotion inductionIowa Gambling TaskOpenReview 项目页

常见合作者