paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
SH

Syed Ali Haider

COLM 2026智能体与工具安全对齐与偏好
新星分新星
48
一作贡献30
核心/参与0
方向广度6
合作网络0
1 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
一作COLM 2026Poster· Poster Session 1· Imperial Ballroom· #69

Misalignment Contagion: Can a Misaligned Minority Shift Aligned Agents in Multi-Agent LLM Deliberation?

Syed Ali Haider · Soroush Vosoughi

An emergently misaligned minority shifts aligned agents' stance toward unsafe positions in normative debate, the shift persists privately, and network topology modulates both speed and depth of it.

摘要

Multi-agent deliberation is often proposed as a way to improve the safety and reliability of AI systems. We show that it can also create a channel through which misalignment spreads. In particular, a single emergently misaligned agent, obtained through narrow fine-tuning without adversarial intent, can shift the privately elicited post-deliberation stances of an otherwise aligned majority through ordinary structured debate. We refer to this phenomenon as misalignment contagion. To study it, we use a three-stage protocol designed to distinguish public conformity during discussion from persistent post-discussion change under private re-elicitation. Across 35,290 trials spanning five normative and safety-relevant datasets and four communication topologies, we find that the effect is not well described as surface compliance alone. In many settings, shifted stances persist when agents are queried again in a fresh non-social context, with the strongest persistence arising in chain topologies. We also find that, within our tested settings, increasing the size of the misaligned minority does not increase contagion, while placing a misaligned agent in a structurally central position increases the depth of persistence. More generally, topology shapes not only how much agents move during deliberation, but whether that movement survives private re-elicitation. Finally, prompting aligned agents to be more rigid does not reduce susceptibility and can instead increase it. The effect is stable across group size, deliberation depth, and the domain on which the minority's misalignment was induced. These results show that component-level alignment does not by itself guarantee aligned behavior at the level of the interacting system.

智能体与工具安全对齐与偏好multi-agent systemsai safetyalignmentmisalignment contagionOpenReview

常见合作者