paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
TL

Tong Liu

COLM 2026安全可解释性智能体与工具
新星分贡献者
27
一作贡献0
核心/参与5
方向广度6
合作网络6
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #6/11COLM 2026Poster· Poster Session 1· Imperial Ballroom· #70

Deep Research Agents Bring Deeper Harm

Shuo Chen · Zonggen Li · Xingyu Jin · Zhen Han · Bailan He · Tong Liu · Haokun Chen · Georg Groh · Philip Torr · Volker Tresp · Jindong Gu

We find that Deep Research agents can bring deeper harm and provide deep analysis as well as two novel jailbreak methods to red-team DR agents.

摘要

We reveal that Deep Research (DR) agents systematically expose safety risks: simply submitting harmful queries that a standalone LLM would reject outright can elicit detailed and dangerous reports from DR agents. Empirical analysis reveals that the advantages that make DR agents powerful unintentionally make them vulnerable: both the research role assignment (e.g., `Planner') and the multi-step execution mechanism weaken alignment of the base LLM, leading to severe safety breaches. Through linear probe analysis of internal hidden states, we demonstrate that role assignment suppresses refusal awareness by shifting representations away from safety boundaries. Besides, multi-step execution distributes harmfulness across individual steps, preventing alignment mechanisms from being activated throughout the research process. Exploiting these vulnerabilities, we design Intent Hijack (i.e., rephrasing harmful queries as academic research) and Plan Injection (i.e., manipulating execution plans) to further examine the safety risks of DR agents. Extensive experiments show that our methods achieve near-perfect compliance and elicit detailed, actionable reports that significantly exceed standalone LLM outputs in technical depth and applicability. These results demonstrate fundamental misalignment in DR agents and underscore the urgent need for tailored alignment techniques.

安全可解释性智能体与工具Deep Research AgentsRed-TeamingAgentsOpenReview

常见合作者