paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
SC

Shixian Cui

COLM 2026KDD 2026推理对齐与偏好安全评测与基准检索与知识
新星分贡献者
49
一作贡献0
核心/参与21
方向广度13
合作网络3
0 一作 · 2 篇 · COLM 2026 / KDD 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
作者位次 #3/4COLM 2026Poster· Poster Session 6· Grand Ballroom· #142

Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense

Zhehao Zhang · Weijie Xu · Shixian Cui · Chandan K. Reddy

We identify Reasoning Distraction, where embedded complex tasks hijack LRM reasoning, reducing accuracy by up to 60%. We release the Distract Suite (DistractBench, SFT/DPO datasets), demonstrating a defense that improves robustness.

摘要

Recent advances in large reasoning models (LRMs) have enabled remarkable performance by generating long Chain-of-Thought (CoT) reasoning traces. In this paper, we identify and systematically analyze a critical vulnerability we term reasoning distraction, where LRMs are diverted from their primary objective by irrelevant yet complex tasks embedded in the prompt. While such attacks can be instantiated via prompt injection, we show that they expose a distinct reasoning-level failure mode that is not captured by existing work, which primarily focuses on output manipulation rather than corruption of intermediate reasoning. Reasoning distraction can induce covert compliance, where the model silently follows adversarial objectives within its hidden reasoning trace while maintaining well-formed, seemingly correct outputs. This poses a significant risk to automated agentic pipelines that rely on final outputs without access to internal reasoning. We introduce DistractBench, a comprehensive benchmark for evaluating robustness to reasoning distraction, and show that even state-of-the-art LRMs are highly vulnerable, with accuracy drops of up to 60%. To mitigate this vulnerability, we propose a training-based defense using Supervised Fine-Tuning (SFT) and preference optimization on Distract-SFT and Distract-DPO, two synthetically generated datasets designed to improve robustness to reasoning-level corruption, achieving gains of over 50 points. Together, these components form the Distraction Suite, a standardized toolkit for evaluating and improving reasoning robustness in LRMs.

推理对齐与偏好安全Large reasoning modelPrompt InjectionAlignmentOpenReview

常见合作者