paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
ZT

Zhen Tan

ICLR 2026×6COLM 2026CVPR 2026推理强化学习与后训练可解释性社会与人本效率与系统
新星分新星
87
一作贡献30
核心/参与56
方向广度16
合作网络12
1 一作 · 8 篇 · ICLR 2026 / COLM 2026 / CVPR 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

8
作者位次 #2/6COLM 2026Poster· Poster Session 5· Grand Ballroom· #137

TRUST: A Crowdsourcing Framework for Auditing Large Language Model Reasoning

Morris Yu-Chao Huang · Zhen Tan · Mohan Zhang · Pingzhi Li · Zhuo Zhang · Tianlong Chen

TRUST is a crowdsourcing auditing framework for large language models reasoning.

摘要

Large Language Models (LLMs) can produce complex reasoning chains, offering a window into their decision-making processes. However, verifying the quality (e.g., faithfulness and correctness) of these intermediate steps is a critical, unsolved challenge. Current auditing methods usually rely on a centralized auditor, either human or verifier model, to inspect full reasoning traces. This paper addresses three key challenges in those methods. **Robustness**: Centralized systems are single points of failure, vulnerable to attacks and systemic bias. **Scalability**: The lengthiness and complexity of reasoning traces create a severe bottleneck for human auditors. **IP confidentiality**: Model providers risk intellectual property theft or model distillation when exposing complete reasoning traces. To overcome these barriers, we introduce TRUST, a crowdsourcing framework for auditing LLM reasoning. TRUST makes the following contributions: *First*, it establishes a consensus mechanism among a diverse set of auditors that removes reliance on any *single trusted auditor*: under the modeled seat-corruption process the trace-level failure bound holds up to a 20% adversarial seat fraction, and empirically TRUST retains 69.0% accuracy with one compromised seat per segment, where centralized baselines collapse to ~20%. *Second*, it introduces a scalable decomposition method that transforms reasoning traces into hierarchical directed acyclic graphs, enabling atomic reasoning steps to be audited in parallel by a crowd of independent auditors. *Third*, the framework limits exposure by distributing only partial segments of the reasoning trace to auditors. We provide theoretical guarantees for the security and economic incentives. Experiments across multiple LLMs (e.g., GPT-OSS, DeepSeek-r1, Qwen) and reasoning tasks (e.g., math, medicine, science, and humanities) demonstrate that TRUST is highly effective at identifying reasoning flaws and is significantly more resilient to corrupted and adversarial auditors than centralized baselines. Our work introduces an auditing framework for reasoning AI systems, enabling safer and secure deployment in high-stakes settings.

安全推理社会与人本Reasoning AuditLLM SafetyOpenReview

常见合作者