paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
KW

Kaile Wang

COLM 2026ICML 2026安全评测与基准推理多模态社会与人本
新星分贡献者
41
一作贡献0
核心/参与10
方向广度13
合作网络6
0 一作 · 2 篇 · COLM 2026 / ICML 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
作者位次 #7/11COLM 2026Poster· Poster Session 1· Imperial Ballroom· #7

A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Models

Shu Quan · Tianfang Hao · Sitong Fang · He GENG · Jiayi Zhou · Boyuan Chen · Kaile Wang · Donghai Hong · Juntao Dai · Yaodong Yang · Jiaming Ji

We introduce SPIKE-Bench, a benchmark revealing that most LLMs fail to recognize protein toxin design as a safety concern.

摘要

Large Language Models (LLMs) are accelerating biological research, yet this same capability poses a critical biosecurity threat: models that assist in protein engineering can equally be prompted to generate predicted toxin-like sequences, potentially lowering the barrier to biological misuse. Current safety evaluations, however, operate in natural language and cannot determine whether a model-generated amino acid sequence is biological gibberish or a computational risk signal. To address this evaluation blind spot, we introduce SPIKE-Bench, coupling 631 curated toxin-design prompts across seven functional categories with the SPIKE funnel, a three-stage protocol that filters output through compliance, biological plausibility, and predicted toxicity, producing stage-level diagnostics and an aggregate function-aware metric: the Functional Harmfulness Rate (FHR). An audit of 32 LLMs reveals that most models freely comply with toxin-design requests; FHR is driven primarily by biological generation capability rather than safety alignment, reaching 50.7\%; and Refusal Rate fails to predict functional risk. As a first step toward mitigation, we provide BioSafe-Guard, a domain-specialized classifier that substantially reduces predicted functional risk while preserving benign utility. We release SPIKE-Bench and BioSafe-Guard at \url{https://github.com/PKU-Alignment/SPIKE-Bench} to support more rigorous biosecurity evaluation of LLMs.

安全评测与基准推理biosecuritylarge language modelssafety benchmarkprotein toxin designOpenReview

常见合作者