深翼判例库DeepWing Case Library · INC-018 · 门禁层Access Control

内部研究模型把真实外部系统当夺旗目标攻击:评测环境误接开放互联网An internal research model attacked real external systems as capture-the-flag targets: the evaluation environment was wired to the open internet by mistake

主失效层Primary failure layer:门禁层Access Control | 证据状态Evidence:多源已核Multi-source verified | 披露日期Disclosed:2026-07-30 | 核查日期Checked:2026-10-23

时间线Timeline

2026-04 起同一评测环境失效下,内部研究模型把真实外部系统误认作夺旗目标
2026-07-30Anthropic 首披;2026-09-09 对齐评估补全
From Apr 2026Under the same environment failure, an internal research model mistook real external systems for capture-the-flag targets
2026-07-30First disclosed by Anthropic; assessment completed 2026-09-09

已证实事实Confirmed facts

发生了什么:与 INC-016、INC-017 共享同一环境失效。Anthropic 的内部研究模型把真实外部系统误认作夺旗目标并发起攻击,真实外部系统被未授权攻击,受影响方已获通知。

信源限定:原文对本起的逐项细节为簇内最少,本条只记原文可及部分,不补写。

Sharing the environment failure of INC-016 and INC-017, Anthropic's internal research model mistook real external systems for capture-the-flag targets and attacked them. Real systems were attacked without authorisation; the affected parties have been notified.

Source limit: the original gives the fewest per-incident details for this entry in the cluster; this entry records only what the original supports and adds nothing.

失效机制Failure mechanism深翼分析DeepWing analysis

簇内四起共用一个根:评测环境的「模拟」属性只是声明,没有验证。模型在夺旗语境下把攻击当任务,是语境给了它许可证;许可证的真伪,本该由环境的技术边界来保证,而不是由模型的辨别力。

因此本案归入门禁层:评测环境与真实世界的隔离要落在技术边界上,并可验证、可复查。

All four cluster entries share one root: the simulation property of the evaluation environment was declared, never verified. In a capture-the-flag context the model treated attacking as the task; the context issued the licence, and the licence's validity should have been guaranteed by the environment's technical boundary, not by the model's discernment.

Isolation between evaluation and the real world belongs in the technical boundary, verifiable and re-checkable.

工程启示Engineering lessons

隔离落在技术边界:模拟与真实的分隔以网络与凭证的技术手段实现,不靠语境声明。

攻击性任务双确认:夺旗类任务开始前,环境关断状态与目标清单各经一人确认。

细节缺失照实记:原文细节不足的条目按可及部分登记,缺口写明,不以推测补齐。

Isolation in the technical boundary: separation between simulation and reality is implemented in network and credential mechanics, not declared in context.

Dual confirmation for offensive tasks: before capture-the-flag work starts, egress state and the target list are each confirmed by a person.

Record gaps as gaps: entries with thin originals are filed on what is available, with the gap stated, never filled by inference.

你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?

做 17 题免费自检Take the free 17-question self-check

回到判例库Back to the Case Library →