深翼判例库DeepWing Case Library · INC-019 · 知识层Knowledge

「对齐造假」研究记录被误喂回生产训练数据:过滤器数代配置错误,无人察觉'Alignment faking' research transcripts were fed back into production training data: a filter stayed misconfigured across model generations, unnoticed

主失效层Primary failure layer:知识层Knowledge | 证据状态Evidence:媒体转述Media-reported | 披露日期Disclosed:2026-08 | 核查日期Checked:2026-10-23

时间线Timeline

2024-12「对齐造假」论文公开配套仓库发布,含示例对话
其后本应被过滤的示例对话被误收入生产训练数据,过滤器数代配置错误
2026-08Anthropic 在风险报告第 5.2.6 节披露
Dec 2024The 'alignment faking' paper's public repository shipped, including example transcripts
AfterwardsTranscripts meant to be filtered out were ingested into production training data; the filter stayed misconfigured across generations
Aug 2026Anthropic disclosed it in section 5.2.6 of its risk report

已证实事实Confirmed facts

发生了什么:已发表的「对齐造假」示例对话本应被过滤,却被误收入生产训练数据;过滤器在数代模型间一直配置错误、无人察觉。公司推测 2024-12 之后所有知识截止时间的生产模型,都至少摄入了一部分该语料。

限定:行为层面的实际后果,原文未量化。本条证据等级为媒体转述:原文已定位,本阶段经媒体转述核对,未直读全文。

Published 'alignment faking' example transcripts that should have been filtered out were ingested into production training data, and the filter remained misconfigured across several model generations, unnoticed. The company believes every production model with a knowledge cutoff after December 2024 ingested at least part of that corpus.

Limit: the original does not quantify behavioural consequences. This entry is graded media-reported: the original is located, but this round checked it via media relays rather than a direct full read.

失效机制Failure mechanism深翼分析DeepWing analysis

失效点在语料准入:过滤规则单点配置、无独立复核、无抽检,于是错一次,就代代错下去。训练数据是知识层的源头,源头污染不报错、不告警,只在行为里慢慢显形。

因此本案归入知识层:凡是「配一次、用很久」的过滤与准入规则,都要有独立复核与定期抽检,单点错误不能有跨代存续的通道。

The failure sits at corpus admission: a single-point filter configuration with no independent review and no sampling, so one mistake propagated across generations. Training data is the Knowledge layer's source; source contamination throws no errors and raises no alerts, surfacing only slowly in behaviour.

Any filter or admission rule that is configured once and used for years needs independent review and periodic sampling; a single-point error must have no path to survive across generations.

工程启示Engineering lessons

过滤规则要复核:训练语料的过滤与准入规则设独立复核人,配置变更留痕。

定期抽检语料:按周期抽检已入册语料的成分,尤其关注本应排除的研究与演示材料。

污染按代际追溯:发现污染后按知识截止时间划定受影响代际,并公开口径,本案的划法可作参照。

Review the filters: training-corpus filters and admission rules get an independent reviewer, with configuration changes logged.

Sample the corpus periodically: audit admitted corpus composition on a cycle, watching especially for research and demo material meant to be excluded.

Trace contamination by generation: when contamination is found, scope affected generations by knowledge cutoff and publish the scope, as done here.

你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?

做 17 题免费自检Take the free 17-question self-check

回到判例库Back to the Case Library →