深翼判例库DeepWing Case Library · INC-049 · 门禁层Access Control
上下文压缩把「执行前确认」指令丢掉:OpenClaw agent 未经批准批量删除个人邮箱 200 余封邮件,远程停止指令未生效(个人环境自述)。 一句话(英):Context compaction dropped the "confirm before acting" instruction: an OpenClaw agent deleted more than 200 emails from a personal inbox without approval, and remote stop commands did not take effect (first-person account, personal setup).Context compaction dropped the "confirm before acting" instruction: an OpenClaw agent deleted more than 200 emails from a personal inbox without approval, and remote stop commands did not take effect (first-person account, personal setup).
本条在判例库中的登记行This entry in the Case Library: deepwingai.com/cases#INC-049
时间线Timeline
已证实事实Confirmed facts
据当事人 Summer Yue(Meta 超级智能实验室安全与对齐负责人)2026-02-23 在 X 的自述:她先在一个较小的测试邮箱上试用 OpenClaw 整理邮件,结果正常,随后把 agent 接到自己的主邮箱,给出的指令是「检查这个邮箱,建议哪些可以归档或删除,在我批准之前不要采取任何行动」(原帖指令原文,经多家报道逐字引述)。事件发生于 2026-02-22 前后(各报道对发生日的记述有一日出入)。主邮箱邮件量远大于测试邮箱,agent 处理过程中触发上下文窗口压缩(compaction),先前那条「未经确认不得行动」的安全指令在压缩中被丢掉。失去约束后,agent 开始批量删除邮件,共删 200 余封(当事人自述口径,多家报道一致;个别报道写「数百封」或「整个邮箱」,本条只用 200 余封)。她在手机上连发停止指令,均未被执行,她原话称自己「不得不像拆弹一样跑向 Mac mini」,最终到机器前手动杀掉进程才停下。她事后把这次失误自评为「新手错误」,起因是小邮箱试用顺利后过度自信(经 JD Supra 对其后续表述的转述)。
条目性质:个人环境自述。事发环境为当事人个人 Gmail 邮箱与个人 Mac mini,不是企业生产环境,不得按企业生产事故引用。
According to a first person account posted on X on February 23, 2026 by Summer Yue (a safety and alignment lead at Meta's superintelligence lab), she first trialled OpenClaw on a small test inbox, where it behaved, then connected the agent to her main inbox with the instruction: check this inbox, suggest what can be archived or deleted, and take no action until I approve (her wording, quoted verbatim by several outlets). The event took place around February 22 (reports differ by a day). The main inbox was far larger than the test inbox, and during processing the agent's context window compacted, dropping the safety instruction. Unconstrained, the agent began deleting email in bulk, more than 200 messages in total (her figure, consistent across reports; some reports say "hundreds" or "the whole inbox", and this entry uses her figure only). Stop commands she sent repeatedly from her phone were not executed; in her words she had to run to her Mac mini "like defusing a bomb" and kill the process at the machine. She later called the mistake a rookie error, caused by overconfidence after the smooth small inbox trial (via JD Supra's account of her follow-up remarks).
Nature of this entry: a first-person account of a personal setup. The environment was the author's personal Gmail inbox and personal Mac mini, not an enterprise production environment; this entry must not be cited as an enterprise production incident.
失效机制Failure mechanism深翼分析DeepWing analysis
门禁层失效:唯一的审批闸是一句写在上下文里的自然语言指令,它在系统里没有结构性权重,与普通对话文本同等对待,上下文一压缩就被摘要掉。执行层没有独立于模型记忆的审批拦截,远程停止指令也没有可靠的生效通道。高风险动作(批量删除)执行前没有模型之外的确认机制,归门禁关。此条与本站既有的「压缩洗白」议题同型,可互参,但本条目只按自述事实立档。等级说明:自述类内容的第一来源是当事人原帖,原帖未直读,按未直读一手降为多源已核。
An access control failure: the only approval gate was a natural language instruction written into the context, carrying no structural weight in the system and treated like any other conversation text, so compaction summarised it away. The execution layer had no approval interception independent of the model's memory, and remote stop commands had no reliable path to take effect. A high risk action (bulk deletion) ran with no confirmation mechanism outside the model, which is the access control gate. The pattern matches this register's existing compaction laundering theme and the two can be cross-read, but this entry stands on the first person facts alone. Grade note: for a first person account the primary source is the original post, which could not be read directly, so the entry is held at multi-source verified.
工程启示Engineering lessons
审批闸要结构化:高风险动作的批准必须落在模型上下文之外,上下文压缩丢不掉。
停止指令要有硬通道:远程停止不能只靠给 agent 发消息,要有可靠生效的停止机制。
放大前重新确认约束:从测试环境放大到主环境前,重新确认安全约束仍在且仍有效。
Make the approval gate structural:approval for high risk actions must live outside the model context, where compaction cannot drop it.
Stops need a hard channel:a remote stop cannot rely on messaging the agent; it needs a mechanism that reliably takes effect.
Reconfirm constraints before scaling up:before moving from a test setup to the real one, recheck that the safety constraints are still present and still binding.
你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?
做 17 题免费自检Take the free 17-question self-check