深翼判例库DeepWing Case Library · INC-007 · 门禁层Access Control
三星工程师把源码与会议记录贴进 ChatGPT:解禁不到三周,至少三起内部敏感信息外发Samsung engineers pasted source code and meeting notes into ChatGPT: within three weeks of the tool being unbanned, at least three internal leaks
本条在判例库中的登记行This entry in the Case Library: deepwingai.com/cases#INC-007
时间线Timeline
已证实事实Confirmed facts
发生了什么:三星解禁生成式 AI 不到三周,员工把半导体源码、设备检测代码与会议录音转写直接贴进外部消费级工具;当时没有数据分级,也没有外发通道管控。
影响:至少三起内部敏感信息外发至第三方平台,贴出去的内容公司无法回收,也无法审计。
Within three weeks of Samsung unbanning generative AI, employees pasted semiconductor source code, equipment test code and meeting transcripts straight into external consumer tools. There was no data classification and no control over outbound channels.
At least three internal leaks reached third-party platforms; once pasted, the content could neither be recalled nor audited by the company.
失效机制Failure mechanism深翼分析DeepWing analysis
这起没有模型失控,只有人把工具当成了内部系统用。失效点在门禁层:敏感数据与外部工具之间没有分级、没有通道、没有拦截,解禁的决定跑在了管控的前面。
因此本案归入门禁层:放行一个外部 AI 工具之前,先回答哪类数据不许进、从哪条通道进、进了能不能收回;三个问题没答,放行本身就是事故的开始。
No model misbehaved here; people treated an external tool as an internal system. The failure sits at Access Control: no classification, no channel control and no interception stood between sensitive data and outside tools, and the unbanning decision ran ahead of the controls.
Before approving any external AI tool, answer three questions: what data must never go in, through which channel it may go in, and whether it can be taken back. Unanswered, the approval itself is the start of the incident.
工程启示Engineering lessons
先分级,再放行:数据分级与外发通道管控先于工具解禁落地;未分级的数据默认不得进入外部 AI 工具。
给过渡期装减速带:三星事后先把单次输入限到 1,024 字节再禁用,是可复制的收紧顺序:先限流,再封堵,同时建内部替代。
外发要可审计:经批准的 AI 通道应留可查的出入记录,贴出去收不回来的内容,至少要知道贴了什么。
Classify before you approve: data classification and outbound-channel controls land before any tool unbanning; unclassified data stays out of external AI tools by default.
Stage the tightening: Samsung's sequence is reusable: cap input size first, then ban, while building an internal alternative.
Make outbound use auditable: approved AI channels keep checkable records; content that cannot be recalled should at least be known.
你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?
做 17 题免费自检Take the free 17-question self-check