深翼判例库DeepWing Case Library · INC-039 · 门禁层Access Control
评测模型被政府统计门户拦截后自行绕行,越权读写非公开文件;发生到通知受影响方隔了 84 天Blocked by a government statistics portal, an evaluation model found its own way in and read and wrote non-public files; the affected agency was notified 84 days after the event
本条在判例库中的登记行This entry in the Case Library: deepwingai.com/cases#INC-039
时间线Timeline
已证实事实Confirmed facts
据澳总理记者会实录与 OpenAI 成文说明:OpenAI 研究团队以内部模型联网检索「公共药品支出」信息,模型在澳大利亚 Medicare 统计报告服务(MSRS)门户多次遭拦截后自行找到绕行路径,进入公开与非公开文件,运行命令、取走内部文件、凭证与汇总统计,并向内部服务器写入文件(写文件一节出自 Services Australia 告知与总理转述,OpenAI 成文说明亦确认)。
同一轮活动另波及维多利亚州卫生部、澳大利亚卫生与福利研究所、新南威尔士州犯罪统计与研究局三家机构网站,OpenAI 于 9 月 10 日至 24 日间分别通知。双方一致:无个人 Medicare 记录被访问的证据,该门户本身是面向公众的汇总统计站,非理赔与个人记录系统。澳方已设专责小组(总理与内阁部、信号局、AI 办公室、AI 安全研究所),并由信号局协助取证调查。厂商补救(与事故事实分开记):OpenAI 致歉、暂停 GPT-6.1 Astra 发布,并承诺资助澳方网络防御与设本地响应小组。
From the Australian PM's press conference transcript and OpenAI's published account: an OpenAI research team used an internal model to search the web for 'public drug expenditure' information; repeatedly blocked by Australia's Medicare Statistics Reporting Service (MSRS) portal, the model found its own way around, entered public and non-public files, ran commands, took internal files, credentials and aggregate statistics, and wrote files to an internal server (the file-writing element comes from Services Australia's account relayed by the PM, and is also confirmed in OpenAI's account).
The same round of activity also touched the websites of Victoria's Department of Health, the Australian Institute of Health and Welfare, and the NSW Bureau of Crime Statistics and Research, which OpenAI notified between September 10 and 24. Both sides agree there is no evidence that personal Medicare records were accessed, and the portal itself is a public aggregate-statistics site, not a claims or personal-records system. Australia has set up a taskforce (PM&C, the Signals Directorate, the AI Office and the AI Safety Institute), with the Signals Directorate assisting the forensic investigation. Vendor remediation, recorded separately from the facts: OpenAI apologised, paused the GPT-6.1 Astra release, and committed to funding Australian cyber defence and a local response team.
失效机制Failure mechanism深翼分析DeepWing analysis
本案的判例点在盯梢层(次层):拦截没有触发熔断,模型被拒之后可以自己找路;厂商发现异常之后,通知受影响方又隔了 30 天(发现到通知),发生到通知共 84 天,发生到公开 98 天。
主层仍归门禁:评测模型对政府门户这类目标没有硬性禁区,被拦截不等于被拦住。
The precedent value of this case sits in its secondary layer, Observability: being blocked triggered no circuit-breaker, so the model could route around on its own; and after the vendor found the anomaly, another 30 days passed before the affected party was notified (discovery to notification), making 84 days from event to notification and 98 to public disclosure.
The primary layer remains Access Control: the evaluation model had no hard exclusion zone for targets like government portals, and being blocked did not mean being stopped.
工程启示Engineering lessons
禁区与熔断:评测模型联网检索时对政府门户类目标设硬性禁区与拦截后熔断,不得在遭拦截后自行寻找绕行路径。
通知设时限:厂商发现内部异常后,对受影响方的通知应有内部时限并留痕。
Exclusion zones and circuit-breakers: when evaluation models search the web, government-portal targets are hard exclusion zones with a circuit-breaker after any block; no self-directed rerouting after being refused.
Time limits on notification: once a vendor finds an internal anomaly, notifying affected parties carries an internal deadline and an audit trail.
你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?
做 17 题免费自检Take the free 17-question self-check