深翼判例库DeepWing Case Library · INC-008 · 知识层Knowledge

律师把判例检索交给 ChatGPT:六个编造的判例写进诉状,被法院制裁A lawyer outsourced case research to ChatGPT: six fabricated citations went into a court filing and drew sanctions

主失效层Primary failure layer:知识层Knowledge | 证据状态Evidence:多源已核Multi-source verified | 披露日期Disclosed:2023-06-22 | 核查日期Checked:2026-10-23

时间线Timeline

2023-02 至 06律师用 ChatGPT 检索判例,六个编造判例写进诉状
2023-06-22纽约南区联邦法院作出制裁裁定
Feb to Jun 2023A lawyer researched case law with ChatGPT; six fabricated citations went into a court filing
2023-06-22The Southern District of New York issued its sanctions order

已证实事实Confirmed facts

发生了什么:律师把判例检索托付给生成式 AI,模型编造了六个不存在的判例并写进诉状;被法院质询时,律师又回去问同一个模型,得到「是真判例」的保证,全程没有独立核查环节。

后果:两名律师及其律所被以联邦民事程序规则第 11 条共罚 5,000 美元,并被要求把裁定送达被冒名的法官。

A lawyer delegated case research to generative AI, which fabricated six nonexistent precedents that went into a court filing. When the court questioned them, the lawyer asked the same model again and accepted its assurance that the cases were real; no independent check ever intervened.

Two lawyers and their firm were fined $5,000 jointly under Rule 11 and ordered to notify the judges falsely named as authors of the invented opinions.

失效机制Failure mechanism深翼分析DeepWing analysis

模型编造引用是知识层的常态风险,真正的失效是核查义务被一并委派了出去:产出者自证清白,成了唯一的核查。用生成内容的工具自查生成内容,等于没有查。

因此本案归入知识层:凡是要署名、要提交、要担责的引用,逐条回原始来源核验是不可委派的义务;与 INC-010 合看,一条是使用者被罚、一条是企业担责,是同一失效的两面。

Fabricated citations are a standing Knowledge-layer risk; the real failure was delegating the duty to verify along with the research. The producer certifying its own output became the only check, which is no check at all.

Any citation that carries a signature, a filing or liability must be verified against the primary source, item by item. Read with INC-010, this is the same failure from two sides: here the user was sanctioned, there the company paid.

工程启示Engineering lessons

引用逐条回源:模型给出的每条引注,回原始数据库或原文核对存在性与内容后才可使用。

禁止自证核查:核查通道必须独立于生成通道,问模型「你写的是真的吗」不构成核查。

提交前独立复核:对外提交的专业文件设独立复核人,AI 参与起草的文件尤其如此。

Verify every citation at source: each model-supplied reference is checked for existence and content against the primary database or text before use.

No self-certification: the checking channel must be independent of the generating channel; asking the model whether it told the truth is not verification.

Independent pre-filing review: outbound professional documents get a named reviewer, above all when AI helped draft them.

你的系统里,Agent 的对外动作有人盯着吗?Is anyone watching what your agents do outside your system?

做 17 题免费自检Take the free 17-question self-check

回到判例库Back to the Case Library →