Mingyu's Library主页

Anthropic 反蒸馏防御:推理轨迹怎么被保护,代价是什么

How Anthropic Defends Claude's Reasoning Against Distillation, and What It Costs

10 月 12 日原文读完后的整理:三层防御、官方数字怎么读、你的集成要查什么。

A read-through of the October 12 post: three defense layers, how to read the numbers, and what to check in your integration.

2026-10-21 · AI 每日简报深度学习
2026-10-21 · AI Daily deep dive

结论先说

The short version

10 月 12 日 Anthropic 发了一篇长文,讲它怎么防别人“蒸馏”Claude。蒸馏就是拿一个强模型的输出去训练另一个模型。Anthropic 特别在意的是 Claude 的推理轨迹(最终答案之前写的那段思考),因为它最能教会别的模型“怎么想”。

它的做法分三层:控制推理内容流到哪里、用分类器拦“把推理吐出来”的请求、让反复尝试的账号越来越难受。Anthropic 自己给的结果是:被蒸馏方拿走的数据少了 90%~99%。这些数字都是它自己报的,没有第三方复核。

对你的实际影响有两点:一是新账号上你没法再随意改写 Claude 之前的推理上下文;二是被安全机制拦下的请求现在也要收费。如果你在做 Agent 平台,这篇是难得的“防御方视角”材料。

On October 12 Anthropic published a long post on how it defends Claude against distillation, which means training one model on another model's outputs. What it cares about most is Claude's reasoning transcripts, the thinking written before the final answer, because they teach another model how to think.

The defense has three layers: control where reasoning content can go, use classifiers to block attempts to extract it, and make repeated attempts increasingly costly. Anthropic's own result is a 90-99% drop in the data distillers harvest. All of these numbers are Anthropic's; none has been independently checked.

Two things change for you in practice. On new accounts you can no longer freely rewrite Claude's earlier reasoning context. And requests blocked by the safeguards are now billed. If you build agent platforms, this is a rare look from the defender's side.

蒸馏攻击是什么,为什么盯着推理轨迹

What a distillation attack is, and why reasoning transcripts

Anthropic 的定义是:有组织、成规模地提取一个模型的能力去训练另一个模型,而且没有得到授权,常常通过一大批假账号进行。它给了两个担心:蒸馏出来的模型可能接近前沿能力却没有同等的安全措施(比如生物、网络安全方向);复制来的能力也可能被用进军事、情报和监控系统。

为什么盯着推理?因为推理轨迹展示的是 Claude 怎么得出答案,不只是答案本身。文章里有个具体对比:一个预训练模型,用 Claude Opus 4.8 的完整推理轨迹训练,在 SWE-bench Verified 上得 80.4%;只用摘要版轨迹,只有 71.8%。差了 8.6 个百分点,这就是“推理值钱”的量化说明。

Anthropic defines it as covert, large-scale extraction of one model's capabilities to build another, without permission, often through networks of fraudulent accounts. It gives two worries: distilled models may approach the frontier without matching safeguards (biology and cybersecurity are the examples), and the copied capability may end up in military, intelligence and surveillance systems.

Why reasoning? Because a transcript shows how Claude reaches an answer, not just the answer. The post has a concrete comparison: a pretrained model trained on full reasoning transcripts from Claude Opus 4.8 scored 80.4% on SWE-bench Verified; trained on summarized transcripts only, it scored 71.8%. That 8.6-point gap is the number behind "reasoning is valuable".

同一个预训练模型,蒸馏用的数据不同(SWE-bench Verified) 完整推理轨迹 80.4% 只有摘要轨迹 71.8% 训练数据来自 Claude Opus 4.8;数字为 Anthropic 自报,条形从 0 起画。
图 1:完整推理轨迹 vs 摘要轨迹,蒸馏效果差 8.6 个点(Anthropic 自报)。
Same pretrained model, different distillation data (SWE-bench Verified) Full reasoning transcripts 80.4% Summarized transcripts only 71.8% Training data came from Claude Opus 4.8. Figures are Anthropic’s own; bars start at 0.
Figure 1: Full vs summarized reasoning transcripts, an 8.6-point gap in distillation quality (Anthropic-reported).

攻击方怎么做

How the attackers operate

文章把手法分成两类。被动蒸馏:发普通请求,把回答拿去训练,早期防御主要针对这种。主动提取:Claude 开始只给推理摘要之后,攻击方转而想办法让它吐出完整推理。文章举的例子有:让 Claude 逐字输出之前的推理;还有一个实验室测试了 12,000 个请求,每个用一种不同的花招。

规模和躲避手段也很夸张:控制几十万假账号的代理网络、在不受支持的地区转售访问、用假身份和被盗支付信息开户,被封后把推理在不同对话、不同模型(用防护更弱的模型)、不同账号之间搬运。2 月的一份报告里,一个网络同时管理超过 20,000 个假账号。

The post splits the methods in two. Passive distillation: send ordinary requests and train on the responses; early defenses targeted this. Active extraction: once Claude began showing only summarized reasoning, attackers looked for ways to make it reveal the full reasoning. Examples include telling Claude to output its earlier reasoning verbatim, and one lab testing 12,000 requests, each with a different trick.

The scale and evasion are large: proxy networks controlling hundreds of thousands of fraudulent accounts, resold access in unsupported regions, accounts opened with false identities and stolen payment details, and reasoning moved between conversations, between models (using one with weaker safeguards) and between accounts after bans. A February report described one network managing more than 20,000 fraudulent accounts at once.

三层防御各做了什么

What each of the three layers does

第一层:控制推理流向。先是只展示推理摘要。然后是 preserved thinking(随 Claude Fable 5.1 和 Opus 5.5 引入):2026 年 8 月 31 日及之后创建的新 API 账号,不能编辑 Claude 之前的上下文,这样攻击者没法拿“改过的上下文”去套出推理。推理也不再能被防护更弱的旧模型读到。Claude Sonnet 5.5 起,推理轨迹只有发起那次请求的组织才能访问。

第二层:拦截和修补。一个两阶段分类器,基于 Anthropic 的 constitutional classifiers 研究,用蒸馏方真实的提取尝试来训练。Anthropic 称它的稳健程度大致相当于防生物武器协助的那套防护,误拦率低于 0.1%。目前部署在 Sonnet 5.5、Opus 5 和 5.5、Fable 5 和 5.1 上。新手法出现后能快速补,比如“把之前的推理翻译成另一种语言”,或“把推理写在标签里跟答案一起给”,都已经被挡住。

关于“两阶段”长什么样,这篇文章没细讲。Anthropic 另一篇 constitutional classifiers 研究里的下一代设计是:一个读模型内部激活的轻量线性探针先筛全部流量,被标记的再交给更贵的探针加分类器组合做最终判断,额外算力约 1%。这是不同的研究文章,我没法确认蒸馏用的分类器和它完全一样,这里只当背景参考。

第三层:让反复尝试变难。对反复尝试提取推理的账号收紧用量限制,持续尝试就封禁关联账号。另外从 9 月 24 日起,在 Claude 回答之前就被安全机制拦下的请求也要收费,覆盖包括蒸馏在内的几个领域,Anthropic 说误判率低于 0.1%。

Layer 1: control where reasoning goes. First, show only summaries of reasoning. Then preserved thinking (introduced with Claude Fable 5.1 and Opus 5.5): new API accounts created on or after August 31, 2026 cannot edit Claude's prior context, so attackers can't use doctored context to coax reasoning out. Reasoning is also no longer readable by earlier models with weaker safeguards. With Claude Sonnet 5.5, reasoning transcripts are accessible only to the organization whose request produced them.

Layer 2: block and patch. A two-stage classifier, built on Anthropic's constitutional classifiers research and trained on distillers' real extraction attempts. Anthropic says its robustness roughly matches the safeguards against bioweapons help, with a false positive rate below 0.1%. It is deployed on Sonnet 5.5, Opus 5 and 5.5, and Fable 5 and 5.1. New tricks get patched quickly; asking Claude to translate earlier reasoning into another language, or to write it in tags next to the answer, are both blocked now.

This post doesn't describe what "two-stage" looks like inside. A separate Anthropic research post on next-generation constitutional classifiers describes a lightweight linear probe that reads the model's internal activations and screens all traffic, with flagged exchanges passed to a more expensive probe-plus-classifier ensemble, at roughly 1% extra compute. That is a different article, and I can't confirm the distillation classifier is identical, so treat it as background only.

Layer 3: make repeated attempts hard. Stricter usage limits for accounts that keep trying to extract reasoning, and bans on associated accounts after persistent attempts. Since September 24, requests blocked by safeguards before Claude responds are also billed, in several areas including distillation, with a stated false positive rate below 0.1%.

蒸馏方 大量假账号 ① 控制推理流向 只给摘要 preserved thinking 推理只对发起请求的组织可读 ② 拦截提取请求 两阶段分类器 误拦率低于 0.1% 新手法快速补丁 ③ 让反复尝试变贵 更严的限额 封禁关联账号 被拦请求照常收费(9/24 起) 结果(官方数字) 提取量 -90%~99% 推理 token 低 10~100 倍
图 2:三层防御和官方给出的结果。
Distiller many fake accounts 1 Control where reasoning goes Show summaries only Preserved thinking Reasoning readable only to the requesting org 2 Block extraction attempts Two-stage classifier False positives below 0.1% Fast patches for new tricks 3 Make repeat tries costly Tighter usage limits Ban linked accounts Blocked requests are billed (since Sep 24) Result (Anthropic figures) Harvest down 90-99% Reasoning tokens 10-100x lower
Figure 2: The three defense layers and the results Anthropic reports.

数字怎么读

How to read the numbers

Anthropic 给的结果:早期证据显示蒸馏方拿走的数据减少 90%~99%;分类器上线后,蒸馏方在 Anthropic 平台上提取的推理 token 持续低了 10 到 100 倍,有些天少到测不出来;数万个与蒸馏相关的账号被封,常常在一场行动开始后不到两小时;Anthropic 还说自己拒绝了可观的收入和“数万亿 token”的蒸馏方付费流量。

我的读法有三点。第一,这些都是 Anthropic 自己统计的,文章没有第三方数据,而且“早期证据”“consistently”这类措辞说明还在观察期。第二,“减少”衡量的是 Anthropic 平台上被拿走的量,蒸馏方也用别的平台,文章自己也承认防御依赖别人配合。第三,文章说它还没见过“高度复杂、持续”的绕过尝试,所以这些数字面对强对手时会怎样,目前没有答案。

Anthropic's reported results: early evidence of a 90-99% reduction in data harvested by distillers; after the classifier launched, reasoning tokens extracted on Anthropic's platform were consistently 10 to 100 times lower, and on some days too small to measure; tens of thousands of distillation-linked accounts were banned, often within two hours of a campaign starting; and Anthropic says it turned away meaningful revenue and "trillions of tokens" of paying distiller traffic.

Three ways I read this. First, these are Anthropic's own statistics; the post has no third-party data, and wording like "early evidence" and "consistently" says it's still a watching period. Second, the reduction measures what was taken from Anthropic's platform; distillers use other platforms too, and the post admits the defense depends on others. Third, it says Anthropic hasn't yet seen a highly sophisticated, persistent bypass attempt, so how these numbers hold up against a strong adversary is an open question.

对正常用户的代价,和你该检查什么

The cost to legitimate users, and what to check

文章没有回避代价。Anthropic 承认没有完全做到“不影响正常用户”:preserved thinking 让一部分开发者得改集成;分类器会在不到 0.1% 的情况下误拦正常请求,而被拦的请求现在要收费。

如果你在用 Claude API 做 Agent,值得自查这几项:

  • 你的框架是否会改写、裁剪或重排历史里的推理块?新账号(2026-08-31 及之后创建)上这可能不再行。
  • 你是否依赖在不同组织之间共享推理轨迹(比如把轨迹交给第三方评测或存档)?Sonnet 5.5 起轨迹只对发起请求的组织可读。具体 API 细节我没读到,请对照官方文档。
  • 你的监控是否会把“被安全机制拦下”的请求当成零成本?现在它们会出现在账单上。

The post doesn't hide the cost. Anthropic admits it hasn't fully met the goal of not affecting legitimate users: preserved thinking forced some developers to update their integrations, and the classifier misidentifies benign requests in fewer than 0.1% of cases, and blocked requests are now billed.

If you build agents on the Claude API, worth checking:

  • Does your framework rewrite, trim or reorder reasoning blocks in history? On new accounts (created on or after 2026-08-31) that may no longer work.
  • Do you rely on sharing reasoning transcripts across organizations, say with a third-party evaluator or archive? From Sonnet 5.5, transcripts are readable only by the organization that made the request. I didn't read the API details, so check the official docs.
  • Does your cost monitoring assume safeguard-blocked requests are free? They now show up on the bill.

点名的两个案例

The two named cases

文章点了两家中国公司。智谱(Zhipu):在开发 GLM-5.3 期间蒸馏了美国领先模型的网络攻击能力;Claude 的网络安全防护让它的攻击受阻后,它换去用较旧的 Claude 模型和另一家实验室的模型。美国 CAISSI 评估 GLM-5.3 是迄今发布的网络能力最强的开放权重模型;Anthropic 的研究称它的安全措施很容易被绕过。月之暗面(Moonshot,Kimi):发给 Kimi 模型的请求被偷偷转发到 Claude 做蒸馏;其中一名据信与中国人民解放军有关联的用户,想分析针对特定个人的监控录像。

这些都是 Anthropic 单方面的说法。我没有查到被点名公司的回应,所以“这点我没查到”。

The post names two Chinese companies. Zhipu: distilled the cyber capabilities of leading US models while developing GLM-5.3; after Claude's cyber safeguards degraded its attacks, it tried an older Claude model and another lab's model. The US CAISSI assessed GLM-5.3 as the most cyber-capable open-weights model released to date, and Anthropic's research found its safeguards easy to bypass. Moonshot (Kimi): requests to Kimi models were secretly forwarded to Claude for distillation; one user, believed to be affiliated with China's People's Liberation Army, sought to analyze CCTV surveillance of a specific individual.

These are Anthropic's claims alone. I found no response from the named companies, so: I couldn't find that.

局限,和 Anthropic 对行业的要求

Limits, and what Anthropic asks of the industry

Anthropic 自己说这是一场“猫鼠游戏”,要持续迭代。它要求:所有前沿模型开发者都做反蒸馏防护,因为任何一家的弱防护都会削弱别人;云平台、推理服务商和 API 平台要快速发现并处置滥用、清退假账号。它也承认行业激励是反着的:防御有成本,而蒸馏方还是付费客户。它公开方法,是想证明有可行的替代方案。

我觉得这里有个值得想的张力:摘要推理、限制推理共享,一边保护了模型方的投入,一边让开发者更难看清、调试和复用模型的思考过程。文章没有讨论这个取舍,这是我的判断,不是它的结论。

Anthropic calls this a cat-and-mouse game that needs continued iteration. It asks all frontier developers to invest in anti-distillation safeguards, since weak safeguards at any lab undermine the others, and asks cloud, inference and API platforms to detect and disrupt abuse fast and offboard fraudulent accounts. It also admits the incentives run the other way: defense is costly, and illicit distillers are paying customers. It published its methods to show that a workable alternative exists.

One tension I think is worth holding: summarizing reasoning and restricting who can read it protects the model maker's investment, but also makes it harder for developers to see, debug and reuse the model's thinking. The post doesn't discuss that trade-off. That's my judgment, not its conclusion.

术语表

Glossary

distillation(蒸馏)
拿一个强模型的输出训练另一个模型。合法使用(自己的模型)和未授权提取是两回事。
reasoning transcript(推理轨迹)
模型在给出最终答案前写的思考过程。
preserved thinking
Anthropic 的机制:新 API 账号不能编辑 Claude 之前的上下文。
constitutional classifiers
Anthropic 的一类安全分类器研究,按一套明文规则训练,用来拦有害请求。
false positive(误拦)
把正常请求当成攻击拦下。
SWE-bench Verified
用真实 GitHub issue 测编码 Agent 的基准。
distillation
Training one model on another model's outputs. Using your own model is one thing; unauthorized extraction is another.
reasoning transcript
The thinking a model writes before its final answer.
preserved thinking
Anthropic's mechanism: new API accounts cannot edit Claude's prior context.
constitutional classifiers
Anthropic's line of safety-classifier research, trained against a written set of rules to block harmful requests.
false positive
A legitimate request blocked as if it were an attack.
SWE-bench Verified
A benchmark of coding agents on real GitHub issues.

来源

Sources

我只读到了这一篇一手原文,没找到第三方复核或被点名公司的回应。一个聚合站的报道(2026-10-14 的简报里引用过)与原文方向一致,但以原文为准。

I read only this one primary source, and found no third-party verification or response from the named companies. An aggregator report cited in the 2026-10-14 briefing points the same way, but the original post governs.