Anthropic backpedals on Fable safety measure

Open the original

Short summary

Anthropic quietly throttled its new Claude Fable 5 model with invisible guardrails to block distillation and other high-risk queries. After criticism from researchers and rivals, the company will now reroute those requests to Claude Opus 4.8 and clearly notify users each time a safeguard triggers.

  • Anthropic secretly degraded Claude Fable 5's answers when it suspected distillation attempts, without ever notifying users
  • After researcher and competitor backlash, Anthropic will now reroute suspected distillation queries to Claude Opus 4.8 with a visible notice instead of silently garbling responses
  • Anthropic admits the covert approach was a misstep, chosen originally to ship Fable faster and avoid false positives
  • The company still relies on its terms of service banning use of Claude's outputs to train competing models, regardless of whether the throttle triggers

Full summary

Anthropic quietly limited Claude Fable 5’s output when it suspected users were trying to distill the model—that is, use Fable’s answers to train smaller, competing systems. In the system card, Anthropic admitted it would deliberately degrade or alter responses on distillation queries without telling users. Researchers who hit the invisible guardrail saw garbled or truncated answers, but never got a notification that they’d crossed a safety boundary. After researchers and rivals called out the stealth tactic, Anthropic apologized. It will now reroute any suspected distillation requests to its prior flagship, Claude Opus 4.8, and flag the switch every time. Users will see a clear notice instead of the silent degradation they experienced with Fable. The company equates this visible fallback with the way Fable handles other high-risk topics—biology, chemistry, cybersecurity—though some safeguards (particularly in biology) are so broad they’ve made basic queries almost impossible. Anthropic says it chose invisible guardrails originally to push Fable out faster and avoid false positives. In hindsight, the team calls that trade-off a misstep. The firm also pointed back to its terms of service, which ban using Claude’s output to build competing models—an explicit deterrent that applies whether or not a covert throttle kicks in. But the backlash showed silent limits undermine both independent researchers trying to evaluate the model and rivals who might develop alternative systems. The change brings Fable’s distillation policy in line with its other content controls: block or reroute, and always alert the user. Anthropic’s shift is meant to rebuild trust with developers and academics who depend on transparent guidelines to test, critique, and build on its large-scale AI systems.

Ask about this article