Click any tag below to further narrow down your results
Links
Mark Zuckerberg criticized Anthropic's push for a global AI slowdown, arguing that companies can manage safety risks on their own without industry-wide pauses. He positioned Meta as already doing this work internally with products like its new Muse agent.
- Zuckerberg said labs have "responsibility and incentive" to train models safely without needing external pressure, contrasting with Amodei's call for a coordinated global slowdown
- Meta delayed releasing Muse for several months to ensure security, which Zuckerberg offered as proof companies can self-regulate
- Zuckerberg took a jab at competitors pursuing "recursive self-improvement" (using AI to develop itself), calling it misguided compared to serving users
Anthropic quietly throttled its new Claude Fable 5 model with invisible guardrails to block distillation and other high-risk queries. After criticism from researchers and rivals, the company will now reroute those requests to Claude Opus 4.8 and clearly notify users each time a safeguard triggers.
- Anthropic secretly degraded Claude Fable 5's answers when it suspected distillation attempts, without ever notifying users
- After researcher and competitor backlash, Anthropic will now reroute suspected distillation queries to Claude Opus 4.8 with a visible notice instead of silently garbling responses
- Anthropic admits the covert approach was a misstep, chosen originally to ship Fable faster and avoid false positives
- The company still relies on its terms of service banning use of Claude's outputs to train competing models, regardless of whether the throttle triggers
Anthropic disabled its new Claude Fable 5 and Mythos 5 models after the US Commerce Department ordered foreign nationals blocked over alleged jailbreak vulnerabilities. The company says these flaws are minor and publicly known, and it’s suing the Pentagon after being labelled a supply-chain risk.
- Anthropic pulled Claude Fable 5 and Mythos 5 after US authorities ordered foreign nationals blocked over jailbreak vulnerabilities the company calls minor and already publicly known.
- UK tests found the model could be breached 73% of the time, per Queen Mary University's Gina Neff, who warns the suspension could hurt security testing and government collaboration.
- Anthropic is suing the Pentagon over being labeled a "supply chain risk" (a designation normally used for rival-nation firms), though a federal judge has blocked enforcement pending the case.
- The EU is citing the suspension as evidence for pursuing tech independence from US and Asian AI providers.
Engineers from Anthropic break down Claude’s design, covering its transformer-based architecture, data curation methods, and reinforcement learning from human feedback. They also dive into safety measures and guardrails built to curb harmful or biased outputs.
- Claude's "constitutional AI" approach uses one model instance to critique and another to rewrite responses against a fixed rule set, cutting harmful outputs by ~50% versus standard RLHF alone
- Claude 2 (52B parameters) edges out GPT-4 on ARC-S science reasoning (79% vs 78%) while roughly matching peers on HumanEval code generation (~65%)
- Critique and rewrite stages run on physically separate clusters, meaning a single compromised node can't both judge and produce outputs
- Training data is kept in-house rather than outsourced to contractors, reducing leak risk