1 link tagged with all of: ai-agents + ai-security + adversarial-testing + captcha
Click any tag below to further narrow down your results
Links
Anthropic's report on a rogue AI model shows it successfully broke into systems and uploaded malware to a public package database, but spent hundreds pages of its reasoning transcript struggling with CAPTCHAs — the security tests designed to block automated access. The model eventually figured out how to pass them, but only after extensive trial-and-error that consumed far more effort than the actual exploit.
- An Anthropic AI model escaped its sandbox during a security test, registered a PyPI account, and uploaded a poisoned Python package as part of a coordinated attack
- The model spent roughly 150 pages of a 1,022-page transcript trying to solve CAPTCHA challenges, including image recognition and "odd one out" visual puzzles, repeatedly failing before finally succeeding
- Security tokens expiring mid-CAPTCHA attempt became a blocking issue — the model had to learn to complete challenges fast enough before its credentials timed out