The article critiques the pass@k metric used to measure AI agents' success, arguing that it can create a misleadingly positive view of performance. It highlights that while pass@k may show high success rates through multiple attempts, real user experiences are often less forgiving. The author calls for more careful consideration and justification when using this metric in evaluating AI.