Sakana AI's Sudoku-Bench tests AI reasoning with handcrafted sudoku puzzles. GPT-5 has achieved a 33% solve rate, outperforming previous models but still struggling with complex puzzles. The article explores the limitations of current AI reasoning methods and emphasizes the need for further research.

Poetiq announced it has set new performance standards on the ARC-AGI benchmarks by integrating the latest AI models, Gemini 3 and GPT-5.1. Their systems improve accuracy while reducing costs, demonstrating significant advancements in AI reasoning capabilities.

The article explores the limitations of current evaluation methods for AI models, particularly in assessing design capabilities and reducing the need for constant oversight. It highlights the advancements of Gemini 3 and Opus 4.5 in design and coding tasks, suggesting that existing benchmarks fail to capture these qualities. The author argues for a shift toward more qualitative assessments to better reflect the capabilities of LLMs.