4 links tagged with all of: benchmarks + reasoning + models
Click any tag below to further narrow down your results
Links
This article outlines Distribution-Aligned Sequence Distillation, a new pipeline for improving reasoning tasks like math and code generation using minimal training data. It introduces models such as DASD-4B-Thinking and DASD-30B-A3B-Thinking-Preview, which outperform larger models in various benchmarks. The methodology includes temperature-scheduled learning and mixed-policy distillation for better performance.
Sakana AI's Sudoku-Bench tests AI reasoning with handcrafted sudoku puzzles. GPT-5 has achieved a 33% solve rate, outperforming previous models but still struggling with complex puzzles. The article explores the limitations of current AI reasoning methods and emphasizes the need for further research.
Poetiq announced it has set new performance standards on the ARC-AGI benchmarks by integrating the latest AI models, Gemini 3 and GPT-5.1. Their systems improve accuracy while reducing costs, demonstrating significant advancements in AI reasoning capabilities.
The ARC Prize Foundation evaluates OpenAI's latest models, o3 and o4-mini, using their ARC-AGI benchmarks, revealing varying performance levels in reasoning tasks. While o3 shows significant improvements in accuracy on ARC-AGI-1, both models struggle with the more challenging ARC-AGI-2, indicating ongoing challenges in AI reasoning capabilities. The article emphasizes the importance of model efficiency and the role of public benchmarks in understanding AI advancements.