18 August 2026

Smaller AI models match larger ones using hidden reasoning and memory

  • A smaller model called BDH-CQ achieved 29.5% accuracy on ARC-AGI, a benchmark for general reasoning, using internal reasoning steps and temporary memory storage.
  • GPT-5.6 Sol improved from 13.3% to 38.3% on the same benchmark by keeping reasoning steps and using 6 times fewer input tokens than before.
  • Both examples show that how a model thinks internally, not just its size, determines how well it solves problems.

How it was covered

Latent Spaceswyx & Alessio

Small models like BDH-CQ use latent-space reasoning with temporary memory to hit 29.5% on ARC-AGI at very low cost, while GPT-5.6 Sol improved from 13.3% to 38.3% on ARC-AGI-3 using retained reasoning and 6x fewer tokens. The newsletter frames memory and compaction strategy as a first-class capability multiplier.