Tokyo-based Sakana AI has introduced a novel AI architecture named Continuous Thought Machines (CTMs), aiming to enable artificial intelligence models to reason more like human brains and with significantly less explicit guidance. This development, announced on May 12, 2025, tackles a core challenge in AI: moving beyond pattern recognition to achieve genuine, step-by-step reasoning.
CTMs represent a departure from traditional deep learning models by explicitly incorporating time and the synchronization of neuron activity as a fundamental component of their reasoning process. This approach is inspired by the complex neural dynamics observed in biological brains, where the timing and interplay between neurons are critical to information processing.
Most current AI architectures, while powerful, abstract away these temporal dynamics. Sakana AI's CTMs, however, are designed to leverage these neural dynamics as their core representation.The architecture introduces two key innovations: neuron-level temporal processing, where individual neurons use unique parameters to process a history of incoming signals, and neural synchronization, which is employed as a latent representation for the model to observe data and make predictions.
This unique design allows CTMs to "think" through problems in a series of internal "thought steps," effectively creating an internal dimension where reasoning can unfold. This contrasts with conventional models that might process information in a single pass.The ability to observe this internal process also offers greater interpretability, allowing researchers to visualize how the model arrives at a solution, much like tracing a path through a maze.
Sakana AI's research indicates that CTMs demonstrate strong performance and versatility across a range of challenging tasks, including image classification, maze solving, sorting, and question-answering. A notable feature is their capacity for adaptive compute, meaning the model can dynamically adjust its computational effort, stopping earlier for simpler tasks or continuing to process for more complex challenges without needing additional complex instructions.
The introduction of Continuous Thought Machines marks a significant step in the quest for more biologically plausible and powerful AI systems.[2] By focusing on the temporal dynamics of neural activity, Sakana AI aims to bridge the gap between the computational efficiency of current AI and the nuanced reasoning capabilities of the human brain, potentially unlocking new frontiers in artificial intelligence.
