Looped Transformers achieve logical‑reasoning gains without any extra generated tokens. By reusing the same Transformer block multiple times at inference, they deepen the computation on‑the‑fly; although the model size remains unchanged, deeper loops naturally increase inference time compared to a single‑pass forward pass.
Before this work, most reasoning systems either relied on chain‑of‑thought prompting—adding token‑by‑token steps that linearly increase runtime—or fixed‑depth decision heads that could not allocate more compute to hard questions. Neither approach let a model dynamically deepen its thinking without paying the cost of additional output tokens.
Repeating the same layers at inference lifts JevBench accuracy from 63.2 % at depth 1 to 76.2 % at depth 4 for a 2.6 B checkpoint, a full 13‑point jump on a standard logical reasoning benchmark [1] .
Most of that boost comes from the hard tier: LEV gains ten correct answers out of 72 standard items and nineteen out of 111 hard items when moving from…