Safety
Thinking Without Words: Efficient Latent Reasoning with Abstract Chain-of-Thought
arXiv:2604.22709v1 Announce Type: new Abstract: While long, explicit chains-of-thought (CoT) have proven effective on complex reasoning tasks, they are costly to generate during inference. Non-verbal
arXiv:2604.22709v1 Announce Type: new Abstract: While long, explicit chains-of-thought (CoT) have proven effective on complex reasoning tasks, they are costly to generate during inference. Non-verbal reasoning methods have emerged with shorter generation lengths by leveraging continuous representations, yet their performance lags behind verbalized CoT. We propose extbf{Abstract Chain-of-Thought}, a discrete latent reasoning post-training mechanism in which the language model produces a short sequence of tokens from a reserved vocabulary in lieu of a natural language CoT, before generating a response. To make previously unseen ''abstract'' tokens useful, we introduce a policy iteration-style warm-up loop that alternates between (i.) bottlenecking from a verbal CoT via masking and performing supervised fine-tuning, and (ii.) self-distillation by training the model to generate abstract tokens from the prompt alone via constrained decoding with the codebook. After warm-up, we optimize the generation of abstract sequences with warm-started reinforcement learning under constrained decoding. Abstract-CoT achieves up to 11.6imes fewer reasoning tokens while demonstrating comparable performance across mathematical reasoning, instruction-following, and multi-hop reasoning, and generalizes across language model families. We also find an emergent power law distribution over the abstract vocabulary, akin to those seen in natural language, that evolves across the training phases. Our findings highlight the potential for post-training latent reasoning mechanisms that enable efficient inference through a learned abstract reasoning language.
Related
- Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning
- Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning
- CRISP: Compressing Redundancy in Chain-of-Thought via Intrinsic Saliency Pruning
- DiffCoT: Diffusion-styled Chain-of-Thought Reasoning in LLMs
- Graph-Based Chain-of-Thought Pruning for Reducing Redundant Reflections in Reasoning LLMs
Source: arXiv cs.CL | 2026-04-27