I built a tool that shows you what GPT-2 is 'thinking' in real-time as it generates 3D graph of concept activations per token [R]

A developer created a visualization tool that displays GPT-2's internal concept activations in real-time during text generation, representing the model's "thinking" process as a 3D graph that updates for each token produced. The tool provides interpretability insights by mapping neural network activations to human-understandable concepts, allowing researchers to observe which conceptual features the model prioritizes at each generation step. This approach contributes to the broader field of neural network interpretability by making black-box language model reasoning more transparent and analyzable.

Source: r/MachineLearning | 2026-05-19