I built a tool that shows you what GPT-2 is 'thinking' in real-time as it generates 3D graph of concept activations per token

This post describes a visualization tool that provides real-time insight into GPT-2's internal processing by displaying concept activations as a 3D graph, with each token generation showing which neural concepts are being activated. The tool appears designed to make the black-box nature of language models more interpretable by mapping and visualizing the activation patterns that occur during text generation. This type of work contributes to mechanistic interpretability research, which aims to understand how neural networks make decisions at a granular level.

Source: r/ChatGPT | 2026-05-19