Model Releases
I turned a transformer into a game console that runs Pong, Tetris, Space Invaders and 116 more games.
I turned a CHIP-8 game console into a decoder-only transformer. The transformer is the game engine. It executes instructions, updates machine memory, and renders every frame through next-token predict
I turned a CHIP-8 game console into a decoder-only transformer. The transformer is the game engine. It executes instructions, updates machine memory, and renders every frame through next-token prediction. Every generated token is a memory write, and your keypresses go directly into the model's context window. There's no separate emulator. Pong, Tetris, Space Invaders and a bunch of other CHIP-8 games run on the same model. Just swap the ROM in the prompt to switch games. The weights are compiled from a circuit, not learned through training. Attention handles memory reads by finding the most recent write to an address, while ReLU circuits handle opcode decoding, arithmetic, comparisons and bitwise operations. Even the compatibility quirks are encoded in the initial prompt, so different games don't need different weights. The model has 18 layers, 42 attention heads and 32M parameters (139k nonzero). It uses fp64 and can be loaded through Hugging Face transformers. Model weights: https://huggingface.co/divagr1925/chipformer Try it out: https://divagr.com/chipformer Code + desktop app: https://github.com/divagr18/chipformer submitted by /u/RevealIndividual7567 [link] [comments]
Related
Source: r/LocalLLaMA | 2026-10-15