Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling
arXiv:2609.09691v1 Announce Type: new Abstract: When training data are limited, increasing parameter count is not the only way to improve language-model performance. A small parameter set, when repeat