Subword Segmental BabyLMs: Learning to Tokenise for Sample-Efficient Pretraining
DGX agentarXiv:2609.01151v1 Announce Type: new Abstract: In the standard LM training pipeline, subword tokenisation is applied as a preprocessing step. Subword segmental language modelling is an alternative pa