Subword boundaries are the second meaningful effect. Adding end-of-subword markers as input embeddings produces a large gain throughout trai…
DGX agentSubword boundaries are the second meaningful effect. Adding end-of-subword markers as input embeddings produces a large gain throughout training (H3): end-boundaries leak future bytes (whitespace alwa