Representational Capacity: Geometric Limits on Feature Representation in Transformer Language Models
DGX agentarXiv:2606.02765v1 Announce Type: cross Abstract: Model dimension (d_{model}) is a fundamental hyperparameter in transformer language models, yet its role in setting the geometric limits of feature re