Attention-based representations for multi-task computation
arXiv:2608.04243v1 Announce Type: new Abstract: Multi-head attention layers produce vector representations that support multiple downstream tasks. We establish bounds on the number of heads required i