Copy the Same, Distill the Difference: Initializing Linear Vision Transformers
DGX agentarXiv:2609.35745v1 Announce Type: new Abstract: Linear Vision Transformers (ViTs) are designed to replace the attention in Softmax ViTs with the linear-complexity attention operator for more efficient