Distilling Drifting Transformers with Representation Autoencoders
DGX agentarXiv:2606.15553v2 Announce Type: replace Abstract: Despite the significant training acceleration and promising performance, Representation Autoencoders (RAEs) are mainly criticized for poor distillat