Analyzing Stream Collapse in Hyper-Connections: From Diagnosis to Mitigation
DGX agentarXiv:2606.03483v1 Announce Type: cross Abstract: Hyper-Connections (HC) replace the single Transformer residual stream with multiple streams, introducing a permutation symmetry over stream indices. W