SG-Blend: Learning an Interpolation Between Improved Swish and GELU for Robust Neural Representations
arXiv:2505.23942v2 Announce Type: replace Abstract: Prevailing activation functions such as Swish and GELU tend toward domain-specific optima, Swish was discovered via neural architecture search on vi