Activation-Free Backbones for Image Recognition: Polynomial Alternatives within MetaFormer-Style Vision Models
DGX agentarXiv:2605.20839v1 Announce Type: new Abstract: Modern vision backbones treat pointwise activations (e.g., ReLU, GELU) and exponential softmax as essential sources of nonlinearity, but we demonstrate