Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks
DGX agentarXiv:2506.22429v2 Announce Type: replace-cross Abstract: In recent years, the neural tangent kernel (NTK) and neural network Gaussian process kernel (NNGP) have given theoreticians tractable limiting