Approximating Softmax in Pretrained LLMs: Model Sensitivity and Kernel Acceleration
DGX agentarXiv:2609.33586v1 Announce Type: new Abstract: On NVIDIA Blackwell B200, tensor-core throughput outpaces special-function exponential throughput by more than two orders of magnitude, exposing exponen