The Integer Alibi: Localizing Cross-Kernel Divergence in INT8-Quantized LLM Inference
arXiv:2608.13756v1 Announce Type: new Abstract: Two GPU kernels implementing the same scaled INT8 GEMM interface are usually treated as interchangeable. We test that assumption: holding the checkpoint