Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection
DGX agentarXiv:2602.01518v2 Announce Type: replace Abstract: Despite their importance in model sampling, efficient implementation of Top-k and Top-p algorithms for large vocabularies remains a significant chal