What Fixed-Rollout pass@k Evaluations Can Identify
DGX agentarXiv:2609.09245v1 Announce Type: cross Abstract: Repeated-sampling evaluations increasingly extrapolate pass@k far beyond the number n of samples collected per problem. We show that, in the pooled/ra