Don't Label Twice: Quantity Beats Quality when Comparing Binary Classifiers on a Budget
DGX agentarXiv:2402.02249v3 Announce Type: replace Abstract: We study how to best spend a budget of noisy labels to compare the accuracy of two binary classifiers. It's common practice to collect and aggregate