Principled Evaluation with Human Labels: One Rater at a Time and Rater Equivalence
DGX agentarXiv:2106.01254v3 Announce Type: replace Abstract: In many classification tasks, there is no definitive ground truth, only human judgments that may disagree. We address two challenges that arise in s