The state of public AI benchmarking is dire and is undermining our ability to understand how good AI is now. Most famous measures are maxed …
DGX agentThe state of public AI benchmarking is dire and is undermining our ability to understand how good AI is now. Most famous measures are maxed out, and, as this paper shows, the non-saturated benchmarks