Model Releases
Measuring LLM performance drift: observations and methodology from 31,352 repeated benchmark measurements [D]
DGX agentOne thing that has bothered me about LLM benchmarks for a while is that most of them are essentially snapshots. A model is evaluated, a score is published, and we tend to talk about that score as if i