We let open models access the outside world during evals on tasks from public benchmarks. Here's what happened: Most went and found upstream…
DGX agentWe let open models access the outside world during evals on tasks from public benchmarks. Here's what happened: Most went and found upstream commits containing fixes for the tasks they were supposed t