SWE-Race: a coding-agent benchmark of 188 real concurrency bugs, with results from three models [P]
DGX agentWe've been building a benchmark out of real concurrency bugs (race conditions, deadlocks, cancellation issues) taken from merged PRs in about 100 Python projects. Each task gets graded by the project'