Research
Failure to Reproduce Modern Paper Claims [D]
This r/MachineLearning discussion thread addresses the widespread challenge of reproducing results claimed in modern ML research papers, a topic of significant concern in the field. Community members
This r/MachineLearning discussion thread addresses the widespread challenge of reproducing results claimed in modern ML research papers, a topic of significant concern in the field. Community members share experiences and debate root causes such as missing or incomplete code, data leakage, cherry-picked results, and the "publish or perish" pressures that incentivize overstated claims. The thread reflects broader industry concerns that a substantial portion of ML papers may be non-reproducible, undermining scientific progress and wasting researcher time and compute resources.
Related
- What is the criteria for a ML paper to be published?[D]
- 'There's a new generation of empirical deep learning researchers, hacking away at whatever seems trendy, blowing with the wind' [D]
- Was looking at a ICLR 2025 Oral paper and I am shocked it got oral [D]
- Just did an analysis on ICLR 2025 vs 2026 scores and WOW [D]
- Which conference/journal do you believe currently has the most fair and accurate review process?[D]
- TMLR reviews stalled [D]
Source: r/MachineLearning | 2026-04-15