Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in [1].
International Conference on Learning Representations (ICLR)
The Percentage of Empirical Papers Documenting Each Reproducibility Variable
| Venue |
Reproducibility Score based on Gundersen et al. (2025)
|
Global mean is the average score over the seven reproducibility variables for empirical research papers.
|
Percentage of papers that are empirical research vs theoretical research
|
Percentage of empirical research papers with at least one author from Industry
|
Website | ||
|---|---|---|---|---|---|---|---|
| ICLR | 2025 | 3700 | 0.66 | 4.54 | 97.97% | 42.65% | |
| ICLR | 2024 | 2260 | 0.66 | 4.27 | 97.43% | 48.86% | |
| ICLR | 2023 | 1573 | 0.66 | 4.29 | 96.82% | 51.48% | |
| ICLR | 2022 | 1094 | 0.66 | 4.3 | 97.62% | 50.94% | |
| ICLR | 2021 | 859 | 0.6 | 4.04 | 98.02% | 51.43% | |
| ICLR | 2020 | 687 | 0.56 | 3.79 | 97.67% | 55.89% | |
| ICLR | 2019 | 502 | 0.53 | 3.55 | 98.8% | 54.44% | |
| ICLR | 2018 | 337 | 0.5 | 3.47 | 98.52% | 56.93% | |
| ICLR | 2017 | 245 | 0.47 | 3.39 | 98.78% | 51.65% | |
| ICLR | 2016 | 80 | 0.43 | 3.33 | 97.5% | 51.28% | |
| ICLR | 2015 | 31 | 0.53 | 3.5 | 96.77% | 50.0% | |
| ICLR | 2014 | 38 | 0.39 | 3.16 | 97.37% | 27.03% |