Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..
Reviewer Assignment Problem: A Systematic Review of the Literature
Authors: Meltem Aksoy, Seda Yanik, Mehmet Fatih Amasyali
JAIR 2023 | Venue PDF | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Theoretical | The primary objective of this survey paper is to provide scholars and practitioners with a comprehensive overview of available research on the RAP. |
| Researcher Affiliation | Academia | Meltem Aksoy EMAIL Seda Yanik EMAIL Istanbul Technical University, Industrial Engineering Department, Maçka, Istanbul, Turkey Mehmet Fatih Amasyali EMAIL Yildiz Technical University, Computer Engineering Department, Davutpaşa, Istanbul, Turkey |
| Pseudocode | No | The paper describes algorithms from other studies (e.g., 'greedy algorithm', 'ant colony optimization') but does not contain a structured pseudocode or algorithm block within its own text. |
| Open Source Code | No | The paper is a systematic review of the literature and does not describe a new methodology for which open-source code would be provided. Appendix A lists datasets and systems from other reviewed papers, not source code for this paper's methodology. |
| Open Datasets | No | The paper conducts a systematic literature review and does not perform experiments on a dataset in the traditional sense. Appendix A lists 'Available Datasets' which are datasets used by the studies reviewed in this paper, not datasets used for this paper's own analysis. |
| Dataset Splits | No | As a systematic literature review, this paper does not involve experimental data processing that would require dataset splits. |
| Hardware Specification | No | The paper is a systematic literature review and does not report on experiments conducted using specific hardware. |
| Software Dependencies | No | The paper mentions 'Mendeley' for duplicate removal during the review process, but it does not specify software dependencies with version numbers for replicating a computational methodology or experimental results. |
| Experiment Setup | No | The paper details a systematic literature review methodology, not an experimental setup with hyperparameters or training configurations. |