Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in [1].
Reviewer Assignment Problem: A Systematic Review of the Literature
Authors: Meltem Aksoy, Seda Yanik, Mehmet Fatih Amasyali
JAIR 2023 | Venue PDF | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Theoretical | The primary objective of this survey paper is to provide scholars and practitioners with a comprehensive overview of available research on the RAP. |
| Researcher Affiliation | Academia | Meltem Aksoy EMAIL Seda Yanik EMAIL Istanbul Technical University, Industrial Engineering Department, Maçka, Istanbul, Turkey Mehmet Fatih Amasyali EMAIL Yildiz Technical University, Computer Engineering Department, Davutpaşa, Istanbul, Turkey |
| Pseudocode | No | The paper describes algorithms from other studies (e.g., 'greedy algorithm', 'ant colony optimization') but does not contain a structured pseudocode or algorithm block within its own text. |
| Open Source Code | No | The paper is a systematic review of the literature and does not describe a new methodology for which open-source code would be provided. Appendix A lists datasets and systems from other reviewed papers, not source code for this paper's methodology. |
| Open Datasets | No | The paper conducts a systematic literature review and does not perform experiments on a dataset in the traditional sense. Appendix A lists 'Available Datasets' which are datasets used by the studies reviewed in this paper, not datasets used for this paper's own analysis. |
| Dataset Splits | No | As a systematic literature review, this paper does not involve experimental data processing that would require dataset splits. |
| Hardware Specification | No | The paper is a systematic literature review and does not report on experiments conducted using specific hardware. |
| Software Dependencies | No | The paper mentions 'Mendeley' for duplicate removal during the review process, but it does not specify software dependencies with version numbers for replicating a computational methodology or experimental results. |
| Experiment Setup | No | The paper details a systematic literature review methodology, not an experimental setup with hyperparameters or training configurations. |