Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..
Position-based Multiple-play Bandit Problem with Unknown Position Bias
Authors: Junpei Komiyama, Junya Honda, Akiko Takeda
NeurIPS 2017 | Venue PDF | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Experimental | To evaluate the empirical performance of the proposed algorithms, we conducted computer simulations with synthetic and real-world datasets. |
| Researcher Affiliation | Academia | Junpei Komiyama The University of Tokyo EMAIL Junya Honda The University of Tokyo / RIKEN EMAIL Akiko Takeda The Institute of Statistical Mathematics / RIKEN EMAIL |
| Pseudocode | Yes | Algorithm 1 PMED and PMED-Hinge Algorithms |
| Open Source Code | No | The paper does not provide concrete access to source code for the methodology described. |
| Open Datasets | Yes | Following the existing work [24, 27], we used the KDD Cup 2012 track 2 dataset [22] that involves session logs of soso.com, a search engine owned by Tencent. |
| Dataset Splits | No | The paper uses synthetic and real-world datasets but does not explicitly provide details about training, validation, and test splits (e.g., percentages or sample counts). |
| Hardware Specification | No | The paper does not provide specific hardware details (e.g., CPU, GPU models, or memory) used for running its experiments. |
| Software Dependencies | No | The paper mentions using 'the Gurobi LP solver' but does not provide a specific version number for it or any other software dependencies. |
| Experiment Setup | Yes | We set α = 10 for PMED. |