On the Optimality of Batch Policy Optimization Algorithms
Authors: Chenjun Xiao, Yifan Wu, Jincheng Mei, Bo Dai, Tor Lattimore, Lihong Li, Csaba Szepesvari, Dale Schuurmans
ICML 2021 | Conference PDF | Archive PDF | Plain Text | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Experimental | Simulation results. Since our discussion is based on comparing only the upper bounds (instead of the exact regret) for different algorithms, it is a question that whether these statements still hold in terms of their actual performance. To answer this question, we verify these statements through experiments on synthetic problems. The details of these synthetic experiments can be found in the supplementary material. |
| Researcher Affiliation | Collaboration | 1University of Alberta 2Google Research, Brain Team 3Carnegie Mellon University 4Deep Mind 5Amazon. |
| Pseudocode | No | The paper describes algorithms in prose and mathematical formulas, but does not include explicit pseudocode blocks or labeled algorithm sections. |
| Open Source Code | No | The paper does not include any statement about releasing open-source code for the described methodology or provide a link to a code repository. |
| Open Datasets | No | The paper uses 'synthetic problems' and describes how the data is generated (e.g., 'Gaussian reward distributions N(µ1, 1) and N(µ2, 1)', 'The data set is generated by a behavior policy') rather than relying on or providing access to a publicly available dataset. |
| Dataset Splits | No | The paper describes generating synthetic data for simulations but does not specify train, validation, or test splits for this data. |
| Hardware Specification | No | The paper does not provide any specific hardware details (e.g., GPU/CPU models, memory) used for running its experiments. |
| Software Dependencies | No | The paper does not specify any software dependencies with version numbers (e.g., programming languages, libraries, or frameworks). |
| Experiment Setup | No | The paper states that 'The details of these synthetic experiments can be found in the supplementary material,' but these details are not provided in the main text of the paper. |