On the Occupancy Measure of Non-Markovian Policies in Continuous MDPs
Authors: Romain Laroche, Remi Tachet Des Combes
ICML 2023 | Conference PDF | Archive PDF | Plain Text | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Theoretical | Our main contribution is to fill this gap and to provide a general measuretheoretic treatment of the problem, permitting, in particular, its extension to continuous MDPs. Furthermore, we show that when the occupancy is infinite, we may encounter some non-trivial cases where the result does not hold anymore. |
| Researcher Affiliation | Industry | 1Unemployed, work done while at Microsoft Research Montréal, Canada. |
| Pseudocode | No | The paper does not contain any structured pseudocode or algorithm blocks. |
| Open Source Code | No | The paper does not provide concrete access to source code for the methodology described. |
| Open Datasets | No | The paper is theoretical and does not use datasets for empirical training or evaluation. It mentions environments like 'Mu Jo Co' and 'Deep Mind Control' as systems to which their theory extends, but not as sources of datasets used in experiments. |
| Dataset Splits | No | The paper is theoretical and does not conduct experiments, therefore no dataset split information for validation is provided. |
| Hardware Specification | No | The paper is theoretical and does not report on experiments, therefore no hardware specifications are provided. |
| Software Dependencies | No | The paper is theoretical and does not report on experiments, therefore no specific software dependencies with version numbers are provided. |
| Experiment Setup | No | The paper is theoretical and does not report on experiments, therefore no experimental setup details like hyperparameters or training configurations are provided. |