Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in [1].
Eddy: A Graphical Editor for OWL 2 Ontologies
Authors: Domenico Lembo, Daniele Pantaleone, Valerio Santarelli, Domenico Fabio Savo
IJCAI 2016 | Venue PDF | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Experimental | We conducted a first evaluation study for Eddy, involving ten participants from the industrial world, who have some background in conceptual design, which is basically the knowhow we assume for Eddy users. After a brief introduction to GRAPHOL and Eddy, participants were asked to perform ten editing tasks on the Pizza ontology6 specified in GRAPHOL. Each user was also asked to indicate the time it took him to complete the task, how clear it was to him how to perform the task, and how easy it was to carry out the task. In Figure 2 we show a synthesis of the results. |
| Researcher Affiliation | Academia | Domenico Lembo, Daniele Pantaleone, Valerio Santarelli, Domenico Fabio Savo Dipartimento di Ingegneria Informatica, Automatica e Gestionale A. Ruberti Sapienza Universit a di Roma EMAIL |
| Pseudocode | No | The paper does not contain any structured pseudocode or algorithm blocks. |
| Open Source Code | Yes | Eddy is a stand-alone software written in Python 3, with a GUI implemented through the Py Qt5 bindings for the Qt5 framework, and distributed under the GPL v3 license5. 5http://www.dis.uniroma1.it/graphol/download.html |
| Open Datasets | Yes | participants were asked to perform ten editing tasks on the Pizza ontology6 specified in GRAPHOL. 6http://protege.stanford.edu/ontologies/pizza/pizza.owl |
| Dataset Splits | No | No explicit mention of training, validation, or test splits for the dataset in the context of a machine learning model. The evaluation is a user study on a single ontology. |
| Hardware Specification | No | The paper does not provide specific details about the hardware used for running the experiments or the software. |
| Software Dependencies | Yes | Eddy is a stand-alone software written in Python 3, with a GUI implemented through the Py Qt5 bindings for the Qt5 framework |
| Experiment Setup | Yes | After a brief introduction to GRAPHOL and Eddy, participants were asked to perform ten editing tasks on the Pizza ontology6 specified in GRAPHOL. Each user was also asked to indicate the time it took him to complete the task, how clear it was to him how to perform the task, and how easy it was to carry out the task. |