Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..
Forgetting Concept and Role Symbols in
Authors: ALCOIHμ
IJCAI 2016 | Venue PDF | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Experimental | We have implemented a prototype of the forgetting method in Java using the OWL-API1 and conducted two series of experiments on real-world ontologies to evaluate the practicality of the method. |
| Researcher Affiliation | Academia | Yizheng Zhao and Renate A. Schmidt The University of Manchester, UK |
| Pseudocode | No | The paper presents formal rules for calculus (Figures 2-5) but does not include structured pseudocode or algorithm blocks describing the procedural steps of the implementation. |
| Open Source Code | No | The paper states 'We have implemented a prototype of the forgetting method in Java using the OWL-API1' but does not provide a link or explicit statement about making their prototype's source code publicly available. |
| Open Datasets | Yes | The ontologies used for our evaluation were taken from the NCBO Bio Portal2 and Oxford Ontology3 repositories and were restricted to the ALCOIH(O, u)-fragments |
| Dataset Splits | No | The paper applies its method to entire ontologies and evaluates success rates; it does not describe train/validation/test dataset splits as would typically be done for machine learning experiments. |
| Hardware Specification | Yes | The experiments were run on a desktop with an Intelr Core TM i7-4790 processor, and four cores running at up to 3.60 GHz and 8 GB of DDR3-1600 MHz RAM. |
| Software Dependencies | No | The paper mentions using 'Java' and 'OWL-API1' (with a URL for OWL-API), but it does not specify version numbers for either of these software components. |
| Experiment Setup | Yes | To fit in with real-world applications...we forgot 10% and 30% of concept and role symbols in each ontology...We therefore set up another series of experiments where we forgot 80% of the concept symbols and 50% of the role symbols in each ontology. The symbols to be forgotten were randomly selected...a timeout of 15 minutes was used. |