Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..

Journal of Artificial Intelligence Research (JAIR) - 2016

Documentation Rate of Empirical Papers by Reproducibility Variable

Distribution of Empirical Papers by Number of Documented Variables

Website:

Venue Year Papers
Reproducibility Score Reproducibility Score based on Gundersen et al. (2025). See Methods for details.
Documentation Score Documentation Score is the average score over the seven reproducibility variables for empirical research papers. See Methods for details.
% Empirical Percentage of papers that are empirical research vs theoretical research.
% Industry Percentage of empirical research papers with at least one author from Industry.
Website
JAIR 2016 65 0.44 3.94 80.0% 19.23%
Pseudocode
Open Source Code
Open Datasets
Dataset Splits
Hardware Specification
Software Dependencies
Experiment Setup
A Disaster Response System based on Human-Agent Collectives 3
A Distributed Representation-Based Framework for Cross-Lingual Transfer Parsing 4
A Primer on Neural Network Models for Natural Language Processing 1
A Study of Proxies for Shapley Allocations of Transport Costs 6
A Survey of Computational Treatments of Biomolecules by Robotics-Inspired Methods Modeling Equilibrium Structure and Dynamic 1
Adaptive Contract Design for Crowdsourcing Markets: Bandit Algorithms for Repeated Principal-Agent Problems 2
An Exact Algorithm Based on MaxSAT Reasoning for the Maximum Weight Clique Problem 6
Association Discovery and Diagnosis of Alzheimers Disease with Bayesian Multiview Learning 3
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures 2
Automatic Wordnet Development for Low-Resource Languages using Cross-Lingual WSD 4
Bayesian Optimization in a Billion Dimensions via Random Embeddings 4
Bilingual Distributed Word Representations from Document-Aligned Comparable Data 5
Budgeted Optimization with Constrained Experiments 3
Combining Two and Three-Way Embedding Models for Link Prediction in Knowledge Bases 4
Combining the Delete Relaxation with Critical-Path Heuristics: A Direct Characterization 6
Computing Repairs of Inconsistent DL-Programs over EL Ontologies 6
Convergence of Iterative Scoring Rules 0
Cross-Lingual Bridges with Models of Lexical Borrowing 2
DL-Lite Contraction and Revision 1
Datalog+- Ontology Consolidation 0
Distributional Correspondence Indexing for Cross-Lingual and Cross-Domain Sentiment Classification. 6
Effective Heuristics for Suboptimal Best-First Search 3
Effectiveness of Automatic Translations for Cross-Lingual Ontology Mapping 3
Efficient Mechanism Design for Online Scheduling 1
Embarrassingly Parallel Search in Constraint Programming 5
Exact Algorithms for MRE Inference 4
Exploiting Causality for Selective Belief Filtering in Dynamic Bayesian Networks 4
Finding Strategyproof Social Choice Functions via SAT Solving 1
Generating Models of a Matched Formula With a Polynomial Delay 1
Global Continuous Optimization with Error Bound and Fast Convergence 3
Goal Probability Analysis in Probabilistic Planning: Exploring and Enhancing the State of the Art 5
How Translation Alters Sentiment 2
Integrating Rules and Dictionaries from Shallow-Transfer Machine Translation into Phrase-Based Statistical Machine Translation 6
Introduction to the Special Issue on Cross-Language Algorithms and Applications 1
Knowledge Representation in Probabilistic Spatio-Temporal Knowledge Bases 0
Large-Scale Election Campaigns: Combinatorial Shift Bribery 1
Learning Concept Graphs from Online Educational Data 5
Learning Continuous Time Bayesian Networks in Non-stationary Domains 3
Lightweight Random Indexing for Polylingual Text Classification 6
Module Extraction in Expressive Ontology Languages via Datalog Reasoning 5
Multi-objective Reinforcement Learning through Continuous Pareto Manifold Approximation 3
News Across Languages - Cross-Lingual Document Similarity and Event Tracking 6
On the Satisfiability Problem for SPARQL Patterns 4
Optimal Any-Angle Pathfinding In Practice 6
Optimal Partial-Order Plan Relaxation via MaxSAT 5
Optimally Solving Dec-POMDPs as Continuous-State MDPs 3
P-SyncBB: A Privacy Preserving Branch and Bound DCOP Algorithm 3
PDT Logic: A Probabilistic Doxastic Temporal Logic for Reasoning about Beliefs in Multi-agent Systems 1
Parallel Model-Based Diagnosis on Multi-Core Computers 5
Predicting Twitter User Demographics using Distant Supervision from Website Traffic Data 4
ProMoca: Probabilistic Modeling and Analysis of Agents in Commitment Protocols 2
Quadratization and Roof Duality of Markov Logic Networks 3
Qualitative Spatial Logics for Buffered Geometries 1
Query and Predicate Emptiness in Ontology-Based Data Access 2
Scrubbing During Learning In Real-time Heuristic Search 3
Searching for the M Best Solutions in Graphical Models 4
Semantic Visualization with Neighborhood Graph Regularization 2
Semi-supervised Learning with Induced Word Senses for State of the Art Word Sense Disambiguation 4
Synthetic Treebanking for Cross-Lingual Dependency Parsing 4
The IBaCoP Planning System: Instance-Based Configured Portfolios 5
Time-Bounded Best-First Search for Reversible and Non-reversible Search Graphs 4
Time-Sensitive Bayesian Information Aggregation for Crowdsourcing Systems 3
Two Aspects of Relevance in Structured Argumentation: Minimality and Paraconsistency 0
Utilisation of Metadata Fields and Query Expansion in Cross-Lingual Search of User-Generated Internet Video 3
ZERO++: Harnessing the Power of Zero Appearances to Detect Anomalies in Large-Scale Data Sets 6