Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..

Journal of Artificial Intelligence Research (JAIR) - 2014

Documentation Rate of Empirical Papers by Reproducibility Variable

Distribution of Empirical Papers by Number of Documented Variables

Website:

Venue Year Papers
Reproducibility Score Reproducibility Score based on Gundersen et al. (2025). See Methods for details.
Documentation Score Documentation Score is the average score over the seven reproducibility variables for empirical research papers. See Methods for details.
% Empirical Percentage of papers that are empirical research vs theoretical research.
% Industry Percentage of empirical research papers with at least one author from Industry.
Website
JAIR 2014 68 0.35 3.77 69.12% 4.26%
Pseudocode
Open Source Code
Open Datasets
Dataset Splits
Hardware Specification
Software Dependencies
Experiment Setup
A Decision-Theoretic Model of Assistance 2
A Hidden Markov Model-Based Acoustic Cicada Detector for Crowdsourced Smartphone Biodiversity Monitoring 2
A Multivariate Complexity Analysis of Lobbying in Multiple Referenda 6
A Novel SAT-Based Approach to Model Based Diagnosis 5
A Procedural Characterization of Solution Concepts in Games 1
Algorithms and Applications for the Same-Decision Probability 3
Algorithms for Argumentation Semantics: Labeling Attacks as a Generalization of Labeling Arguments 4
An Efficient Algorithm for Estimating State Sequences in Imprecise Hidden Markov Models 5
An Empirical Evaluation of Ranking Measures With Respect to Robustness to Noise 4
An Exact Double-Oracle Algorithm for Zero-Sum Extensive-Form Games with Imperfect Information 5
Arbitration and Stability in Cooperative Games with Overlapping Coalitions 0
Automaton Plans 1
BDD Ordering Heuristics for Classical Planning 3
Belief Tracking for Planning with Sensing: Width, Complexity and Approximations 3
Closure and Consistency In Logic-Associated Argumentation 0
Comparative Evaluation of Link-Based Approaches for Candidate Ranking in Link-to-Wikipedia Systems 5
Convergence of a Q-learning Variant for Continuous States and Actions 6
Cooperative Monitoring to Diagnose Multiagent Plans 6
Demand Side Energy Management via Multiagent Coordination in Consumer Cooperatives 4
Distributed Heuristic Forward Search for Multi-agent Planning 7
Efficient HEX-Program Evaluation Based on Unfounded Sets 5
Enhanced Partial Expansion A* 4
Entrenchment-Based Horn Contraction 0
False-Name Manipulation in Weighted Voting Games is Hard for Probabilistic Polynomial Time 0
Finding Optimal Solutions for Voting Game Design Problems 2
Game-Theoretic Patrolling with Dynamic Execution Uncertainty and a Case Study on a Real Transit System 4
HC-Search: A Learning Framework for Search-based Structured Prediction 4
Improved Separations of Regular Resolution from Clause Learning Proof Systems 0
Improving Delete Relaxation Heuristics Through Explicitly Represented Conjunctions 4
Inapproximability of Treewidth and Related Problems 0
Information-Theoretic Multi-view Domain Adaptation: A Theoretical and Empirical Study 4
Integrating Queueing Theory and Scheduling for Dynamic Scheduling Problems 3
Iterative Plan Construction for the Workflow Satisfiability Problem 3
Knowledge Forgetting in Answer Set Programming 1
Large-Scale Optimization for Evaluation Functions with Minimax Search 5
MDD Propagation for Sequence Constraints 5
Mechanisms for Fair Allocation Problems: No-Punishment Payment Rules in Verifiable Settings 1
Monotone Temporal Planning: Tractability, Extensions and Applications 1
Multiagent Only Knowing in Dynamic Systems 1
Multimodal Distributional Semantics 4
No Agent Left Behind: Dynamic Fair Division of Multiple Resources 3
On Minimum Representations of Matched Formulas 0
On the Testability of BDI Agent Systems 1
Optimal Scheduling of Contract Algorithms for Anytime Problem-Solving 0
Planning through Automatic Portfolio Configuration: The PbP Approach 6
Policy Iteration Based on Stochastic Factorization 2
Probabilistic Inference in Credal Networks: New Complexity Results 0
Property Directed Reachability for Automated Planning 6
Push and Rotate: a Complete Multi-agent Pathfinding Algorithm 3
Reasoning about Topological and Cardinal Direction Relations Between 2-Dimensional Spatial Objects 1
Reconnection with the Ideal Tree: A New Approach to Real-Time Search 4
Representing and Reasoning About the Rules of General Games With Imperfect Information 0
Robustness and Stability in Constraint Programming under Dynamism and Uncertainty 4
Scoring Functions Based on Second Level Score for k-SAT with Long Clauses 5
Selfishness Level of Strategic Games 0
Sensitivity of Diffusion Dynamics to Network Uncertainty 2
Sentiment Analysis of Short Informal Texts 2
Simple Regret Optimization in Online Planning for Markov Decision Processes 3
Speeding Up Iterative Ontology Alignment using Block-Coordinate Descent 3
Symmetric Subgame-Perfect Equilibria in Resource Allocation 1
Text Rewriting Improves Semantic Role Labeling 3
Text-Based Twitter User Geolocation Prediction 3
The Complexity of Answering Conjunctive and Navigational Queries over OWL 2 EL Knowledge Bases 1
Topic-Based Dissimilarity and Sensitivity Models for Translation Rule Selection 3
Towards Minimizing Disappointment in Repeated Games 2
Tutorial on Structured Continuous-Time Markov Processes 1
Using Meta-mining to Support Data Mining Workflow Planning and Optimization 4
Verification of Agent-Based Artifact Systems 0