Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..

Journal of Artificial Intelligence Research (JAIR) - 2019

Documentation Rate of Empirical Papers by Reproducibility Variable

Distribution of Empirical Papers by Number of Documented Variables

Website:

Venue Year Papers
Reproducibility Score Reproducibility Score based on Gundersen et al. (2025). See Methods for details.
Documentation Score Documentation Score is the average score over the seven reproducibility variables for empirical research papers. See Methods for details.
% Empirical Percentage of papers that are empirical research vs theoretical research.
% Industry Percentage of empirical research papers with at least one author from Industry.
Website
JAIR 2019 75 0.41 3.71 65.33% 22.45%
Pseudocode
Open Source Code
Open Datasets
Dataset Splits
Hardware Specification
Software Dependencies
Experiment Setup
A Coupled Operational Semantics for Goals and Commitments βœ… ❌ ❌ ❌ ❌ ❌ ❌ 1
A Generalisation of AGM Contraction and Revision to Fragments of First-Order Logic ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
A Sampling Approach for Proactive Project Scheduling under Generalized Time-dependent Workability Uncertainty βœ… ❌ βœ… ❌ βœ… βœ… βœ… 5
A Semantic Characterization ASP Base Revision ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
A Survey of Cross-lingual Word Embedding Models ❌ ❌ βœ… ❌ ❌ ❌ ❌ 1
A Survey on Temporal Reasoning for Temporal Information Extraction from Text ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
AI Generality and Spearman’s Law of Diminishing Returns βœ… ❌ βœ… ❌ ❌ ❌ βœ… 3
Acceptable Planning: Influencing Individual Behavior to Reduce Transportation Energy Expenditure of a City ❌ ❌ βœ… βœ… ❌ ❌ βœ… 3
Approximating Weighted and Priced Bribery in Scoring Rules βœ… ❌ ❌ ❌ ❌ ❌ ❌ 1
Automatic Language Identification in Texts: A Survey ❌ ❌ βœ… ❌ ❌ ❌ ❌ 1
Autonomous Target Search with Multiple Coordinated UAVs βœ… ❌ ❌ ❌ βœ… βœ… βœ… 4
Classifying Inconsistency Measures Using Graphs ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Community Structure in Industrial SAT Instances βœ… βœ… βœ… ❌ ❌ ❌ βœ… 4
Computing Multi-Modal Journey Plans under Uncertainty βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Computing and Explaining Query Answers over Inconsistent DL-Lite Knowledge Bases βœ… βœ… βœ… ❌ βœ… βœ… βœ… 6
Conditional Simple Temporal Networks with Uncertainty and Resources ❌ βœ… ❌ ❌ βœ… ❌ ❌ 2
Context Vectors are Reflections of Word Vectors in Half the Dimensions ❌ βœ… βœ… βœ… βœ… ❌ βœ… 5
Cost-Based Goal Recognition in Navigational Domains ❌ ❌ βœ… βœ… βœ… ❌ βœ… 4
DSTL: Solution to Limitation of Small Corpus in Speech Emotion Recognition βœ… ❌ βœ… βœ… ❌ ❌ βœ… 4
Deep Dialog Act Recognition using Multiple Token, Segment, and Context Information Representations ❌ ❌ βœ… βœ… ❌ ❌ βœ… 3
Dependency Learning for QBF βœ… βœ… βœ… ❌ βœ… ❌ βœ… 5
Distributed Gibbs: A Linear-Space Sampling-Based DCOP Algorithm βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Dynamic Controllability of Controllable Conditional Temporal Problems with Uncertainty βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Embedding Projection for Targeted Cross-lingual Sentiment: Model Comparisons and a Real-World Study ❌ βœ… βœ… βœ… ❌ ❌ βœ… 4
Enhancing Statement Evaluation in Argumentation via Multi-labelling Systems ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Fair Allocation of Indivisible Goods to Asymmetric Agents βœ… ❌ βœ… ❌ ❌ ❌ βœ… 3
Formulas Free From Inconsistency: An Atom-Centric Characterization in Priest's Minimally Inconsistent LP ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
From Support Propagation to Belief Propagation in Constraint Programming βœ… βœ… βœ… ❌ βœ… βœ… βœ… 6
Full Characterization of Parikh's Relevance-Sensitive Axiom for Belief Revision ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
General Game Playing with Imperfect Information βœ… ❌ ❌ ❌ ❌ ❌ ❌ 1
Goal Recognition Design in Deterministic Environments βœ… βœ… βœ… ❌ βœ… ❌ βœ… 5
IKBT: Solving Symbolic Inverse Kinematics with Behavior Tree ❌ βœ… βœ… ❌ ❌ ❌ βœ… 3
If Nothing Is Accepted -- Repairing Argumentation Frameworks ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Implicitly Coordinated Multi-Agent Path Finding under Destination Uncertainty: Success Guarantees and Computational Complexity ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Interpretable Charge Prediction for Criminal Cases with Dynamic Rationale Attention ❌ ❌ βœ… βœ… ❌ ❌ βœ… 3
Iterative Local Voting for Collective Decision-making in Continuous Spaces βœ… ❌ βœ… ❌ ❌ ❌ βœ… 3
Level-0 Models for Predicting Human Behavior in Games ❌ ❌ βœ… βœ… ❌ ❌ ❌ 2
Logical Foundations of Linked Data Anonymisation ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Modeling and Planning with Macro-Actions in Decentralized POMDPs βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Multi-agent Inverse Reinforcement Learning for Certain General-sum Stochastic Games βœ… ❌ ❌ ❌ ❌ ❌ βœ… 2
Multi-fidelity Gaussian Process Bandit Optimisation βœ… βœ… βœ… βœ… ❌ ❌ βœ… 5
Multi-scale Hierarchical Residual Network for Dense Captioning ❌ ❌ βœ… βœ… βœ… βœ… βœ… 5
Negotiable Votes ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
New Approximations for Coalitional Manipulation in Scoring Rules βœ… βœ… ❌ ❌ ❌ βœ… βœ… 4
On Inductive Abilities of Latent Factor Models for Relational Learning βœ… ❌ βœ… βœ… ❌ ❌ βœ… 4
On Non-Cooperativeness in Social Distance Games ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
On Overfitting and Asymptotic Bias in Batch Reinforcement Learning with Partial Observability ❌ βœ… ❌ βœ… ❌ ❌ βœ… 3
On the Time and Space Complexity of Genetic Programming for Evolving Boolean Conjunctions βœ… ❌ ❌ ❌ ❌ ❌ ❌ 1
OptStream: Releasing Time Series Privately βœ… ❌ ❌ ❌ ❌ ❌ βœ… 2
Pattern-Based Approach to the Workflow Satisfiability Problem with User-Independent Constraints βœ… βœ… βœ… ❌ βœ… ❌ βœ… 5
Pitfalls and Best Practices in Algorithm Configuration βœ… βœ… βœ… βœ… βœ… βœ… βœ… 7
Point-Based Value Iteration for Finite-Horizon POMDPs βœ… ❌ βœ… ❌ ❌ ❌ βœ… 3
Polynomial and Exponential Bounded Logic Programs with Function Symbols: Some New Decidable Classes ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Preference Orders on Families of Sets - When Can Impossibility Results Be Avoided? ❌ βœ… ❌ ❌ ❌ ❌ ❌ 1
Probabilistic Planning with Reduced Models βœ… βœ… βœ… ❌ βœ… ❌ βœ… 5
REBA: A Refinement-Based Architecture for Knowledge Representation and Reasoning in Robotics βœ… βœ… ❌ ❌ βœ… ❌ βœ… 4
Rank Pruning for Dominance Queries in CP-Nets βœ… βœ… βœ… ❌ ❌ ❌ βœ… 4
Recognizing Top-Monotonic Preference Profiles in Polynomial Time ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Revisiting CFR+ and Alternating Updates ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Revisiting Counting Solutions for the Global Cardinality Constraint βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Solving the Torpedo Scheduling Problem βœ… ❌ βœ… ❌ βœ… ❌ βœ… 4
Strategic Abstention based on Preference Extensions: Positive Results and Computer-Generated Impossibilities ❌ ❌ ❌ ❌ ❌ βœ… ❌ 1
Strong Stubborn Set Pruning for Star-Topology Decoupled State Space Search ❌ ❌ βœ… ❌ βœ… ❌ βœ… 3
Synthesizing Argumentation Frameworks from Examples βœ… βœ… βœ… βœ… βœ… βœ… ❌ 6
The Mathematics of Changing One’s Mind, via Jeffrey’s or via Pearl’s Update Rule ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Timed ATL: Forget Memory, Just Count ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Type-aware Convolutional Neural Networks for Slot Filling ❌ βœ… βœ… βœ… ❌ ❌ βœ… 4
Unifying System Health Management and Automated Decision Making ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Using Collective Behavior of Coupled Oscillators for Solving DCOP βœ… ❌ ❌ ❌ βœ… ❌ βœ… 3
Variable Elimination in Binary CSPs βœ… ❌ βœ… ❌ βœ… ❌ βœ… 4
Viewpoint: Human-in-the-loop Artificial Intelligence ❌ ❌ ❌ ❌ ❌ ❌ ❌ 0
Weighted Matching Markets with Budget Constraints βœ… ❌ ❌ ❌ ❌ ❌ ❌ 1
What is this Article about? Extreme Summarization with Topic-aware Convolutional Neural Networks ❌ βœ… βœ… βœ… βœ… ❌ βœ… 5
Xeggora: Exploiting Immune-to-Evidence Symmetries with Full Aggregation in Statistical Relational Models βœ… βœ… βœ… ❌ βœ… βœ… βœ… 6