Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..

Journal of Artificial Intelligence Research (JAIR) - 2022

Documentation Rate of Empirical Papers by Reproducibility Variable

Distribution of Empirical Papers by Number of Documented Variables

Website:

Venue Year Papers
Reproducibility Score Reproducibility Score based on Gundersen et al. (2025). See Methods for details.
Documentation Score Documentation Score is the average score over the seven reproducibility variables for empirical research papers. See Methods for details.
% Empirical Percentage of papers that are empirical research vs theoretical research.
% Industry Percentage of empirical research papers with at least one author from Industry.
Website
JAIR 2022 118 0.5 4.13 72.03% 23.53%
Pseudocode
Open Source Code
Open Datasets
Dataset Splits
Hardware Specification
Software Dependencies
Experiment Setup
A Comprehensive Framework for Learning Declarative Action Models 0
A Few Queries Go a Long Way: Information-Distortion Tradeoffs in Matching 1
A Logic-Based Explanation Generation Framework for Classical and Hybrid Planning Problems 5
A Metric Space for Point Process Excitations 3
A Survey of Methods for Automated Algorithm Configuration 3
A Survey of Opponent Modeling in Adversarial Domains 0
AAN+: Generalized Average Attention Network for Accelerating Neural Transformer 5
Adaptive Greedy versus Non-adaptive Greedy for Influence Maximization 2
Admissibility in Probabilistic Argumentation 5
Adversarial Framework with Certified Robustness for Time-Series Domain via Statistical Features 5
Agent-Based Modeling for Predicting Pedestrian Trajectories Around an Autonomous Vehicle 5
Altruistic Hedonic Games 0
Approximating Perfect Recall when Model Checking Strategic Abilities: Theory and Applications 4
Asymmetric Action Abstractions for Planning in Real-Time Strategy Games 3
Automated Dynamic Algorithm Configuration 6
Automated Reinforcement Learning (AutoRL): A Survey and Open Problems 1
Automatic Recognition of the General-Purpose Communicative Functions Defined by the ISO 24617-2 Standard for Dialog Act Annotation 3
Autotelic Agents with Intrinsically Motivated Goal-Conditioned Reinforcement Learning: A Short Survey 1
Avoiding Negative Side Effects of Autonomous Systems in the Open World 2
Better Decision Heuristics in CDCL through Local Search and Target Phases 6
C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition 5
CASA: Conversational Aspect Sentiment Analysis for Dialogue Understanding 4
Can We Automate Scientific Reviewing? 5
Chance-constrained Static Schedules for Temporally Probabilistic Plans 2
Classical Planning in Deep Latent Space 6
CoLLIE: Continual Learning of Language Grounding from Language-Image Embeddings 5
Communication-Aware Local Search for Distributed Constraint Optimization 3
Computational Benefits of Intermediate Rewards for Goal-Reaching Policy Learning 4
Computational Short Cuts in Infinite Domain Constraint Satisfaction 1
Constraint Solving Approaches to the Business-to-Business Meeting Scheduling Problem 5
Cooperation and Learning Dynamics under Wealth Inequality and Diversity in Individual Risk 2
Core Challenges in Embodied Vision-Language Planning 2
Creative Problem Solving in Artificially Intelligent Agents: A Survey and Framework 0
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems 3
Data-Driven Revision of Conditional Norms in Multi-Agent Systems 5
DeepSym: Deep Symbol Generation and Rule Learning for Planning from Unsupervised Robot Interaction 3
Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey 0
Doubly Robust Crowdsourcing 3
Efficient Learning of Interpretable Classification Rules 6
Evolutionary Dynamics and Phi-Regret Minimization in Games 2
Explainable Deep Learning: A Field Guide for the Uninitiated 0
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization 4
FOND Planning with Explicit Fairness Assumptions 4
Fair Division of Indivisible Goods for a Class of Concave Valuations 1
Fair in the Eyes of Others 5
Fairness in Influence Maximization through Randomization 6
Fast Adaptive Non-Monotone Submodular Maximization Subject to a Knapsack Constraint 3
Finding and Recognizing Popular Coalition Structures 0
Fine-grained Prediction of Political Leaning on Social Media with Unsupervised Deep Learning 3
First-Order Rewritability and Complexity of Two-Dimensional Temporal Ontology-Mediated Queries 0
Get out of the BAG! Silos in AI Ethics Education: Unsupervised Topic Modeling Analysis of Global AI Curricula 2
HEBO: Pushing The Limits of Sample-Efficient Hyper-parameter Optimisation 4
Image Captioning as an Assistive Technology: Lessons Learned from VizWiz 2020 Challenge 4
Impact of Imputation Strategies on Fairness in Machine Learning 4
Improving Simulated Annealing for Clique Partitioning Problems 5
Incremental Event Calculus for Run-Time Reasoning 6
Inductive Logic Programming At 30: A New Introduction 1
Initialization of Feature Selection Search for Classification 5
Interpretable Local Concept-based Explanation with Human Feedback to Predict All-cause Mortality 4
Joint Optimization of Concave Scalarized Multi-Objective Reinforcement Learning with Policy Gradient Based Algorithm 4
Jointly Learning Environments and Control Policies with Projected Stochastic Gradient Ascent 3
Learning Bayesian Networks Under Sparsity Constraints: A Parameterized Complexity Analysis 0
Learning to Design Fair and Private Voting Rules 1
Low-Rank Representation of Reinforcement Learning Policies 5
Marginal Distance and Hilbert-Schmidt Covariances-Based Independence Tests for Multivariate Functional Data 3
Mean-Semivariance Policy Optimization via Risk-Averse Reinforcement Learning 3
Metric-Distortion Bounds under Limited Information 5
Migrating Techniques from Search-based Multi-Agent Path Finding Solvers to SAT-based Approach 6
Motion Planning Under Uncertainty with Complex Agents and Environments via Hybrid Search 4
Multi-Agent Advisor Q-Learning 6
Multi-Agent Path Finding: A New Boolean Encoding 3
Multilingual Machine Translation: Deep Analysis of Language-Specific Encoder-Decoders 6
Multiobjective Tree-Structured Parzen Estimator 6
Neural Character-Level Syntactic Parsing for Chinese 6
Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning 0
Objective Bayesian Nets for Integrating Consistent Datasets 2
On Efficient Reinforcement Learning for Full-length Game of StarCraft II 5
On Tackling Explanation Redundancy in Decision Trees 5
On the Indecisiveness of Kelly-Strategyproof Social Choice Functions 0
On the Tractability of SHAP Explanations 1
Online Relaxation Refinement for Satisficing Planning: On Partial Delete Relaxation, Complete Hill-Climbing, and Novelty Pruning 5
Ordinal Maximin Share Approximation for Goods 3
Out of Context: A New Clue for Context Modeling of Aspect-based Sentiment Analysis 3
Path Counting for Grid-Based Navigation 3
Planning with Critical Section Macros: Theory and Practice 6
Planning with Perspectives -- Decomposing Epistemic Planning using Functional STRIPS 3
Planted Dense Subgraphs in Dense Random Graphs Can Be Recovered using Graph-based Machine Learning 4
Predicting Decisions in Language Based Persuasion Games 4
Preferences Single-Peaked on a Tree: Multiwinner Elections and Structural Results 1
Pricing Problems with Buyer Preselection 0
Proactive Dynamic Distributed Constraint Optimization Problems 4
Proofs and Certificates for Max-SAT 5
Ranking Sets of Objects: The Complexity of Avoiding Impossibility Results 0
Recursion in Abstract Argumentation is Hard --- On the Complexity of Semantics Based on Weak Admissibility 0
Reinforcement Learning from Optimization Proxy for Ride-Hailing Vehicle Relocation 6
Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches 0
Reward Machines: Exploiting Reward Function Structure in Reinforcement Learning 5
SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits 4
Scalable Online Planning for Multi-Agent MDPs 4
Solving the Watchman Route Problem with Heuristic Search 2
Some Inapproximability Results of MAP Inference and Exponentiated Determinantal Point Processes 0
Strategy Graphs for Influence Diagrams 3
Sum-of-Products with Default Values: Algorithms and Complexity Results 1
Supervised Visual Attention for Simultaneous Multimodal Machine Translation 4
Survey and Evaluation of Causal Discovery Methods for Time Series 4
Synthesis and Properties of Optimally Value-Aligned Normative Systems 3
TOOLTANGO: Common sense Generalization in Predicting Sequential Tool Interactions for Robot Plan Synthesis 4
The Application of Machine Learning Techniques for Predicting Match Results in Team Sport: A Review 0
The Complexity of Network Satisfaction Problems for Symmetric Relation Algebras with a Flexible Atom 0
The Computational Complexity of ReLU Network Training Parameterized by Data Dimensionality 0
The LM-Cut Heuristic Family for Optimal Numeric Planning with Simple Conditions 6
Threshold Treewidth and Hypertree Width 5
Towards Continual Reinforcement Learning: A Review and Perspectives 0
Towards Evidence Retrieval Cost Reduction in Abstract Argumentation Frameworks with Fallible Evidence 4
Two-phase Multi-document Event Summarization on Core Event Graphs 4
Viewpoint: Ethical By Designer - How to Grow Ethical Designers of Artificial Intelligence 0
Visually Grounded Models of Spoken Language: A Survey of Datasets, Architectures and Evaluation Techniques 4
sEMG-Based Upper Limb Movement Classifier: Current Scenario and Upcoming Challenges 1