Notice: The reproducibility variables underlying each score are classified using an automated LLM-based pipeline, validated against a manually labeled dataset. LLM-based classification introduces uncertainty and potential bias; scores should be interpreted as estimates. Full accuracy metrics and methodology are described in Coakley et alK. L. Coakley, T. Snelleman, H. Hoos, and O. E. Gundersen, "The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers," Under Review, 2026..

Journal of Artificial Intelligence Research (JAIR) - 2024

Documentation Rate of Empirical Papers by Reproducibility Variable

Distribution of Empirical Papers by Number of Documented Variables

Website:

Venue Year Papers
Reproducibility Score Reproducibility Score based on Gundersen et al. (2025). See Methods for details.
Documentation Score Documentation Score is the average score over the seven reproducibility variables for empirical research papers. See Methods for details.
% Empirical Percentage of papers that are empirical research vs theoretical research.
% Industry Percentage of empirical research papers with at least one author from Industry.
Website
JAIR 2024 105 0.63 4.19 68.57% 16.67%
Pseudocode
Open Source Code
Open Datasets
Dataset Splits
Hardware Specification
Software Dependencies
Experiment Setup
A Fortiori Case-Based Reasoning: From Theory to Data 4
A Hybrid Intelligence Method for Argument Mining 3
A Map of Diverse Synthetic Stable Matching Instances 3
A Principled Distributional Approach to Trajectory Similarity Measurement and its Application to Anomaly Detection 4
A Scoping Study on AI Affordances in Early Childhood Education: Mapping the Global Landscape, Identifying Research Gaps, and Charting Future Research Directions 1
A Unified Perspective on Value Backup and Exploration in Monte-Carlo Tree Search 4
An Algorithm with Improved Complexity for Pebble Motion/Multi-Agent Path Finding on Trees 3
Approximate Counting of Linear Extensions in Practice 5
Axiomatization of Non-Recursive Aggregates in First-Order Answer Set Programming 0
Best of Both Worlds: Agents with Entitlements 1
Bias Mitigation Methods: Applicability, Legality, and Recommendations for Development 0
Block Domain Knowledge-Driven Learning of Chain Graphs Structure 3
Boolean Observation Games 1
Bt-GAN: Generating Fair Synthetic Healthdata via Bias-transforming Generative Adversarial Networks 4
Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML 1
Collision Avoiding Max-Sum for Mobile Sensor Teams 4
Computational Argumentation-based Chatbots: A Survey 0
Computing Pareto-Optimal and Almost Envy-Free Allocations of Indivisible Goods 1
Computing Unsatisfiable Cores for LTLf Specifications 5
Counting Complexity for Reasoning in Abstract Argumentation 1
Cross-domain Constituency Parsing by Leveraging Heterogeneous Data 4
Cultural Bias in Explainable AI Research: A Systematic Analysis 1
DIGCN: A Dynamic Interaction Graph Convolutional Network Based on Learnable Proposals for Object Detection 4
Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities 6
Declarative Approaches to Outcome Determination in Judgment Aggregation 6
Detecting Change Intervals with Isolation Distributional Kernel 7
Differentially Private Neural Tangent Kernels (DP-NTK) for Privacy-Preserving Data Generation 4
Digraph k-Coloring Games: New Algorithms and Experiments 6
Does CLIP Know My Face? 6
Effectiveness of Tree-based Ensembles for Anomaly Discovery: Insights, Batch and Streaming Active Learning 4
Efficient and Fair Healthcare Rationing 1
Efficiently Adapt to New Dynamic via Meta-Model 4
Estimating Agent Skill in Continuous Action Domains 2
Expected 1.x Makespan-Optimal Multi-Agent Path Finding on Grid Graphs in Low Polynomial Time 4
Experimental Design of Extractive Question-Answering Systems: Influence of Error Scores and Answer Length 3
Exploiting Contextual Target Attributes for Target Sentiment Classification 3
Exploring the Tradeoff Between System Profit and Income Equality Among Ride-hailing Drivers 3
Expressing and Exploiting Subgoal Structure in Classical Planning Using Sketches 4
From Single-Objective to Bi-Objective Maximum Satisfiability Solving 6
General Policies, Subgoal Structure, and Planning Width 1
Human Activity Recognition in an Open World 5
Human-in-the-Loop Reinforcement Learning: A Survey and Position on Requirements, Challenges, and Opportunities 0
Improving Reproducibility in AI Research: Four Mechanisms Adopted by JAIR 0
Individual Fairness, Base Rate Tracking and the Lipschitz Condition 0
Inverting Cryptographic Hash Functions via Cube-and-Conquer 6
Iterative Train Scheduling under Disruption with Maximum Satisfiability 6
Language-Models-as-a-Service: Overview of a New Paradigm and its Challenges 0
Learning Logic Specifications for Policy Guidance in POMDPs: an Inductive Logic Programming Approach 3
Learning to Resolve Social Dilemmas: A Survey 0
MallobSat: Scalable SAT Solving by Clause Sharing 5
Methods for Recovering Conditional Independence Graphs: A Survey 2
Mitigating Value Hallucination in Dyna-Style Planning via Multistep Predecessor Models 3
Mixed Fair Division: A Survey 0
Multi-Modal Attentive Prompt Learning for Few-shot Emotion Recognition in Conversations 3
Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework 4
On Mitigating the Utility-Loss in Differentially Private Learning: A New Perspective by a Geometrically Inspired Kernel Approach 6
On the Convergence of Swap Dynamics to Pareto-Optimal Matchings 0
On the Trade-off between Redundancy and Cohesiveness in Extractive Summarization 4
Opening the Analogical Portal to Explainability: Can Analogies Help Laypeople in AI-assisted Decision Making? 3
Performative Ethics From Within the Ivory Tower: How CS Practitioners Uphold Systems of Oppression 0
Practical and Parallelizable Algorithms for Non-Monotone Submodular Maximization with Size Constraint 4
Preserving Fairness in AI under Domain Shift 5
Principles and their Computational Consequences for Argumentation Frameworks with Collective Attacks 1
Probabilities of the Third Type: Statistical Relational Learning and Reasoning with Relative Frequencies 0
Proof Theory and Decision Procedures for Deontic STIT Logics 1
QCDCL vs QBF Resolution: Further Insights 0
Quantization Aware Factorization for Deep Neural Network Compression 5
Query-driven Qualitative Constraint Acquisition 6
Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challenges 0
Removing Bias and Incentivizing Precision in Peer-grading 5
Right Place, Right Time: Proactive Multi-Robot Task Allocation Under Spatiotemporal Uncertainty 3
Robust Average-Reward Reinforcement Learning 3
SAT-based Decision Tree Learning for Large Data Sets 7
Satisfiability Modulo User Propagators 6
Scalable Distributed Algorithms for Size-Constrained Submodular Maximization in the MapReduce and Adaptive Complexity Models 6
Scalable Primal Heuristics Using Graph Neural Networks for Combinatorial Optimization 7
Selfishly Prepaying in Financial Credit Networks 2
Separating and Collapsing Electoral Control Types 1
Similarity-Based Adaptation for Task-Aware and Task-Free Continual Learning 4
Simulating Counterfactuals 4
Structure in Deep Reinforcement Learning: A Survey and Open Problems 0
Symbolic Task Inference in Deep Reinforcement Learning 6
Tackling Cooperative Incompatibility for Zero-Shot Human-AI Coordination 5
The AI Race: Why Current Neural Network-based Architectures are a Poor Basis for Artificial General Intelligence 0
The Complexity of Subelection Isomorphism Problems 5
The Effect of Preferences in Abstract Argumentation under a Claim-Centric View 0
The Goal after Tomorrow: Offline Goal Reasoning with Norms 1
The Human in Interactive Machine Learning: Analysis and Perspectives for Ambient Intelligence 1
The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models 0
The State of Computer Vision Research in Africa 2
The TOAD System for Totally Ordered HTN Planning 5
Towards Robust Offline-to-Online Reinforcement Learning via Uncertainty and Smoothness 5
Towards Trustworthy AI-Enabled Decision Support Systems: Validation of the Multisource AI Scorecard Table (MAST) 3
Truth-tracking with Non-expert Information Sources 0
USN: A Robust Imitation Learning Method against Diverse Action Noise 4
Uncertainty as a Fairness Measure 3
Understanding Sample Generation Strategies for Learning Heuristic Functions in Classical Planning 6
Understanding What Affects the Generalization Gap in Visual Reinforcement Learning: Theory and Empirical Evidence 6
Undesirable Biases in NLP: Addressing Challenges of Measurement 0
Unifying SAT-Based Approaches to Maximum Satisfiability Solving 5
Using Constraint Propagation to Bound Linear Programs 5
Viewpoint: Hybrid Intelligence Supports Application Development for Diabetes Lifestyle Management 0
Visually Grounded Language Learning: A Review of Language Games, Datasets, Tasks, and Models 1
Weighted, Circular and Semi-Algebraic Proofs 0
conDENSE: Conditional Density Estimation for Time Series Anomaly Detection 3