New evaluation methods and benchmarks
Methods and benchmarks for evaluating human-agent systems in deployed settings.
Machine Learning/CORE Unranked
NeurIPS-26 HAIC Workshop 2026
2026 NeurIPS Workshop Human-AI Coevolution
The HAIC @ NeurIPS 2026 workshop focuses on developing rigorous empirical methods to evaluate human-agent teams as they coevolve in real-world deployment, particularly in high-stakes domains like healthcare, mental health, aviation, and finance. Building on the inaugural ICLR 2025 workshop, this second edition centers on three interlinked themes: validity in deployed contexts, expert disagreement in human feedback, and adaptive evaluation for coevolving systems.
Key deadlines
Verified September 9, 2026Full paper
September 3, 2026
AoE
Workshop timeline
Submission and decisions
Full paperKey deadline
September 3, 2026 · AoE
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Datasets
Datasets capturing human-agent interaction in deployed or longitudinal settings.
Case studies
Case studies from high-stakes domains such as healthcare, mental health, aviation, and finance.
Reproducible critiques and replications
Reproducible critiques or replications of existing agentic benchmarks.
Position papers
Position papers advancing validity-centered or coevolutionary evaluation frameworks.
Research areas in scope
01
Themes
Validity of evaluation in deployed contextsExpert disagreement and the limits of human feedbackAdaptive testing and continual evaluation for coevolving systems
Policies worth checking twice
- Submissions are double-blind via OpenReview.
- Main text must not exceed 9 pages; references and appendices are excluded from this limit.
- Submissions must use the official NeurIPS 2026 LaTeX style files with the dblblindworkshop option.
- Author names, affiliations, and acknowledgments must be omitted for anonymization.
- References to authors' own prior work must be written in the third person.
- The workshop is non-archival: accepted papers may be submitted to conferences or journals afterwards.
- Posting to preprint servers (e.g., arXiv) is permitted before and during review.
- Work previously presented at venues without published proceedings may be submitted.
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026