Research Track Paper
Short, focused contributions (4–8 pages in COLM format) on theory, methodology, or systems related to the three core challenges of AI measurement science.
NLP/CORE Unranked
COLM 2026
First Workshop in AI Measurement Science: Toward Rigorous AI Evaluation
The AI Measurement Science Workshop is an inaugural one-day in-person event co-located with COLM 2026, aiming to establish AI evaluation as a rigorous scientific discipline. It brings together researchers from machine learning, statistics, psychometrics, economics, and policy to address challenges in measuring interactive, strategically optimized, and non-stationary AI systems.
Key deadlines
Verified September 9, 2026Full paper
July 2, 2026
AoE
Workshop timeline
Submission and decisions
Full paperKey deadline
July 2, 2026 · AoE
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Competition Track Paper
Write-ups from participants of the Predictive AI Evaluation Challenge, describing methods, results, and lessons learned in predicting model responses from sparse observations.
Research areas in scope
01
Research Track
Interactive MeasurementMeasurement under Strategic OptimizationMeasurement under Non-Stationarity
Policies worth checking twice
- Submissions must be 4–8 pages in COLM format with unlimited references.
- Review is double-blind with at least three reviews per paper.
- Accepted papers are non-archival.
- Submissions must be made via OpenReview.
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026