Full papers
Up to 9 pages, excluding references and appendices, using the official NeurIPS 2026 style.
Machine Learning/CORE Unranked
IAEval 2026
Workshop on Evaluation of Interactive Agents @ NeurIPS 2026
The IAEval 2026 workshop, held in conjunction with NeurIPS 2026 in Atlanta, focuses on developing rigorous, scalable, and scientific evaluation methods for interactive agents that engage with users, tools, and environments over time. It addresses challenges in evaluating multi-turn interactions, user simulation, trajectory-level metrics, and ethical considerations in agentic AI systems.
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Short papers
Up to 4 pages, excluding references and appendices, using the official NeurIPS 2026 style.
Opinion papers
Must be titled in the format 'Opinion: [Your Title]' and present a clear viewpoint on evaluation challenges.
Research areas in scope
01
Evaluation Methods
Evaluation protocols for multi-turn assistants, tool-using agents, computer-use agents, collaborative agents, and user-facing systemsTrajectory-level evaluation, including transcripts, tool calls, intermediate states, final task outcomes, latency, cost, and other operational metricsRealistic simulation of users, environments, and interaction partnersValidation of user simulators as proxies for human behavior and as stress tests for deployed agentsGrader design, including deterministic checks, model-based rubrics, human evaluation, and calibration between themBenchmarks for long-horizon interaction, memory, adaptation, error recovery, and reliability across repeated trialsLearning from interaction data, production failures, user feedback, and human preference signalsSafety, fairness, privacy, and ethical considerations in evaluating interactive agents and simulated users
Policies worth checking twice
- Submissions must use the official NeurIPS 2026 style, available as an Overleaf template.
- Submissions are double-blind: author names, affiliations, and identifying information must be removed.
- The workshop is non-archival: accepted papers will not appear in published proceedings and may be submitted elsewhere.
- Work already under review or accepted at another venue may be submitted.
- At least one author of each accepted paper must attend in person to present.
- Papers accepted to the NeurIPS 2026 main conference are eligible for expedited review if relevant to the workshop themes.
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026