Position papers
Opinion-based or conceptual contributions on human-centered LLM evaluation and auditing.
NLP/CORE Unranked
HEAL@CHI'26 2026
Third Workshop on Human-Centered Evaluation and Auditing of Language Models: AI Agents-in-the-Loop
HEAL@CHI'26 is a workshop focused on human-centered evaluation and auditing of language models, bringing together HCI and AI researchers to address the 'evaluation crisis' in LLM research. Building on previous editions at CHI 2024 and 2025, the 2026 workshop emphasizes practical methods, tools, and ethical considerations for auditing LLMs, with a special theme on AI agents-in-the-loop and how to balance automation with human agency.
Key deadlines
Verified September 9, 2026Full paper
February 20, 2026
AoE
Workshop timeline
Submission and decisions
Full paperKey deadline
February 20, 2026 · AoE
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Full or in-progress empirical studies
Research presenting collected data and analysis on LLM evaluation methods or systems.
Literature reviews
Syntheses of existing research on human-centered LLM auditing.
System demos
Demonstrations of tools or platforms designed for LLM evaluation or auditing.
Method descriptions
Detailed explanations of novel evaluation or auditing methodologies.
Encore of published work (non-archival)
Re-submission of previously published work, exempt from anonymization and subject to jury review.
Research areas in scope
01
General Topics
Empirical understanding of stakeholders' needs and goals in LLM evaluation and auditingHuman-centered evaluation and auditing methods for LLMsTools, processes, and guidelines for LLM evaluation and auditingDiscussion of regulatory measures and public policies for LLM auditingEthics in LLM evaluation and auditing
02
Special Theme: AI Agents-in-the-Loop
Task allocation and workflow integration between human evaluators and AI agentsImpact of hybrid human-AI approaches on vulnerability discoveryMeta-evaluation frameworks for assessing trustworthiness of AI agents as auditing toolsMethodologies for evaluating complex agent behaviors (multi-step reasoning, tool use, emergent patterns)Design patterns and safeguards for maintaining human oversight in automated evaluationEmpirical studies of agent-assisted evaluation in practice
Policies worth checking twice
- Submissions must be 2-6 pages in ACM double-column format, excluding references.
- Review process is double-blind, except for encore submissions.
- Encore submissions do not need to be anonymized and undergo a jury review process.
- Authors must use \documentclass[sigconf,anonymous]{acmart} for submissions.
- New OpenReview profiles without institutional email may take up to two weeks to be moderated.
- Authors are encouraged to participate in the review process.
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026