Long papers
Up to 9 pages with unlimited references and appendices
AI/CORE Unranked
EvalMG (ARR Paper Commitment) 2026
The Second Workshop on Evaluation of Multimodal Generation (ARR Paper Commitment)
EvalMG26 @ SIGIR 2026 is the second workshop focused on evaluation methods for multimodal generation and retrieval systems, aiming to address challenges in assessing text-image-audio-video-3D generation within information retrieval and multimodal AI. It brings together researchers from IR, NLP, computer vision, and AI to advance principled evaluation frameworks, benchmarks, and metrics for multimodal systems.
Key deadlines
Verified September 9, 2026Full paper
May 27, 2026
AoE
Workshop timeline
Submission and decisions
Full paperKey deadline
May 27, 2026 · AoE
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Short papers
Up to 4 pages with unlimited references and appendices
ARR paper commitment
Submissions via ARR commitment page on OpenReview, with papers previously submitted to ARR
SIGIR Fast Track
Submissions of papers rejected from SIGIR 2026, including the original paper and review comments
Non-archival submissions
Papers accepted at other conferences (e.g., ACL, EMNLP, WWW, KDD, SIGIR) that are submitted for presentation only, without inclusion in proceedings
Research areas in scope
01
Evaluation Methods and Metrics
Multimodal retrieval for RAG, Agentic AI, recommendation systemsEvaluation of retrieved cross-modal samples, without relying on augmented generationMulti-aspect evaluation methods capturing inter- and intra-modal coherence, relevance, grounding, and contextual consistencyAutomatic and human-centric metrics for informativeness, factuality, fluency, faithfulness, calibration, and usability for multimodal generationMethodology for detecting, analysing, and mitigating multimodal bias, stereotypes, toxicity, and hallucinationsEvaluation in multimodal low-resource and multilingual settings, including culturally aware and cross-lingual metricsAgent-based evaluation of multimodal generation in multi-turn, tool-use, or iterative editing scenariosGame-theoretic or optimization-based formulations of evaluation objectives and protocolsEvaluation of the generation quality of synthetic multimodal data, provenance/attribution, and downstream impact on training and deployment
02
Benchmarking and Datasets
Benchmark retrieval datasets, evaluation protocols and annotations for text–image–audio–video–3D generation
03
Ethical and Security Considerations
Ethical considerations in the evaluation of multimodal text generation, including bias detection and mitigation strategiesEvaluation of Security and Privacy Dimensions in Multimodal Applications
Policies worth checking twice
- Papers must be anonymous for double-blind review
- Submissions must strictly follow SIGIR submission guidelines
- Direct submissions without review comments for SIGIR Fast Track will be desk rejected
- Non-archival submissions are not included in workshop proceedings
- Both long papers (9 pages) and short papers (4 pages) are accepted with unlimited references and appendices
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026