Long papers
Up to 9 pages with unlimited references and appendices
AI/CORE Unranked
EvalMG (ARR Paper Commitment) 2026
The Second Workshop on Evaluation of Multimodal Generation (ARR Paper Commitment)
EvalMG26 @ SIGIR 2026 is the second workshop focused on evaluation methods for multimodal generation and retrieval systems, aiming to address challenges in assessing text-image-audio-video-3D systems used in RAG, multimodal search, and agentic AI. It brings together researchers from information retrieval, NLP, computer vision, and multimodal AI to advance principled, human-centric, and ethical evaluation frameworks.
Key deadlines
Verified September 9, 2026Full paper
May 27, 2026
AoE
Workshop timeline
Submission and decisions
Full paperKey deadline
May 27, 2026 · AoE
Paper fit
Contribution paths
A strong submission should clearly identify its contribution and evaluate it appropriately.
Short papers
Up to 4 pages with unlimited references and appendices
ARR paper commitment
Submissions via ARR paper commitment process on OpenReview
SIGIR Fast Track
Submissions of previously submitted SIGIR papers with review comments attached
Non-archival submissions
Papers accepted at other conferences (e.g., ACL, EMNLP, WWW, KDD, SIGIR) for presentation only, not included in proceedings
Research areas in scope
01
Evaluation Methods and Metrics
Multimodal retrieval for RAG, Agentic AI, recommendation systemsEvaluation of retrieved cross-modal samples, without relying on augmented generationMulti-aspect evaluation methods capturing inter- and intra-modal coherence, relevance, grounding, and contextual consistencyAutomatic and human-centric metrics for informativeness, factuality, fluency, faithfulness, calibration, and usability for multimodal generationMethodology for detecting, analysing, and mitigating multimodal bias, stereotypes, toxicity, and hallucinationsEvaluation in multimodal low-resource and multilingual settings, including culturally aware and cross-lingual metricsAgent-based evaluation of multimodal generation in multi-turn, tool-use, or iterative editing scenariosGame-theoretic or optimization-based formulations of evaluation objectives and protocolsEvaluation of the generation quality of synthetic multimodal data, provenance/attribution, and downstream impact on training and deployment
02
Benchmarking and Datasets
Benchmark retrieval datasets, evaluation protocols and annotations for text–image–audio–video–3D generation
03
Ethical and Security Considerations
Ethical considerations in the evaluation of multimodal text generation, including bias detection and mitigation strategiesEvaluation of Security and Privacy Dimensions in Multimodal Applications
Policies worth checking twice
- Papers must be anonymous for double-blind review
- Submissions must strictly follow SIGIR submission guidelines
- Long papers are limited to 9 pages, short papers to 4 pages (references and appendices unlimited)
- SIGIR Fast-track submissions require both paper and review comments as attachments; submissions without reviews will be desk rejected
- Non-archival submissions are accepted from papers already accepted at other conferences and will not be included in proceedings
Official sources
Compiled from the official call for papers. The organizers’ pages remain authoritative.
Last verified September 9, 2026