01
Workshop Topics
Formal tools for uncertainty representationTheoretical work on probability and its generalizationsSymbolic representations of uncertaintyDocumenting sources of uncertaintyTheoretical underpinnings of linguistic sources of variationData collection (e.g., to document linguistic variability, multiple perspectives, etc.)Explicit representation of model uncertainty (e.g., parameter and/or hypothesis uncertainty, Bayesian NNs in NLU/NLG, verbalised uncertainty, feature density, external calibration modules)Disentangled representation of different sources of uncertainty (e.g., hierarchical models, prompting)Reducing uncertainty due to additional context (e.g. clarification questions, retrieval/API augmented models)Learning from single and/or multiple referencesGradient estimation in latent variable modelsProbabilistic inference (Theoretical and applied work on approximate inference e.g., variational inference, Langevin dynamics)Unbiased and asymptotically unbiased sampling algorithmsUtility-aware decoders and controllable generationSelective predictionActive learningStatistical evaluation of language modelsCalibration to interpretable notions of uncertainty (e.g., calibration error, conformal prediction)Evaluation of epistemic uncertaintyTheoretical and empirical study of hallucination phenomena in NLU/NLGDescribing, formalising, categorising hallucination phenomenaMethods for detecting and quantifying hallucinationsMitigation techniques including uncertainty-aware generation, retrieval-augmented methods, and controllable generationRelationship between specific kinds (or sources) of uncertainty and hallucination occurrence