Modality independent or modality specific? Common computations underlie confidence judgements in visual and auditory decisions

The mechanisms that enable humans to evaluate their confidence across a range of different decisions remain poorly understood. To bridge this gap in understanding, we used computational modelling to investigate the processes that underlie confidence judgements for perceptual decisions and the extent to which these computations are the same in the visual and auditory modalities. Participants completed two versions of a categorisation task with visual or auditory stimuli and made confidence judgements about their category decisions. In each modality, we varied both evidence strength, (i.e., the strength of the evidence for a particular category) and sensory uncertainty (i.e., the intensity of the sensory signal). We evaluated several classes of computational models which formalise the mapping of evidence strength and sensory uncertainty to confidence in different ways: 1) unscaled evidence strength models, 2) scaled evidence strength models, and 3) Bayesian models. Our model comparison results showed that across tasks and modalities, participants take evidence strength and sensory uncertainty into account in a way that is consistent with the scaled evidence strength class. Notably, the Bayesian class provided a relatively poor account of the data across modalities, particularly in the more complex categorisation task. Our findings suggest that a common process is used for evaluating confidence in perceptual decisions across domains, but that the parameter settings governing the process are tuned differently in each modality. Overall, our results highlight the impact of sensory uncertainty on confidence and the unity of metacognitive processing across sensory modalities.Author summary: In this study, we investigated the computational processes that describe how people derive a sense of confidence in their decisions. In particular, we used computational models to describe how decision confidence is generated from different stimulus features, specifically evidence strength and sensory uncertainty, and determined whether the same computations generalise to both visual and auditory decisions. We tested a range of different computational models from three distinct theoretical classes, where each class of models instantiated different algorithmic hypotheses about the computations that are used to generate confidence. We found that a single class of models, in which confidence is derived from a subjective assessment of the strength of the evidence for a particular choice scaled by an estimate of sensory uncertainty, provided the best account of confidence for both visual and auditory decisions. Our findings suggest that the same type of algorithm is used for evaluating confidence across sensory modalities but that the ‘settings’ (or parameters) of this process are fine-tuned within each modality.