Heterogeneous relationships between working speed and ability on the Reasoning and Intelligence Online Test (RIOT)

Mental speed is a multidimensional construct that encompasses three distinct time-related measures: reaction time, processing speed, and tempo, the latter of which is defined as the rate at which individuals respond to items varying in difficulty. This study jointly analyzes item responses and response times from 1467 adults taking the nine core subtests of the Reasoning and Intelligence Online Test (RIOT; https://riotiq.com). Using a joint hierarchical model of responses and response times, results indicated good model fit across subtests, with weak correlations between examinee ability and examinee tempo for verbal tasks (r = −0.208 to 0.317) and stronger negative correlations for visuospatial tasks (r = −0.504 to −0.774), supporting predictions from dual process theory. Item intensity positively correlated with response times with difficulty on most subtests, indicating that item characteristics were the cause of longer response times for more difficult items. Few examinees (2.5 %) exhibited dual misfit in responses and times, but the Figure Weights subtest revealed anomalous slow responding. Findings are consistent with tempo (i.e., examinee response times) being largely independent of cognitive ability, with observed correlations influenced by item characteristics. Implications for intelligence testing and future experimental validation are discussed. A preprint of this article is available at https://osf.io/preprints/psyarxiv/c82b7.