Reanalysis of Butler and Pogrebna (2018) using true and error model

Butler and Pogrebna (2018) devised triples of three-branch gambles theorized to violate transitivity of preference according to a most probable winner model. According to this model, a person chooses the option that has the higher probability to yield a better outcome than the other alternative. They tested 11 triples with 100 participants and found cases that appeared to violate weak stochastic transitivity and the triangle inequality. But tests of weak stochastic transitivity and the triangle inequality do not provide a proper method to compare transitive and intransitive models that allow mixtures of preference patterns and random errors. Those older methods can yield false conclusions regarding transitivity, for example, if different participants have different true preferences or if different choice problems have different rates of error. This paper reanalyzes their data using a true and error (TE) model, which does not require these unrealistic assumptions, and which provides estimates of the incidence of transitive and intransitive behavior in a mixture. Reanalysis indicated that 3 of the 11 triples showed convincing evidence of violations of transitivity in the opposite direction of the predictions of the most probable winner model. Further, these and other triples showed other significant violations of the most probable winner model. Despite some violations of the true and error model, the data of Butler and Pogrebna appear to contradict not only transitive utility models but they also refute the most probable winner model as a descriptive theory of choice behavior.