IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022is2ps461-s484.html
   My bibliography  Save this article

A diagnostic framework for the Bradley–Terry model

Author

Listed:
  • Weichen Wu
  • Nynke Niezink
  • Brian Junker

Abstract

Pairwise comparison data are widely seen in the social sciences, criminology, perception, genetics, bibliometrics, zoology, sports analytics and other fields, and the Bradley–Terry model is among the most commonly used to analyse such data. In this paper, we propose a framework of diagnostics for this class of models, developing diagnostics for both the objects being compared and the subjects making the comparisons. We illustrate the proposed framework in two survey data sets.

Suggested Citation

  • Weichen Wu & Nynke Niezink & Brian Junker, 2022. "A diagnostic framework for the Bradley–Terry model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 461-484, December.
  • Handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s461-s484
    DOI: 10.1111/rssa.12959
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12959
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12959?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Duchesne, Pierre & Lafaye De Micheaux, Pierre, 2010. "Computing the distribution of quadratic forms: Further comparisons between the Liu-Tang-Zhang approximation and exact methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 858-862, April.
    2. Turner, Heather & Firth, David, 2012. "Bradley-Terry Models in R: The BradleyTerry2 Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i09).
    3. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    4. Carolin Strobl & Florian Wickelmaier & Achim Zeileis, 2011. "Accounting for Individual Differences in Bradley-Terry Models by Means of Recursive Partitioning," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 135-153, April.
    5. A. Springall, 1973. "Response Surface Fitting Using a Generalization of the Bradley‐Terry Paired Comparison Model," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 22(1), pages 59-68, March.
    6. Hatzinger, Reinhold & Dittrich, Regina, 2012. "prefmod: An R Package for Modeling Preferences Based on Paired Comparisons, Rankings, or Ratings," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i10).
    7. Pena, Edsel A. & Slate, Elizabeth H., 2006. "Global Validation of Linear Model Assumptions," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 341-354, March.
    8. Ballinger, T Parker & Wilcox, Nathaniel T, 1997. "Decisions, Error and Heterogeneity," Economic Journal, Royal Economic Society, vol. 107(443), pages 1090-1105, July.
    9. Matthew J Salganik & Karen E C Levy, 2015. "Wiki Surveys: Open and Quantifiable Social Data Collection," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-17, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rowland G. Seymour & David Sirl & Simon P. Preston & Ian L. Dryden & Madeleine J. A. Ellis & Bertrand Perrat & James Goulding, 2022. "The Bayesian Spatial Bradley–Terry model: Urban deprivation modelling in Tanzania," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(2), pages 288-308, March.
    2. Francesca Giambona & Mariano Porcu & Isabella Sulis, 2017. "Students Mobility: Assessing the Determinants of Attractiveness Across Competing Territorial Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(3), pages 1105-1132, September.
    3. Anna Gottard & Giorgio Calzolari, 2014. "Alternative estimating procedures for multiple membership logit models with mixed effects: indirect inference and data cloning," Econometrics Working Papers Archive 2014_07, Universita' degli Studi di Firenze, Dipartimento di Statistica, Informatica, Applicazioni "G. Parenti".
    4. Gerhard Tutz & Gunther Schauberger, 2015. "Extended ordered paired comparison models with application to football data from German Bundesliga," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(2), pages 209-227, April.
    5. Wickelmaier, Florian & Strobl, Carolin & Zeileis, Achim, 2012. "Psychoco: Psychometric Computing in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i01).
    6. Jiménez-Gamero, M.D. & Alba-Fernández, M.V. & Jodrá, P. & Barranco-Chamorro, I., 2017. "Fast tests for the two-sample problem based on the empirical characteristic function," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 137(C), pages 390-410.
    7. Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2019. "Deliberately Stochastic," American Economic Review, American Economic Association, vol. 109(7), pages 2425-2445, July.
      • Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2012. "Deliberately Stochastic," PIER Working Paper Archive 17-013, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 25 May 2017.
    8. Butler, D. J., 2000. "Do non-expected utility choice patterns spring from hazy preferences? An experimental study of choice 'errors'," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 277-297, March.
    9. Nadeem Shafique Butt & Ahmad Azam Malik & Muhammad Qaiser Shahbaz, 2021. "Bibliometric Analysis of Statistics Journals Indexed in Web of Science Under Emerging Source Citation Index," SAGE Open, , vol. 11(1), pages 21582440209, January.
    10. Glen Archibald & Nathaniel Wilcox, 2002. "A New Variant of the Winner's Curse in a Coasian Contracting Game," Experimental Economics, Springer;Economic Science Association, vol. 5(2), pages 155-172, October.
    11. Schmidt, Ulrich & Neugebauer, Tibor, 2003. "An Experimental Investigation of the Role of Errors for Explaining Violations of Expected Utility," Hannover Economic Papers (HEP) dp-279, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    12. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 107420, University Library of Munich, Germany.
    13. David Lamparter & Daniel Marbach & Rico Rueedi & Zoltán Kutalik & Sven Bergmann, 2016. "Fast and Rigorous Computation of Gene and Pathway Scores from SNP-Based Summary Statistics," PLOS Computational Biology, Public Library of Science, vol. 12(1), pages 1-20, January.
    14. Ghiglietti, Andrea & Paganoni, Anna Maria, 2017. "Exact tests for the means of Gaussian stochastic processes," Statistics & Probability Letters, Elsevier, vol. 131(C), pages 102-107.
    15. Guillaume Hollard & Hela Maafi & Jean-Christophe Vergnaud, 2016. "Consistent inconsistencies? Evidence from decision under risk," Theory and Decision, Springer, vol. 80(4), pages 623-648, April.
    16. Herziger, Atar & Claborn, Kelly A. & Brooks, Jeremy S., 2020. "Is There Hope for the Double Dividend? How Social Context Can Shape Synergies and Tradeoffs between Sustainable Consumption and Well-Being," Ecological Economics, Elsevier, vol. 176(C).
    17. Nathaniel T. Wilcox, 2018. "Conditional Independence in a Binary Choice Experiment," Working Papers 18-08, Chapman University, Economic Science Institute.
    18. Gafari Lukumon & Mark Klein, 2023. "Crowd-sourced idea filtering with Bag of Lemons: the impact of the token budget size," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 50(2), pages 205-219, June.
    19. Gomes Adriana Maria Silva & de Sousa Paulo Sérgio Amaral & Moreira Maria do Rosário Alves, 2023. "Having a better environmental performance translates into a better financial performance: A study of the European food industry," Environmental & Socio-economic Studies, Sciendo, vol. 11(3), pages 1-13, September.
    20. D. A. Peel & Jie Zhang & D. Law, 2008. "The Markowitz model of utility supplemented with a small degree of probability distortion as an explanation of outcomes of Allais experiments over large and small payoffs and gambling on unlikely outc," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 17-26.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s461-s484. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.