IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0216235.html
   My bibliography  Save this article

The effect of trial repetition and problem size on the consistency of decision making

Author

Listed:
  • Vladimír Bureš
  • Daniela Ponce
  • Pavel Čech
  • Karel Mls

Abstract

Human decision making involving many alternatives is encumbered with inconsistent prioritization. Although inconsistency is assumed to grow with the number of comparisons, it is shown to be reduced by conscious awareness under certain conditions. This study experimentally investigated the effect of repeating a criteria ranking task on inconsistency scores as measured by four different inconsistency coefficients. A total of 107 participants were engaged in a selection task that comprised of ranking from 3 to 10 criteria and was repeated in three trials. Upon completing the first trial, the participants were informed about the inconsistency issues and could improve their ranking in another two trials. The inconsistency score was computed for each set of comparisons and the effect of repeating the selection task on inconsistency concerning the number of criteria was analyzed using the repeated measures ANOVA. The results reveal a significant change in the inconsistency as the task was repeated but the difference depended on the number of criteria. There exists a borderline in the problem size under which the rankings are associated with significantly lower inconsistency, while the rankings with the larger number of criteria were found to have significantly higher inconsistency.

Suggested Citation

  • Vladimír Bureš & Daniela Ponce & Pavel Čech & Karel Mls, 2019. "The effect of trial repetition and problem size on the consistency of decision making," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-14, May.
    • Handle: RePEc:plo:pone00:0216235
    DOI: 10.1371/journal.pone.0216235
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0216235
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0216235&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0216235?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Saaty, Thomas L., 2003. "Decision-making with the AHP: Why is the principal eigenvector necessary," European Journal of Operational Research, Elsevier, vol. 145(1), pages 85-91, February.
    2. Matteo Brunelli & Luisa Canal & Michele Fedrizzi, 2013. "Inconsistency indices for pairwise comparison matrices: a numerical study," Annals of Operations Research, Springer, vol. 211(1), pages 493-509, December.
    3. Schreiber, Philipp & Weber, Martin, 2016. "Time inconsistent preferences and the annuitization decision," Journal of Economic Behavior & Organization, Elsevier, vol. 129(C), pages 37-55.
    4. Doorga, Jay R.S. & Rughooputh, Soonil D.D.V. & Boojhawon, Ravindra, 2019. "Multi-criteria GIS-based modelling technique for identifying potential solar farm sites: A case study in Mauritius," Renewable Energy, Elsevier, vol. 133(C), pages 1201-1219.
    5. Loomes, Graham & Sugden, Robert, 1982. "Regret Theory: An Alternative Theory of Rational Choice under Uncertainty," Economic Journal, Royal Economic Society, vol. 92(368), pages 805-824, December.
    6. Lin, Chang-Chun, 2007. "A revised framework for deriving preference values from pairwise comparison matrices," European Journal of Operational Research, Elsevier, vol. 176(2), pages 1145-1150, January.
    7. Leung, L. C. & Cao, D., 2000. "On consistency and ranking of alternatives in fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 124(1), pages 102-113, July.
    8. Majumdar, Debaleena & Pasqualetti, Martin J., 2019. "Analysis of land availability for utility-scale power plants and assessment of solar photovoltaic development in the state of Arizona, USA," Renewable Energy, Elsevier, vol. 134(C), pages 1213-1231.
    9. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    10. Ishizaka, Alessio & Siraj, Sajid, 2018. "Are multi-criteria decision-making tools useful? An experimental comparative study of three methods," European Journal of Operational Research, Elsevier, vol. 264(2), pages 462-471.
    11. Ralph L. Keeney, 2002. "Common Mistakes in Making Value Trade-Offs," Operations Research, INFORMS, vol. 50(6), pages 935-945, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vladimír Bureš & Jiří Cabal & Pavel Čech & Karel Mls & Daniela Ponce, 2020. "The Influence of Criteria Selection Method on Consistency of Pairwise Comparison," Mathematics, MDPI, vol. 8(12), pages 1-13, December.
    2. Yung-Lun Liu & Pen-Fa Ko & Jui-Te Chiang, 2021. "Developing an Evaluation Model for Monitoring Country-Based Tourism Competitiveness," SAGE Open, , vol. 11(3), pages 21582440211, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vladimír Bureš & Jiří Cabal & Pavel Čech & Karel Mls & Daniela Ponce, 2020. "The Influence of Criteria Selection Method on Consistency of Pairwise Comparison," Mathematics, MDPI, vol. 8(12), pages 1-13, December.
    2. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    3. Sahoo, Somadutta & Zuidema, Christian & van Stralen, Joost N.P. & Sijm, Jos & Faaij, André, 2022. "Detailed spatial analysis of renewables’ potential and heat: A study of Groningen Province in the northern Netherlands," Applied Energy, Elsevier, vol. 318(C).
    4. Sward, Jeffrey A. & Nilson, Roberta S. & Katkar, Venktesh V. & Stedman, Richard C. & Kay, David L. & Ifft, Jennifer E. & Zhang, K. Max, 2021. "Integrating social considerations in multicriteria decision analysis for utility-scale solar photovoltaic siting," Applied Energy, Elsevier, vol. 288(C).
    5. Lundy, Michele & Siraj, Sajid & Greco, Salvatore, 2017. "The mathematical equivalence of the “spanning tree” and row geometric mean preference vectors and its implications for preference analysis," European Journal of Operational Research, Elsevier, vol. 257(1), pages 197-208.
    6. József Temesi, 2019. "An interactive approach to determine the elements of a pairwise comparison matrix," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(2), pages 533-549, June.
    7. Paweł Karczmarek & Witold Pedrycz & Adam Kiersztyn, 2021. "Fuzzy Analytic Hierarchy Process in a Graphical Approach," Group Decision and Negotiation, Springer, vol. 30(2), pages 463-481, April.
    8. Paul Thaddeus Kazibudzki, 2016. "An examination of performance relations among selected consistency measures for simulated pairwise judgments," Annals of Operations Research, Springer, vol. 244(2), pages 525-544, September.
    9. Xiaobo Zhang & Chengshan Wang & Jie Fan & Huijun Wang & Hailong Li, 2020. "Optimizing the Analytic Hierarchy Process through a Suitability Evaluation of Underground Space Development in Tonghu District, Huizhou City," Energies, MDPI, vol. 13(3), pages 1-22, February.
    10. Benítez, Julio & Carpitella, Silvia & Certa, Antonella & Izquierdo, Joaquín, 2020. "Constrained consistency enforcement in AHP," Applied Mathematics and Computation, Elsevier, vol. 380(C).
    11. Zsombor Szádoczki & Sándor Bozóki & Patrik Juhász & Sergii V. Kadenko & Vitaliy Tsyganok, 2023. "Incomplete pairwise comparison matrices based on graphs with average degree approximately 3," Annals of Operations Research, Springer, vol. 326(2), pages 783-807, July.
    12. Colak, H. Ebru & Memisoglu, Tugba & Gercek, Yasin, 2020. "Optimal site selection for solar photovoltaic (PV) power plants using GIS and AHP: A case study of Malatya Province, Turkey," Renewable Energy, Elsevier, vol. 149(C), pages 565-576.
    13. Ting Kuo & Ming-Hui Chen, 2022. "On Indeterminacy of Interval Multiplicative Pairwise Comparison Matrix," Mathematics, MDPI, vol. 10(4), pages 1-18, February.
    14. Brunelli, Matteo & Fedrizzi, Michele, 2024. "Inconsistency indices for pairwise comparisons and the Pareto dominance principle," European Journal of Operational Research, Elsevier, vol. 312(1), pages 273-282.
    15. Sofia Spyridonidou & Georgia Sismani & Eva Loukogeorgaki & Dimitra G. Vagiona & Hagit Ulanovsky & Daniel Madar, 2021. "Sustainable Spatial Energy Planning of Large-Scale Wind and PV Farms in Israel: A Collaborative and Participatory Planning Approach," Energies, MDPI, vol. 14(3), pages 1-23, January.
    16. Mejías, Ana M. & Bellas, Roberto & Pardo, Juan E. & Paz, Enrique, 2019. "Traceability management systems and capacity building as new approaches for improving sustainability in the fashion multi-tier supply chain," International Journal of Production Economics, Elsevier, vol. 217(C), pages 143-158.
    17. Ergu, Daji & Kou, Gang & Peng, Yi & Shi, Yong, 2011. "A simple method to improve the consistency ratio of the pair-wise comparison matrix in ANP," European Journal of Operational Research, Elsevier, vol. 213(1), pages 246-259, August.
    18. Balali, Amirhossein & Yunusa-Kaltungo, Akilu & Edwards, Rodger, 2023. "A systematic review of passive energy consumption optimisation strategy selection for buildings through multiple criteria decision-making techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 171(C).
    19. Kwak, Yoonshin & Deal, Brian & Heavisides, Tom, 2021. "A large scale multi criteria suitability analysis for identifying solar development potential: A decision support approach for the state of Illinois, USA," Renewable Energy, Elsevier, vol. 177(C), pages 554-567.
    20. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0216235. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.