IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0216235.html
   My bibliography  Save this article

The effect of trial repetition and problem size on the consistency of decision making

Author

Listed:
  • Vladimír Bureš
  • Daniela Ponce
  • Pavel Čech
  • Karel Mls

Abstract

Human decision making involving many alternatives is encumbered with inconsistent prioritization. Although inconsistency is assumed to grow with the number of comparisons, it is shown to be reduced by conscious awareness under certain conditions. This study experimentally investigated the effect of repeating a criteria ranking task on inconsistency scores as measured by four different inconsistency coefficients. A total of 107 participants were engaged in a selection task that comprised of ranking from 3 to 10 criteria and was repeated in three trials. Upon completing the first trial, the participants were informed about the inconsistency issues and could improve their ranking in another two trials. The inconsistency score was computed for each set of comparisons and the effect of repeating the selection task on inconsistency concerning the number of criteria was analyzed using the repeated measures ANOVA. The results reveal a significant change in the inconsistency as the task was repeated but the difference depended on the number of criteria. There exists a borderline in the problem size under which the rankings are associated with significantly lower inconsistency, while the rankings with the larger number of criteria were found to have significantly higher inconsistency.

Suggested Citation

  • Vladimír Bureš & Daniela Ponce & Pavel Čech & Karel Mls, 2019. "The effect of trial repetition and problem size on the consistency of decision making," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-14, May.
    • Handle: RePEc:plo:pone00:0216235
    DOI: 10.1371/journal.pone.0216235
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0216235
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0216235&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0216235?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matteo Brunelli & Luisa Canal & Michele Fedrizzi, 2013. "Inconsistency indices for pairwise comparison matrices: a numerical study," Annals of Operations Research, Springer, vol. 211(1), pages 493-509, December.
    2. Schreiber, Philipp & Weber, Martin, 2016. "Time inconsistent preferences and the annuitization decision," Journal of Economic Behavior & Organization, Elsevier, vol. 129(C), pages 37-55.
    3. Doorga, Jay R.S. & Rughooputh, Soonil D.D.V. & Boojhawon, Ravindra, 2019. "Multi-criteria GIS-based modelling technique for identifying potential solar farm sites: A case study in Mauritius," Renewable Energy, Elsevier, vol. 133(C), pages 1201-1219.
    4. Loomes, Graham & Sugden, Robert, 1982. "Regret Theory: An Alternative Theory of Rational Choice under Uncertainty," Economic Journal, Royal Economic Society, vol. 92(368), pages 805-824, December.
    5. Lin, Chang-Chun, 2007. "A revised framework for deriving preference values from pairwise comparison matrices," European Journal of Operational Research, Elsevier, vol. 176(2), pages 1145-1150, January.
    6. Ishizaka, Alessio & Siraj, Sajid, 2018. "Are multi-criteria decision-making tools useful? An experimental comparative study of three methods," European Journal of Operational Research, Elsevier, vol. 264(2), pages 462-471.
    7. Ralph L. Keeney, 2002. "Common Mistakes in Making Value Trade-Offs," Operations Research, INFORMS, vol. 50(6), pages 935-945, December.
    8. Saaty, Thomas L., 2003. "Decision-making with the AHP: Why is the principal eigenvector necessary," European Journal of Operational Research, Elsevier, vol. 145(1), pages 85-91, February.
    9. Leung, L. C. & Cao, D., 2000. "On consistency and ranking of alternatives in fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 124(1), pages 102-113, July.
    10. Majumdar, Debaleena & Pasqualetti, Martin J., 2019. "Analysis of land availability for utility-scale power plants and assessment of solar photovoltaic development in the state of Arizona, USA," Renewable Energy, Elsevier, vol. 134(C), pages 1213-1231.
    11. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vladimír Bureš & Jiří Cabal & Pavel Čech & Karel Mls & Daniela Ponce, 2020. "The Influence of Criteria Selection Method on Consistency of Pairwise Comparison," Mathematics, MDPI, vol. 8(12), pages 1-13, December.
    2. Yung-Lun Liu & Pen-Fa Ko & Jui-Te Chiang, 2021. "Developing an Evaluation Model for Monitoring Country-Based Tourism Competitiveness," SAGE Open, , vol. 11(3), pages 21582440211, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vladimír Bureš & Jiří Cabal & Pavel Čech & Karel Mls & Daniela Ponce, 2020. "The Influence of Criteria Selection Method on Consistency of Pairwise Comparison," Mathematics, MDPI, vol. 8(12), pages 1-13, December.
    2. Sahoo, Somadutta & Zuidema, Christian & van Stralen, Joost N.P. & Sijm, Jos & Faaij, André, 2022. "Detailed spatial analysis of renewables’ potential and heat: A study of Groningen Province in the northern Netherlands," Applied Energy, Elsevier, vol. 318(C).
    3. Sward, Jeffrey A. & Nilson, Roberta S. & Katkar, Venktesh V. & Stedman, Richard C. & Kay, David L. & Ifft, Jennifer E. & Zhang, K. Max, 2021. "Integrating social considerations in multicriteria decision analysis for utility-scale solar photovoltaic siting," Applied Energy, Elsevier, vol. 288(C).
    4. Lundy, Michele & Siraj, Sajid & Greco, Salvatore, 2017. "The mathematical equivalence of the “spanning tree” and row geometric mean preference vectors and its implications for preference analysis," European Journal of Operational Research, Elsevier, vol. 257(1), pages 197-208.
    5. Cho, Sangmin & Kim, Jinsoo & Lim, Deokoh, 2024. "Optimal design of renewable energy certificate multipliers using an LCOE-Integrated AHP model: A case study of South Korea," Renewable Energy, Elsevier, vol. 226(C).
    6. Mejías, Ana M. & Bellas, Roberto & Pardo, Juan E. & Paz, Enrique, 2019. "Traceability management systems and capacity building as new approaches for improving sustainability in the fashion multi-tier supply chain," International Journal of Production Economics, Elsevier, vol. 217(C), pages 143-158.
    7. Balali, Amirhossein & Yunusa-Kaltungo, Akilu & Edwards, Rodger, 2023. "A systematic review of passive energy consumption optimisation strategy selection for buildings through multiple criteria decision-making techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 171(C).
    8. Manolan Kandy, D. & Mörtberg, U. & Wretling, V. & Kuhlefelt, A. & Byström, G. & Polatidis, H. & Barney, A. & Balfors, B., 2024. "Spatial multicriteria framework for sustainable wind-farm planning – Accounting for conflicts," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    9. Elkadeem, M.R. & Younes, Ali & Sharshir, Swellam W. & Campana, Pietro Elia & Wang, Shaorong, 2021. "Sustainable siting and design optimization of hybrid renewable energy system: A geospatial multi-criteria analysis," Applied Energy, Elsevier, vol. 295(C).
    10. Hasan, Mostafa & Büyüktahtakın, İ. Esra & Elamin, Elshami, 2019. "A multi-criteria ranking algorithm (MCRA) for determining breast cancer therapy," Omega, Elsevier, vol. 82(C), pages 83-101.
    11. Bice Cavallo & Alessio Ishizaka, 2023. "Evaluating scales for pairwise comparisons," Annals of Operations Research, Springer, vol. 325(2), pages 951-965, June.
    12. Günen, Mehmet Akif, 2021. "A comprehensive framework based on GIS-AHP for the installation of solar PV farms in Kahramanmaraş, Turkey," Renewable Energy, Elsevier, vol. 178(C), pages 212-225.
    13. Dimitra G. Vagiona, 2021. "Comparative Multicriteria Analysis Methods for Ranking Sites for Solar Farm Deployment: A Case Study in Greece," Energies, MDPI, vol. 14(24), pages 1-23, December.
    14. Katkar, Venktesh V. & Sward, Jeffrey A. & Worsley, Alex & Zhang, K. Max, 2021. "Strategic land use analysis for solar energy development in New York State," Renewable Energy, Elsevier, vol. 173(C), pages 861-875.
    15. Kou, Gang & Ergu, Daji & Shang, Jennifer, 2014. "Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction," European Journal of Operational Research, Elsevier, vol. 236(1), pages 261-271.
    16. Afrasiabi, Ahmadreza & Chalmardi, Mazyar Kaboli & Balezentis, Tomas, 2022. "A novel hybrid evaluation framework for public organizations based on employees’ performance factors," Evaluation and Program Planning, Elsevier, vol. 91(C).
    17. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    18. József Temesi, 2019. "An interactive approach to determine the elements of a pairwise comparison matrix," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(2), pages 533-549, June.
    19. Paweł Karczmarek & Witold Pedrycz & Adam Kiersztyn, 2021. "Fuzzy Analytic Hierarchy Process in a Graphical Approach," Group Decision and Negotiation, Springer, vol. 30(2), pages 463-481, April.
    20. Yang, Hua & Xu, Yong & Zhou, Kan & Li, Jiuyi, 2024. "Mapping development potential and priority zones for utility-scale photovoltaic on the Qinghai-Tibet Plateau," Renewable Energy, Elsevier, vol. 237(PA).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0216235. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.