IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v211y2013i1p493-50910.1007-s10479-013-1329-0.html
   My bibliography  Save this article

Inconsistency indices for pairwise comparison matrices: a numerical study

Author

Listed:
  • Matteo Brunelli
  • Luisa Canal
  • Michele Fedrizzi

Abstract

Evaluating the level of inconsistency of pairwise comparisons is often a crucial step in multi criteria decision analysis. Several inconsistency indices have been proposed in the literature to estimate the deviation of expert’s judgments from a situation of full consistency. This paper surveys and analyzes ten indices from the numerical point of view. Specifically, we investigate degrees of agreement between them to check how similar they are. Results show a wide range of behaviors, ranging from very strong to very weak degrees of agreement. Copyright Springer Science+Business Media New York 2013

Suggested Citation

  • Matteo Brunelli & Luisa Canal & Michele Fedrizzi, 2013. "Inconsistency indices for pairwise comparison matrices: a numerical study," Annals of Operations Research, Springer, vol. 211(1), pages 493-509, December.
    • Handle: RePEc:spr:annopr:v:211:y:2013:i:1:p:493-509:10.1007/s10479-013-1329-0
    DOI: 10.1007/s10479-013-1329-0
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-013-1329-0
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10479-013-1329-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Osei-Bryson, Kweku-Muata, 2006. "An action learning approach for assessing the consistency of pairwise comparison data," European Journal of Operational Research, Elsevier, vol. 174(1), pages 234-244, October.
    2. Stein, William E. & Mizzi, Philip J., 2007. "The harmonic consistency index for the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 177(1), pages 488-497, February.
    3. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    4. Marcin Anholcer & Volodymyr Babiy & Sándor Bozóki & Waldemar Koczkodaj, 2011. "A simplified implementation of the least squares solution for pairwise comparisons matrices," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(4), pages 439-444, December.
    5. Salo, Ahti A. & Hamalainen, Raimo P., 1995. "Preference programming through approximate ratio comparisons," European Journal of Operational Research, Elsevier, vol. 82(3), pages 458-475, May.
    6. Saaty, Thomas L., 1994. "Highlights and critical points in the theory and application of the Analytic Hierarchy Process," European Journal of Operational Research, Elsevier, vol. 74(3), pages 426-447, May.
    7. Linares, Pedro, 2009. "Are inconsistent decisions better? An experiment with pairwise comparisons," European Journal of Operational Research, Elsevier, vol. 193(2), pages 492-498, March.
    8. Michele Fedrizzi & Matteo Brunelli, 2009. "Fair Consistency Evaluation For Reciprocal Relations And In Group Decision Making," New Mathematics and Natural Computation (NMNC), World Scientific Publishing Co. Pte. Ltd., vol. 5(02), pages 407-420.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pedro Linares & Sara Lumbreras & Alberto Santamaría & Andrea Veiga, 2016. "How relevant is the lack of reciprocity in pairwise comparisons? An experiment with AHP," Annals of Operations Research, Springer, vol. 245(1), pages 227-244, October.
    2. Yuji Sato & Kim Hua Tan, 2023. "Inconsistency indices in pairwise comparisons: an improvement of the Consistency Index," Annals of Operations Research, Springer, vol. 326(2), pages 809-830, July.
    3. Banai, Reza, 2010. "Evaluation of land use-transportation systems with the Analytic Network Process," The Journal of Transport and Land Use, Center for Transportation Studies, University of Minnesota, vol. 3(1), pages 85-112.
    4. Mustajoki, Jyri & Hamalainen, Raimo P. & Lindstedt, Mats R.K., 2006. "Using intervals for global sensitivity and worst-case analyses in multiattribute value trees," European Journal of Operational Research, Elsevier, vol. 174(1), pages 278-292, October.
    5. Chao, Ching-Cheng & Yu, Po-Cheng, 2013. "Quantitative evaluation model of air cargo competitiveness and comparative analysis of major Asia-Pacific airports," Transport Policy, Elsevier, vol. 30(C), pages 318-326.
    6. Sato, Yuji, 2012. "Optimal budget planning for investment in safety measures of a chemical company," International Journal of Production Economics, Elsevier, vol. 140(2), pages 579-585.
    7. Yulan Wang & Huayou Chen & Ligang Zhou, 2013. "Logarithm Compatibility of Interval Multiplicative Preference Relations with an Application to Determining the Optimal Weights of Experts in the Group Decision Making," Group Decision and Negotiation, Springer, vol. 22(4), pages 759-772, July.
    8. Valentin Bertsch & Wolf Fichtner, 2016. "A participatory multi-criteria approach for power generation and transmission planning," Annals of Operations Research, Springer, vol. 245(1), pages 177-207, October.
    9. Xu, Zeshui & Chen, Jian, 2008. "Some models for deriving the priority weights from interval fuzzy preference relations," European Journal of Operational Research, Elsevier, vol. 184(1), pages 266-280, January.
    10. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    11. Liu Fang & Peng Yanan & Zhang Weiguo & Pedrycz Witold, 2017. "On Consistency in AHP and Fuzzy AHP," Journal of Systems Science and Information, De Gruyter, vol. 5(2), pages 128-147, April.
    12. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    13. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.
    14. P Ji & R Jiang, 2003. "Scale transitivity in the AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 896-905, August.
    15. Jiménez, Antonio & Mateos, Alfonso & Sabio, Pilar, 2013. "Dominance intensity measure within fuzzy weight oriented MAUT: An application," Omega, Elsevier, vol. 41(2), pages 397-405.
    16. Wu-E Yang & Chao-Qun Ma & Zhi-Qiu Han & Wen-Jun Chen, 2016. "Checking and adjusting order-consistency of linguistic pairwise comparison matrices for getting transitive preference relations," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 38(3), pages 769-787, July.
    17. Abrahamsen, Eirik Bjorheim & Milazzo, Maria Francesca & Selvik, Jon T. & Asche, Frank & Abrahamsen, HÃ¥kon Bjorheim, 2020. "Prioritising investments in safety measures in the chemical industry by using the Analytic Hierarchy Process," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    18. Brunelli, Matteo & Fedrizzi, Michele, 2024. "Inconsistency indices for pairwise comparisons and the Pareto dominance principle," European Journal of Operational Research, Elsevier, vol. 312(1), pages 273-282.
    19. Phillips, Jason, 2013. "Determining the sustainability of large-scale photovoltaic solar power plants," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 435-444.
    20. Guo, Min & Yang, Jian-Bo & Chin, Kwai-Sang & Wang, Hongwei, 2007. "Evidential reasoning based preference programming for multiple attribute decision analysis under uncertainty," European Journal of Operational Research, Elsevier, vol. 182(3), pages 1294-1312, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:211:y:2013:i:1:p:493-509:10.1007/s10479-013-1329-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.