IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v211y2013i1p511-52810.1007-s10479-013-1328-1.html
   My bibliography  Save this article

Analysis of pairwise comparison matrices: an empirical research

Author

Listed:
  • Sándor Bozóki
  • Linda Dezső
  • Attila Poesz
  • József Temesi

Abstract

Pairwise comparison (PC) matrices are used in multi-attribute decision problems (MADM) in order to express the preferences of the decision maker. Our research focused on testing various characteristics of PC matrices. In a controlled experiment with university students (N=227) we have obtained 454 PC matrices. The cases have been divided into 18 subgroups according to the key factors to be analyzed. Our team conducted experiments with matrices of different size given from different types of MADM problems. Additionally, the matrix elements have been obtained by different questioning procedures differing in the order of the questions. Results are organized to answer five research questions. Three of them are directly connected to the inconsistency of a PC matrix. Various types of inconsistency indices have been applied. We have found that the type of the problem and the size of the matrix had impact on the inconsistency of the PC matrix. However, we have not found any impact of the questioning order. Incomplete PC matrices played an important role in our research. The decision makers behavioral consistency was as well analyzed in case of incomplete matrices using indicators measuring the deviation from the final order of alternatives and from the final score vector. Copyright Springer Science+Business Media New York 2013

Suggested Citation

  • Sándor Bozóki & Linda Dezső & Attila Poesz & József Temesi, 2013. "Analysis of pairwise comparison matrices: an empirical research," Annals of Operations Research, Springer, vol. 211(1), pages 511-528, December.
    • Handle: RePEc:spr:annopr:v:211:y:2013:i:1:p:511-528:10.1007/s10479-013-1328-1
    DOI: 10.1007/s10479-013-1328-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-013-1328-1
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10479-013-1328-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S I Gass & S M Standard, 2002. "Characteristics of positive reciprocal matrices in the analytic hierarchy process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(12), pages 1385-1389, December.
    2. Bana e Costa, Carlos A. & Vansnick, Jean-Claude, 2008. "A critical analysis of the eigenvalue method used to derive priorities in AHP," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1422-1428, June.
    3. Gass, S. I. & Rapcsak, T., 2004. "Singular value decomposition in AHP," European Journal of Operational Research, Elsevier, vol. 154(3), pages 573-584, May.
    4. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.
    5. Sándor Bozóki & János Fülöp & Attila Poesz, 2011. "On pairwise comparison matrices that can be made consistent by the modification of a few elements," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 157-175, June.
    6. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    7. Linares, Pedro, 2009. "Are inconsistent decisions better? An experiment with pairwise comparisons," European Journal of Operational Research, Elsevier, vol. 193(2), pages 492-498, March.
    8. Thomas L. Saaty, 2005. "The Analytic Hierarchy and Analytic Network Processes for the Measurement of Intangible Criteria and for Decision-Making," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 345-405, Springer.
    9. Kuenz Murphy, Catherine, 1993. "Limits on the analytic hierarchy process from its consistency index," European Journal of Operational Research, Elsevier, vol. 65(1), pages 138-139, February.
    10. Jozsef Temesi, 2006. "Consistency of the decision-maker in pair-wise comparisons," International Journal of Management and Decision Making, Inderscience Enterprises Ltd, vol. 7(2/3), pages 267-274.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. João Carneiro & Luís Conceição & Diogo Martinho & Goreti Marreiros & Paulo Novais, 2018. "Including cognitive aspects in multiple criteria decision analysis," Annals of Operations Research, Springer, vol. 265(2), pages 269-291, June.
    2. Kułakowski, Konrad, 2018. "Inconsistency in the ordinal pairwise comparisons method with and without ties," European Journal of Operational Research, Elsevier, vol. 270(1), pages 314-327.
    3. Paul Thaddeus Kazibudzki, 2016. "An examination of performance relations among selected consistency measures for simulated pairwise judgments," Annals of Operations Research, Springer, vol. 244(2), pages 525-544, September.
    4. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    5. Bice Cavallo & Alessio Ishizaka, 2023. "Evaluating scales for pairwise comparisons," Annals of Operations Research, Springer, vol. 325(2), pages 951-965, June.
    6. Ágoston, Kolos Csaba & Csató, László, 2022. "Inconsistency thresholds for incomplete pairwise comparison matrices," Omega, Elsevier, vol. 108(C).
    7. Bertsch, Valentin & Hyland, Marie & Mahony, Michael, 2017. "What drives people's opinions of electricity infrastructure? Empirical evidence from Ireland," Energy Policy, Elsevier, vol. 106(C), pages 472-497.
    8. Bertsch, Valentin & Hall, Margeret & Weinhardt, Christof & Fichtner, Wolf, 2016. "Public acceptance and preferences related to renewable energy and grid expansion policy: Empirical insights for Germany," Energy, Elsevier, vol. 114(C), pages 465-477.
    9. Vladimír Bureš & Jiří Cabal & Pavel Čech & Karel Mls & Daniela Ponce, 2020. "The Influence of Criteria Selection Method on Consistency of Pairwise Comparison," Mathematics, MDPI, vol. 8(12), pages 1-13, December.
    10. Tarján, Tamás & Veres, Zoltán, 2018. "Szekvenciális fogyasztói termékválasztás döntési kontinuuma [The decision-making continuum of sequential consumer-product choices]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(5), pages 525-550.
    11. Matteo Brunelli, 2017. "Studying a set of properties of inconsistency indices for pairwise comparisons," Annals of Operations Research, Springer, vol. 248(1), pages 143-161, January.
    12. Zsombor Szádoczki & Sándor Bozóki & Patrik Juhász & Sergii V. Kadenko & Vitaliy Tsyganok, 2023. "Incomplete pairwise comparison matrices based on graphs with average degree approximately 3," Annals of Operations Research, Springer, vol. 326(2), pages 783-807, July.
    13. Brunelli, Matteo, 2019. "A study on the anonymity of pairwise comparisons in group decision making," European Journal of Operational Research, Elsevier, vol. 279(2), pages 502-510.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.
    2. József Temesi, 2019. "An interactive approach to determine the elements of a pairwise comparison matrix," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(2), pages 533-549, June.
    3. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.
    4. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Does AHP help us make a choice? An experimental evaluation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(10), pages 1801-1812, October.
    5. Yuji Sato & Kim Hua Tan, 2023. "Inconsistency indices in pairwise comparisons: an improvement of the Consistency Index," Annals of Operations Research, Springer, vol. 326(2), pages 809-830, July.
    6. C. Acuña-Soto & V. Liern & B. Pérez-Gladish, 2021. "Normalization in TOPSIS-based approaches with data of different nature: application to the ranking of mathematical videos," Annals of Operations Research, Springer, vol. 296(1), pages 541-569, January.
    7. Bice Cavallo, 2019. "$$\mathcal {G}$$ G -distance and $$\mathcal {G}$$ G -decomposition for improving $$\mathcal {G}$$ G -consistency of a Pairwise Comparison Matrix," Fuzzy Optimization and Decision Making, Springer, vol. 18(1), pages 57-83, March.
    8. Angilella, Silvia & Giarlotta, Alfio, 2009. "Implementations of PACMAN," European Journal of Operational Research, Elsevier, vol. 194(2), pages 474-495, April.
    9. Lai, Po‐Lin & Potter, Andrew & Beynon, Malcolm & Beresford, Anthony, 2015. "Evaluating the efficiency performance of airports using an integrated AHP/DEA-AR technique," Transport Policy, Elsevier, vol. 42(C), pages 75-85.
    10. Angilella, Silvia & Greco, Salvatore & Matarazzo, Benedetto, 2010. "Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral," European Journal of Operational Research, Elsevier, vol. 201(1), pages 277-288, February.
    11. Hassan, Mohammad Nurul & Hawas, Yaser E. & Ahmed, Kamran, 2013. "A multi-dimensional framework for evaluating the transit service performance," Transportation Research Part A: Policy and Practice, Elsevier, vol. 50(C), pages 47-61.
    12. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    13. Corrente, Salvatore & Greco, Salvatore & Ishizaka, Alessio, 2016. "Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression," Omega, Elsevier, vol. 61(C), pages 2-18.
    14. Thomas L. Saaty & Daji Ergu, 2015. "When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(06), pages 1171-1187, November.
    15. Stein, William E. & Mizzi, Philip J., 2007. "The harmonic consistency index for the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 177(1), pages 488-497, February.
    16. Liu, Fang & Zhang, Wei-Guo & Zhang, Li-Hua, 2014. "Consistency analysis of triangular fuzzy reciprocal preference relations," European Journal of Operational Research, Elsevier, vol. 235(3), pages 718-726.
    17. Jiří Mazurek, 2018. "Some notes on the properties of inconsistency indices in pairwise comparisons," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 28(1), pages 27-42.
    18. Salvatore Corrente & Michael Doumpos & Salvatore Greco & Roman Słowiński & Constantin Zopounidis, 2017. "Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions," Annals of Operations Research, Springer, vol. 251(1), pages 117-139, April.
    19. Pedro Linares & Sara Lumbreras & Alberto Santamaría & Andrea Veiga, 2016. "How relevant is the lack of reciprocity in pairwise comparisons? An experiment with AHP," Annals of Operations Research, Springer, vol. 245(1), pages 227-244, October.
    20. Sándor Bozóki & János Fülöp & Attila Poesz, 2011. "On pairwise comparison matrices that can be made consistent by the modification of a few elements," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 157-175, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:211:y:2013:i:1:p:511-528:10.1007/s10479-013-1328-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.