IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v304y2023i2p676-688.html
   My bibliography  Save this article

Robustness to rank reversal in pairwise comparison matrices based on uncertainty bounds

Author

Listed:
  • Faramondi, Luca
  • Oliva, Gabriele
  • Setola, Roberto
  • Bozóki, Sándor

Abstract

In the context of decision making, pairwise comparisons matrices (PCMs) based on a ratio scale are essential for deriving absolute preferences from relative comparisons. Such techniques are based on Subject Matter Experts (SMEs), which express their relative judgements on pairs of alternatives, providing pairwise comparison information, also in the case of incomplete or uncertain data, in order to obtain an absolute ranking about the alternatives. In this work, we propose a novel approach, complementary to measuring inconsistency, able to integrate and evaluate the concept of uncertainty in PCMs in order to verify the credibility of the final outcome. Such approach characterizes how SMEs’ uncertainty reflects into rank reversal. This is done via a novel optimization problem aiming to identify the smallest perturbations of the pairwise comparison values which result in an altered ranking of alternatives, e.g., reverting the ranking for at least a pair of alternatives.

Suggested Citation

  • Faramondi, Luca & Oliva, Gabriele & Setola, Roberto & Bozóki, Sándor, 2023. "Robustness to rank reversal in pairwise comparison matrices based on uncertainty bounds," European Journal of Operational Research, Elsevier, vol. 304(2), pages 676-688.
  • Handle: RePEc:eee:ejores:v:304:y:2023:i:2:p:676-688
    DOI: 10.1016/j.ejor.2022.04.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722003083
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2022.04.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James S. Dyer, 1990. "Remarks on the Analytic Hierarchy Process," Management Science, INFORMS, vol. 36(3), pages 249-258, March.
    2. Faramondi, Luca & Oliva, Gabriele & Setola, Roberto, 2020. "Multi-criteria node criticality assessment framework for critical infrastructure networks," International Journal of Critical Infrastructure Protection, Elsevier, vol. 28(C).
    3. Matteo Brunelli & Michele Fedrizzi, 2015. "Axiomatic properties of inconsistency indices for pairwise comparisons," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(1), pages 1-15, January.
    4. Dejian Yu & Gang Kou & Zeshui Xu & Shunshun Shi, 2021. "Analysis of Collaboration Evolution in AHP Research: 1982–2018," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 20(01), pages 7-36, January.
    5. Golany, B. & Kress, M., 1993. "A multicriteria evaluation of methods for obtaining weights from ratio-scale matrices," European Journal of Operational Research, Elsevier, vol. 69(2), pages 210-220, September.
    6. Wei, Chun-Chin & Chien, Chen-Fu & Wang, Mao-Jiun J., 2005. "An AHP-based approach to ERP system selection," International Journal of Production Economics, Elsevier, vol. 96(1), pages 47-62, April.
    7. Fernando A. F. Ferreira & Sérgio P. Santos & Paulo M. M. Rodrigues & Ronald W. Spahr, 2014. "How to create indices for bank branch financial performance measurement using MCDA techniques: an illustrative example," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 15(4), pages 708-728, September.
    8. Thomas L. Saaty, 1990. "An Exposition of the AHP in Reply to the Paper "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 259-268, March.
    9. Leung, L. C. & Cao, D., 2000. "On consistency and ranking of alternatives in fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 124(1), pages 102-113, July.
    10. Xu, Z., 2000. "On consistency of the weighted geometric mean complex judgement matrix in AHP," European Journal of Operational Research, Elsevier, vol. 126(3), pages 683-687, November.
    11. Wang, Ying-Ming & Luo, Ying & Hua, Zhongsheng, 2008. "On the extent analysis method for fuzzy AHP and its applications," European Journal of Operational Research, Elsevier, vol. 186(2), pages 735-747, April.
    12. Arbel, Ami & Vargas, Luis G., 1993. "Preference simulation and preference programming: robustness issues in priority derivation," European Journal of Operational Research, Elsevier, vol. 69(2), pages 200-209, September.
    13. Chang, Da-Yong, 1996. "Applications of the extent analysis method on fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 95(3), pages 649-655, December.
    14. James S. Dyer, 1990. "A Clarification of "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 274-275, March.
    15. Danae Diakoulaki & Carlos Henggeler Antunes & António Gomes Martins, 2005. "MCDA and Energy Planning," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 859-890, Springer.
    16. Zhu, Ke-Jun & Jing, Yu & Chang, Da-Yong, 1999. "A discussion on Extent Analysis Method and applications of fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 116(2), pages 450-456, July.
    17. Neves, L.P. & Dias, L.C. & Antunes, C.H. & Martins, A.G., 2009. "Structuring an MCDA model using SSM: A case study in energy efficiency," European Journal of Operational Research, Elsevier, vol. 199(3), pages 834-845, December.
    18. Wang, Xiaoting & Triantaphyllou, Evangelos, 2008. "Ranking irregularities when evaluating alternatives by using some ELECTRE methods," Omega, Elsevier, vol. 36(1), pages 45-63, February.
    19. Cook, Wade D. & Kress, Moshe, 1988. "Deriving weights from pairwise comparison ratio matrices: An axiomatic approach," European Journal of Operational Research, Elsevier, vol. 37(3), pages 355-362, December.
    20. Sajjad Zahir, M., 1991. "Incorporating the uncertainty of decision judgements in the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 53(2), pages 206-216, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Kędzior & Konrad Kułakowski, 2023. "Multiple-Criteria Heuristic Rating Estimation," Mathematics, MDPI, vol. 11(13), pages 1-19, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mikhailov, L., 2004. "A fuzzy approach to deriving priorities from interval pairwise comparison judgements," European Journal of Operational Research, Elsevier, vol. 159(3), pages 687-704, December.
    2. Van den Honert, R. C., 1998. "Stochastic group preference modelling in the multiplicative AHP: A model of group consensus," European Journal of Operational Research, Elsevier, vol. 110(1), pages 99-111, October.
    3. Zhü, Kèyù, 2014. "Fuzzy analytic hierarchy process: Fallacy of the popular methods," European Journal of Operational Research, Elsevier, vol. 236(1), pages 209-217.
    4. Satish Tyagi, 2016. "An improved fuzzy-AHP (IFAHP) approach to compare SECI modes," International Journal of Production Research, Taylor & Francis Journals, vol. 54(15), pages 4520-4536, August.
    5. Yu-Jie Wang, 2023. "Extending Quality Function Deployment and Analytic Hierarchy Process under Interval-Valued Fuzzy Environment for Evaluating Port Sustainability," Sustainability, MDPI, vol. 15(7), pages 1-19, March.
    6. Liu, Xianliang & Ma, Yonghao, 2021. "A method to analyze the rank reversal problem in the ELECTRE II method," Omega, Elsevier, vol. 102(C).
    7. Rezaei, Jafar & Ortt, Roland, 2013. "Multi-criteria supplier segmentation using a fuzzy preference relations based AHP," European Journal of Operational Research, Elsevier, vol. 225(1), pages 75-84.
    8. Heo, Eunnyeong & Kim, Jinsoo & Boo, Kyung-Jin, 2010. "Analysis of the assessment factors for renewable energy dissemination program evaluation using fuzzy AHP," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(8), pages 2214-2220, October.
    9. Matteo Brunelli, 2017. "Studying a set of properties of inconsistency indices for pairwise comparisons," Annals of Operations Research, Springer, vol. 248(1), pages 143-161, January.
    10. Shapiro, Arnold F. & Koissi, Marie-Claire, 2017. "Fuzzy logic modifications of the Analytic Hierarchy Process," Insurance: Mathematics and Economics, Elsevier, vol. 75(C), pages 189-202.
    11. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.
    12. Madjid Tavana & Mariya Sodenkamp & Leena Suhl, 2010. "A soft multi-criteria decision analysis model with application to the European Union enlargement," Annals of Operations Research, Springer, vol. 181(1), pages 393-421, December.
    13. M Tavana & M A Sodenkamp, 2010. "A fuzzy multi-criteria decision analysis model for advanced technology assessment at Kennedy Space Center," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(10), pages 1459-1470, October.
    14. Nitidetch Koohathongsumrit & Pongchanun Luangpaiboon, 2022. "An integrated FAHP–ZODP approach for strategic marketing information system project selection," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(6), pages 1792-1809, September.
    15. Lundy, Michele & Siraj, Sajid & Greco, Salvatore, 2017. "The mathematical equivalence of the “spanning tree” and row geometric mean preference vectors and its implications for preference analysis," European Journal of Operational Research, Elsevier, vol. 257(1), pages 197-208.
    16. Hsin-Chieh Wu & Toly Chen & Chin-Hau Huang, 2020. "A Piecewise Linear FGM Approach for Efficient and Accurate FAHP Analysis: Smart Backpack Design as an Example," Mathematics, MDPI, vol. 8(8), pages 1-18, August.
    17. Grošelj, Petra & Hodges, Donald G. & Zadnik Stirn, Lidija, 2016. "Participatory and multi-criteria analysis for forest (ecosystem) management: A case study of Pohorje, Slovenia," Forest Policy and Economics, Elsevier, vol. 71(C), pages 80-86.
    18. Kevin Kam Fung Yuen, 2022. "Decision models for information systems planning using primitive cognitive network process: comparisons with analytic hierarchy process," Operational Research, Springer, vol. 22(3), pages 1759-1785, July.
    19. Rosenbloom, E. S., 1997. "A probabilistic interpretation of the final rankings in AHP," European Journal of Operational Research, Elsevier, vol. 96(2), pages 371-378, January.
    20. Finan, J. S. & Hurley, W. J., 1999. "Transitive calibration of the AHP verbal scale," European Journal of Operational Research, Elsevier, vol. 112(2), pages 367-372, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:304:y:2023:i:2:p:676-688. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.