IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v333y2024i1d10.1007_s10479-023-05753-0.html
   My bibliography  Save this article

Robustness of priority deriving methods for pairwise comparison matrices against rank reversal: a probabilistic approach

Author

Listed:
  • Jan Górecki

    (Silesian University in Opava)

  • David Bartl

    (Silesian University in Opava)

  • Jaroslav Ramík

    (Silesian University in Opava)

Abstract

This work aims to answer the natural question of how probable it is that a given method produces rank reversal in a priority vector (PV) if a decision maker (DM) introduces perturbations to the pairwise comparison matrix (PCM) under concern. We focus primarily on the concept of robustness against rank reversal, independent of specific methods, and provide an in-depth statistical insight into the application of the Monte Carlo (MC) approach in this context. This concept is applied to three selected methods, with a special emphasis on scenarios where a method may not provide outputs for all possible PCMs. All results presented in this work are replicable using our open-source implementation.

Suggested Citation

  • Jan Górecki & David Bartl & Jaroslav Ramík, 2024. "Robustness of priority deriving methods for pairwise comparison matrices against rank reversal: a probabilistic approach," Annals of Operations Research, Springer, vol. 333(1), pages 249-273, February.
    • Handle: RePEc:spr:annopr:v:333:y:2024:i:1:d:10.1007_s10479-023-05753-0
    DOI: 10.1007/s10479-023-05753-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-023-05753-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-023-05753-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bice Cavallo, 2019. "Coherent weights for pairwise comparison matrices and a mixed-integer linear programming problem," Journal of Global Optimization, Springer, vol. 75(1), pages 143-161, September.
    2. A. Azzalini & A. Capitanio, 1999. "Statistical applications of the multivariate skew normal distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 579-602.
    3. Csató, László & Petróczy, Dóra Gréta, 2021. "On the monotonicity of the eigenvector method," European Journal of Operational Research, Elsevier, vol. 292(1), pages 230-237.
    4. Saaty, Thomas L. & Vargas, Luis G., 1987. "Uncertainty and rank order in the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 32(1), pages 107-117, October.
    5. Can, Burak, 2014. "Weighted distances between preferences," Journal of Mathematical Economics, Elsevier, vol. 51(C), pages 109-115.
    6. Saaty, Thomas L., 1990. "Eigenvector and logarithmic least squares," European Journal of Operational Research, Elsevier, vol. 48(1), pages 156-160, September.
    7. Jiří Mazurek & Radomír Perzina & Jaroslav Ramík & David Bartl, 2021. "A Numerical Comparison of the Sensitivity of the Geometric Mean Method, Eigenvalue Method, and Best–Worst Method," Mathematics, MDPI, vol. 9(5), pages 1-13, March.
    8. Alessio Ishizaka & Markus Lusti, 2006. "How to derive priorities in AHP: a comparative study," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 14(4), pages 387-400, December.
    9. Faramondi, Luca & Oliva, Gabriele & Setola, Roberto & Bozóki, Sándor, 2023. "Robustness to rank reversal in pairwise comparison matrices based on uncertainty bounds," European Journal of Operational Research, Elsevier, vol. 304(2), pages 676-688.
    10. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    11. László Csató, 2017. "On the ranking of a Swiss system chess team tournament," Annals of Operations Research, Springer, vol. 254(1), pages 17-36, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anna Kędzior & Konrad Kułakowski, 2023. "Multiple-Criteria Heuristic Rating Estimation," Mathematics, MDPI, vol. 11(13), pages 1-19, June.
    2. Amelia Bilbao-Terol & Mar Arenas-Parra & Raquel Quiroga-García & Celia Bilbao-Terol, 2022. "An extended best–worst multiple reference point method: application in the assessment of non-life insurance companies," Operational Research, Springer, vol. 22(5), pages 5323-5362, November.
    3. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    4. Szádoczki, Zsombor & Bozóki, Sándor & Tekile, Hailemariam Abebe, 2022. "Filling in pattern designs for incomplete pairwise comparison matrices: (Quasi-)regular graphs with minimal diameter," Omega, Elsevier, vol. 107(C).
    5. Conde, Eduardo & de la Paz Rivera Pérez, María, 2010. "A linear optimization problem to derive relative weights using an interval judgement matrix," European Journal of Operational Research, Elsevier, vol. 201(2), pages 537-544, March.
    6. Nikolai Krivulin & Alexey Prinkov & Igor Gladkikh, 2022. "Using Pairwise Comparisons to Determine Consumer Preferences in Hotel Selection," Mathematics, MDPI, vol. 10(5), pages 1-25, February.
    7. Shunsuke Shiraishi & Tsuneshi Obata, 2025. "Calculating Maximum Eigenvalues in Pairwise Comparison Matrices for the Analytic Hierarchy Process," SN Operations Research Forum, Springer, vol. 6(1), pages 1-15, March.
    8. Jacek Szybowski & Konrad Kułakowski & Sebastian Ernst, 2024. "Almost optimal manipulation of pairwise comparisons of alternatives," Journal of Global Optimization, Springer, vol. 90(1), pages 243-259, September.
    9. Ahn, Byeong Seok, 2017. "The analytic hierarchy process with interval preference statements," Omega, Elsevier, vol. 67(C), pages 177-185.
    10. Bice Cavallo & Alessio Ishizaka, 2023. "Evaluating scales for pairwise comparisons," Annals of Operations Research, Springer, vol. 325(2), pages 951-965, June.
    11. Csató, László, 2024. "Right-left asymmetry of the eigenvector method: A simulation study," European Journal of Operational Research, Elsevier, vol. 313(2), pages 708-717.
    12. Dede, Georgia & Kamalakis, Thomas & Sphicopoulos, Thomas, 2016. "Theoretical estimation of the probability of weight rank reversal in pairwise comparisons," European Journal of Operational Research, Elsevier, vol. 252(2), pages 587-600.
    13. Gyimesi, András, 2021. "Hosszú távú versenyegyensúly egy csapatsportliga közgazdasági modelljében [Long-term competitive balance in an economic model of a team sports league]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(6), pages 585-616.
    14. Zsombor Szádoczki & Sándor Bozóki & Patrik Juhász & Sergii V. Kadenko & Vitaliy Tsyganok, 2023. "Incomplete pairwise comparison matrices based on graphs with average degree approximately 3," Annals of Operations Research, Springer, vol. 326(2), pages 783-807, July.
    15. Leung, L. C. & Cao, D., 2000. "On consistency and ranking of alternatives in fuzzy AHP," European Journal of Operational Research, Elsevier, vol. 124(1), pages 102-113, July.
    16. Ausloos, Marcel, 2024. "Hierarchy selection: New team ranking indicators for cyclist multi-stage races," European Journal of Operational Research, Elsevier, vol. 314(2), pages 807-816.
    17. Bice Cavallo, 2019. "Coherent weights for pairwise comparison matrices and a mixed-integer linear programming problem," Journal of Global Optimization, Springer, vol. 75(1), pages 143-161, September.
    18. James J. H. Liou & Perry C. Y. Liu & Huai-Wei Lo, 2020. "A Failure Mode Assessment Model Based on Neutrosophic Logic for Switched-Mode Power Supply Risk Analysis," Mathematics, MDPI, vol. 8(12), pages 1-19, December.
    19. Can, Burak & Pourpouneh, Mohsen & Storcken, Ton, 2017. "Cost of transformation: a measure on matchings," Research Memorandum 015, Maastricht University, Graduate School of Business and Economics (GSBE).
    20. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2022. "Monotonicity in sharing the revenues from broadcasting sports leagues," European Journal of Operational Research, Elsevier, vol. 297(1), pages 338-346.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:333:y:2024:i:1:d:10.1007_s10479-023-05753-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.