IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v246y2015i2p543-553.html
   My bibliography  Save this article

Elicitation of criteria importance weights through the Simos method: A robustness concern

Author

Listed:
  • Siskos, Eleftherios
  • Tsotsolas, Nikos

Abstract

In the field of multicriteria decision aid, the Simos method is considered as an effective tool to assess the criteria importance weights. Nevertheless, the method's input data do not lead to a single weighting vector, but infinite ones, which often exhibit great diversification and threaten the stability and acceptability of the results. This paper proves that the feasible weighting solutions, of both the original and the revised Simos procedures, are vectors of a non-empty convex polyhedral set, hence the reason it proposes a set of complementary robustness analysis rules and measures, integrated in a Robust Simos Method. This framework supports analysts and decision makers in gaining insight into the degree of variation of the multiple acceptable sets of weights, and their impact on the stability of the final results. In addition, the proposed measures determine if, and what actions should be implemented, prior to reaching an acceptable set of criteria weights and forming a final decision. Two numerical examples are provided, to illustrate the paper's evidence, and demonstrate the significance of consistently analyzing the robustness of the Simos method results, in both the original and the revised method's versions.

Suggested Citation

  • Siskos, Eleftherios & Tsotsolas, Nikos, 2015. "Elicitation of criteria importance weights through the Simos method: A robustness concern," European Journal of Operational Research, Elsevier, vol. 246(2), pages 543-553.
  • Handle: RePEc:eee:ejores:v:246:y:2015:i:2:p:543-553
    DOI: 10.1016/j.ejor.2015.04.037
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221715003306
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2015.04.037?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Madlener, Reinhard & Kowalski, Katharina & Stagl, Sigrid, 2007. "New ways for the integrated appraisal of national energy scenarios: The case of renewable energy use in Austria," Energy Policy, Elsevier, vol. 35(12), pages 6060-6074, December.
    2. Evangelos Grigoroudis & Yannis Siskos, 2010. "Customer Satisfaction Evaluation," International Series in Operations Research and Management Science, Springer, number 978-1-4419-1640-2, December.
    3. Vassilis Kostoglou & Jason Papathanasiou & Odysseas Moschidis & Paraskevi Ladopoulou, 2014. "A comparative analysis of Greek universities' presence on the World Wide Web using an analytical MCDM methodology," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 4(3), pages 279-298.
    4. Cavallaro, Fausto, 2009. "Multi-criteria decision aid to assess concentrated solar thermal technologies," Renewable Energy, Elsevier, vol. 34(7), pages 1678-1685.
    5. Myriam Merad & Nicolas Dechy & Frédéric Marcel & Igor Linkov, 2013. "Multiple-criteria decision-aiding framework to analyze and assess the governance of sustainability," Environment Systems and Decisions, Springer, vol. 33(2), pages 305-321, June.
    6. Merad, Myriam & Dechy, Nicolas & Serir, Lisa & Grabisch, Michel & Marcel, Frédéric, 2013. "Using a multi-criteria decision aid methodology to implement sustainable development principles within an organization," European Journal of Operational Research, Elsevier, vol. 224(3), pages 603-613.
    7. Kodikara, P.N. & Perera, B.J.C. & Kularathna, M.D.U.P., 2010. "Stakeholder preference elicitation and modelling in multi-criteria decision analysis - A case study on urban water supply," European Journal of Operational Research, Elsevier, vol. 206(1), pages 209-220, October.
    8. Augusto, Mario & Lisboa, Joao & Yasin, Mahmoud & Figueira, Jose Rui, 2008. "Benchmarking in a multiple criteria performance context: An application and a conceptual framework," European Journal of Operational Research, Elsevier, vol. 184(1), pages 244-254, January.
    9. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    10. Cavallaro, Fausto, 2010. "A comparative assessment of thin-film photovoltaic production processes using the ELECTRE III method," Energy Policy, Elsevier, vol. 38(1), pages 463-474, January.
    11. Robert L. Smith, 1984. "Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions," Operations Research, INFORMS, vol. 32(6), pages 1296-1308, December.
    12. Hurson, Christian & Siskos, Yannis, 2014. "A synergy of multicriteria techniques to assess additive value models," European Journal of Operational Research, Elsevier, vol. 238(2), pages 540-551.
    13. Kadziński, MiŁosz & Greco, Salvatore & SŁowiński, Roman, 2012. "Extreme ranking analysis in robust ordinal regression," Omega, Elsevier, vol. 40(4), pages 488-501.
    14. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    15. Pictet, Jacques & Bollinger, Dominique, 2008. "Extended use of the cards procedure as a simple elicitation technique for MAVT. Application to public procurement in Switzerland," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1300-1307, March.
    16. Greco, Salvatore & Kadzinski, Milosz & Mousseau, Vincent & Slowinski, Roman, 2011. "ELECTREGKMS: Robust ordinal regression for outranking methods," European Journal of Operational Research, Elsevier, vol. 214(1), pages 118-135, October.
    17. Solymosi, Tamas & Dombi, Jozsef, 1986. "A method for determining the weights of criteria: The centralized weights," European Journal of Operational Research, Elsevier, vol. 26(1), pages 35-41, July.
    18. Dawson, Lucas & Schlyter, Peter, 2012. "Less is more: Strategic scale site suitability for concentrated solar thermal power in Western Australia," Energy Policy, Elsevier, vol. 47(C), pages 91-101.
    19. Figueira, José Rui & Greco, Salvatore & Slowinski, Roman, 2009. "Building a set of additive value functions representing a reference preorder and intensities of preference: GRIP method," European Journal of Operational Research, Elsevier, vol. 195(2), pages 460-486, June.
    20. Figueira, Jose & Roy, Bernard, 2002. "Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure," European Journal of Operational Research, Elsevier, vol. 139(2), pages 317-326, June.
    21. Khaled Jabeur & Jean-Marc Martel & Slim Ben Khélifa, 2004. "A Distance-Based Collective Preorder Integrating the Relative Importance of the Group's Members," Group Decision and Negotiation, Springer, vol. 13(4), pages 327-349, July.
    22. Jabeur, Khaled & Martel, Jean-Marc, 2007. "An ordinal sorting method for group decision-making," European Journal of Operational Research, Elsevier, vol. 180(3), pages 1272-1289, August.
    23. Dov Pekelman & Subrata K. Sen, 1974. "Mathematical Programming Models for the Determination of Attribute Weights," Management Science, INFORMS, vol. 20(8), pages 1217-1229, April.
    24. Fu-Ling Cai & Xiuwu Liao & Kan-Liang Wang, 2012. "An interactive sorting approach based on the assignment examples of multiple decision makers with different priorities," Annals of Operations Research, Springer, vol. 197(1), pages 87-108, August.
    25. Vansnick, Jean-Claude, 1986. "On the problem of weights in multiple criteria decision making (the noncompensatory approach)," European Journal of Operational Research, Elsevier, vol. 24(2), pages 288-294, February.
    26. Ines Wilkens (nee Braune) & Peter Schmuck, 2012. "Transdisciplinary Evaluation of Energy Scenarios for a German Village Using Multi-Criteria Decision Analysis," Sustainability, MDPI, vol. 4(4), pages 1-26, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    2. Chakhar, Salem & Ishizaka, Alessio & Thorpe, Andy & Cox, Joe & Nguyen, Thang & Ford, Liz, 2020. "Calculating the relative importance of condition attributes based on the characteristics of decision rules and attribute reducts: Application to crowdfunding," European Journal of Operational Research, Elsevier, vol. 286(2), pages 689-712.
    3. Ana Sara Costa & José Rui Figueira & José Borbinha, 2022. "A multiple criteria socio-technical approach for the Portuguese Army Special Forces recruitment," 4OR, Springer, vol. 20(2), pages 289-331, June.
    4. Figueira, José Rui & Oliveira, Henrique M. & Serro, Ana Paula & Colaço, Rogério & Froes, Filipe & Robalo Cordeiro, Carlos & Diniz, António & Guimarães, Miguel, 2023. "A multiple criteria approach for building a pandemic impact assessment composite indicator: The case of COVID-19 in Portugal," European Journal of Operational Research, Elsevier, vol. 309(2), pages 795-818.
    5. Siskos, Eleftherios & Burgherr, Peter, 2022. "Multicriteria decision support for the evaluation of electricity supply resilience: Exploration of interacting criteria," European Journal of Operational Research, Elsevier, vol. 298(2), pages 611-626.
    6. A. Spyridakos & N. Tsotsolas & Y. Siskos & D. Yannakopoulos & I. Vryzidis, 2020. "A visualization approach for robustness analysis in multicriteria disaggregation–aggregation approaches," Operational Research, Springer, vol. 20(3), pages 1841-1861, September.
    7. Marta Bottero & Chiara D’Alpaos & Alessandra Oppio, 2019. "Ranking of Adaptive Reuse Strategies for Abandoned Industrial Heritage in Vulnerable Contexts: A Multiple Criteria Decision Aiding Approach," Sustainability, MDPI, vol. 11(3), pages 1-18, February.
    8. Jafar Rezaei & Miłosz Kadziński & Chrysoula Vana & Lori Tavasszy, 2022. "Embedding carbon impact assessment in multi-criteria supplier segmentation using ELECTRE TRI-rC," Annals of Operations Research, Springer, vol. 312(2), pages 1445-1467, May.
    9. Govindan, Kannan & Kadziński, Miłosz & Sivakumar, R., 2017. "Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain," Omega, Elsevier, vol. 71(C), pages 129-145.
    10. Ferretti, Valentina & Liu, Jun & Mousseau, V & Ouerdane, W, 2017. "Reference-based ranking procedure for environmental decision making: insights from an ex-post analysis," LSE Research Online Documents on Economics 85933, London School of Economics and Political Science, LSE Library.
    11. Marek Gaworski & Piotr F. Borowski & Łukasz Kozioł, 2022. "Supporting Decision-Making in the Technical Equipment Selection Process by the Method of Contradictory Evaluations," Sustainability, MDPI, vol. 14(13), pages 1-17, June.
    12. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    13. N. Tsotsolas & A. Spyridakos & E. Siskos & I. Salmon, 2019. "Criteria weights assessment through prioritizations (WAP) using linear programming techniques and visualizations," Operational Research, Springer, vol. 19(1), pages 135-150, March.
    14. Psarras, John, 2016. "Multicriteria decision support to evaluate potential long-term natural gas supply alternatives: The case of GreeceAuthor-Name: Androulaki, Stella," European Journal of Operational Research, Elsevier, vol. 253(3), pages 791-810.
    15. Grigoroudis, Evangelos & Noel, Laurent & Galariotis, Emilios & Zopounidis, Constantin, 2021. "An ordinal regression approach for analyzing consumer preferences in the art market," European Journal of Operational Research, Elsevier, vol. 290(2), pages 718-733.
    16. Bottero, M. & Ferretti, V. & Figueira, J.R. & Greco, S. & Roy, B., 2018. "On the Choquet multiple criteria preference aggregation model: Theoretical and practical insights from a real-world application," European Journal of Operational Research, Elsevier, vol. 271(1), pages 120-140.
    17. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    18. Corrente, S. & Figueira, J.R. & Greco, S., 2021. "Pairwise comparison tables within the deck of cards method in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 291(2), pages 738-756.
    19. Elissaios Sarmas & Vangelis Marinakis & Haris Doukas, 2022. "A data-driven multicriteria decision making tool for assessing investments in energy efficiency," Operational Research, Springer, vol. 22(5), pages 5597-5616, November.
    20. Angelopoulos, Dimitrios & Siskos, Yannis & Psarras, John, 2019. "Disaggregating time series on multiple criteria for robust forecasting: The case of long-term electricity demand in Greece," European Journal of Operational Research, Elsevier, vol. 275(1), pages 252-265.
    21. Zhao, Jianyu & Wei, Jiang & Yu, Lean & Xi, Xi, 2022. "Robustness of knowledge networks under targeted attacks: Electric vehicle field of China evidence," Structural Change and Economic Dynamics, Elsevier, vol. 63(C), pages 367-382.
    22. Hadi Lalghorbani & Ali Jahan, 2022. "Selection of a Wheat Harvester according to Qualitative and Quantitative Criteria," Sustainability, MDPI, vol. 14(3), pages 1-17, January.
    23. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    24. Ermis Chelmis & Dimitrios Niklis & George Baourakis & Constantin Zopounidis, 2019. "Multiciteria evaluation of football clubs: the Greek Superleague," Operational Research, Springer, vol. 19(2), pages 585-614, June.
    25. Marinakis, Vangelis & Doukas, Haris & Xidonas, Panos & Zopounidis, Constantin, 2017. "Multicriteria decision support in local energy planning: An evaluation of alternative scenarios for the Sustainable Energy Action Plan," Omega, Elsevier, vol. 69(C), pages 1-16.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    2. Kadziński, MiŁosz & Greco, Salvatore & SŁowiński, Roman, 2012. "Extreme ranking analysis in robust ordinal regression," Omega, Elsevier, vol. 40(4), pages 488-501.
    3. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    4. Salvatore Corrente & Salvatore Greco & Benedetto Matarazzo & Roman Słowiński, 2016. "Robust ordinal regression for decision under risk and uncertainty," Journal of Business Economics, Springer, vol. 86(1), pages 55-83, January.
    5. Marinakis, Vangelis & Doukas, Haris & Xidonas, Panos & Zopounidis, Constantin, 2017. "Multicriteria decision support in local energy planning: An evaluation of alternative scenarios for the Sustainable Energy Action Plan," Omega, Elsevier, vol. 69(C), pages 1-16.
    6. A. Spyridakos & N. Tsotsolas & Y. Siskos & D. Yannakopoulos & I. Vryzidis, 2020. "A visualization approach for robustness analysis in multicriteria disaggregation–aggregation approaches," Operational Research, Springer, vol. 20(3), pages 1841-1861, September.
    7. Corrente, S. & Figueira, J.R. & Greco, S., 2021. "Pairwise comparison tables within the deck of cards method in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 291(2), pages 738-756.
    8. Marta Bottero & Chiara D’Alpaos & Alessandra Oppio, 2019. "Ranking of Adaptive Reuse Strategies for Abandoned Industrial Heritage in Vulnerable Contexts: A Multiple Criteria Decision Aiding Approach," Sustainability, MDPI, vol. 11(3), pages 1-18, February.
    9. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    10. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    11. Silvia Angilella & Marta Bottero & Salvatore Corrente & Valentina Ferretti & Salvatore Greco & Isabella M. Lami, 2016. "Non Additive Robust Ordinal Regression for urban and territorial planning: an application for siting an urban waste landfill," Annals of Operations Research, Springer, vol. 245(1), pages 427-456, October.
    12. Liu, Jiapeng & Liao, Xiuwu & Huang, Wei & Liao, Xianzhao, 2019. "Market segmentation: A multiple criteria approach combining preference analysis and segmentation decision," Omega, Elsevier, vol. 83(C), pages 1-13.
    13. Liu, Jiapeng & Liao, Xiuwu & Yang, Jian-bo, 2015. "A group decision-making approach based on evidential reasoning for multiple criteria sorting problem with uncertainty," European Journal of Operational Research, Elsevier, vol. 246(3), pages 858-873.
    14. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    15. Kadziński, Miłosz & Wójcik, Michał & Ciomek, Krzysztof, 2022. "Review and experimental comparison of ranking and choice procedures for constructing a univocal recommendation in a preference disaggregation setting," Omega, Elsevier, vol. 113(C).
    16. Kadziński, Miłosz & Greco, Salvatore & Słowiński, Roman, 2012. "Selection of a representative value function in robust multiple criteria ranking and choice," European Journal of Operational Research, Elsevier, vol. 217(3), pages 541-553.
    17. Hurson, Christian & Siskos, Yannis, 2014. "A synergy of multicriteria techniques to assess additive value models," European Journal of Operational Research, Elsevier, vol. 238(2), pages 540-551.
    18. Spliet, Remy & Tervonen, Tommi, 2014. "Preference inference with general additive value models and holistic pair-wise statements," European Journal of Operational Research, Elsevier, vol. 232(3), pages 607-612.
    19. Ru, Zice & Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu, 2022. "Bayesian ordinal regression for multiple criteria choice and ranking," European Journal of Operational Research, Elsevier, vol. 299(2), pages 600-620.
    20. Chakhar, Salem & Ishizaka, Alessio & Thorpe, Andy & Cox, Joe & Nguyen, Thang & Ford, Liz, 2020. "Calculating the relative importance of condition attributes based on the characteristics of decision rules and attribute reducts: Application to crowdfunding," European Journal of Operational Research, Elsevier, vol. 286(2), pages 689-712.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:246:y:2015:i:2:p:543-553. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.