IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v96y2020ics0305048319310710.html
   My bibliography  Save this article

How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy

Author

Listed:
  • Cinelli, Marco
  • Kadziński, Miłosz
  • Gonzalez, Michael
  • Słowiński, Roman

Abstract

Decision making is a complex task that involves a multitude of perspectives, constraints, and variables. Multiple Criteria Decision Analysis (MCDA) is a process that has been used for several decades to support decision making. It includes a series of steps that systematically help Decision Maker(s) (DM(s)) and stakeholders in structuring a decision making problem, identifying their preferences, and building a decision recommendation consistent with those preferences. Over the last decades, many studies have demonstrated the conduct of the MCDA process and how to select an MCDA method. Until now, there has not been a review of these studies, nor a proposal of a unified and comprehensive high-level representation of the MCDA process characteristics (i.e., features), which is the goal of this paper. We introduce a review of the research that defines how to conduct the MCDA process, compares MCDA methods, and presents Decision Support Systems (DSSs) to recommend a relevant MCDA method or a subset of methods. We then synthesize this research into a taxonomy of characteristics of the MCDA process, grouped into three main phases, (i) problem formulation, (ii) construction of the decision recommendation, and (iii) qualitative features and technical support. Each of these phases includes a subset of the 10 characteristics that helps the analyst implementing the MCDA process, while also being aware of the implication of these choices at each step. By showing how decision making can be split into manageable and justifiable steps, we reduce the risk of overwhelming the analyst, as well as the DMs/stakeholders during the MCDA process. A questioning strategy is also proposed to demonstrate how to apply the taxonomy to map MCDA methods and select the most relevant one(s) using real case studies. Additionally, we show how the DSSs for MCDA method recommendation can be grouped into three main clusters. This proposal can enhance a traceable and categorizable development of such systems.

Suggested Citation

  • Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
  • Handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319310710
    DOI: 10.1016/j.omega.2020.102261
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048319310710
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2020.102261?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wątróbski, Jarosław & Jankowski, Jarosław & Ziemba, Paweł & Karczmarczyk, Artur & Zioło, Magdalena, 2019. "Generalised framework for multi-criteria method selection," Omega, Elsevier, vol. 86(C), pages 107-124.
    2. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    3. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    4. Podinovski, Vladislav V., 2010. "Set choice problems with incomplete information about the preferences of the decision maker," European Journal of Operational Research, Elsevier, vol. 207(1), pages 371-379, November.
    5. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    6. Laaribi, A. & Chevallier, J.J. & Martel, J.M., 1996. "A Spatial Decision Aid: A Multicriterion Evaluation Approach," Papers 96-45, Laval - Faculte des sciences de administration.
    7. Ciomek, Krzysztof & Ferretti, Valentina & Kadzinski, Milosz, 2018. "Predictive analytics and disused railways requalification: insights from a Post Factum Analysis perspective," LSE Research Online Documents on Economics 85922, London School of Economics and Political Science, LSE Library.
    8. Michel Grabisch & Christophe Labreuche, 2010. "A decade of application of the Choquet and Sugeno integrals in multi-criteria decision aid," Annals of Operations Research, Springer, vol. 175(1), pages 247-286, March.
    9. Doumpos, Michael & Zopounidis, Constantin, 2011. "Preference disaggregation and statistical learning for multicriteria decision support: A review," European Journal of Operational Research, Elsevier, vol. 209(3), pages 203-214, March.
    10. Buchholz, Thomas & Rametsteiner, Ewald & Volk, Timothy A. & Luzadis, Valerie A., 2009. "Multi Criteria Analysis for bioenergy systems assessments," Energy Policy, Elsevier, vol. 37(2), pages 484-495, February.
    11. Salvatore Corrente & Michael Doumpos & Salvatore Greco & Roman Słowiński & Constantin Zopounidis, 2017. "Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions," Annals of Operations Research, Springer, vol. 251(1), pages 117-139, April.
    12. Marta Bottero & Valentina Ferretti & Giulio Mondini, 2013. "A Choquet integral-based approach for assessing the sustainability of a new waste incinerator," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 3(2/3), pages 157-177.
    13. Ferretti, Valentina & Montibeller, Gilberto, 2016. "Key challenges and meta-choices in designing and applying multi-criteria spatial decision support systems," LSE Research Online Documents on Economics 65368, London School of Economics and Political Science, LSE Library.
    14. Angilella, Silvia & Corrente, Salvatore & Greco, Salvatore, 2015. "Stochastic multiobjective acceptability analysis for the Choquet integral preference model and the scale construction problem," European Journal of Operational Research, Elsevier, vol. 240(1), pages 172-182.
    15. Robin M. Hogarth & Natalia Karelaia, 2005. "Simple Models for Multiattribute Choice with Many Alternatives: When It Does and Does Not Pay to Face Trade-offs with Binary Attributes," Management Science, INFORMS, vol. 51(12), pages 1860-1872, December.
    16. P. Thokala & A. Duenas, 2012. "Multiple Criteria Decision Analysis for Health Technology Assessment," Post-Print hal-00800398, HAL.
    17. Gomes, Carlos F. Simões & Nunes, Kátia R.A. & Helena Xavier, Lucia & Cardoso, Rosangela & Valle, Rogerio, 2008. "Multicriteria decision making applied to waste recycling in Brazil," Omega, Elsevier, vol. 36(3), pages 395-404, June.
    18. Figueira, José Rui & Roy, Bernard, 2009. "A note on the paper, "Ranking irregularities when evaluating alternatives by using some ELECTRE methods", by Wang and Triantaphyllou, Omega (2008)," Omega, Elsevier, vol. 37(3), pages 731-733, June.
    19. Munda, Giuseppe, 2004. "Social multi-criteria evaluation: Methodological foundations and operational consequences," European Journal of Operational Research, Elsevier, vol. 158(3), pages 662-677, November.
    20. Dias, Luis C. & Antunes, Carlos Henggeler & Dantas, Guilherme & de Castro, Nivalde & Zamboni, Lucca, 2018. "A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil," Omega, Elsevier, vol. 76(C), pages 100-111.
    21. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 2004. "Axiomatic characterization of a general utility function and its particular cases in terms of conjoint measurement and rough-set decision rules," European Journal of Operational Research, Elsevier, vol. 158(2), pages 271-292, October.
    22. Matteo Mazziotta, Adriano Pareto, 2013. "Methods For Constructing Composite Indices: One For All Or All For One?," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 67(2), pages 67-80, April-Jun.
    23. H. Roland Weistroffer & Yan Li, 2016. "Multiple Criteria Decision Analysis Software," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 1301-1341, Springer.
    24. Wang, Xiaoting & Triantaphyllou, Evangelos, 2008. "Ranking irregularities when evaluating alternatives by using some ELECTRE methods," Omega, Elsevier, vol. 36(1), pages 45-63, February.
    25. Jasiński, Dominik & Cinelli, Marco & Dias, Luis C. & Meredith, James & Kirwan, Kerry, 2018. "Assessing supply risks for non-fossil mineral resources via multi-criteria decision analysis," Resources Policy, Elsevier, vol. 58(C), pages 150-158.
    26. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    27. Raymond Bisdorff & Luis C. Dias & Patrick Meyer & Vincent Mousseau & Marc Pirlot (ed.), 2015. "Evaluation and Decision Models with Multiple Criteria," International Handbooks on Information Systems, Springer, edition 127, number 978-3-662-46816-6, November.
    28. Montibeller, Gilberto & Patel, Pratik & del Rio Vilas, Victor J., 2020. "A critical analysis of multi-criteria models for the prioritisation of health threats," European Journal of Operational Research, Elsevier, vol. 281(1), pages 87-99.
    29. Haag, Fridolin & Lienert, Judit & Schuwirth, Nele & Reichert, Peter, 2019. "Identifying non-additive multi-attribute value functions based on uncertain indifference statements," Omega, Elsevier, vol. 85(C), pages 49-67.
    30. Pollesch, N. & Dale, V.H., 2015. "Applications of aggregation theory to sustainability assessment," Ecological Economics, Elsevier, vol. 114(C), pages 117-127.
    31. Cheul Rhee & H. Raghav Rao, 2008. "Evaluation of Decision Support Systems," International Handbooks on Information Systems, in: Handbook on Decision Support Systems 2, chapter 51, pages 313-327, Springer.
    32. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, September.
    33. Roy, Bernard & Slowinski, Roman, 2008. "Handling effects of reinforced preference and counter-veto in credibility of outranking," European Journal of Operational Research, Elsevier, vol. 188(1), pages 185-190, July.
    34. repec:hal:wpaper:hal-00874292 is not listed on IDEAS
    35. Salvatore Greco & Benedetto Matarazzo & Roman Słowiński, 2016. "Decision Rule Approach," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 497-552, Springer.
    36. James S. Dyer, 1990. "Remarks on the Analytic Hierarchy Process," Management Science, INFORMS, vol. 36(3), pages 249-258, March.
    37. Mulliner, Emma & Smallbone, Kieran & Maliene, Vida, 2013. "An assessment of sustainable housing affordability using a multiple criteria decision making method," Omega, Elsevier, vol. 41(2), pages 270-279.
    38. Govindan, Kannan & Kadziński, Miłosz & Sivakumar, R., 2017. "Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain," Omega, Elsevier, vol. 71(C), pages 129-145.
    39. Feng, Bo & Lai, Fujun, 2014. "Multi-attribute group decision making with aspirations: A case study," Omega, Elsevier, vol. 44(C), pages 136-147.
    40. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    41. Thies, Christian & Kieckhäfer, Karsten & Spengler, Thomas S. & Sodhi, Manbir S., 2019. "Operations research for sustainability assessment of products: A review," European Journal of Operational Research, Elsevier, vol. 274(1), pages 1-21.
    42. Pollesch, N.L. & Dale, V.H., 2016. "Normalization in sustainability assessment: Methods and implications," Ecological Economics, Elsevier, vol. 130(C), pages 195-208.
    43. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    44. Risto Lahdelma & Pekka Salminen, 2010. "Stochastic Multicriteria Acceptability Analysis (SMAA)," International Series in Operations Research & Management Science, in: Matthias Ehrgott & José Rui Figueira & Salvatore Greco (ed.), Trends in Multiple Criteria Decision Analysis, chapter 0, pages 285-315, Springer.
    45. Jyri Seppälä & Lauren Basson & Gregory A. Norris, 2001. "Decision Analysis Frameworks for Life‐Cycle Impact Assessment," Journal of Industrial Ecology, Yale University, vol. 5(4), pages 45-68, October.
    46. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    47. Branke, Juergen & Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman & Zielniewicz, Piotr, 2016. "Using Choquet integral as preference model in interactive evolutionary multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 250(3), pages 884-901.
    48. Konstantinos V. Katsikopoulos, 2011. "Psychological Heuristics for Making Inferences: Definition, Performance, and the Emerging Theory and Practice," Decision Analysis, INFORMS, vol. 8(1), pages 10-29, March.
    49. Katsikopoulos, Konstantinos V. & Durbach, Ian N. & Stewart, Theodor J., 2018. "When should we use simple decision models? A synthesis of various research strands," Omega, Elsevier, vol. 81(C), pages 17-25.
    50. Bernard Roy & Roman Slowinski, 2013. "Questions guiding the choice of a multicriteria decision aiding method," Post-Print hal-00874292, HAL.
    51. Roy, B. & Figueira, J.R. & Almeida-Dias, J., 2014. "Discriminating thresholds as a tool to cope with imperfect knowledge in multiple criteria decision aiding: Theoretical results and practical issues," Omega, Elsevier, vol. 43(C), pages 9-20.
    52. Roman Słowiński & Salvatore Greco & Benedetto Matarazzo, 2014. "Rough-Set-Based Decision Support," Springer Books, in: Edmund K. Burke & Graham Kendall (ed.), Search Methodologies, edition 2, chapter 0, pages 557-609, Springer.
    53. repec:dau:papers:123456789/2944 is not listed on IDEAS
    54. Roy, Bernard, 1990. "Decision-aid and decision-making," European Journal of Operational Research, Elsevier, vol. 45(2-3), pages 324-331, April.
    55. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    56. Mousseau, Vincent & Figueira, Jose & Dias, Luis & Gomes da Silva, Carlos & Climaco, Joao, 2003. "Resolving inconsistencies among constraints on the parameters of an MCDA model," European Journal of Operational Research, Elsevier, vol. 147(1), pages 72-93, May.
    57. Mousseau, Vincent & Dias, Luis, 2004. "Valued outranking relations in ELECTRE providing manageable disaggregation procedures," European Journal of Operational Research, Elsevier, vol. 156(2), pages 467-482, July.
    58. Jean-M. Martel & Benedetto Matarazzo, 2016. "Other Outranking Approaches," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 221-282, Springer.
    59. Denis Bouyssou & Thierry Marchant & Marc Pirlot & Alexis Tsoukiàs & Philippe Vincke, 2006. "Evaluation and Decision Models with Multiple Criteria," International Series in Operations Research and Management Science, Springer, number 978-0-387-31099-2, September.
    60. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    61. Frada Burstein & Clyde Holsapple, 2008. "Handbook on Decision Support Systems 2," International Handbooks on Information Systems, Springer, number 978-3-540-48716-6, November.
    62. James S. Dyer, 1990. "A Clarification of "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 274-275, March.
    63. Angilella, Silvia & Greco, Salvatore & Matarazzo, Benedetto, 2010. "Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral," European Journal of Operational Research, Elsevier, vol. 201(1), pages 277-288, February.
    64. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    65. Metin Celik & Y. Ilker Topcu, 2009. "Analytical modelling of shipping business processes based on MCDM methods," Maritime Policy & Management, Taylor & Francis Journals, vol. 36(6), pages 469-479, December.
    66. Barker, Theresa J. & Zabinsky, Zelda B., 2011. "A multicriteria decision making model for reverse logistics using analytical hierarchy process," Omega, Elsevier, vol. 39(5), pages 558-573, October.
    67. Maria Rosaria Guarini & Fabrizio Battisti & Anthea Chiovitti, 2018. "A Methodology for the Selection of Multi-Criteria Decision Analysis Methods in Real Estate and Land Management Processes," Sustainability, MDPI, vol. 10(2), pages 1-28, February.
    68. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    69. Jeffrey C. Cegan & Ashley M. Filion & Jeffrey M. Keisler & Igor Linkov, 2017. "Trends and applications of multi-criteria decision analysis in environmental sciences: literature review," Environment Systems and Decisions, Springer, vol. 37(2), pages 123-133, June.
    70. Guitouni, Adel & Martel, Jean-Marc, 1998. "Tentative guidelines to help choosing an appropriate MCDA method," European Journal of Operational Research, Elsevier, vol. 109(2), pages 501-521, September.
    71. Gattoufi, Said & Oral, Muhittin & Reisman, Arnold, 2004. "A taxonomy for data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 38(2-3), pages 141-158.
    72. Salvatore Greco & Alessio Ishizaka & Benedetto Matarazzo & Gianpiero Torrisi, 2018. "Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions," Regional Studies, Taylor & Francis Journals, vol. 52(4), pages 585-600, April.
    73. Bernard Roy, 2016. "Paradigms and Challenges," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 19-39, Springer.
    74. Luis C. Dias & Alec Morton & John Quigley, 2018. "Elicitation: State of the Art and Science," International Series in Operations Research & Management Science, in: Luis C. Dias & Alec Morton & John Quigley (ed.), Elicitation, chapter 0, pages 1-14, Springer.
    75. Grabisch, Michel, 1996. "The application of fuzzy integrals in multicriteria decision making," European Journal of Operational Research, Elsevier, vol. 89(3), pages 445-456, March.
    76. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    2. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    3. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    4. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    5. Arandarenko, Mihail & Corrente, Salvatore & Jandrić, Maja & Stamenković, Mladen, 2020. "Multiple criteria decision aiding as a prediction tool for migration potential of regions," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1154-1166.
    6. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    7. Silvia Angilella & Marta Bottero & Salvatore Corrente & Valentina Ferretti & Salvatore Greco & Isabella M. Lami, 2016. "Non Additive Robust Ordinal Regression for urban and territorial planning: an application for siting an urban waste landfill," Annals of Operations Research, Springer, vol. 245(1), pages 427-456, October.
    8. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    9. Marco Cinelli & Matteo Spada & Wansub Kim & Yiwen Zhang & Peter Burgherr, 2021. "MCDA Index Tool: an interactive software to develop indices and rankings," Environment Systems and Decisions, Springer, vol. 41(1), pages 82-109, March.
    10. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    11. Liao, Huchang & Wu, Xingli & Mi, Xiaomei & Herrera, Francisco, 2020. "An integrated method for cognitive complex multiple experts multiple criteria decision making based on ELECTRE III with weighted Borda rule," Omega, Elsevier, vol. 93(C).
    12. Wątróbski, Jarosław & Jankowski, Jarosław & Ziemba, Paweł & Karczmarczyk, Artur & Zioło, Magdalena, 2019. "Generalised framework for multi-criteria method selection," Omega, Elsevier, vol. 86(C), pages 107-124.
    13. Mustajoki, Jyri & Saarikoski, Heli & Belton, Valerie & Hjerppe, Turo & Marttunen, Mika, 2020. "Utilizing ecosystem service classifications in multi-criteria decision analysis – Experiences of peat extraction case in Finland," Ecosystem Services, Elsevier, vol. 41(C).
    14. Sarah Ben Amor & Fateh Belaid & Ramzi Benkraiem & Boumediene Ramdani & Khaled Guesmi, 2023. "Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda," Annals of Operations Research, Springer, vol. 325(2), pages 771-793, June.
    15. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    16. Sarah Ben Amor & Fateh Belaid & Ramzi Benkraiem & Boumediene Ramdani & Khaled Guesmi, 2023. "Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda," Annals of Operations Research, Springer, vol. 325(2), pages 771-793, June.
    17. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    18. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    19. Fernández, Eduardo & Figueira, José Rui & Navarro, Jorge & Solares, Efrain, 2022. "Handling imperfect information in multiple criteria decision-making through a comprehensive interval outranking approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    20. Bottero, M. & Ferretti, V. & Figueira, J.R. & Greco, S. & Roy, B., 2018. "On the Choquet multiple criteria preference aggregation model: Theoretical and practical insights from a real-world application," European Journal of Operational Research, Elsevier, vol. 271(1), pages 120-140.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319310710. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.