IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v76y2018icp100-111.html
   My bibliography  Save this article

A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil

Author

Listed:
  • Dias, Luis C.
  • Antunes, Carlos Henggeler
  • Dantas, Guilherme
  • de Castro, Nivalde
  • Zamboni, Lucca

Abstract

This work presents a methodology to perform a multi-criteria decision analysis based on qualitative assessments from multiple experts or stakeholders. The application that motivated these methodological developments is also described, consisting of an assessment of policies to foster technological innovations in the electricity sector, namely in a context of evolution to smart grids. Qualitative assessments were elicited from 28 experts using a Delphi process. The assessments concern the impact of policies on different objectives, but also opinions concerning the importance of these objectives. These opinions are translated into constraints on the weights of the corresponding criteria, in a partial information setting. Then, policies are sorted into categories based on a stochastic multi-criteria analysis for the ELECTRE TRI method. A new ranking approach is also developed to be compatible with the sorting results, based on a robustness analysis of ELECTRE TRI credibility indices. Results are discussed considering the entire set of experts and considering subsets of experts representing different perspectives.

Suggested Citation

  • Dias, Luis C. & Antunes, Carlos Henggeler & Dantas, Guilherme & de Castro, Nivalde & Zamboni, Lucca, 2018. "A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil," Omega, Elsevier, vol. 76(C), pages 100-111.
    • Handle: RePEc:eee:jomega:v:76:y:2018:i:c:p:100-111
    DOI: 10.1016/j.omega.2017.04.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048316305965
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.omega.2017.04.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Craig W. Kirkwood & Rakesh K. Sarin, 1985. "Ranking with Partial Information: A Method and an Application," Operations Research, INFORMS, vol. 33(1), pages 38-48, February.
    2. von Winterfeldt, Detlof & Fasolo, Barbara, 2009. "Structuring decision problems: A case study and reflections for practitioners," European Journal of Operational Research, Elsevier, vol. 199(3), pages 857-866, December.
    3. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    4. Luis Dias & João Clímaco, 2000. "ELECTRE TRI for Groups with Imprecise Information on Parameter Values," Group Decision and Negotiation, Springer, vol. 9(5), pages 355-377, September.
    5. Neves, Lui­s Pires & Martins, António Gomes & Antunes, Carlos Henggeler & Dias, Lui­s Cândido, 2008. "A multi-criteria decision approach to sorting actions for promoting energy efficiency," Energy Policy, Elsevier, vol. 36(7), pages 2351-2363, July.
    6. Tervonen, Tommi & van Valkenhoef, Gert & Baştürk, Nalan & Postmus, Douwe, 2013. "Hit-And-Run enables efficient weight generation for simulation-based multiple criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 224(3), pages 552-559.
    7. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2010. "Electre Tri-C: A multiple criteria sorting method based on characteristic reference actions," European Journal of Operational Research, Elsevier, vol. 204(3), pages 565-580, August.
    8. Tommi Tervonen, 2014. "JSMAA: open source software for SMAA computations," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(1), pages 69-81.
    9. Kadziński, Miłosz & Tervonen, Tommi & Rui Figueira, José, 2015. "Robust multi-criteria sorting with the outranking preference model and characteristic profiles," Omega, Elsevier, vol. 55(C), pages 126-140.
    10. Carlos A. Bana e Costa & João Carlos Lourenço & Mónica Duarte Oliveira & João C. Bana e Costa, 2014. "A Socio-technical Approach for Group Decision Support in Public Strategic Planning: The Pernambuco PPA Case," Group Decision and Negotiation, Springer, vol. 23(1), pages 5-29, January.
    11. Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2016. "Multiple Criteria Hierarchy Process for ELECTRE Tri methods," European Journal of Operational Research, Elsevier, vol. 252(1), pages 191-203.
    12. Neves, L.P. & Dias, L.C. & Antunes, C.H. & Martins, A.G., 2009. "Structuring an MCDA model using SSM: A case study in energy efficiency," European Journal of Operational Research, Elsevier, vol. 199(3), pages 834-845, December.
    13. Raymond Bisdorff & Luis C. Dias & Patrick Meyer & Vincent Mousseau & Marc Pirlot (ed.), 2015. "Evaluation and Decision Models with Multiple Criteria," International Handbooks on Information Systems, Springer, edition 127, number 978-3-662-46816-6, November.
    14. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    15. Sébastien Damart & Luis Dias & Vincent Mousseau, 2007. "Supporting groups in sorting decisions: methodology and use of a multi-criteria aggregation-disaggregation DSS," Post-Print halshs-00170234, HAL.
    16. Stewart, Theodor J. & French, Simon & Rios, Jesus, 2013. "Integrating multicriteria decision analysis and scenario planning—Review and extension," Omega, Elsevier, vol. 41(4), pages 679-688.
    17. Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2013. "Multiple Criteria Hierarchy Process with ELECTRE and PROMETHEE," Omega, Elsevier, vol. 41(5), pages 820-846.
    18. Rolland, Antoine, 2013. "Reference-based preferences aggregation procedures in multi-criteria decision making," European Journal of Operational Research, Elsevier, vol. 225(3), pages 479-486.
    19. Govindan, Kannan & Kadziński, Miłosz & Sivakumar, R., 2017. "Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain," Omega, Elsevier, vol. 71(C), pages 129-145.
    20. Ralph L. Keeney & Timothy L. McDaniels, 1992. "Value-Focused Thinking about Strategic Decisions at BC Hydro," Interfaces, INFORMS, vol. 22(6), pages 94-109, December.
    21. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    22. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2012. "A multiple criteria sorting method where each category is characterized by several reference actions: The Electre Tri-nC method," European Journal of Operational Research, Elsevier, vol. 217(3), pages 567-579.
    23. Dias, Luis & Mousseau, Vincent & Figueira, Jose & Climaco, Joao, 2002. "An aggregation/disaggregation approach to obtain robust conclusions with ELECTRE TRI," European Journal of Operational Research, Elsevier, vol. 138(2), pages 332-348, April.
    24. Gouveia, M.C. & Dias, L.C. & Antunes, C.H. & Boucinha, J. & Inácio, C.F., 2015. "Benchmarking of maintenance and outage repair in an electricity distribution company using the value-based DEA method," Omega, Elsevier, vol. 53(C), pages 104-114.
    25. Bouyssou, Denis & Marchant, Thierry, 2013. "Multiattribute preference models with reference points," European Journal of Operational Research, Elsevier, vol. 229(2), pages 470-481.
    26. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    27. Roy, B. & Figueira, J.R. & Almeida-Dias, J., 2014. "Discriminating thresholds as a tool to cope with imperfect knowledge in multiple criteria decision aiding: Theoretical results and practical issues," Omega, Elsevier, vol. 43(C), pages 9-20.
    28. De Smet, Yves & Nemery, Philippe & Selvaraj, Ramkumar, 2012. "An exact algorithm for the multicriteria ordered clustering problem," Omega, Elsevier, vol. 40(6), pages 861-869.
    29. repec:dau:papers:123456789/1482 is not listed on IDEAS
    30. Mousseau, Vincent & Dias, Luis, 2004. "Valued outranking relations in ELECTRE providing manageable disaggregation procedures," European Journal of Operational Research, Elsevier, vol. 156(2), pages 467-482, July.
    31. Schuwirth, N. & Reichert, P. & Lienert, J., 2012. "Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater," European Journal of Operational Research, Elsevier, vol. 220(2), pages 472-483.
    32. Sánchez-Lozano, Juan M. & Henggeler Antunes, Carlos & García-Cascales, M. Socorro & Dias, Luis C., 2014. "GIS-based photovoltaic solar farms site selection using ELECTRE-TRI: Evaluating the case for Torre Pacheco, Murcia, Southeast of Spain," Renewable Energy, Elsevier, vol. 66(C), pages 478-494.
    33. Marinakis, Vangelis & Doukas, Haris & Xidonas, Panos & Zopounidis, Constantin, 2017. "Multicriteria decision support in local energy planning: An evaluation of alternative scenarios for the Sustainable Energy Action Plan," Omega, Elsevier, vol. 69(C), pages 1-16.
    34. Mastorakis, Kostis & Siskos, Eleftherios, 2016. "Value focused pharmaceutical strategy determination with multicriteria decision analysis techniques," Omega, Elsevier, vol. 59(PA), pages 84-96.
    35. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    2. Lucia Della Spina, 2020. "Adaptive Sustainable Reuse for Cultural Heritage: A Multiple Criteria Decision Aiding Approach Supporting Urban Development Processes," Sustainability, MDPI, vol. 12(4), pages 1-20, February.
    3. Bruno Brentan & Silvia Carpitella & Daniel Barros & Gustavo Meirelles & Antonella Certa & Joaquín Izquierdo, 2021. "Water Quality Sensor Placement: A Multi-Objective and Multi-Criteria Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(1), pages 225-241, January.
    4. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    5. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    6. Kadziński, Miłosz & Ghaderi, Mohammad & Dąbrowski, Maciej, 2020. "Contingent preference disaggregation model for multiple criteria sorting problem," European Journal of Operational Research, Elsevier, vol. 281(2), pages 369-387.
    7. Jamal, Taskin & Urmee, Tania & Shafiullah, G.M., 2020. "Planning of off-grid power supply systems in remote areas using multi-criteria decision analysis," Energy, Elsevier, vol. 201(C).
    8. Silvia Angilella & Maria Rosaria Pappalardo, 2022. "Performance assessment of energy companies employing Hierarchy Stochastic Multi-Attribute Acceptability Analysis," Operational Research, Springer, vol. 22(1), pages 299-370, March.
    9. Muhammad Riaz & Wojciech Sałabun & Hafiz Muhammad Athar Farid & Nawazish Ali & Jarosław Wątróbski, 2020. "A Robust q-Rung Orthopair Fuzzy Information Aggregation Using Einstein Operations with Application to Sustainable Energy Planning Decision Management," Energies, MDPI, vol. 13(9), pages 1-39, May.
    10. Puthearath Chan & Myeong-Hun Lee, 2019. "Developing Sustainable City Indicators for Cambodia through Delphi Processes of Panel Surveys," Sustainability, MDPI, vol. 11(11), pages 1-32, June.
    11. Miłosz Kadziński & Magdalena Martyn, 2021. "Enriched preference modeling and robustness analysis for the ELECTRE Tri-B method," Annals of Operations Research, Springer, vol. 306(1), pages 173-207, November.
    12. Jiapeng Liu & Miłosz Kadziński & Xiuwu Liao & Xiaoxin Mao, 2021. "Data-Driven Preference Learning Methods for Value-Driven Multiple Criteria Sorting with Interacting Criteria," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 586-606, May.
    13. Wang, Liang & Zhang, Zi-Xin & Ishizaka, Alessio & Wang, Ying-Ming & Martínez, Luis, 2023. "TODIMSort: A TODIM based method for sorting problems," Omega, Elsevier, vol. 115(C).
    14. Kadziński, Miłosz & Ciomek, Krzysztof, 2021. "Active learning strategies for interactive elicitation of assignment examples for threshold-based multiple criteria sorting," European Journal of Operational Research, Elsevier, vol. 293(2), pages 658-680.
    15. Marta Bottero & Chiara D’Alpaos & Alessandra Oppio, 2019. "Ranking of Adaptive Reuse Strategies for Abandoned Industrial Heritage in Vulnerable Contexts: A Multiple Criteria Decision Aiding Approach," Sustainability, MDPI, vol. 11(3), pages 1-18, February.
    16. Chaofeng Li & Yasir Ahmed Solangi & Sharafat Ali, 2023. "Evaluating the Factors of Green Finance to Achieve Carbon Peak and Carbon Neutrality Targets in China: A Delphi and Fuzzy AHP Approach," Sustainability, MDPI, vol. 15(3), pages 1-21, February.
    17. Chiara D’Alpaos & Maria Rosa Valluzzi, 2020. "Protection of Cultural Heritage Buildings and Artistic Assets from Seismic Hazard: A Hierarchical Approach," Sustainability, MDPI, vol. 12(4), pages 1-14, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    2. Fernández, Eduardo & Figueira, José Rui & Navarro, Jorge & Solares, Efrain, 2023. "A generalized approach to ordinal classification based on the comparison of actions with either limiting or characteristic profiles," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1309-1322.
    3. Fernández, Eduardo & Navarro, Jorge & Solares, Efrain, 2022. "A hierarchical interval outranking approach with interacting criteria," European Journal of Operational Research, Elsevier, vol. 298(1), pages 293-307.
    4. Eduardo Fernández & José Rui Figueira & Jorge Navarro, 2023. "A theoretical look at ordinal classification methods based on comparing actions with limiting boundaries between adjacent classes," Annals of Operations Research, Springer, vol. 325(2), pages 819-843, June.
    5. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    6. Arandarenko, Mihail & Corrente, Salvatore & Jandrić, Maja & Stamenković, Mladen, 2020. "Multiple criteria decision aiding as a prediction tool for migration potential of regions," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1154-1166.
    7. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    8. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    9. Rocha, António & Costa, Ana Sara & Figueira, José Rui & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2021. "Quality assessment of the Portuguese public hospitals: A multiple criteria approach," Omega, Elsevier, vol. 105(C).
    10. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    11. Denis Bouyssou & Thierry Marchant, 2013. "Some remarks on ELECTRE TRI," Working Papers hal-00942310, HAL.
    12. Bouyssou, Denis & Marchant, Thierry, 2015. "On the relations between ELECTRE TRI-B and ELECTRE TRI-C and on a new variant of ELECTRE TRI-B," European Journal of Operational Research, Elsevier, vol. 242(1), pages 201-211.
    13. Francesca Abastante & Salvatore Corrente & Salvatore Greco & Isabella M. Lami & Beatrice Mecca, 2022. "The introduction of the SRF-II method to compare hypothesis of adaptive reuse for an iconic historical building," Operational Research, Springer, vol. 22(3), pages 2397-2436, July.
    14. Fu-Ling Cai & Xiuwu Liao & Kan-Liang Wang, 2012. "An interactive sorting approach based on the assignment examples of multiple decision makers with different priorities," Annals of Operations Research, Springer, vol. 197(1), pages 87-108, August.
    15. Hu, Qiwei & Chakhar, Salem & Siraj, Sajid & Labib, Ashraf, 2017. "Spare parts classification in industrial manufacturing using the dominance-based rough set approach," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1136-1163.
    16. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    17. Pelissari, Renata & Oliveira, Maria Célia & Ben Amor, Sarah & Abackerli, Alvaro José, 2019. "A new FlowSort-based method to deal with information imperfections in sorting decision-making problems," European Journal of Operational Research, Elsevier, vol. 276(1), pages 235-246.
    18. Chakhar, Salem & Ishizaka, Alessio & Labib, Ashraf & Saad, Inès, 2016. "Dominance-based rough set approach for group decisions," European Journal of Operational Research, Elsevier, vol. 251(1), pages 206-224.
    19. Kadziński, Miłosz & Tervonen, Tommi & Rui Figueira, José, 2015. "Robust multi-criteria sorting with the outranking preference model and characteristic profiles," Omega, Elsevier, vol. 55(C), pages 126-140.
    20. Eduardo Fernandez & Jorge Navarro & Efrain Solares, 2021. "A theoretical look at ordinal classification methods based on reference sets composed of characteristic actions," Papers 2107.04656, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:76:y:2018:i:c:p:100-111. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.