IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/118192.html
   My bibliography  Save this paper

Desirability–doability group judgment framework for the collaborative multicriteria evaluation of public policies

Author

Listed:
  • Bana e Costa, Carlos A.
  • Oliveira, Mónica D.
  • Rodrigues, Teresa C.
  • Vieira, Ana C.L.

Abstract

Desirability–doability framework (2 × D) is a novel framework for the collaborative evaluation of public policies. Fundamental objectives and performance indicators are agreed upon in workshops, policies are characterised, and barriers to implementation identified. MACBETH interactive protocols are then applied in decision conferences to elicit qualitative judgments about the desirability of policies, within and across objectives; and about their doability under the expected graveness of barriers on contrasting scenarios. Elicited judgments allow, respectively, to construct a shared multicriteria model measuring the overall desirability of policies; and, to measure their doability. Desirability–doability graphs enable visual interactive classification of policies, with sensitivity/robustness analyses of uncertainties. 2 × D was successfully tested in a real-world urban-health policymaking case to evaluate spatial policies. The main novelty of 2 × D is that it bridges the socio-technical gap, present in OR, between the support required by a complex social decision-making process, and that usually offered by analytic techniques – while keeping modeling theoretically sound and simple.

Suggested Citation

  • Bana e Costa, Carlos A. & Oliveira, Mónica D. & Rodrigues, Teresa C. & Vieira, Ana C.L., 2023. "Desirability–doability group judgment framework for the collaborative multicriteria evaluation of public policies," LSE Research Online Documents on Economics 118192, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:118192
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/118192/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carlos A. Bana e Costa & Jean-Marie Corte & Jean-Claude Vansnick, 2005. "On the Mathematical Foundation of MACBETH," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 409-437, Springer.
    2. Bana e Costa, Carlos A. & Ensslin, Leonardo & Correa, Emerson C. & Vansnick, Jean-Claude, 1999. "Decision Support Systems in action: Integrated application in a multicriteria decision aid process," European Journal of Operational Research, Elsevier, vol. 113(2), pages 315-335, March.
    3. Valentin Bertsch & Jutta Geldermann & Otto Rentz, 2007. "Preference Sensitivity Analyses for Multi-Attribute Decision Support," Operations Research Proceedings, in: Karl-Heinz Waldmann & Ulrike M. Stocker (ed.), Operations Research Proceedings 2006, pages 411-416, Springer.
    4. Eden, Colin, 2004. "Analyzing cognitive maps to help structure issues or problems," European Journal of Operational Research, Elsevier, vol. 159(3), pages 673-686, December.
    5. Morera, Osvaldo F. & Budescu, David V., 1998. "A Psychometric Analysis of the "Divide and Conquer" Principle in Multicriteria Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 75(3), pages 187-206, September.
    6. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    7. L. Robin Keller & Jay Simon, 2019. "Preference Functions for Spatial Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 39(1), pages 244-256, January.
    8. Durbach, Ian N. & Stewart, Theodor J., 2012. "Modeling uncertainty in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 223(1), pages 1-14.
    9. Jay Simon & Craig W. Kirkwood & L. Robin Keller, 2014. "Decision Analysis with Geographically Varying Outcomes: Preference Models and Illustrative Applications," Operations Research, INFORMS, vol. 62(1), pages 182-194, February.
    10. Vieira, Ana C.L. & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2020. "Enhancing knowledge construction processes within multicriteria decision analysis: The Collaborative Value Modelling framework," Omega, Elsevier, vol. 94(C).
    11. James E. Smith & James S. Dyer, 2021. "On (Measurable) Multiattribute Value Functions: An Expository Argument," Decision Analysis, INFORMS, vol. 18(4), pages 247-256, December.
    12. Christopher W. Karvetski & James H. Lambert, 2012. "Evaluating deep uncertainties in strategic priority‐setting with an application to facility energy investments," Systems Engineering, John Wiley & Sons, vol. 15(4), pages 483-493, December.
    13. James S. Dyer & Rakesh K. Sarin, 1979. "Measurable Multiattribute Value Functions," Operations Research, INFORMS, vol. 27(4), pages 810-822, August.
    14. Angelis, Aris & Kanavos, Panos, 2017. "Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework," Social Science & Medicine, Elsevier, vol. 188(C), pages 137-156.
    15. Dodgson, JS & Spackman, M & Pearman, A & Phillips, LD, 2009. "Multi-criteria analysis: a manual," Economic History Working Papers 12761, London School of Economics and Political Science, Department of Economic History.
    16. Carlos A. Bana e Costa & João Carlos Lourenço & Mónica Duarte Oliveira & João C. Bana e Costa, 2014. "A Socio-technical Approach for Group Decision Support in Public Strategic Planning: The Pernambuco PPA Case," Group Decision and Negotiation, Springer, vol. 23(1), pages 5-29, January.
    17. Fasolo, Barbara & Bana e Costa, Carlos A., 2014. "Tailoring value elicitation to decision makers' numeracy and fluency: Expressing value judgments in numbers or words," Omega, Elsevier, vol. 44(C), pages 83-90.
    18. Theodor J Stewart, 2005. "Dealing with Uncertainties in MCDA," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 445-466, Springer.
    19. Ricardo J. G. Mateus & João C. Bana e Costa & Pedro Verga Matos, 2017. "Supporting Multicriteria Group Decisions with MACBETH Tools: Selection of Sustainable Brownfield Redevelopment Actions," Group Decision and Negotiation, Springer, vol. 26(3), pages 495-521, May.
    20. Lawrence Phillips & Carlos Bana e Costa, 2007. "Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing," Annals of Operations Research, Springer, vol. 154(1), pages 51-68, October.
    21. Bernard Roy, 2010. "Two conceptions of decision aiding," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 1(1), pages 74-79.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bana e Costa, Carlos A. & Oliveira, Mónica D. & Vieira, Ana C.L. & Freitas, Liliana & Rodrigues, Teresa C. & Bana e Costa, João & Freitas, Ângela & Santana, Paula, 2023. "Collaborative development of composite indices from qualitative value judgements: The EURO-HEALTHY Population Health Index model," European Journal of Operational Research, Elsevier, vol. 305(1), pages 475-492.
    2. Rodrigues, Teresa C. & Montibeller, Gilberto & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2017. "Modelling multicriteria value interactions with Reasoning Maps," European Journal of Operational Research, Elsevier, vol. 258(3), pages 1054-1071.
    3. Gomes, Luís S. & Santos, Sérgio P. & Coelho, Luís Serra & Rebelo, Efigénio L., 2023. "Using MCDA to assist an Intermunicipal community develop a resilience strategy in face of the pandemic caused by the SARS-CoV-2," Socio-Economic Planning Sciences, Elsevier, vol. 87(PB).
    4. Angelis, A. & Linch, M. & Montibeller, G. & Molina-Lopez, T. & Zawada, A. & Orzel, K. & Arickx, F. & Espin, J. & Kanavos, P., 2020. "Multiple Criteria Decision Analysis for HTA across four EU Member States: Piloting the Advance Value Framework," Social Science & Medicine, Elsevier, vol. 246(C).
    5. F A F Ferreira & S P Santos & P M M Rodrigues, 2011. "Adding value to bank branch performance evaluation using cognitive maps and MCDA: a case study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1320-1333, July.
    6. Mónica D. Oliveira & Inês Mataloto & Panos Kanavos, 2019. "Multi-criteria decision analysis for health technology assessment: addressing methodological challenges to improve the state of the art," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(6), pages 891-918, August.
    7. Vieira, Ana C.L. & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2020. "Enhancing knowledge construction processes within multicriteria decision analysis: The Collaborative Value Modelling framework," Omega, Elsevier, vol. 94(C).
    8. Scholten, Lisa & Schuwirth, Nele & Reichert, Peter & Lienert, Judit, 2015. "Tackling uncertainty in multi-criteria decision analysis – An application to water supply infrastructure planning," European Journal of Operational Research, Elsevier, vol. 242(1), pages 243-260.
    9. Dimitrios Gouglas & Kendall Hoyt & Elizabeth Peacocke & Aristidis Kaloudis & Trygve Ottersen & John-Arne Røttingen, 2019. "Setting Strategic Objectives for the Coalition for Epidemic Preparedness Innovations: An Exploratory Decision Analysis Process," Service Science, INFORMS, vol. 49(6), pages 430-446, November.
    10. Andrea C. Hupman & Jay Simon, 2023. "The Legacy of Peter Fishburn: Foundational Work and Lasting Impact," Decision Analysis, INFORMS, vol. 20(1), pages 1-15, March.
    11. Montibeller, Gilberto & Franco, Alberto & Lord, Ewan & Iglesias, Aline, 2008. "Structuring multi-criteria portfolio analysis models," LSE Research Online Documents on Economics 22693, London School of Economics and Political Science, LSE Library.
    12. Montibeller, Gilberto & Franco, L. Alberto & Lord, Ewan & Iglesias, Aline, 2009. "Structuring resource allocation decisions: A framework for building multi-criteria portfolio models with area-grouped options," European Journal of Operational Research, Elsevier, vol. 199(3), pages 846-856, December.
    13. Florian Methling & Steffen A. Borden & Deepak Veeraraghavan & Insa Sommer & Johannes Ulrich Siebert & Rüdiger von Nitzsch & Mark Seidler, 2022. "Supporting Innovation in Early-Stage Pharmaceutical Development Decisions," Decision Analysis, INFORMS, vol. 19(4), pages 337-353, December.
    14. Ezbakhe, Fatine & Pérez-Foguet, Agustí, 2021. "Decision analysis for sustainable development: The case of renewable energy planning under uncertainty," European Journal of Operational Research, Elsevier, vol. 291(2), pages 601-613.
    15. Jay Simon, 2016. "On the existence of altruistic value and utility functions," Theory and Decision, Springer, vol. 81(3), pages 371-391, September.
    16. Jay Simon, 2020. "Weight Approximation for Spatial Outcomes," Sustainability, MDPI, vol. 12(14), pages 1-18, July.
    17. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    18. Wulf, David & Bertsch, Valentin, 2016. "A natural language generation approach to support understanding and traceability of multi-dimensional preferential sensitivity analysis in multi-criteria decision making," MPRA Paper 75025, University Library of Munich, Germany.
    19. Meinard, Y. & Tsoukiàs, A., 2019. "On the rationality of decision aiding processes," European Journal of Operational Research, Elsevier, vol. 273(3), pages 1074-1084.
    20. Salvatore F. Pileggi, 2019. "Is the World Becoming a Better or a Worse Place? A Data-Driven Analysis," Sustainability, MDPI, vol. 12(1), pages 1-24, December.

    More about this item

    Keywords

    desirability; doability; elicitation protocols; MACBETH; multicriteria analysis; policy evaluation; scenarios; socio-technical framework; European Union's Horizon 2020 research and innovation programme under Grant Agreement No. 643398;
    All these keywords.

    JEL classification:

    • J50 - Labor and Demographic Economics - - Labor-Management Relations, Trade Unions, and Collective Bargaining - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:118192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.