IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v279y2019i3p912-928.html
   My bibliography  Save this article

Enhancing the elicitation of diverse decision objectives for public planning

Author

Listed:
  • Haag, Fridolin
  • Zürcher, Sara
  • Lienert, Judit

Abstract

Identifying objectives is essential for decision making, but individuals have difficulties stating their important objectives. In public and environmental decisions, the diverse views of stakeholders should be included, but eliciting a broad set of objectives is challenging. We (1) study the effectiveness of individual brainstorming for eliciting objectives in a real-world setting; (2) test three interventions to support individuals in generating objectives; (3) investigate which and how many stakeholders are necessary to generate a comprehensive set of objectives; and (4) develop a feasible elicitation procedure for practice. In an experimental test, 71 stakeholders participated in five decisions about regional wastewater infrastructure planning in Switzerland. Three interventions were tested with an online survey procedure: (i) providing category cues, (ii) a perspective-taking task, and (iii) providing a predefined master list of objectives. In simple brainstorming, participants stated few objectives (M = 3.3) associated with 2.9 different categories on average. Participants consistently missed objectives they later considered important. Providing a master list was the only intervention that substantially increased the number and breadth of objectives (M = 12 objectives in M = 5.3 categories). With the help of our survey, participants generated between 30 and 38 distinct objectives for each decision case. Between five and nine participants were sufficient to generate these; more participants did not contribute new objectives. Most decision makers need help generating their objectives; combining simple brainstorming with a master list is a straightforward improvement that does not require a facilitator. An online process is promising for involving a large group of stakeholders.

Suggested Citation

  • Haag, Fridolin & Zürcher, Sara & Lienert, Judit, 2019. "Enhancing the elicitation of diverse decision objectives for public planning," European Journal of Operational Research, Elsevier, vol. 279(3), pages 912-928.
    • Handle: RePEc:eee:ejores:v:279:y:2019:i:3:p:912-928
    DOI: 10.1016/j.ejor.2019.06.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719304771
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2019.06.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    2. G Montibeller & V Belton, 2006. "Causal maps and the evaluation of decision options—a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 779-791, July.
    3. Payne, John W & Bettman, James R & Schkade, David A, 1999. "Measuring Constructed Preferences: Towards a Building Code," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 243-270, December.
    4. Ralph L. Keeney, 1988. "Structuring Objectives for Problems of Public Interest," Operations Research, INFORMS, vol. 36(3), pages 396-405, June.
    5. Abbott, Malcolm & Cohen, Bruce, 2009. "Productivity and efficiency in the water industry," Utilities Policy, Elsevier, vol. 17(3-4), pages 233-244, September.
    6. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    7. Samuel D. Bond & Kurt A. Carlson & Ralph L. Keeney, 2010. "Improving the Generation of Decision Objectives," Decision Analysis, INFORMS, vol. 7(3), pages 238-255, September.
    8. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    9. Fuenfschilling, Lea & Truffer, Bernhard, 2014. "The structuration of socio-technical regimes—Conceptual foundations from institutional theory," Research Policy, Elsevier, vol. 43(4), pages 772-791.
    10. Scholten, Lisa & Schuwirth, Nele & Reichert, Peter & Lienert, Judit, 2015. "Tackling uncertainty in multi-criteria decision analysis – An application to water supply infrastructure planning," European Journal of Operational Research, Elsevier, vol. 242(1), pages 243-260.
    11. De Brucker, Klaas & Macharis, Cathy & Verbeke, Alain, 2013. "Multi-criteria analysis and the resolution of sustainable development dilemmas: A stakeholder management approach," European Journal of Operational Research, Elsevier, vol. 224(1), pages 122-131.
    12. V. Chvatal, 1979. "A Greedy Heuristic for the Set-Covering Problem," Mathematics of Operations Research, INFORMS, vol. 4(3), pages 233-235, August.
    13. Rajagopal, 2014. "Organizations and Innovation," Palgrave Macmillan Books, in: Architecting Enterprise, chapter 3, pages 58-86, Palgrave Macmillan.
    14. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    15. Rüdiger von Nitzsch & Martin Weber, 1993. "The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements," Management Science, INFORMS, vol. 39(8), pages 937-943, August.
    16. Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward, 2017. "Reviewing the role of stakeholders in Operational Research: A stakeholder theory perspectiveAuthor-Name: de Gooyert, Vincent," European Journal of Operational Research, Elsevier, vol. 262(2), pages 402-410.
    17. Gilberto Montibeller & Detlof Winterfeldt, 2018. "Individual and Group Biases in Value and Uncertainty Judgments," International Series in Operations Research & Management Science, in: Luis C. Dias & Alec Morton & John Quigley (ed.), Elicitation, chapter 0, pages 377-392, Springer.
    18. Neves, L.P. & Dias, L.C. & Antunes, C.H. & Martins, A.G., 2009. "Structuring an MCDA model using SSM: A case study in energy efficiency," European Journal of Operational Research, Elsevier, vol. 199(3), pages 834-845, December.
    19. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    20. Samuel D. Bond & Kurt A. Carlson & Ralph L. Keeney, 2008. "Generating Objectives: Can Decision Makers Articulate What They Want?," Management Science, INFORMS, vol. 54(1), pages 56-70, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    2. Sara Schmid & Rudolf Vetschera & Judit Lienert, 2021. "Testing Fairness Principles for Public Environmental Infrastructure Decisions," Group Decision and Negotiation, Springer, vol. 30(3), pages 611-640, June.
    3. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    2. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    3. Siebert, Johannes Ulrich & Kunz, Reinhard E. & Rolf, Philipp, 2021. "Effects of decision training on individuals’ decision-making proactivity," European Journal of Operational Research, Elsevier, vol. 294(1), pages 264-282.
    4. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    5. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    6. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    7. Zheng, Jun & Lienert, Judit, 2018. "Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS," European Journal of Operational Research, Elsevier, vol. 267(1), pages 273-287.
    8. Dimitrios Gouglas & Kendall Hoyt & Elizabeth Peacocke & Aristidis Kaloudis & Trygve Ottersen & John-Arne Røttingen, 2019. "Setting Strategic Objectives for the Coalition for Epidemic Preparedness Innovations: An Exploratory Decision Analysis Process," Service Science, INFORMS, vol. 49(6), pages 430-446, November.
    9. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    10. Robin L. Dillon & Vicki M. Bier & Richard Sheffield John & Abdullah Althenayyan, 2023. "Closing the Gap Between Decision Analysis and Policy Analysts Before the Next Pandemic," Decision Analysis, INFORMS, vol. 20(2), pages 109-132, June.
    11. Gilberto Montibeller & L. Alberto Franco & Ashley Carreras, 2020. "A Risk Analysis Framework for Prioritizing and Managing Biosecurity Threats," Risk Analysis, John Wiley & Sons, vol. 40(11), pages 2462-2477, November.
    12. Tavana, Madjid & Di Caprio, Debora, 2016. "Modeling synergies in multi-criteria supplier selection and order allocation: An application to commodity tradingAuthor-Name: Sodenkamp, Mariya A," European Journal of Operational Research, Elsevier, vol. 254(3), pages 859-874.
    13. Terry Walshe & Mark Burgman, 2010. "A Framework for Assessing and Managing Risks Posed by Emerging Diseases," Risk Analysis, John Wiley & Sons, vol. 30(2), pages 236-249, February.
    14. Bana e Costa, Carlos A. & Oliveira, Mónica D. & Vieira, Ana C.L. & Freitas, Liliana & Rodrigues, Teresa C. & Bana e Costa, João & Freitas, Ângela & Santana, Paula, 2023. "Collaborative development of composite indices from qualitative value judgements: The EURO-HEALTHY Population Health Index model," European Journal of Operational Research, Elsevier, vol. 305(1), pages 475-492.
    15. A Morton & B Fasolo, 2009. "Behavioural decision theory for multi-criteria decision analysis: a guided tour," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 268-275, February.
    16. Shuang Liu & Kirsten Maclean & Cathy Robinson, 2019. "A cost-effective framework to prioritise stakeholder participation options," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 7(3), pages 221-241, November.
    17. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    18. Elena Bakhanova & Jaime A. Garcia & William L. Raffe & Alexey Voinov, 2023. "Gamification Framework for Participatory Modeling: A Proposal," Group Decision and Negotiation, Springer, vol. 32(5), pages 1167-1182, October.
    19. Tim H¨ofer & Rüdiger von Nitzsch & Reinhard Madlener, 2020. "Using Value-Focused Thinking and Multicriteria Decision Making to Evaluate Energy Transition Alternatives," Decision Analysis, INFORMS, vol. 17(4), pages 330-355, December.
    20. Ferretti, V., 2021. "Framing territorial regeneration decisions: Purpose, perspective and scope," Land Use Policy, Elsevier, vol. 102(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:279:y:2019:i:3:p:912-928. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.