IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v308y2023i3p1268-1285.html
   My bibliography  Save this article

Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications

Author

Listed:
  • Kuller, M.
  • Beutler, P.
  • Lienert, J.

Abstract

Public decisions are typically related to large investments leaving long legacies. We should therefore strive for wide societal agreement regarding such decisions, which meet the diversity of preferences between stakeholders and over time. But if, how and why do stakeholder preferences change over time? In decision analysis, these questions received little attention. We explored them using three real-world public decision processes, based on Multi-Criteria Decision Analysis (MCDA). We used repeatedly elicited ranking of objectives over time. These were obtained during three to five moderated workshops we organised several months apart (total N = 200 questionnaires, and 100 stakeholders). We analysed individual and aggregated (group) preferences, their changes and potential drivers including demographic and experience variables. We also analysed the effect of preference evolution on the performance of decision-alternatives with MCDA over time. We found that stakeholder preferences often changed over time, both on an individual and group level. These changes did not systematically diminish over time, but some convergence of preferences was observed for stakeholders who repeatedly participated in workshops. High-ranking objectives were relatively stable and similar between stakeholders. While preference changes could not be explained by demographics and personal experiences, repeated interaction with the decision problem might play a role. Neither the observed disagreement between stakeholders, nor the preference changes over time affected the best and worst performing alternatives in our decision problems. Thus, despite changing stakeholder preferences over time, public decision-makers can contrive robust solutions to complex public decision problems in the present.

Suggested Citation

  • Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    • Handle: RePEc:eee:ejores:v:308:y:2023:i:3:p:1268-1285
    DOI: 10.1016/j.ejor.2022.12.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722009286
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2022.12.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John C. Whitehead & Thomas J. Hoban, 1999. "Testing for Temporal Reliability in Contingent Valuation with Time for Changes in Factors Affecting Demand," Land Economics, University of Wisconsin Press, vol. 75(3), pages 453-465.
    2. K. McConnell* & I. Strand & Sebastián Valdés, 1998. "Testing Temporal Reliability and Carry-over Effect: The Role of Correlated Responses in Test-retest Reliability Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 12(3), pages 357-374, October.
    3. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    4. Kiyotada Hayashi & Hiroki Hondo & Yue Moriizumi, 2016. "Preference Construction Processes for Renewable Energies: Assessing the Influence of Sustainability Information and Decision Support Methods," Sustainability, MDPI, vol. 8(11), pages 1-14, November.
    5. de Almeida, Jonatas Araujo & Costa, Ana Paula Cabral Seixas & de Almeida-Filho, Adiel Teixeira, 2016. "A new method for elicitation of criteria weights in additive models: Flexible and interactive tradeoffAuthor-Name: de Almeida, Adiel Teixeira," European Journal of Operational Research, Elsevier, vol. 250(1), pages 179-191.
    6. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    7. A Morton & B Fasolo, 2009. "Behavioural decision theory for multi-criteria decision analysis: a guided tour," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 268-275, February.
    8. de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2022. "Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes," European Journal of Operational Research, Elsevier, vol. 299(2), pages 589-599.
    9. Bettman, James R & Luce, Mary Frances & Payne, John W, 1998. "Constructive Consumer Choice Processes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(3), pages 187-217, December.
    10. Richard T. Carson & W. Michael Hanemann, & Raymond J. Kopp & Jon A. Krosnick & Robert C. Mitchell & Stanley Presser & Paul A. Rudd & V. Kerry Smith & Michael Conaway & Kerry Martin, 1997. "Temporal Reliability of Estimates from Contingent Valuation," Land Economics, University of Wisconsin Press, vol. 73(2), pages 151-163.
    11. John B. Loomis, 1989. "Test-Retest Reliability of the Contingent Valuation Method: A Comparison of General Population and Visitor Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 76-84.
    12. Gregory, Robin & Lichtenstein, Sarah & Slovic, Paul, 1993. "Valuing Environmental Resources: A Constructive Approach," Journal of Risk and Uncertainty, Springer, vol. 7(2), pages 177-197, October.
    13. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    14. Biernacki, Christophe & Jacques, Julien, 2013. "A generative model for rank data based on insertion sort algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 162-176.
    15. Brouwer, Roy, 2006. "Do stated preference methods stand the test of time? A test of the stability of contingent values and models for health risks when facing an extreme event," Ecological Economics, Elsevier, vol. 60(2), pages 399-406, December.
    16. Katsikopoulos, Konstantinos V. & Durbach, Ian N. & Stewart, Theodor J., 2018. "When should we use simple decision models? A synthesis of various research strands," Omega, Elsevier, vol. 81(C), pages 17-25.
    17. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    18. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    19. Cameron, John I., 1997. "Applying socio-ecological economics: A case study of contingent valuation and integrated catchment management," Ecological Economics, Elsevier, vol. 23(2), pages 155-165, November.
    20. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    21. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    22. Haag, Fridolin & Zürcher, Sara & Lienert, Judit, 2019. "Enhancing the elicitation of diverse decision objectives for public planning," European Journal of Operational Research, Elsevier, vol. 279(3), pages 912-928.
    23. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    24. Slovic, Paul & Finucane, Melissa L. & Peters, Ellen & MacGregor, Donald G., 2007. "The affect heuristic," European Journal of Operational Research, Elsevier, vol. 177(3), pages 1333-1352, March.
    25. Roy Brouwer & Ivana Logar & Oleg Sheremet, 2017. "Choice Consistency and Preference Stability in Test-Retests of Discrete Choice Experiment and Open-Ended Willingness to Pay Elicitation Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 729-751, November.
    26. Gilberto Montibeller & Detlof Winterfeldt, 2018. "Individual and Group Biases in Value and Uncertainty Judgments," International Series in Operations Research & Management Science, in: Luis C. Dias & Alec Morton & John Quigley (ed.), Elicitation, chapter 0, pages 377-392, Springer.
    27. Zheng, Jun & Lienert, Judit, 2018. "Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS," European Journal of Operational Research, Elsevier, vol. 267(1), pages 273-287.
    28. Albert V. Norström & Christopher Cvitanovic & Marie F. Löf & Simon West & Carina Wyborn & Patricia Balvanera & Angela T. Bednarek & Elena M. Bennett & Reinette Biggs & Ariane Bremond & Bruce M. Campbe, 2020. "Principles for knowledge co-production in sustainability research," Nature Sustainability, Nature, vol. 3(3), pages 182-190, March.
    29. Gebeyehu Fetene & Søren Olsen & Ole Bonnichsen, 2014. "Disentangling the Pure Time Effect From Site and Preference Heterogeneity Effects in Benefit Transfer: An Empirical Investigation of Transferability," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(4), pages 583-611, December.
    30. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    31. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    32. Haag, Fridolin & Lienert, Judit & Schuwirth, Nele & Reichert, Peter, 2019. "Identifying non-additive multi-attribute value functions based on uncertain indifference statements," Omega, Elsevier, vol. 85(C), pages 49-67.
    33. Richard J Ormerod, 2014. "The mangle of OR practice: towards more informative case studies of ‘technical’ projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(8), pages 1245-1260, August.
    34. Brouwer, Roy & Akter, Sonia & Brander, Luke & Haque, Enamul, 2009. "Economic valuation of flood risk exposure and reduction in a severely flood prone developing country," Environment and Development Economics, Cambridge University Press, vol. 14(3), pages 397-417, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hynes, Stephen & Armstrong, Claire W. & Xuan, Bui Bich & Ankamah-Yeboah, Isaac & Simpson, Katherine & Tinch, Robert & Ressurreição, Adriana, 2021. "Have environmental preferences and willingness to pay remained stable before and during the global Covid-19 shock?," Ecological Economics, Elsevier, vol. 189(C).
    2. Rolfe, John & Dyack, Brenda, 2019. "Testing Temporal Stability of Recreation Values," Ecological Economics, Elsevier, vol. 159(C), pages 75-83.
    3. J. Price & D. Dupont & W. Adamowicz, 2017. "As Time Goes By: Examination of Temporal Stability Across Stated Preference Question Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 643-662, November.
    4. Lew, Daniel K. & Wallmo, Kristy, 2017. "Temporal stability of stated preferences for endangered species protection from choice experiments," Ecological Economics, Elsevier, vol. 131(C), pages 87-97.
    5. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    6. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    7. Jie He & Bing Zhang, 2021. "Current Air Pollution and Willingness to Pay for Better Air Quality: Revisiting the Temporal Reliability of the Contingent Valuation Method," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(1), pages 135-168, May.
    8. Gebeyehu Fetene & Søren Olsen & Ole Bonnichsen, 2014. "Disentangling the Pure Time Effect From Site and Preference Heterogeneity Effects in Benefit Transfer: An Empirical Investigation of Transferability," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(4), pages 583-611, December.
    9. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    10. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    11. Roy Brouwer & Ivana Logar & Oleg Sheremet, 2017. "Choice Consistency and Preference Stability in Test-Retests of Discrete Choice Experiment and Open-Ended Willingness to Pay Elicitation Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 729-751, November.
    12. Wanggi Jaung & Louis Putzel & Gary Q. Bull & Diswandi Diswandi & Witardi & Markum, 2019. "Temporal Reliability of Willingness to Pay for Payments for Environmental Services: Lessons from Lombok, Indonesia," Water Economics and Policy (WEP), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 1-22, October.
    13. Zheng, Jun & Lienert, Judit, 2018. "Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS," European Journal of Operational Research, Elsevier, vol. 267(1), pages 273-287.
    14. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    15. Jee W Hwang, 2012. "Temporal reliability test of nonconsumptive wildlife recreation benefits constructed from choke price data," Economics Bulletin, AccessEcon, vol. 32(1), pages 788-798.
    16. Gasparini, Gaia & Brunelli, Matteo & Chiriac, Marius Dan, 2022. "Multi-period portfolio decision analysis: A case study in the infrastructure management sector," Operations Research Perspectives, Elsevier, vol. 9(C).
    17. Loureiro, Maria L. & Loomis, John, 2017. "How Sensitive Are Environmental Valuations To Economic Downturns?," Ecological Economics, Elsevier, vol. 140(C), pages 235-240.
    18. Joseph Cook & Marc Jeuland & Brian Maskery & Dale Whittington, 2012. "Giving Stated Preference Respondents “Time to Think”: Results From Four Countries," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 473-496, April.
    19. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    20. Mikołaj Czajkowski & Anna Bartczak & Wiktor Budziński & Marek Giergiczny, 2014. "Within- and between- sample tests of preference stability and willingness to pay for forest management," Working Papers 2014-24, Faculty of Economic Sciences, University of Warsaw.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:308:y:2023:i:3:p:1268-1285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.