IDEAS home Printed from https://ideas.repec.org/a/wsi/jeapmx/v20y2018i03ns1464333218400021.html
   My bibliography  Save this article

Use of Analyst-Generated Stakeholder Preference Profiles in Multi-Criteria Decision Analysis — Experiences from an Urban Planning Case

Author

Listed:
  • Mika Marttunen

    (SYKE, Finnish Environment Institute, P.O. Box 140, 00251 Helsinki, Finland)

  • Jyri Mustajoki

    (SYKE, Finnish Environment Institute, P.O. Box 140, 00251 Helsinki, Finland)

Abstract

Multi-criteria decision analysis (MCDA) is a generic term for approaches supporting the systematic evaluation of alternatives in problems involving multiple criteria and stakeholders. One of the most challenging tasks is to gather preference information from stakeholders in a way that both reflects their true opinions and meets the theoretical requirements of the applied MCDA approach. Various techniques have been used in practice, including interviews and decision conferences. In this paper, we present a new cost-efficient approach in which an analyst generates weight profiles for various stakeholder groups. That is, instead of personally asking specific trade-off questions from the stakeholders, weight profiles are developed on the basis of more general preference information collected from the stakeholders. The potential advantages of this approach are: (i) the collection of the preferences using surveys is less laborious than personal interviews or decision conferences and (ii) the risk of cognitive biases in the weight elicitation can be reduced, because the most challenging task of MCDA — assigning weights to the criteria — is left to the analyst, who should be aware of typical biases and how to avoid them. We developed and tested the approach in a contested public decision-making situation related to the development of a new residential area. We utilised the data gathered from the participants of the workshops (21) as well as the data from a web survey including 177 responds via a randomly sampled closed survey, in addition to 484 responds via an open survey. Four preference profiles each having specific weight distributions to criteria were developed, using a multi-stage procedure. Four development alternatives were compared as based on the developed preference profiles. We were able to realise the MCDA process within a very tight time schedule, create plausible preference profiles and summarise each alternative’s pros and cons from different perspectives. However, we also identified several issues which have to be paid more attention in future cases or require further research.

Suggested Citation

  • Mika Marttunen & Jyri Mustajoki, 2018. "Use of Analyst-Generated Stakeholder Preference Profiles in Multi-Criteria Decision Analysis — Experiences from an Urban Planning Case," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 20(03), pages 1-29, September.
    • Handle: RePEc:wsi:jeapmx:v:20:y:2018:i:03:n:s1464333218400021
    DOI: 10.1142/S1464333218400021
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S1464333218400021
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://libkey.io/10.1142/S1464333218400021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    2. Wendy Proctor & Martin Drechsler, 2006. "Deliberative Multicriteria Evaluation," Environment and Planning C, , vol. 24(2), pages 169-190, April.
    3. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    4. Munda, Giuseppe, 2004. "Social multi-criteria evaluation: Methodological foundations and operational consequences," European Journal of Operational Research, Elsevier, vol. 158(3), pages 662-677, November.
    5. Martin Weber & Franz Eisenführ & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    6. Jeffrey Keisler & Igor Linkov, 2014. "Environment models and decisions," Environment Systems and Decisions, Springer, vol. 34(3), pages 369-372, September.
    7. Langemeyer, Johannes & Gómez-Baggethun, Erik & Haase, Dagmar & Scheuer, Sebastian & Elmqvist, Thomas, 2016. "Bridging the gap between ecosystem service assessments and land-use planning through Multi-Criteria Decision Analysis (MCDA)," Environmental Science & Policy, Elsevier, vol. 62(C), pages 45-56.
    8. A Morton & B Fasolo, 2009. "Behavioural decision theory for multi-criteria decision analysis: a guided tour," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 268-275, February.
    9. Marttunen, Mika & Hamalainen, Raimo P., 1995. "Decision analysis interviews in environmental impact assessment," European Journal of Operational Research, Elsevier, vol. 87(3), pages 551-563, December.
    10. Rüdiger von Nitzsch & Martin Weber, 1993. "The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements," Management Science, INFORMS, vol. 39(8), pages 937-943, August.
    11. Lennox, James & Proctor, Wendy & Russell, Shona, 2011. "Structuring stakeholder participation in New Zealand's water resource governance," Ecological Economics, Elsevier, vol. 70(7), pages 1381-1394, May.
    12. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    13. H. J. Corsair & Jennifer Bassman Ruch & Pearl Q. Zheng & Benjamin F. Hobbs & Joseph F. Koonce, 2009. "Multicriteria Decision Analysis of Stream Restoration: Potential and Examples," Group Decision and Negotiation, Springer, vol. 18(4), pages 387-417, July.
    14. Stefan Hajkowicz & Kerry Collins, 2007. "A Review of Multiple Criteria Analysis for Water Resource Planning and Management," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 21(9), pages 1553-1566, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Weiwei & Gao, Pengpeng & Wang, Jiahaoran, 2023. "Nexus among digital inclusive finance and carbon neutrality: Evidence from company-level panel data analysis," Resources Policy, Elsevier, vol. 80(C).
    2. Chang, Lei & Taghizadeh-Hesary, Farhad & Saydaliev, Hayot Berk, 2022. "How do ICT and renewable energy impact sustainable development?," Renewable Energy, Elsevier, vol. 199(C), pages 123-131.
    3. Witold Chmielarz & Marek Zborowski & Mesut Atasever & Jin Xuetao & Justyna Szpakowska, 2023. "The Role of ICT in Creating the Conscious Development of Green Energy Applications in Times of Crisis: Comparison of Poland, Türkiye and People's Republic of China," European Research Studies Journal, European Research Studies Journal, vol. 0(1), pages 492-519.
    4. Sadiq, Muhammad & Lin, Chia-Yang & Wang, Kuan-Ting & Trung, Lam Minh & Duong, Khoa Dang & Ngo, Thanh Quang, 2022. "Commodity dynamism in the COVID-19 crisis: Are gold, oil, and stock commodity prices, symmetrical?," Resources Policy, Elsevier, vol. 79(C).
    5. Yan, Juan & Haroon, Muhammad, 2023. "Financing efficiency in natural resource markets mobilizing private and public capital for a green recovery," Resources Policy, Elsevier, vol. 85(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mustajoki, Jyri & Saarikoski, Heli & Belton, Valerie & Hjerppe, Turo & Marttunen, Mika, 2020. "Utilizing ecosystem service classifications in multi-criteria decision analysis – Experiences of peat extraction case in Finland," Ecosystem Services, Elsevier, vol. 41(C).
    2. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    3. Saarikoski, Heli & Mustajoki, Jyri & Barton, David N. & Geneletti, Davide & Langemeyer, Johannes & Gomez-Baggethun, Erik & Marttunen, Mika & Antunes, Paula & Keune, Hans & Santos, Rui, 2016. "Multi-Criteria Decision Analysis and Cost-Benefit Analysis: Comparing alternative frameworks for integrated valuation of ecosystem services," Ecosystem Services, Elsevier, vol. 22(PB), pages 238-249.
    4. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    5. Saarikoski, Heli & Mustajoki, Jyri & Hjerppe, Turo & Aapala, Kaisu, 2019. "Participatory multi-criteria decision analysis in valuing peatland ecosystem services—Trade-offs related to peat extraction vs. pristine peatlands in Southern Finland," Ecological Economics, Elsevier, vol. 162(C), pages 17-28.
    6. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    7. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    8. Schuwirth, N. & Reichert, P. & Lienert, J., 2012. "Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater," European Journal of Operational Research, Elsevier, vol. 220(2), pages 472-483.
    9. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    10. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    11. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    12. Sarah K. Jacobi & Benjamin F. Hobbs, 2007. "Quantifying and Mitigating the Splitting Bias and Other Value Tree-Induced Weighting Biases," Decision Analysis, INFORMS, vol. 4(4), pages 194-210, December.
    13. Hämäläinen, Raimo P. & Alaja, Susanna, 2008. "The threat of weighting biases in environmental decision analysis," Ecological Economics, Elsevier, vol. 68(1-2), pages 556-569, December.
    14. Josephine Gatti Schafer & Caleb T Gallemore, 2016. "Biases in multicriteria decision analysis: The case of environmental planning in Southern Nevada," Environment and Planning C, , vol. 34(8), pages 1652-1675, December.
    15. Anna Straton & Sue Jackson & Oswald Marinoni & Wendy Proctor & Emma Woodward, 2011. "Exploring and Evaluating Scenarios for a River Catchment in Northern Australia Using Scenario Development, Multi-criteria Analysis and a Deliberative Process as a Tool for Water Planning," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 25(1), pages 141-164, January.
    16. Mónica de Castro-Pardo & Pascual Fernández Martínez & Amelia Pérez Zabaleta & João C. Azevedo, 2021. "Dealing with Water Conflicts: A Comprehensive Review of MCDM Approaches to Manage Freshwater Ecosystem Services," Land, MDPI, vol. 10(5), pages 1-32, April.
    17. McKenna, R. & Bertsch, V. & Mainzer, K. & Fichtner, W., 2018. "Combining local preferences with multi-criteria decision analysis and linear optimization to develop feasible energy concepts in small communities," European Journal of Operational Research, Elsevier, vol. 268(3), pages 1092-1110.
    18. AlSabbagh, Maha & Siu, Yim Ling & Guehnemann, Astrid & Barrett, John, 2017. "Integrated approach to the assessment of CO2e-mitigation measures for the road passenger transport sector in Bahrain," Renewable and Sustainable Energy Reviews, Elsevier, vol. 71(C), pages 203-215.
    19. Garmendia, Eneko & Stagl, Sigrid, 2010. "Public participation for sustainability and social learning: Concepts and lessons from three case studies in Europe," Ecological Economics, Elsevier, vol. 69(8), pages 1712-1722, June.
    20. Andonegi, Aitor & Garmendia, Eneko & Aldezabal, Arantza, 2021. "Social multi-criteria evaluation for managing biodiversity conservation conflicts," Land Use Policy, Elsevier, vol. 109(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:jeapmx:v:20:y:2018:i:03:n:s1464333218400021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/jeapm/jeapm.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.