IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v109y2016icp61-68.html
   My bibliography  Save this article

Policy experts' propensity to change their opinion along Delphi rounds

Author

Listed:
  • Makkonen, Marika
  • Hujala, Teppo
  • Uusivuori, Jussi

Abstract

A key to successful Delphi process is to have some panellists to change their opinion as a result of considering the views of their peers. Despite this, studying the changes in opinions has not been in the research focus outside methodological approaches in the field of forecasting. In addition to forecasting, Delphi technique is also used widely in the fields of public policy and strategic decision-making in companies. We assessed opinion shift between Delphi rounds that were set up to evaluate reforms of specific agriculture and forestry policy measures. Theoretical postulates and findings from previous studies concerning consensus and extreme responses were assessed in this real-world Delphi process. The feedback in the process included both numeric and argumentative information from the previous round outcomes. We found that change in opinion was stimulated by the majority's stand whilst providing extreme responses to the arguments that were fed back meant perseverance of opinions. Additionally, interest groups showed differing response behaviour concerning the evaluated agriculture policy measures. In particular, panellists, who represented interest groups, were more persistent in their opinions compared to panellists representing other groups of expertise (e.g. administration, non-governmental organisations or research). Unlike interest groups, other groups or fields of expertise, age, gender or education did not offer elucidation over opinion change. Our results show not only the connection between changing opinions and the feedback information, but also that panellists can be analysed based on their propensity to change their opinion. This feature can be beneficial not only for policy- and decision-making but also, for example, for conflict assessments and for cases where further understanding of the group dynamics is desired.

Suggested Citation

  • Makkonen, Marika & Hujala, Teppo & Uusivuori, Jussi, 2016. "Policy experts' propensity to change their opinion along Delphi rounds," Technological Forecasting and Social Change, Elsevier, vol. 109(C), pages 61-68.
  • Handle: RePEc:eee:tefoso:v:109:y:2016:i:c:p:61-68
    DOI: 10.1016/j.techfore.2016.05.020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162516300889
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.techfore.2016.05.020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sniezek, Janet A. & Buckley, Timothy, 1995. "Cueing and Cognitive Conflict in Judge-Advisor Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 159-174, May.
    2. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40, January.
    3. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    4. Rowe, Gene & Wright, George, 1996. "The impact of task characteristics on the performance of structured group forecasting techniques," International Journal of Forecasting, Elsevier, vol. 12(1), pages 73-89, March.
    5. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40.
    6. Spickermann, Alexander & Zimmermann, Martin & von der Gracht, Heiko A., 2014. "Surface- and deep-level diversity in panel selection — Exploring diversity effects on response behaviour in foresight," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 105-120.
    7. von der Gracht, Heiko A., 2012. "Consensus measurement in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 79(8), pages 1525-1536.
    8. Ian Masser & Paul Foley, 1987. "Delphi Revisited: Expert Opinion in Urban Analysis," Urban Studies, Urban Studies Journal Limited, vol. 24(3), pages 217-225, June.
    9. Allport, Floyd H. & Hartman, D. A., 1925. "The Measurement and Motivation of Atypical Opinion in a Certain Group1," American Political Science Review, Cambridge University Press, vol. 19(4), pages 735-760, November.
    10. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Winskel, Mark & Kattirtzi, Michael, 2020. "Transitions, disruptions and revolutions: Expert views on prospects for a smart and local energy revolution in the UK," Energy Policy, Elsevier, vol. 147(C).
    2. Guillermo Ivan Pereira & Patrícia Pereira Silva & Deborah Soule, 2018. "Policy-adaptation for a smarter and more sustainable EU electricity distribution industry: a foresight analysis," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 20(1), pages 231-267, December.
    3. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    4. Barrios, Maite & Guilera, Georgina & Nuño, Laura & Gómez-Benito, Juana, 2021. "Consensus in the delphi method: What makes a decision change?," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    5. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    6. José Alex Gualotuña Parra & Ana M. Tarquis & Juan B. Grau Olivé & Federico Colombo Speroni & Antonio Saa-Requejo, 2021. "An Analytical Approach to Assess the Influence of Expert Panel Answer on Decision Making: The Case of Sustainable Land Use in Ribadavia Banda Norte, Salta (Argentina)," Sustainability, MDPI, vol. 13(12), pages 1-17, June.
    7. Mauksch, Stefanie & von der Gracht, Heiko A. & Gordon, Theodore J., 2020. "Who is an expert for foresight? A review of identification methods," Technological Forecasting and Social Change, Elsevier, vol. 154(C).
    8. Antonelli, Marta & Basile, Linda & Gagliardi, Francesca & Isernia, Pierangelo, 2022. "The future of the Mediterranean agri-food systems: Trends and perspectives from a Delphi survey," Land Use Policy, Elsevier, vol. 120(C).
    9. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.
    10. Jeeranan Thongsamak & Dr. Rungrawee Jitpakdee*, 2019. "Sustainability Indicator Analysis of Creative Tourism by Using the Delphi Technique: Case Study of Creative Tourism in Nakhon Si Thammarat Province, Thailand," The Journal of Social Sciences Research, Academic Research Publishing Group, vol. 5(1), pages 201-210, 01-2019.
    11. Hannus, Veronika & Sauer, Johannes, 2021. "It is not only about money —– German farmers' preferences regarding voluntary standards for farm sustainability management," Land Use Policy, Elsevier, vol. 108(C).
    12. Sillman, J. & Hynynen, K. & Dyukov, I. & Ahonen, T. & Jalas, M, 2023. "Emission reduction targets and electrification of the Finnish energy system with low-carbon Power-to-X technologies: Potentials, barriers, and innovations – A Delphi survey," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    13. Belton, Ian & MacDonald, Alice & Wright, George & Hamlin, Iain, 2019. "Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 72-82.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Förster, Bernadette & von der Gracht, Heiko, 2014. "Assessing Delphi panel composition for strategic foresight — A comparison of panels based on company-internal and external participants," Technological Forecasting and Social Change, Elsevier, vol. 84(C), pages 215-229.
    2. Kauko, Karlo & Palmroos, Peter, 2014. "The Delphi method in forecasting financial markets— An experimental study," International Journal of Forecasting, Elsevier, vol. 30(2), pages 313-327.
    3. Winkler, Jens & Moser, Roger, 2016. "Biases in future-oriented Delphi studies: A cognitive perspective," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 63-76.
    4. Gebhardt, Maximilian & Spieske, Alexander & Birkel, Hendrik, 2022. "The future of the circular economy and its effect on supply chain dependencies: Empirical evidence from a Delphi study," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 157(C).
    5. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    6. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    7. Meissner, Philip & Brands, Christian & Wulf, Torsten, 2017. "Quantifiying blind spots and weak signals in executive judgment: A structured integration of expert judgment into the scenario development process," International Journal of Forecasting, Elsevier, vol. 33(1), pages 244-253.
    8. Wilson, Kevin J., 2017. "An investigation of dependence in expert judgement studies with multiple experts," International Journal of Forecasting, Elsevier, vol. 33(1), pages 325-336.
    9. von Briel, Frederik, 2018. "The future of omnichannel retail: A four-stage Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 132(C), pages 217-229.
    10. Van Swol, Lyn M., 2011. "Forecasting another’s enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120.
    11. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.
    12. Meijering, Jurian Vincent & Tobi, Hilde, 2018. "The effects of feeding back experts’ own initial ratings in Delphi studies: A randomized trial," International Journal of Forecasting, Elsevier, vol. 34(2), pages 216-224.
    13. Frevel, Nicolas & Beiderbeck, Daniel & Schmidt, Sascha L., 2022. "The impact of technology on sports – A prospective study," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    14. Belton, Ian & MacDonald, Alice & Wright, George & Hamlin, Iain, 2019. "Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 72-82.
    15. Barrios, Maite & Guilera, Georgina & Nuño, Laura & Gómez-Benito, Juana, 2021. "Consensus in the delphi method: What makes a decision change?," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    16. Fritschy, Carolin & Spinler, Stefan, 2019. "The impact of autonomous trucks on business models in the automotive and logistics industry–a Delphi-based scenario study," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    17. Wright, George & Rowe, Gene, 2011. "Group-based judgmental forecasting: An integration of extant knowledge and the development of priorities for a new research agenda," International Journal of Forecasting, Elsevier, vol. 27(1), pages 1-13, January.
    18. Förster, Bernadette, 2015. "Technology foresight for sustainable production in the German automotive supplier industry," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 237-248.
    19. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    20. Van Swol, Lyn M., 2011. "Forecasting another's enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:109:y:2016:i:c:p:61-68. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.