IDEAS home Printed from https://ideas.repec.org/a/wly/fufsci/v5y2023i2ne146.html
   My bibliography  Save this article

The value of experiments in futures and foresight science as illustrated by the case of scenario planning

Author

Listed:
  • James Derbyshire
  • Mandeep Dhami
  • Ian Belton
  • Dilek Önkal

Abstract

An already pressing need to evidence the effectiveness of futures and foresight tools has been further amplified by the coronavirus pandemic, which highlighted more mainstream tools' difficulty with uncertainty. In light of this, the recent discussion in this journal on providing futures and foresight science with a stronger scientific basis is welcome. In this discussion critical realism has been proffered as a useful philosophical foundation and experiments a useful method for improving this field's scientific basis. Yet, experiments seek to isolate specific causal effects through closure (i.e., by controlling for all extraneous factors) and this may cause it to jar with critical realism's emphasis on uncertainty and openness. We therefore extend the recent discussion on improving the scientific basis of futures and foresight science by doing three things. First, we elaborate on critical realism and why the experimental method may jar with it. Second, we explain why the distinction between a conceptual and a direct replication can help overcome this jarring, meaning experiments can still be a valuable research tool for a futures and foresight science underpinned by critical realism. Third, we consider the appropriate unit of analysis for experiments on futures and foresight tools. In so doing, we situate the recent discussion on improving the scientific basis of futures and foresight science within the much longer running one on improving the scientific basis of business, management and strategy research more broadly. We use the case of scenario planning to illustrate our argument in relation to futures and foresight science.

Suggested Citation

  • James Derbyshire & Mandeep Dhami & Ian Belton & Dilek Önkal, 2023. "The value of experiments in futures and foresight science as illustrated by the case of scenario planning," Futures & Foresight Science, John Wiley & Sons, vol. 5(2), June.
  • Handle: RePEc:wly:fufsci:v:5:y:2023:i:2:n:e146
    DOI: 10.1002/ffo2.146
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/ffo2.146
    Download Restriction: no

    File URL: https://libkey.io/10.1002/ffo2.146?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matti Minkkinen, 2021. "Rigor and diversity in the futures field: A commentary on Fergnani and Chermack 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    2. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    3. Gerard P. Hodgkinson, 2021. "Why appealing to the virtues of scientific theory (and method) is necessary but insufficient for effecting systemic change: Commentary on Fergnani & Chermack, 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    4. Charles R. Schwenk, 1982. "Why sacrifice rigour for relevance? A proposal for combining laboratory and field research in strategic management," Strategic Management Journal, Wiley Blackwell, vol. 3(3), pages 213-225, July.
    5. Nicholas J. Rowland & Matthew J. Spaniol, 2021. "The reception of theory in futures and foresight: A commentary on Fergnani and Chermack," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    6. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    7. Paul Downward & John H. Finch & John Ramsay, 2002. "Critical realism, empirical methods and inference: a critical discussion," Cambridge Journal of Economics, Oxford University Press, vol. 26(4), pages 481-500, July.
    8. James Derbyshire, 2020. "Answers to questions on uncertainty in geography: Old lessons and new scenario tools," Environment and Planning A, , vol. 52(4), pages 710-727, June.
    9. George Cairns, 2021. "Resistance to hegemony in theorising scenario methods: A manifesto in response to Fergnani and Chermack, 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    10. Phadnis, Shardul & Caplice, Chris & Singh, Mahender & Sheffi, Yossi, 2014. "Axiomatic foundation and a structured process for developing firm-specific Intuitive Logics scenarios," Technological Forecasting and Social Change, Elsevier, vol. 88(C), pages 122-139.
    11. Nicholas J. Rowland & Matthew J. Spaniol, 2021. "On inquiry in futures and foresight science," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    12. Meissner, Philip & Wulf, Torsten, 2013. "Cognitive benefits of scenario planning: Its impact on biases and decision quality," Technological Forecasting and Social Change, Elsevier, vol. 80(4), pages 801-814.
    13. Ahti Salo, 2021. "Developing the needed scientific theory will not be easy: A commentary on Fergnani and Chermack 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    14. Derbyshire, James, 2017. "Potential surprise theory as a theoretical foundation for scenario planning," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 77-87.
    15. Shardul Sharad Phadnis, 2021. "Advancing scenario planning theory: A commentary on Fergnani and Chermack, 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    16. Gerard P. Hodgkinson & Nicola J. Bown & A. John Maule & Keith W. Glaister & Alan D. Pearman, 1999. "Breaking the frame: an analysis of strategic cognition and decision making under uncertainty," Strategic Management Journal, Wiley Blackwell, vol. 20(10), pages 977-985, October.
    17. Yusuke Kishita & Toshiki Kusaka & Yuji Mizuno & Yasushi Umeda, 2021. "Toward theory development in futures and foresight by drawing on design theory: A commentary on Fergnani and Chermack 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    18. Christopher Münch & Heiko A. von der Gracht, 2021. "A bibliometric review of scientific theory in futures and foresight: A commentary on Fergnani and Chermack 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    19. David R. Mandel, 2021. "A positive future for futures and foresight science needs fierce competition in the marketplace of ideas: A commentary on Fergnani and Chermack 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    20. Alessandro Fergnani & Thomas J. Chermack, 2021. "The resistance to scientific theory in futures and foresight, and what to do about it," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    21. Joseph Henrich & Steven J. Heine & Ara Norenzayan, 2010. "Most people are not WEIRD," Nature, Nature, vol. 466(7302), pages 29-29, July.
    22. Wilkinson, Angela & Kupers, Roland & Mangalagiu, Diana, 2013. "How plausibility-based scenario practices are grappling with complexity to appreciate and address 21st century challenges," Technological Forecasting and Social Change, Elsevier, vol. 80(4), pages 699-710.
    23. Shardul Phadnis & Chris Caplice & Yossi Sheffi & Mahender Singh, 2015. "Effect of scenario planning on field experts' judgment of long-range investment decisions," Strategic Management Journal, Wiley Blackwell, vol. 36(9), pages 1401-1411, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shardul Sharad Phadnis, 2021. "Advancing scenario planning theory: A commentary on Fergnani and Chermack, 2021," Futures & Foresight Science, John Wiley & Sons, vol. 3(3-4), September.
    2. Lorenz Graf-Vlachy, 2019. "Like student like manager? Using student subjects in managerial debiasing research," Review of Managerial Science, Springer, vol. 13(2), pages 347-376, April.
    3. Crawford, Megan M., 2019. "A comprehensive scenario intervention typology," Technological Forecasting and Social Change, Elsevier, vol. 149(C).
    4. Meissner, Philip & Brands, Christian & Wulf, Torsten, 2017. "Quantifiying blind spots and weak signals in executive judgment: A structured integration of expert judgment into the scenario development process," International Journal of Forecasting, Elsevier, vol. 33(1), pages 244-253.
    5. Derbyshire, James, 2017. "Potential surprise theory as a theoretical foundation for scenario planning," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 77-87.
    6. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    7. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Riccardo Vecchiato & Giampiero Favato & Francesco di Maddaloni & Hang Do, 2020. "Foresight, cognition, and long‐term performance: Insights from the automotive industry and opportunities for future research," Futures & Foresight Science, John Wiley & Sons, vol. 2(1), March.
    10. Ram, Camelia, 2020. "Scenario presentation and scenario generation in multi-criteria assessments: An exploratory study," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    11. Hussain, M. & Tapinos, E. & Knight, L., 2017. "Scenario-driven roadmapping for technology foresight," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 160-177.
    12. John J. Oliver, 2023. "Scenario planning: Reflecting on cases of actionable knowledge," Futures & Foresight Science, John Wiley & Sons, vol. 5(3-4), September.
    13. Shardul S. Phadnis, 2023. "Considering field factors to enhance external validity of scenario planning experiments: A commentary on Derbyshire et al. (2022)," Futures & Foresight Science, John Wiley & Sons, vol. 5(2), June.
    14. Ramboarison-Lalao, Lovanirina & Gannouni, Kais, 2019. "Liberated firm, a leverage of well-being and technological change? A prospective study based on the scenario method," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 129-139.
    15. Philip Meissner & Torsten Wulf, 2016. "Debiasing illusion of control in individual judgment: the role of internal and external advice seeking," Review of Managerial Science, Springer, vol. 10(2), pages 245-263, March.
    16. James Derbyshire, 2019. "Use of scenario planning as a theory‐driven evaluation tool," Futures & Foresight Science, John Wiley & Sons, vol. 1(1), March.
    17. Lehr, Thomas & Lorenz, Ullrich & Willert, Markus & Rohrbeck, René, 2017. "Scenario-based strategizing: Advancing the applicability in strategists' teams," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 214-224.
    18. Muller, Seán M., 2020. "The implications of a fundamental contradiction in advocating randomized trials for policy," World Development, Elsevier, vol. 127(C).
    19. Shardul Sharad Phadnis & Inga‐Lena Darkow, 2021. "Scenario planning as a strategy process to foster supply chain adaptability: theoretical framework and longitudinal case," Futures & Foresight Science, John Wiley & Sons, vol. 3(2), June.
    20. Giulia Parola, 2020. "Escape from parents? basement? Post COVID-19 scenarios for the future of youth employment in Italy," QUADERNI DI ECONOMIA DEL LAVORO, FrancoAngeli Editore, vol. 2020(111), pages 51-71.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:fufsci:v:5:y:2023:i:2:n:e146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2573-5152 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.