IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v154y2020ics0040162519302562.html
   My bibliography  Save this article

Who is an expert for foresight? A review of identification methods

Author

Listed:
  • Mauksch, Stefanie
  • von der Gracht, Heiko A.
  • Gordon, Theodore J.

Abstract

While decision research tends to treat the question of expertise with suspicion, the capacity of experts within the wider, applied field of foresight often remains unquestioned. In this review of expert identification methods, we share the positive assessment of expert judgment for exploring plausible conditions of the future. However, given the contested status of expertise, it is crucial to know how a particular mode of recruitment, or (more often) a combination of diverse methods, seeks to secure the expert status of a person. Our review is motivated by the conviction that foresight researchers should not only assume value in expertise, but defend this value from scientific viewpoints. Based on an introduction to sociological, behavioral and cognitive perspectives on expertise, we trace the epistemological premises guiding different modes of selection. We list eight expert identification methods and explore their core assumptions, strengths, weaknesses and domain examples. Developing such linkages between priorities in expert selection and the arguments underlying them is the major contribution of this article. A second contribution lies in providing an overview of expert selection methods, ranging from simple and low-cost to more complex and combined methodologies.

Suggested Citation

  • Mauksch, Stefanie & von der Gracht, Heiko A. & Gordon, Theodore J., 2020. "Who is an expert for foresight? A review of identification methods," Technological Forecasting and Social Change, Elsevier, vol. 154(C).
    • Handle: RePEc:eee:tefoso:v:154:y:2020:i:c:s0040162519302562
    DOI: 10.1016/j.techfore.2020.119982
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162519302562
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2020.119982?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kembro, Joakim & Näslund, Dag & Olhager, Jan, 2017. "Information sharing across multiple supply chain tiers: A Delphi study on antecedents," International Journal of Production Economics, Elsevier, vol. 193(C), pages 77-86.
    2. Gilles Hilary & Lior Menzly, 2006. "Does Past Success Lead Analysts to Become Overconfident?," Management Science, INFORMS, vol. 52(4), pages 489-500, April.
    3. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.
    4. Praveen Sinha & Lawrence D. Brown & Somnath Das, 1997. "A Re†Examination of Financial Analysts' Differential Earnings Forecast Accuracy," Contemporary Accounting Research, John Wiley & Sons, vol. 14(1), pages 1-42, March.
    5. Bolger, Fergus & Wright, George, 2017. "Use of expert knowledge to anticipate the future: Issues, analysis and directions," International Journal of Forecasting, Elsevier, vol. 33(1), pages 230-243.
    6. Green, Kesten C. & Armstrong, J. Scott, 2007. "Structured analogies for forecasting," International Journal of Forecasting, Elsevier, vol. 23(3), pages 365-376.
    7. Yaniv, Ilan & Kleinberger, Eli, 2000. "Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(2), pages 260-281, November.
    8. Honda, Hidehito & Washida, Yuichi & Sudo, Akihito & Wajima, Yuichiro & Awata, Keigo & Ueda, Kazuhiro, 2017. "The difference in foresight using the scanning method between experts and non-experts," Technological Forecasting and Social Change, Elsevier, vol. 119(C), pages 18-26.
    9. Dufva, Mikko & Ahlqvist, Toni, 2015. "Knowledge creation dynamics in foresight: A knowledge typology and exploratory method to analyse foresight workshops," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 251-268.
    10. Jerker Denrell & Christina Fang, 2010. "Predicting the Next Big Thing: Success as a Signal of Poor Judgment," Management Science, INFORMS, vol. 56(10), pages 1653-1667, October.
    11. Roberto Poli, 2011. "Ethics and futures studies," International Journal of Management Concepts and Philosophy, Inderscience Enterprises Ltd, vol. 5(4), pages 403-410.
    12. Tiberius, Victor & Hirth, Stefanie, 2019. "Impacts of digitization on auditing: A Delphi study for Germany," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 37(C).
    13. Robert R. Hoffman, 1998. "How Can Expertise be Defined? Implications of Research from Cognitive Psychology," Palgrave Macmillan Books, in: Robin Williams & Wendy Faulkner & James Fleck (ed.), Exploring Expertise, chapter 4, pages 81-100, Palgrave Macmillan.
    14. Mikhail, MB & Walther, BR & Willis, RH, 1997. "Do security analysts improve their performance with experience?," Journal of Accounting Research, Wiley Blackwell, vol. 35, pages 131-157.
    15. Meijering, J.V. & Kampen, J.K. & Tobi, H., 2013. "Quantifying the development of agreement among experts in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 80(8), pages 1607-1614.
    16. de Loë, Rob C. & Melnychuk, Natalya & Murray, Dan & Plummer, Ryan, 2016. "Advancing the State of Policy Delphi Practice: A Systematic Review Evaluating Methodological Evolution, Innovation, and Opportunities," Technological Forecasting and Social Change, Elsevier, vol. 104(C), pages 78-88.
    17. David V. Day & Robert G. Lord, 1992. "Expertise And Problem Categorization: The Role Of Expert Processing In Organizational Sense‐Making," Journal of Management Studies, Wiley Blackwell, vol. 29(1), pages 35-47, January.
    18. Kerstin Cuhls & Luke Georghiou, 2004. "Evaluating a participative foresight process: ‘Futur - the German research dialogue’," Research Evaluation, Oxford University Press, vol. 13(3), pages 143-153, December.
    19. Marchant, G, 1990. "Determinants Of Auditor Expertise - Discussion," Journal of Accounting Research, Wiley Blackwell, vol. 28, pages 21-28.
    20. Devine, Dennis J. & Kozlowski, Steve W. J., 1995. "Domain-Specific Knowledge and Task Characteristics in Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 64(3), pages 294-306, December.
    21. Rowe, Gene & Wright, George, 1996. "The impact of task characteristics on the performance of structured group forecasting techniques," International Journal of Forecasting, Elsevier, vol. 12(1), pages 73-89, March.
    22. Jonathan Calof & Jack E Smith, 2010. "Critical success factors for government-led foresight," Science and Public Policy, Oxford University Press, vol. 37(1), pages 31-40, February.
    23. Mark A Burgman & Marissa McBride & Raquel Ashton & Andrew Speirs-Bridge & Louisa Flander & Bonnie Wintle & Fiona Fidler & Libby Rumpff & Charles Twardy, 2011. "Expert Status and Performance," PLOS ONE, Public Library of Science, vol. 6(7), pages 1-7, July.
    24. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    25. Andersen, Per Dannemand & Johnston, Ron & Saritas, Ozcan, 2017. "FTA and Innovation Systems," Technological Forecasting and Social Change, Elsevier, vol. 115(C), pages 236-239.
    26. Dakin, Stephen & Armstrong, J. Scott, 1989. "Predicting job performance: A comparison of expert opinion and research findings," International Journal of Forecasting, Elsevier, vol. 5(2), pages 187-194.
    27. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    28. Shanteau, James & Weiss, David J. & Thomas, Rickey P. & Pounds, Julia C., 2002. "Performance-based assessment of expertise: How to decide if someone is an expert or not," European Journal of Operational Research, Elsevier, vol. 136(2), pages 253-263, January.
    29. Belton, Ian & MacDonald, Alice & Wright, George & Hamlin, Iain, 2019. "Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 72-82.
    30. Kerstin Cuhls, 2003. "From forecasting to foresight processes-new participative foresight activities in Germany," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(2-3), pages 93-111.
    31. Andrea Sutterlüty & Franziska Hesser & Peter Schwarzbauer & Kurt Christian Schuster & Andreas Windsperger & Tobias Stern, 2017. "A Delphi Approach to Understanding Varying Expert Viewpoints in Sustainability Communication: The Case of Water Footprints of Bio-Based Fiber Resources," Journal of Industrial Ecology, Yale University, vol. 21(2), pages 412-422, April.
    32. Wagner, Sascha Alexander & Vogt, Sebastian & Kabst, Rüdiger, 2016. "The future of public participation: Empirical analysis from the viewpoint of policy-makers," Technological Forecasting and Social Change, Elsevier, vol. 106(C), pages 65-73.
    33. Kesten C. Green & J. Scott Armstrong, 2007. "The Ombudsman: Value of Expertise for Forecasting Decisions in Conflicts," Interfaces, INFORMS, vol. 37(3), pages 287-299, June.
    34. Wright, George & Ayton, Peter, 1992. "Judgmental probability forecasting in the immediate and medium term," Organizational Behavior and Human Decision Processes, Elsevier, vol. 51(3), pages 344-363, April.
    35. Anca M. Hanea & Marissa F. McBride & Mark A. Burgman & Bonnie C. Wintle, 2018. "The Value of Performance Weights and Discussion in Aggregated Expert Judgments," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1781-1794, September.
    36. Bedard, Jean, 1989. "Expertise in auditing: Myth or reality?," Accounting, Organizations and Society, Elsevier, vol. 14(1-2), pages 113-131, January.
    37. Shanteau, James, 1992. "Competence in experts: The role of task characteristics," Organizational Behavior and Human Decision Processes, Elsevier, vol. 53(2), pages 252-266, November.
    38. van der Pas, J.W.G.M. & Kwakkel, J.H. & Van Wee, B., 2012. "Evaluating Adaptive Policymaking using expert opinions," Technological Forecasting and Social Change, Elsevier, vol. 79(2), pages 311-325.
    39. Spickermann, Alexander & Grienitz, Volker & von der Gracht, Heiko A., 2014. "Heading towards a multimodal city of the future?," Technological Forecasting and Social Change, Elsevier, vol. 89(C), pages 201-221.
    40. Jacob, John & Lys, Thomas Z. & Neale, Margaret A., 1999. "Expertise in forecasting performance of security analysts," Journal of Accounting and Economics, Elsevier, vol. 28(1), pages 51-82, November.
    41. Winkler, Jens & Moser, Roger, 2016. "Biases in future-oriented Delphi studies: A cognitive perspective," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 63-76.
    42. Abdolmohammadi, Mohammad J. & Shanteau, James, 1992. "Personal attributes of expert auditors," Organizational Behavior and Human Decision Processes, Elsevier, vol. 53(2), pages 158-172, November.
    43. Hoffman, Robert R. & Shadbolt, Nigel R. & Burton, A. Mike & Klein, Gary, 1995. "Eliciting Knowledge from Experts: A Methodological Analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 129-158, May.
    44. Makkonen, Marika & Hujala, Teppo & Uusivuori, Jussi, 2016. "Policy experts' propensity to change their opinion along Delphi rounds," Technological Forecasting and Social Change, Elsevier, vol. 109(C), pages 61-68.
    45. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tobias Meyer & Heiko A. von der Gracht & Evi Hartmann, 2022. "Technology foresight for sustainable road freight transportation: Insights from a global real‐time Delphi study," Futures & Foresight Science, John Wiley & Sons, vol. 4(1), March.
    2. Stumpf, Lukas & Schöggl, Josef-Peter & Baumgartner, Rupert J., 2023. "Circular plastics packaging – Prioritizing resources and capabilities along the supply chain," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    3. Beiderbeck, Daniel & Frevel, Nicolas & von der Gracht, Heiko A. & Schmidt, Sascha L. & Schweitzer, Vera M., 2021. "The impact of COVID-19 on the European football ecosystem – A Delphi-based scenario analysis," Technological Forecasting and Social Change, Elsevier, vol. 165(C).
    4. Schulz, Thomas & Zimmermann, Sina & Böhm, Markus & Gewald, Heiko & Krcmar, Helmut, 2021. "Value co-creation and co-destruction in service ecosystems: The case of the Reach Now app," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    5. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    6. Nayak, Bishwajit & Bhattacharyya, Som Sekhar & Krishnamoorthy, Bala, 2021. "Explicating the role of emerging technologies and firm capabilities towards attainment of competitive advantage in health insurance service firms," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    7. Sakellariou, Evy & Vecchiato, Riccardo, 2022. "Foresight, sensemaking, and new product development: Constructing meanings for the future," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    8. Heiko A. von der Gracht, 2022. "The force that rules the world: Commentary on Fenton‐O'Creevy and Tuckett (2021)," Futures & Foresight Science, John Wiley & Sons, vol. 4(3-4), September.
    9. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    10. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    11. Marcelo Werneck Barbosa & José M. Cansino, 2022. "A Water Footprint Management Construct in Agri-Food Supply Chains: A Content Validity Analysis," Sustainability, MDPI, vol. 14(9), pages 1-17, April.
    12. Milan Daus & Katharina Koberger & Kaan Koca & Felix Beckers & Jorge Encinas Fernández & Barbara Weisbrod & Daniel Dietrich & Sabine Ulrike Gerbersdorf & Rüdiger Glaser & Stefan Haun & Hilmar Hofmann &, 2021. "Interdisciplinary Reservoir Management—A Tool for Sustainable Water Resources Management," Sustainability, MDPI, vol. 13(8), pages 1-21, April.
    13. Oliva, Fábio Lotti & Teberga, Pedro Marins Freire & Testi, Lucas Israel Oliveira & Kotabe, Masaaki & Giudice, Manlio Del & Kelle, Peter & Cunha, Miguel Pina, 2022. "Risks and critical success factors in the internationalization of born global startups of industry 4.0: A social, environmental, economic, and institutional analysis," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    14. Frevel, Nicolas & Beiderbeck, Daniel & Schmidt, Sascha L., 2022. "The impact of technology on sports – A prospective study," Technological Forecasting and Social Change, Elsevier, vol. 182(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    2. Bolger, Fergus & Rowe, Gene & Belton, Ian & Crawford, Megan M & Hamlin, Iain & Sissons, Aileen & Taylor Browne Lūka, Courtney & Vasilichi, Alexandrina & Wright, George, 2020. "The Simulated Group Response Paradigm: A new approach to the study of opinion change in Delphi and other structured-group techniques," OSF Preprints 4ufzg, Center for Open Science.
    3. Andersson, Patric, 2004. "How well do financial experts perform? A review of empirical research on performance of analysts, day-traders, forecasters, fund managers, investors, and stockbrokers," SSE/EFI Working Paper Series in Business Administration 2004:9, Stockholm School of Economics.
    4. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    5. Yi Dong & Nan Hu & Xu Li & Ling Liu, 2017. "Analyst Firm Coverage and Forecast Accuracy: The Effect of Regulation Fair Disclosure," Abacus, Accounting Foundation, University of Sydney, vol. 53(4), pages 450-484, December.
    6. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    7. Van Swol, Lyn M., 2011. "Forecasting another’s enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120.
    8. Akono, Henri & Karim, Khondkar & Nwaeze, Emeka, 2019. "Analyst rounding of EPS forecasts and stock recommendations," Advances in accounting, Elsevier, vol. 44(C), pages 68-80.
    9. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.
    10. Coller, Maribeth & Tuttle, Brad, 2002. "The acquisition of price-relevant domain knowledge by a market," Journal of Economic Psychology, Elsevier, vol. 23(1), pages 77-101, February.
    11. Frevel, Nicolas & Beiderbeck, Daniel & Schmidt, Sascha L., 2022. "The impact of technology on sports – A prospective study," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    12. García-Meca, Emma & Sánchez-Ballesta, Juan Pedro, 2006. "Influences on financial analyst forecast errors: A meta-analysis," International Business Review, Elsevier, vol. 15(1), pages 29-52, February.
    13. Belton, Ian & MacDonald, Alice & Wright, George & Hamlin, Iain, 2019. "Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 72-82.
    14. Chen, Kaihua & Ren, Zhipeng & Mu, Shijun & Sun, Tara Qian & Mu, Rongping, 2020. "Integrating the Delphi survey into scenario planning for China's renewable energy development strategy towards 2030," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    15. Barrios, Maite & Guilera, Georgina & Nuño, Laura & Gómez-Benito, Juana, 2021. "Consensus in the delphi method: What makes a decision change?," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    16. Fontrier, Anna-Maria & Kamphuis, Bregtje W. & Kanavos, Panos, 2023. "How can health technology assessment be improved to optimise access to medicines? Results from a Delphi study in Europe," LSE Research Online Documents on Economics 120537, London School of Economics and Political Science, LSE Library.
    17. Derann Hsu & Cheng-Huei Chiao, 2011. "Relative accuracy of analysts’ earnings forecasts over time: a Markov chain analysis," Review of Quantitative Finance and Accounting, Springer, vol. 37(4), pages 477-507, November.
    18. Van Swol, Lyn M., 2011. "Forecasting another's enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120, January.
    19. Danling Jiang & Alok Kumar & Kelvin K. F. Law, 2016. "Political contributions and analyst behavior," Review of Accounting Studies, Springer, vol. 21(1), pages 37-88, March.
    20. T. Bourveau & A. Garel & P. Peter Joos & A. Petit-Romec, 2024. "When attention is away, analysts misplay: distraction and analyst forecast performance," Post-Print hal-03844012, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:154:y:2020:i:c:s0040162519302562. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.