Over-optimism Among Experts in Assessment and Foresight
AbstractIt is still disputed whether foresight exercises should be based on top-expert assessments or on a broader base of less specialised experts, and whether the self-rating of experts is an acceptable method. Using the German 1993 and the Austrian 1998 Technology Delphis, this study addresses both questions: Self-rating is in fact an appropriate method for selecting experts. But the assessment of self-rated top-experts tend to suffer from an optimism bias, due to the experts’ involvement and their underestimation of realisation and diffusion problems. The degree of optimism is positively correlated with the degree of self-rated knowledge, and it is more pronounced for the least pioneering and for organisational innovations. Experts with top self-ratings working in business have a stronger optimism bias than those working in academia or in the administration. Consistent with the insider hypothesis, they are most optimistic with regard to realisation, innovativeness, and potential leadership in economic exploitation. Given the optimism bias, foresight exercises should base their panels on a fair mixture of experts of different grades, with different types of knowledge and affiliation, and not only on top specialists of the respective field. Delphi-type exercises, therefore, offer an advantage relative to forum groups or small panels of specialists.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Institute of Technology Assessment (ITA) in its series ITA manu:scripts with number 02_05.
Date of creation: 10 Oct 2002
Date of revision:
Foresight exercises; Delphi methods; self-rating of experts; expert optimism;
This paper has been announced in the following NEP Reports:
- NEP-CBE-2002-10-18 (Cognitive & Behavioural Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
- C. West Churchman, 1963. "The X of X," Management Science, INFORMS, vol. 9(3), pages 351-357, April.
- Georg Aichholzer, 2001. "Delphi Austria - An Example of Tailoring Foresight to the Needs of a Small Country," ITA manu:scripts 01_02, Institute of Technology Assessment (ITA).
- JS Armstrong, 2004. "Forecasting Methods for Conflict Situations," General Economics and Teaching 0412025, EconWPA.
- Salazar-Garza, Ricardo, 2012. "The Mexican Peso: Exchange Risk Coverage Management through the Forgotten Effects Theory," Journal of Economics, Finance and Administrative Science, Universidad ESAN, vol. 17(32), pages 53-73.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Werner Kabelka (ITA)).
If references are entirely missing, you can add them using this form.