Overconfident for real? Proper scoring for confidence intervals
AbstractStudies show that people tend to provide overly narrow confidence intervals for unknown values. Such a form of overconfidence would have an important impact on financial markets, among other domains, leading i.a. to excessive trading. The present study is one of the very few that try to incentivize reporting correct confidence intervals. To this end, a reward scheme is proposed, based on a combination of asymmetric loss functions minimized by appropriate quantiles of a probability distribution. In the experiment I find that incentivized subjects provide wider confidence intervals, obtaining a higher hit rate than the control group. The effect is stronger than that of feedback and explicit warning. These findings suggest that the overly narrow confidence intervals reported elsewhere are partly due to an insufficient mental effort that subjects exert and that they can be induced to do so by the proposed incentive scheme.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Faculty of Economic Sciences, University of Warsaw in its series Working Papers with number 2011-15.
Length: 23 pages
Date of creation: 2011
Date of revision:
overconfidence; calibration; confidence intervals; proper scoring rules;
Find related papers by JEL classification:
- C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
- C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
- D03 - Microeconomics - - General - - - Behavioral Microeconomics; Underlying Principles
- D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
- G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-10-09 (All new papers)
- NEP-CBE-2011-10-09 (Cognitive & Behavioural Economics)
- NEP-EXP-2011-10-09 (Experimental Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Smith, Vernon L & Walker, James M, 1993. "Monetary Rewards and Decision Cost in Experimental Economics," Economic Inquiry, Western Economic Association International, vol. 31(2), pages 245-61, April.
- repec:hal:cesptp:halshs-00348826 is not listed on IDEAS
- Amos Tversky & Daniel Kahneman, 1979.
"Prospect Theory: An Analysis of Decision under Risk,"
Levine's Working Paper Archive
7656, David K. Levine.
- Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-91, March.
- Marie-pierre Dargnies & Guillaume Hollard, 2009.
"Incentives to learn calibration: a gender-dependent impact,"
AccessEcon, vol. 29(3), pages 1820-1828.
- Marie-Pierre Dargnies & Guillaume Hollard, 2008. "Incentives to learn calibration : a gender-dependent impact," Documents de travail du Centre d'Economie de la Sorbonne v08088, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
- Ben-David, Itzhak & Graham, John R. & Harvey, Campbell R., 2010.
Working Paper Series
2010-12, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
- Biais, Bruno & Hilton, Denis & Mazurier, Karine & Pouget, Sébastien, 2004.
"Judgmental Overconfidence, Self-Monitoring and Trading Performance in an Experimental Financial Market,"
IDEI Working Papers
259, Institut d'Économie Industrielle (IDEI), Toulouse.
- Bruno Biais & Denis Hilton & Karine Mazurier & Sébastien Pouget, 2005. "Judgemental Overconfidence, Self-Monitoring, and Trading Performance in an Experimental Financial Market," Review of Economic Studies, Oxford University Press, vol. 72(2), pages 287-312.
- Karl Schlag & Joël van der Weele, 2009. "Efficient interval scoring rules," Economics Working Papers 1176, Department of Economics and Business, Universitat Pompeu Fabra.
- Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 33(2), October.
- Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer, vol. 10(2), pages 171-178, June.
- Karl Schlag & James Tremewan & Joel van der Weele, 2014. "A Penny for Your Thoughts:A Survey of Methods for Eliciting Beliefs," Vienna Economics Papers 1401, University of Vienna, Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marcin Bąba).
If references are entirely missing, you can add them using this form.