Overconfident for real? Proper scoring for confidence intervals
Studies show that people tend to provide overly narrow confidence intervals for unknown values. Such a form of overconfidence would have an important impact on financial markets, among other domains, leading i.a. to excessive trading. The present study is one of the very few that try to incentivize reporting correct confidence intervals. To this end, a reward scheme is proposed, based on a combination of asymmetric loss functions minimized by appropriate quantiles of a probability distribution. In the experiment I find that incentivized subjects provide wider confidence intervals, obtaining a higher hit rate than the control group. The effect is stronger than that of feedback and explicit warning. These findings suggest that the overly narrow confidence intervals reported elsewhere are partly due to an insufficient mental effort that subjects exert and that they can be induced to do so by the proposed incentive scheme.
|Date of creation:||2011|
|Date of revision:|
|Contact details of provider:|| Postal: ul. Dluga 44/50, 00-241 Warszawa|
Phone: (+48 22) 55 49 144
Fax: (+48 22) 831 28 46
Web page: http://www.wne.uw.edu.pl/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Smith, Vernon L & Walker, James M, 1993. "Monetary Rewards and Decision Cost in Experimental Economics," Economic Inquiry, Western Economic Association International, vol. 31(2), pages 245-61, April.
- Kahneman, Daniel & Tversky, Amos, 1979.
"Prospect Theory: An Analysis of Decision under Risk,"
Econometric Society, vol. 47(2), pages 263-91, March.
- Amos Tversky & Daniel Kahneman, 1979. "Prospect Theory: An Analysis of Decision under Risk," Levine's Working Paper Archive 7656, David K. Levine.
- Itzhak Ben-David & John R. Graham, 2013.
The Quarterly Journal of Economics,
Oxford University Press, vol. 128(4), pages 1547-1584.
- Ben-David, Itzhak & Graham, John R. & Harvey, Campbell R., 2010. "Managerial Miscalibration," Working Paper Series 2010-12, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
- Itzhak Ben-David & John R. Graham & Campbell R. Harvey, 2010. "Managerial Miscalibration," NBER Working Papers 16215, National Bureau of Economic Research, Inc.
- Bruno Biais & Denis Hilton & Karine Mazurier & Sébastien Pouget, 2005.
"Judgemental Overconfidence, Self-Monitoring, and Trading Performance in an Experimental Financial Market,"
Review of Economic Studies,
Oxford University Press, vol. 72(2), pages 287-312.
- Biais, Bruno & Hilton, Denis & Mazurier, Karine & Pouget, Sébastien, 2004. "Judgmental Overconfidence, Self-Monitoring and Trading Performance in an Experimental Financial Market," IDEI Working Papers 259, Institut d'Économie Industrielle (IDEI), Toulouse.
- Marie-Pierre Dargnies & Guillaume Hollard, 2008.
"Incentives to Learn Calibration : a Gender-Dependent Impact,"
Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers)
- Marie-pierre Dargnies & Guillaume Hollard, 2009. "Incentives to learn calibration: a gender-dependent impact," Economics Bulletin, AccessEcon, vol. 29(3), pages 1820-1828.
- Marie-Pierre Dargnies & Guillaume Hollard, 2009. "Incentives to Learn Calibration: A Gender-Dependent Impact," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00649246, HAL.
- Marie-Pierre Dargnies & Guillaume Hollard, 2008. "Incentives to learn calibration : a gender-dependent impact," Documents de travail du Centre d'Economie de la Sorbonne v08088, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
- Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 33(2), October.
- Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
- Karl Schlag & Joël van der Weele, 2009. "Efficient interval scoring rules," Economics Working Papers 1176, Department of Economics and Business, Universitat Pompeu Fabra.
When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2011-15. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marcin Bąba)
If references are entirely missing, you can add them using this form.