Effective Scoring Rules for Probabilistic Forecasts
AbstractThis paper studies the use of a scoring rule for the elicitation of forecasts in the form of probability distributions and for the subsequent evaluation of such forecasts. Given a metric (distance function) on a space of probability distributions, a scoring rule is said to be effective if the forecaster's expected score is a strictly decreasing function of the distance between the elicited and "true" distributions. Two simple, well-known rules (the spherical and the quadratic) are shown to be effective with respect to suitable metrics. Examples and a practical application (in Foreign Exchange rate forecasting) are also provided.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by INFORMS in its journal Management Science.
Volume (Year): 29 (1983)
Issue (Month): 4 (April)
forecasting; Delphi technique;
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Tang, Fang-Fang, 2003. "A comparative study on learning in a normal form game experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 50(3), pages 385-390, March.
- Onkal, Dilek & Muradoglu, Gulnur, 1995. "Effects of feedback on probabilistic forecasts of stock prices," International Journal of Forecasting, Elsevier, vol. 11(2), pages 307-319, June.
- Atanasios Mitropoulos, 2001. "On the Measurement of the Predictive Success of Learning Theories in Repeated Games," Experimental 0110001, EconWPA.
- Plott, Charles R. & Salmon, Timothy, 2002.
"The Simultaneous, Ascending Auction: Dynamics of Price Adjustment in Experiments and in the U.K. 3G Spectrum Auction,"
1155, California Institute of Technology, Division of the Humanities and Social Sciences.
- Plott, Charles R. & Salmon, Timothy C., 2004. "The simultaneous, ascending auction: dynamics of price adjustment in experiments and in the UK3G spectrum auction," Journal of Economic Behavior & Organization, Elsevier, vol. 53(3), pages 353-383, March.
- Fang, Fang & Stinchcombe, Maxwell B. & Whinston, Andrew B., 2010. "Proper scoring rules with arbitrary value functions," Journal of Mathematical Economics, Elsevier, vol. 46(6), pages 1200-1210, November.
- Reinhard Selten, 1998.
"Axiomatic Characterization of the Quadratic Scoring Rule,"
Springer, vol. 1(1), pages 43-61, June.
- Selten, Reinhard, 1996. "Axiomatic Characterization of the Quadratic Scoring Rule," Discussion Paper Serie B 390, University of Bonn, Germany.
- D. Johnstone, 2007. "The Value of a Probability Forecast from Portfolio Theory," Theory and Decision, Springer, vol. 63(2), pages 153-203, September.
- Radosveta Ivanova-Stenzel & Timothy C. Salmon, 2004.
"Bidder Preferences Among Auction Institutions,"
- Karl Schlag & James Tremewan & Joel van der Weele, 2014. "A Penny for Your Thoughts:A Survey of Methods for Eliciting Beliefs," Vienna Economics Papers 1401, University of Vienna, Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mirko Janc).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.