On eliciting beliefs in strategic games
AbstractSeveral recent studies in experimental economics have tried to measure beliefs of subjects engaged in strategic games with other subjects. Using data from one such study we conduct an experiment where our experienced subjects observe early rounds of strategy choices from that study and are given monetary incentives to report forecasts of choices in later rounds. We elicit beliefs using three different scoring rules: linear, logarithmic, and quadratic. We compare forecasts across the scoring rules and compare the forecasts of our trained observers to forecasts of the actual players in the original experiment. We find significant differences across scoring rules. The improper linear scoring rule produces forecasts closer to 0 and 1 than the proper rules, and these forecasts are poorly calibrated. The two proper scoring rules induce significantly different distributions of forecasts. We find that forecasts by observers under both proper scoring rules are significantly different from the forecasts of the actual players, in terms of accuracy, calibration, and the distribution of forecasts. We also find evidence for belief convergence among the observers.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Journal of Economic Behavior & Organization.
Volume (Year): 71 (2009)
Issue (Month): 2 (August)
Contact details of provider:
Web page: http://www.elsevier.com/locate/jebo
Scoring rules Experiment Game theory Forecasting Beliefs;
Other versions of this item:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
- Miguel A. Costa-Gomes & Georg Weizs�cker, 2008. "Stated Beliefs and Play in Normal-Form Games," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 729-762.
- Ledyard, John & Hanson, Robin & Ishikida, Takashi, 2009. "An experimental test of combinatorial information markets," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 182-189, February.
- Dufwenberg, Martin & Gneezy, Uri, 2000. "Measuring Beliefs in an Experimental Lost Wallet Game," Games and Economic Behavior, Elsevier, vol. 30(2), pages 163-182, February.
- Ochs Jack, 1995. "Games with Unique, Mixed Strategy Equilibria: An Experimental Study," Games and Economic Behavior, Elsevier, vol. 10(1), pages 202-217, July.
- Robert L. Winkler, 1968. "The Consensus of Subjective Probability Distributions," Management Science, INFORMS, vol. 15(2), pages B61-B75, October.
- McKelvey, Richard D & Page, Talbot, 1990. "Public and Private Information: An Experimental Study of Information Pooling," Econometrica, Econometric Society, vol. 58(6), pages 1321-39, November.
- Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-45, July.
- Huck, Steffen & Weizsacker, Georg, 2002. "Do players correctly estimate what others do? : Evidence of conservatism in beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 47(1), pages 71-85, January.
- Offerman, Theo & Sonnemans, Joep, 1998. "Learning by experience and learning by imitating successful others," Journal of Economic Behavior & Organization, Elsevier, vol. 34(4), pages 559-575, March.
- Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
- Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
- Goeree, Jacob K. & Holt, Charles A. & Palfrey, Thomas R., 2003. "Risk averse behavior in generalized matching pennies games," Games and Economic Behavior, Elsevier, vol. 45(1), pages 97-113, October.
- McKelvey, Richard D & Page, Talbot, 1986. "Common Knowledge, Consensus, and Aggregate Information," Econometrica, Econometric Society, vol. 54(1), pages 109-27, January.
- Dominitz, Jeff & Hung, Angela A., 2009. "Empirical models of discrete choice and belief updating in observational learning experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 94-109, February.
- Nielsen, Lars Tyge, et al, 1990. "Common Knowledge of an Aggregate of Expectations," Econometrica, Econometric Society, vol. 58(5), pages 1235-39, September.
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page. reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.