On eliciting beliefs in strategic games
Several recent studies in experimental economics have tried to measure beliefs of subjects engaged in strategic games with other subjects. Using data from one such study we conduct an experiment where our experienced subjects observe early rounds of strategy choices from that study and are given monetary incentives to report forecasts of choices in later rounds. We elicit beliefs using three different scoring rules: linear, logarithmic, and quadratic. We compare forecasts across the scoring rules and compare the forecasts of our trained observers to forecasts of the actual players in the original experiment. We find significant differences across scoring rules. The improper linear scoring rule produces forecasts closer to 0 and 1 than the proper rules, and these forecasts are poorly calibrated. The two proper scoring rules induce significantly different distributions of forecasts. We find that forecasts by observers under both proper scoring rules are significantly different from the forecasts of the actual players, in terms of accuracy, calibration, and the distribution of forecasts. We also find evidence for belief convergence among the observers.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Robert L. Winkler, 1968. "The Consensus of Subjective Probability Distributions," Management Science, INFORMS, vol. 15(2), pages B61-B75, October.
- Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
- Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
- Dominitz, Jeff & Hung, Angela A., 2009. "Empirical models of discrete choice and belief updating in observational learning experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 94-109, February.
- Dufwenberg, Martin & Gneezy, Uri, 2000. "Measuring Beliefs in an Experimental Lost Wallet Game," Games and Economic Behavior, Elsevier, vol. 30(2), pages 163-182, February.
- Nielsen, Lars Tyge, et al, 1990. "Common Knowledge of an Aggregate of Expectations," Econometrica, Econometric Society, vol. 58(5), pages 1235-39, September.
- Miguel A. Costa-Gomes & Georg Weizs�cker, 2008. "Stated Beliefs and Play in Normal-Form Games," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 729-762.
- Huck, Steffen & Weizsacker, Georg, 2002. "Do players correctly estimate what others do? : Evidence of conservatism in beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 47(1), pages 71-85, January.
- Offerman, Theo & Sonnemans, Joep, 1998. "Learning by experience and learning by imitating successful others," Journal of Economic Behavior & Organization, Elsevier, vol. 34(4), pages 559-575, March.
- Ledyard, John & Hanson, Robin & Ishikida, Takashi, 2009. "An experimental test of combinatorial information markets," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 182-189, February.
- Goeree, Jacob K. & Holt, Charles A. & Palfrey, Thomas R., 2003. "Risk averse behavior in generalized matching pennies games," Games and Economic Behavior, Elsevier, vol. 45(1), pages 97-113, October.
- Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-45, July.
- Ochs Jack, 1995. "Games with Unique, Mixed Strategy Equilibria: An Experimental Study," Games and Economic Behavior, Elsevier, vol. 10(1), pages 202-217, July.
- McKelvey, Richard D & Page, Talbot, 1990. "Public and Private Information: An Experimental Study of Information Pooling," Econometrica, Econometric Society, vol. 58(6), pages 1321-39, November.
- McKelvey, Richard D & Page, Talbot, 1986. "Common Knowledge, Consensus, and Aggregate Information," Econometrica, Econometric Society, vol. 54(1), pages 109-27, January.
- Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:71:y:2009:i:2:p:98-109. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)
If references are entirely missing, you can add them using this form.