Advanced Search
MyIDEAS: Login to save this paper or follow this series

Belief Elicitation: A Horse Race among Truth Serums

Contents:

Author Info

  • Trautmann, S.T.
  • Kuilen, G. van de

    (Tilburg University, Center for Economic Research)

Abstract

In survey studies, probabilistic expectations about uncertain events are typically elicited by asking respondents for their introspective beliefs. If more complex procedures are feasible, beliefs can be elicited by incentive compatible revealed preference mechanisms (“truth serums”). Various mechanisms have been proposed in the literature, which differ in the degree to which they account for respondents’ deviations from expected value maximization. In this paper, we pit non-incentivized introspection against five truth serums, to elicit beliefs in a simple two-player game. We test the internal validity (additivity and predictive power for own behavior), and the external validity (predictive power for other players’ behavior, or accuracy) of each method. We find no differences among the truth serums. Beliefs from incentivized methods are better predictors of subjects’ own behavior compared to introspection. However, introspection performs equally well as the truth serums in terms of accuracy and additivity.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://arno.uvt.nl/show.cgi?fid=120794
Our checks indicate that this address may not be valid because: 404 Not Found. If this is indeed the case, please notify (Richard Broekman)
Download Restriction: no

Bibliographic Info

Paper provided by Tilburg University, Center for Economic Research in its series Discussion Paper with number 2011-117.

as in new window
Length:
Date of creation: 2011
Date of revision:
Handle: RePEc:dgr:kubcen:2011117

Contact details of provider:
Web page: http://center.uvt.nl

Related research

Keywords: belief measurement; subjective probability; scoring rules; outcome matching; probability matching; internal validity; external validity;

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Heinemann, Frank & Nagel, Rosemarie & Ockenfels, Peter, 2004. "Measuring Strategic Uncertainty in Coordination Games," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 6, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
  2. Pedro Rey-Biel, 2007. "Equilibrium Play and Best Response to (Stated) Beliefs in Normal Form Games," Working Papers 318, Barcelona Graduate School of Economics.
  3. Ferdinand Vieider, 2011. "Separating real incentives and accountability," Experimental Economics, Springer, vol. 14(4), pages 507-518, November.
  4. Giucca, P. & Jappelli, T. & Terlizzese, D., 1992. "Earning Uncertainty and Precautionary Saving," Papers 161, Banca Italia - Servizio di Studi.
  5. Mark J. Machina & David Schmeidler, 1990. "A More Robust Definition of Subjective Probability," Discussion Paper Serie A 306, University of Bonn, Germany.
  6. Charles Bellemare & Sabine Kröger & Arthur van Soest, 2008. "Measuring Inequity Aversion in a Heterogeneous Population Using Experimental Decisions and Subjective Probabilities," Econometrica, Econometric Society, vol. 76(4), pages 815-839, 07.
  7. Theo Offerman & Joep Sonnemans & Gijs Van De Kuilen & Peter P. Wakker, 2009. "A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes ," Review of Economic Studies, Oxford University Press, vol. 76(4), pages 1461-1489.
  8. Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
  9. Miguel A. Costa-Gomes & Georg Weizs�cker, 2008. "Stated Beliefs and Play in Normal-Form Games," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 729-762.
  10. Costa-Gomes, Miguel A. & Huck, Steffen & Weizsäcker, Georg, 2012. "Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect," Discussion Papers, Research Unit: Economics of Change SP II 2012-302, Social Science Research Center Berlin (WZB).
  11. Fehr, Ernst & Schmidt, Klaus M., 1999. "A theory of fairness, competition, and cooperation," Munich Reprints in Economics 20650, University of Munich, Department of Economics.
  12. Hessel Oosterbeek & Randolph Sloof & Gijs van de Kuilen, 2004. "Cultural differences in ultimatum game experiments: Evidence from a meta-analysis," Experimental 0401003, EconWPA.
  13. Antonio Cabrales & Raffaele Miniaci & Marco Piovesan & Giovanni Ponti, 2009. "Social Preferences and Strategic Uncertainty: An Experiment on Markets and Contracts," Working Papers 2009-09, FEDEA.
  14. Huck, Steffen & Weizsacker, Georg, 2002. "Do players correctly estimate what others do? : Evidence of conservatism in beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 47(1), pages 71-85, January.
  15. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer, vol. 13(1), pages 75-98, March.
  16. Tversky, Amos & Kahneman, Daniel, 1992. " Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
  17. Delavande, Adeline & Gine, Xavier & McKenzie, David, 2009. "Measuring Subjective Expectations in Developing Countries: A Critical Review and New Evidence," Policy Research Working Paper Series 4824, The World Bank.
  18. Olivier Armantier & Nicolas Treich, 2009. "Subjective Probabilities In Games: An Application To The Overbidding Puzzle," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(4), pages 1079-1102, November.
  19. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer, vol. 10(2), pages 171-178, June.
  20. Ronald Bosman & Frans van Winden, 2002. "Emotional Hazard in a Power-to-take Experiment," Economic Journal, Royal Economic Society, vol. 112(476), pages 147-169, January.
  21. Khwaja, Ahmed & Sloan, Frank & Salm, Martin, 2006. "Evidence on preferences and subjective beliefs of risk takers: The case of smokers," International Journal of Industrial Organization, Elsevier, vol. 24(4), pages 667-682, July.
  22. McKelvey, Richard D & Page, Talbot, 1986. "Common Knowledge, Consensus, and Aggregate Information," Econometrica, Econometric Society, vol. 54(1), pages 109-27, January.
  23. Tanjim Hossain & Ryo Okui, 2013. "The Binarized Scoring Rule," Review of Economic Studies, Oxford University Press, vol. 80(3), pages 984-1001.
  24. Lisa Cameron & Manisha Shah, 2013. "Risk-Taking Behavior in the Wake of Natural Disasters," NBER Working Papers 19534, National Bureau of Economic Research, Inc.
  25. Michael D. Hurd, 2009. "Subjective Probabilities in Household Surveys," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 543-564, 05.
  26. Guiso, Luigi & Parigi, Giuseppe, 1996. "Investment and Demand Uncertainty," CEPR Discussion Papers 1497, C.E.P.R. Discussion Papers.
  27. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2010. "Subjective beliefs formation and elicitation rules : experimental evidence," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00543828, HAL.
  28. Richard H. Thaler & Eric J. Johnson, 1990. "Gambling with the House Money and Trying to Break Even: The Effects of Prior Outcomes on Risky Choice," Management Science, INFORMS, vol. 36(6), pages 643-660, June.
  29. Orazio P. Attanasio, 2009. "Expectations and Perceptions in Developing Countries: Their Measurement and Their Use," American Economic Review, American Economic Association, vol. 99(2), pages 87-92, May.
  30. repec:bla:restud:v:76:y:2009:i:4:p:1461-1489 is not listed on IDEAS
  31. Mohammed Abdellaoui & Frank Vossmann & Martin Weber, 2005. "Choice-Based Elicitation and Decomposition of Decision Weights for Gains and Losses Under Uncertainty," Management Science, INFORMS, vol. 51(9), pages 1384-1399, September.
  32. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
  33. Hennig-Schmidt, Heike & Li, Zhu-Yu & Yang, Chaoliang, 2008. "Why people reject advantageous offers--Non-monotonic strategies in ultimatum bargaining: Evaluating a video experiment run in PR China," Journal of Economic Behavior & Organization, Elsevier, vol. 65(2), pages 373-384, February.
  34. Chris Starmer, 2000. "Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 332-382, June.
  35. Li Hao & Daniel Houser, 2010. "Getting It Right the First Time: Belief Elicitation with Novice Participants," Working Papers 1015, George Mason University, Interdisciplinary Center for Economic Science.
  36. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, 09.
  37. repec:bla:restud:v:75:y:2008:i:3:p:729-762 is not listed on IDEAS
  38. William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
  39. Khwaja, Ahmed & Silverman, Dan & Sloan, Frank & Wang, Yang, 2009. "Are mature smokers misinformed?," Journal of Health Economics, Elsevier, vol. 28(2), pages 385-397, March.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Armantier, Olivier & Treich, Nicolas, 2010. "Eliciting Beliefs: Proper Scoring Rules, Incentives, Stakes and Hedging," TSE Working Papers 10-213, Toulouse School of Economics (TSE).
  2. Hyndman, Kyle & Terracol, Antoine & Vaksmann, Jonathan, 2013. "Beliefs and (In)Stability in Normal-Form Games," MPRA Paper 47221, University Library of Munich, Germany.
  3. Glenn W. Harrison & Jimmy Martínez-Correa & J. Todd Swarthout, 2012. "Eliciting Subjective Probabilities with Binary Lotteries," Experimental Economics Center Working Paper Series 2012-16, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:dgr:kubcen:2011117. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Richard Broekman).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.