IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Estimating Subjective Probabilities

Listed author(s):
  • Steffen Andersen
  • John Fountain
  • Glenn W. Harrison
  • E. Elisabet Rutström

Subjective probabilities play a role in many economic decisions. There is a large theoretical literature on the elicitation of subjective probabilities, and an equally large empirical literature. However, there is a gulf between the two. The theoretical literature proposes a range of procedures that can be used to recover subjective probabilities, but stresses the need to make strong auxiliary assumptions or "calibrating adjustments" to elicited reports in order to recover the latent probability. With some notable exceptions, the empirical literature seems intent on either making those strong assumptions or ignoring the need for calibration. We illustrate how the joint estimation of risk attitudes and subjective probabilities using structural maximum likelihood methods can provide the calibration adjustments that theory calls for. This allows the observer to make inferences about the latent subjective probability, calibrating for virtually any well-specified model of choice under uncertainty. We demonstrate our procedures with experiments in which we elicit subjective probabilities. We calibrate the estimates of subjective beliefs assuming that choices are made consistently with expected utility theory or rank-dependent utility theory. Inferred subjective probabilities are significantly different when calibrated according to either theory, thus showing the importance of undertaking such exercises. Our findings also have implications for the interpretation of probabilities inferred from prediction markets.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://excen.gsu.edu/workingpapers/GSU_EXCEN_WP_2010-08.pdf
Download Restriction: no

Paper provided by Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University in its series Experimental Economics Center Working Paper Series with number 2010-08.

as
in new window

Length: 59
Date of creation: Sep 2010
Handle: RePEc:exc:wpaper:2010-08
Contact details of provider: Postal:
(404) 651-3990

Phone: (404) 651-3990
Fax: (404) 651-3996
Web page: http://excen.gsu.edu/

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Terrance Hurley & Jason Shogren, 2005. "An Experimental Comparison of Induced and Elicited Beliefs," Journal of Risk and Uncertainty, Springer, vol. 30(2), pages 169-188, January.
  2. Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
  3. I. Gilboa & A. W. Postlewaite & D. Schmeidler., 2009. "Probability and Uncertainty in Economic Modeling," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 10.
  4. Charness, Gary & Dufwenberg, Martin, 2003. "Promises & Partnership," Research Papers in Economics 2003:3, Stockholm University, Department of Economics.
  5. James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
  6. Holt, Charles A. & Smith, Angela M., 2009. "An update on Bayesian updating," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 125-134, February.
  7. Theo Offerman & Joep Sonnemans & Gijs Van De Kuilen & Peter P. Wakker, 2009. "A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes ," Review of Economic Studies, Oxford University Press, vol. 76(4), pages 1461-1489.
  8. Miguel A. Costa-Gomes & Georg Weizsäcker, 2008. "Stated Beliefs and Play in Normal-Form Games," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 729-762.
  9. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2014. "Eliciting subjective probabilities with binary lotteries," Journal of Economic Behavior & Organization, Elsevier, vol. 101(C), pages 128-140.
  10. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
  11. Hey, John D & Orme, Chris, 1994. "Investigating Generalizations of Expected Utility Theory Using Experimental Data," Econometrica, Econometric Society, vol. 62(6), pages 1291-1326, November.
  12. Edi Karni, 2009. "A Mechanism for Eliciting Probabilities," Econometrica, Econometric Society, vol. 77(2), pages 603-606, 03.
  13. John Fountain & Glenn Harrison, 2011. "What do prediction markets predict?," Applied Economics Letters, Taylor & Francis Journals, vol. 18(3), pages 267-272.
  14. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
  15. Andrew Schotter & Barry Sopher, 2003. "Social Learning and Coordination Conventions in Intergenerational Games: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 498-529, June.
  16. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2013. "Inducing risk neutral preferences with binary lotteries: A reconsideration," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 145-159.
  17. Gary Charness & Martin Dufwenberg, 2006. "Promises and Partnership," Econometrica, Econometric Society, vol. 74(6), pages 1579-1601, November.
  18. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
  19. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
  20. Viscusi, W Kip & Evans, William N, 1990. "Utility Functions That Depend on Health Status: Estimates and Economic Implications," American Economic Review, American Economic Association, vol. 80(3), pages 353-374, June.
  21. Grether, David M., 1992. "Testing bayes rule and the representativeness heuristic: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 31-57, January.
  22. Ghirardato, Paolo & Maccheroni, Fabio & Marinacci, Massimo, 2004. "Differentiating ambiguity and ambiguity attitude," Journal of Economic Theory, Elsevier, vol. 118(2), pages 133-173, October.
  23. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
  24. Ernan Haruvy & Yaron Lahav & Charles N. Noussair, 2007. "Traders' Expectations in Asset Markets: Experimental Evidence," American Economic Review, American Economic Association, vol. 97(5), pages 1901-1920, December.
  25. Dufwenberg, Martin & Gneezy, Uri, 2000. "Measuring Beliefs in an Experimental Lost Wallet Game," Games and Economic Behavior, Elsevier, vol. 30(2), pages 163-182, February.
  26. Forsythe, Robert & Forrest Nelson & George R. Neumann & Jack Wright, 1992. "Anatomy of an Experimental Political Stock Market," American Economic Review, American Economic Association, vol. 82(5), pages 1142-1161, December.
  27. Peter Klibanoff & Massimo Marinacci & Sujoy Mukerji, 2005. "A Smooth Model of Decision Making under Ambiguity," Econometrica, Econometric Society, vol. 73(6), pages 1849-1892, November.
  28. Jaffray, Jean-Yves & Karni, Edi, 1999. "Elicitation of Subjective Probabilities When the Initial Endowment is Unobservable," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 5-20, April.
  29. W. Kip Viscusi & William N. Evans, 1998. "Estimation Of Revealed Probabilities And Utility Functions For Product Safety Decisions," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 28-33, February.
  30. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
  31. Drazen Prelec, 1998. "The Probability Weighting Function," Econometrica, Econometric Society, vol. 66(3), pages 497-528, May.
  32. Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
  33. Vernon L. Smith, 1969. "Measuring Nonmonetary Utilities in Uncertain Choices: The Ellsberg Urn," The Quarterly Journal of Economics, Oxford University Press, vol. 83(2), pages 324-329.
  34. McKelvey, Richard D & Page, Talbot, 1990. "Public and Private Information: An Experimental Study of Information Pooling," Econometrica, Econometric Society, vol. 58(6), pages 1321-1339, November.
  35. Li Hao & Daniel Houser, 2012. "Belief elicitation in the presence of naïve respondents: An experimental study," Journal of Risk and Uncertainty, Springer, vol. 44(2), pages 161-180, April.
  36. Itzhak Gilboa & Andrew Postlewaite & David Schmeidler, 2007. "Probabilities in Economic Modeling," PIER Working Paper Archive 07-023, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  37. Karni, Edi, 1999. "Elicitation of Subjective Probabilities When Preferences Are State-Dependent," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 479-486, May.
  38. Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-845, July.
  39. Hanson, Robin, 1996. "Correction to McKelvey and Page, "Public and Private Information: An Experimental Study of Information Pooling"," Econometrica, Econometric Society, vol. 64(5), pages 1223-1224, September.
  40. Tanga McDaniel & E. Rutström, 2001. "Decision Making Costs and Problem Solving Performance," Experimental Economics, Springer;Economic Science Association, vol. 4(2), pages 145-161, October.
  41. William N. Evans & W. Kip Viscusi, 1993. "Income Effects and the Value of Health," Journal of Human Resources, University of Wisconsin Press, vol. 28(3), pages 497-518.
  42. Glenn W. Harrison & Jimmy Martínez-Correa & J. Todd Swarthout & Eric R. Ulm, 2012. "Scoring Rules for Subjective Probability Distributions," Experimental Economics Center Working Paper Series 2012-18, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University, revised Apr 2013.
  43. W. Viscusi & William Evans, 2006. "Behavioral Probabilities," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 5-15, January.
  44. Ronald Harstad, 2000. "Dominant Strategy Adoption and Bidders' Experience with Pricing Rules," Experimental Economics, Springer;Economic Science Association, vol. 3(3), pages 261-280, December.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:exc:wpaper:2010-08. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (J. Todd Swarthout)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.