IDEAS home Printed from https://ideas.repec.org/p/hhs/cbsnow/2009_005.html
   My bibliography  Save this paper

Estimating Subjective Probabilities

Author

Listed:
  • Andersen, Steffen

    (Department of Economics, Copenhagen Business School)

  • Fountain, John
  • Harrison, Glenn W.
  • Rutström, Elisabet E.

Abstract

Subjective probabilities play a role in many economic decisions. There is a large theoretical literature on the elicitation of subjective probabilities, and an equally large empirical literature. However, there is a gulf between the two. The theoretical literature proposes a range of procedures that can be used to recover subjective probabilities, but stresses the need to make strong auxiliary assumptions or “calibrating adjustments” to elicited reports in order to recover the latent probability. With some notable exceptions, the empirical literature seems intent on either making those strong assumptions or ignoring the need for calibration. We illustrate how one can jointly estimate risk attitudes and subjective probabilities using structural maximum likelihood methods. This allows the observer to make inferences about the latent subjective probability, calibrating for virtually any well-specified model of choice under uncertainty. We demonstrate our procedures with experiments in which we elicit subjective probabilities. We calibrate the estimates of subjective beliefs assuming that choices are made consistently with expected utility theory or rank-dependent utility theory. Inferred subjective probabilities are significantly different when calibrated according to either theory.

Suggested Citation

  • Andersen, Steffen & Fountain, John & Harrison, Glenn W. & Rutström, Elisabet E., 2009. "Estimating Subjective Probabilities," Working Papers 05-2009, Copenhagen Business School, Department of Economics.
  • Handle: RePEc:hhs:cbsnow:2009_005
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10398/7801
    File Function: Full text
    Download Restriction: Full text not avaiable
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Terrance Hurley & Jason Shogren, 2005. "An Experimental Comparison of Induced and Elicited Beliefs," Journal of Risk and Uncertainty, Springer, vol. 30(2), pages 169-188, January.
    2. Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
    3. I. Gilboa & A. W. Postlewaite & D. Schmeidler., 2009. "Probability and Uncertainty in Economic Modeling," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 10.
    4. James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
    5. Holt, Charles A. & Smith, Angela M., 2009. "An update on Bayesian updating," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 125-134, February.
    6. Miguel A. Costa-Gomes & Georg Weizsäcker, 2008. "Stated Beliefs and Play in Normal-Form Games," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 729-762.
    7. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    8. Edi Karni, 2009. "A Mechanism for Eliciting Probabilities," Econometrica, Econometric Society, vol. 77(2), pages 603-606, March.
    9. John Fountain & Glenn Harrison, 2011. "What do prediction markets predict?," Applied Economics Letters, Taylor & Francis Journals, vol. 18(3), pages 267-272.
    10. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
    11. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    12. Viscusi, W Kip & Evans, William N, 1990. "Utility Functions That Depend on Health Status: Estimates and Economic Implications," American Economic Review, American Economic Association, vol. 80(3), pages 353-374, June.
    13. Grether, David M., 1992. "Testing bayes rule and the representativeness heuristic: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 31-57, January.
    14. Ghirardato, Paolo & Maccheroni, Fabio & Marinacci, Massimo, 2004. "Differentiating ambiguity and ambiguity attitude," Journal of Economic Theory, Elsevier, vol. 118(2), pages 133-173, October.
    15. Ernan Haruvy & Yaron Lahav & Charles N. Noussair, 2007. "Traders' Expectations in Asset Markets: Experimental Evidence," American Economic Review, American Economic Association, vol. 97(5), pages 1901-1920, December.
    16. Jaffray, Jean-Yves & Karni, Edi, 1999. "Elicitation of Subjective Probabilities When the Initial Endowment is Unobservable," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 5-20, April.
    17. W. Kip Viscusi & William N. Evans, 1998. "Estimation Of Revealed Probabilities And Utility Functions For Product Safety Decisions," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 28-33, February.
    18. Vernon L. Smith, 1969. "Measuring Nonmonetary Utilities in Uncertain Choices: The Ellsberg Urn," The Quarterly Journal of Economics, Oxford University Press, vol. 83(2), pages 324-329.
    19. Peter Klibanoff & Massimo Marinacci & Sujoy Mukerji, 2005. "A Smooth Model of Decision Making under Ambiguity," Econometrica, Econometric Society, vol. 73(6), pages 1849-1892, November.
    20. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2014. "Eliciting subjective probabilities with binary lotteries," Journal of Economic Behavior & Organization, Elsevier, vol. 101(C), pages 128-140.
    21. Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-845, July.
    22. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd & Ulm, Eric R., 2017. "Scoring rules for subjective probability distributions," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 430-448.
    23. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    24. Itzhak Gilboa & Andrew Postlewaite & David Schmeidler, 2007. "Probabilities in Economic Modeling," Levine's Bibliography 843644000000000357, UCLA Department of Economics.
    25. W. Viscusi & William Evans, 2006. "Behavioral Probabilities," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 5-15, January.
    26. Ronald Harstad, 2000. "Dominant Strategy Adoption and Bidders' Experience with Pricing Rules," Experimental Economics, Springer;Economic Science Association, vol. 3(3), pages 261-280, December.
    27. Charness, Gary & Dufwenberg, Martin, 2003. "Promises & Partnership," Research Papers in Economics 2003:3, Stockholm University, Department of Economics.
    28. Theo Offerman & Joep Sonnemans & Gijs Van De Kuilen & Peter P. Wakker, 2009. "A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes ," Review of Economic Studies, Oxford University Press, vol. 76(4), pages 1461-1489.
    29. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    30. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    31. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2013. "Inducing risk neutral preferences with binary lotteries: A reconsideration," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 145-159.
    32. Gary Charness & Martin Dufwenberg, 2006. "Promises and Partnership," Econometrica, Econometric Society, vol. 74(6), pages 1579-1601, November.
    33. Dufwenberg, Martin & Gneezy, Uri, 2000. "Measuring Beliefs in an Experimental Lost Wallet Game," Games and Economic Behavior, Elsevier, vol. 30(2), pages 163-182, February.
    34. Forsythe, Robert & Forrest Nelson & George R. Neumann & Jack Wright, 1992. "Anatomy of an Experimental Political Stock Market," American Economic Review, American Economic Association, vol. 82(5), pages 1142-1161, December.
    35. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
    36. Drazen Prelec, 1998. "The Probability Weighting Function," Econometrica, Econometric Society, vol. 66(3), pages 497-528, May.
    37. Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
    38. McKelvey, Richard D & Page, Talbot, 1990. "Public and Private Information: An Experimental Study of Information Pooling," Econometrica, Econometric Society, vol. 58(6), pages 1321-1339, November.
    39. Li Hao & Daniel Houser, 2012. "Belief elicitation in the presence of naïve respondents: An experimental study," Journal of Risk and Uncertainty, Springer, vol. 44(2), pages 161-180, April.
    40. Karni, Edi, 1999. "Elicitation of Subjective Probabilities When Preferences Are State-Dependent," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 479-486, May.
    41. Andrew Schotter & Barry Sopher, 2003. "Social Learning and Coordination Conventions in Intergenerational Games: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 498-529, June.
    42. Hanson, Robin, 1996. "Correction to McKelvey and Page, "Public and Private Information: An Experimental Study of Information Pooling"," Econometrica, Econometric Society, vol. 64(5), pages 1223-1224, September.
    43. Tanga McDaniel & E. Rutström, 2001. "Decision Making Costs and Problem Solving Performance," Experimental Economics, Springer;Economic Science Association, vol. 4(2), pages 145-161, October.
    44. William N. Evans & W. Kip Viscusi, 1993. "Income Effects and the Value of Health," Journal of Human Resources, University of Wisconsin Press, vol. 28(3), pages 497-518.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    2. Eyting, Markus & Schmidt, Patrick, 2021. "Belief elicitation with multiple point predictions," European Economic Review, Elsevier, vol. 135(C).
    3. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    4. Constantinos Antoniou & Glenn Harrison & Morten Lau & Daniel Read, 2015. "Subjective Bayesian beliefs," Journal of Risk and Uncertainty, Springer, vol. 50(1), pages 35-54, February.
    5. Markus Eyting & Patrick Schmidt, 2019. "Belief Elicitation with Multiple Point Predictions," Working Papers 1818, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz, revised 16 Nov 2020.
    6. Kai Barron, 2021. "Belief updating: does the ‘good-news, bad-news’ asymmetry extend to purely financial domains?," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 31-58, March.
    7. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2014. "Eliciting subjective probabilities with binary lotteries," Journal of Economic Behavior & Organization, Elsevier, vol. 101(C), pages 128-140.
    8. Theo Offerman & Asa B. Palley, 2016. "Lossed in translation: an off-the-shelf method to recover probabilistic beliefs from loss-averse agents," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 1-30, March.
    9. Steffen Andersen & John Fountain & Glenn Harrison & Arne Hole & E. Rutström, 2012. "Inferring beliefs as subjectively imprecise probabilities," Theory and Decision, Springer, vol. 73(1), pages 161-184, July.
    10. Tsakas, Elias, 2018. "Robust scoring rules," Research Memorandum 023, Maastricht University, Graduate School of Business and Economics (GSBE).
    11. Li Hao & Daniel Houser, 2012. "Belief elicitation in the presence of naïve respondents: An experimental study," Journal of Risk and Uncertainty, Springer, vol. 44(2), pages 161-180, April.
    12. Blanco, Mariana & Engelmann, Dirk & Koch, Alexander K. & Normann, Hans-Theo, 2014. "Preferences and beliefs in a sequential social dilemma: a within-subjects analysis," Games and Economic Behavior, Elsevier, vol. 87(C), pages 122-135.
    13. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd & Ulm, Eric R., 2017. "Scoring rules for subjective probability distributions," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 430-448.
    14. Sandra Ludwig & Julia Nafziger, 2011. "Beliefs about overconfidence," Theory and Decision, Springer, vol. 70(4), pages 475-500, April.
    15. Tsang, Ming, 2020. "Estimating uncertainty aversion using the source method in stylized tasks with varying degrees of uncertainty," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    16. Amit Kothiyal & Vitalie Spinu & Peter Wakker, 2014. "An experimental test of prospect theory for predicting choice under ambiguity," Journal of Risk and Uncertainty, Springer, vol. 48(1), pages 1-17, February.
    17. Chen Li & Uyanga Turmunkh & Peter P. Wakker, 2019. "Trust as a decision under ambiguity," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 51-75, March.
    18. Cheung, Stephen L. & Johnstone, Lachlan, 2017. "True Overconfidence, Revealed through Actions: An Experiment," IZA Discussion Papers 10545, Institute of Labor Economics (IZA).
    19. Simon Gächter & Elke Renner, 2010. "The effects of (incentivized) belief elicitation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(3), pages 364-377, September.
    20. Palfrey, Thomas R. & Wang, Stephanie W., 2009. "On eliciting beliefs in strategic games," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 98-109, August.

    More about this item

    Keywords

    probability; beliefs; utility theory;
    All these keywords.

    JEL classification:

    • C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:cbsnow:2009_005. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/incbsdk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lene Hald (email available below). General contact details of provider: https://edirc.repec.org/data/incbsdk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.