IDEAS home Printed from https://ideas.repec.org/a/kap/jrisku/v30y2005i2p169-188.html
   My bibliography  Save this article

An Experimental Comparison of Induced and Elicited Beliefs

Author

Listed:
  • Terrance Hurley
  • Jason Shogren

Abstract

Understanding choice under risk requires knowledge of beliefs and preferences. A variety of methods have been proposed to elicit peoples’ beliefs. The efficacy of alternative methods, however, has not been rigorously documented. Herein we use an experiment to test whether an induced probability can be recovered using an elicitation mechanism based on peoples’ predictions about a random event. We are unable to recover the induced belief. Instead, the estimated belief is systematically biased in a way that is consistent with anecdotal evidence in the economics, psychology, and statistics literature: people seem to overestimate low and underestimate high probabilities. Copyright Springer Science + Business Media, Inc. 2005

Suggested Citation

  • Terrance Hurley & Jason Shogren, 2005. "An Experimental Comparison of Induced and Elicited Beliefs," Journal of Risk and Uncertainty, Springer, vol. 30(2), pages 169-188, January.
    • Handle: RePEc:kap:jrisku:v:30:y:2005:i:2:p:169-188
    DOI: 10.1007/s11166-005-6565-5
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11166-005-6565-5
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11166-005-6565-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stahl Dale O. & Wilson Paul W., 1995. "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, Elsevier, vol. 10(1), pages 218-254, July.
    2. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    3. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-1289, November.
    4. Powell, Melanie & Ansic, David, 1997. "Gender differences in risk behaviour in financial decision-making: An experimental analysis," Journal of Economic Psychology, Elsevier, vol. 18(6), pages 605-628, November.
    5. Jaffray, Jean-Yves & Karni, Edi, 1999. "Elicitation of Subjective Probabilities When the Initial Endowment is Unobservable," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 5-20, April.
    6. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    7. Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-845, July.
    8. Jianakoplos, Nancy Ammon & Bernasek, Alexandra, 1998. "Are Women More Risk Averse?," Economic Inquiry, Western Economic Association International, vol. 36(4), pages 620-630, October.
    9. Dufwenberg, Martin & Gneezy, Uri, 2000. "Measuring Beliefs in an Experimental Lost Wallet Game," Games and Economic Behavior, Elsevier, vol. 30(2), pages 163-182, February.
    10. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
    11. Norris, Patricia E. & Kramer, Randall A., 1990. "The Elicitation of Subjective Probabilities with Applications in Agricultural Economics," Review of Marketing and Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 58(02-03), pages 1-21, December.
    12. Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
    13. Renate Schubert, 1999. "Financial Decision-Making: Are Women Really More Risk-Averse?," American Economic Review, American Economic Association, vol. 89(2), pages 381-385, May.
    14. McKelvey, Richard D & Page, Talbot, 1990. "Public and Private Information: An Experimental Study of Information Pooling," Econometrica, Econometric Society, vol. 58(6), pages 1321-1339, November.
    15. Sunden, Annika E & Surette, Brian J, 1998. "Gender Differences in the Allocation of Assets in Retirement Savings Plans," American Economic Review, American Economic Association, vol. 88(2), pages 207-211, May.
    16. Machina, Mark J, 1987. "Choice under Uncertainty: Problems Solved and Unsolved," Journal of Economic Perspectives, American Economic Association, vol. 1(1), pages 121-154, Summer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Teisl, Mario F. & Roe, Brian E., 2010. "Consumer willingness-to-pay to reduce the probability of retail foodborne pathogen contamination," Food Policy, Elsevier, vol. 35(6), pages 521-530, December.
    2. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    3. James Tremewan & Chloé Le Coq & Alexander D. Wagner, 2013. "Social Centipedes: the Impact of Group Identity on Preferences and Reasoning," Vienna Economics Papers 1305, University of Vienna, Department of Economics.
    4. Yola Engler & Lionel Page, 2022. "Driving a hard bargain is a balancing act: how social preferences constrain the negotiation process," Theory and Decision, Springer, vol. 93(1), pages 7-36, July.
    5. Karl Schlag & James Tremewan, 2021. "Simple belief elicitation: An experimental evaluation," Journal of Risk and Uncertainty, Springer, vol. 62(2), pages 137-155, April.
    6. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    7. Kaushik Basu & Leonardo Becchetti & Luca Stanca, 2011. "Experiments with the Traveler’s Dilemma: welfare, strategic choice and implicit collusion," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 37(4), pages 575-595, October.
    8. Smith, Alec, 2019. "Lagged beliefs and reference-dependent utility," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 331-340.
    9. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    10. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    11. Cassar, Lea & Armouti-Hansen, Jesper & Dereky, Anna & Engl, Florian, 2021. "Efficiency Wages with Motivated Agents," CEPR Discussion Papers 15723, C.E.P.R. Discussion Papers.
    12. Jesper Armouti-Hansen & Lea Cassar & Anna Deréky & Florian Engl, 2020. "Efficiency Wages with Motivated Agents," CESifo Working Paper Series 8474, CESifo.
    13. Steffen Andersen & John Fountain & Glenn Harrison & E. Rutström, 2014. "Estimating subjective probabilities," Journal of Risk and Uncertainty, Springer, vol. 48(3), pages 207-229, June.
    14. Langrock, Ines & Hurley, Terrance M., 2006. "Risk Preferences, Perceptions and Systematic Biases," 2006 Annual meeting, July 23-26, Long Beach, CA 21343, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    15. Le Coq, Chloé & Tremewan, James & Wagner, Alexander K., 2015. "On the effects of group identity in strategic environments," European Economic Review, Elsevier, vol. 76(C), pages 239-252.
    16. Yola Engler & Lionel Page, 2022. "Driving a hard bargain is a balancing act: how social preferences constrain the negotiation process," Theory and Decision, Springer, vol. 93(1), pages 7-36, July.
    17. Ong, David, 2008. "Sorting with shame in the laboratory," MPRA Paper 16523, University Library of Munich, Germany, revised 27 Jul 2009.
    18. Mariana Blanco & Dirk Engelmann & Alexander Koch & Hans-Theo Normann, 2010. "Belief elicitation in experiments: is there a hedging problem?," Experimental Economics, Springer;Economic Science Association, vol. 13(4), pages 412-438, December.
    19. Michael McBride, 2010. "Threshold uncertainty in discrete public good games: an experimental study," Economics of Governance, Springer, vol. 11(1), pages 77-99, February.
    20. Mingye Ma & Francesco Trevisan, 2023. "An Experiment on Inequality within Groups in Contest," Working Papers 2023: 30, Department of Economics, University of Venice "Ca' Foscari".
    21. Y. Chen & D. Marc Kilgour & Keith W. Hipel, 2012. "A Decision Rule Aggregation Approach to Multiple Criteria-Multiple Participant Sorting," Group Decision and Negotiation, Springer, vol. 21(5), pages 727-745, September.
    22. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    23. W. Viscusi & William Evans, 2006. "Behavioral Probabilities," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 5-15, January.
    24. Ram Ranjan, 2008. "The future of global warming: will it be emissions control or environmental damages?," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 13(4), pages 401-418, May.
    25. Li, Wenhui & Wilde, Christian, 2021. "Separating the effects of beliefs and attitudes on pricing under ambiguity," SAFE Working Paper Series 311, Leibniz Institute for Financial Research SAFE.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steffen Andersen & John Fountain & Glenn Harrison & E. Rutström, 2014. "Estimating subjective probabilities," Journal of Risk and Uncertainty, Springer, vol. 48(3), pages 207-229, June.
    2. Miguel A. Costa-Gomes & Georg Weizsäcker, 2008. "Stated Beliefs and Play in Normal-Form Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 729-762.
    3. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    4. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    5. Palfrey, Thomas R. & Wang, Stephanie W., 2009. "On eliciting beliefs in strategic games," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 98-109, August.
    6. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    7. Becchetti, Leonardo & Degli Antoni, Giacomo & Ottone, Stefania & Solferino, Nazaria, 2013. "Allocation criteria under task performance: The gendered preference for protection," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 96-111.
    8. Sandra Ludwig & Julia Nafziger, 2011. "Beliefs about overconfidence," Theory and Decision, Springer, vol. 70(4), pages 475-500, April.
    9. Huck, Steffen & Weizsacker, Georg, 2002. "Do players correctly estimate what others do? : Evidence of conservatism in beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 47(1), pages 71-85, January.
    10. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    11. Frederic Koessler & Ch. Noussair & A. Ziegelmeyer, 2005. "Individual Behavior and Beliefs in Experimental Parimutuel Betting Markets," THEMA Working Papers 2005-08, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    12. Costa-Gomes, Miguel A. & Huck, Steffen & Weizsäcker, Georg, 2014. "Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 88, pages 298-309.
    13. Frédéric Koessler & Charles Noussair & Anthony Ziegelmeyer, 2007. "Information Aggregation and Beliefs in Experimental Parimutuel Betting Markets," Papers on Strategic Interaction 2005-12, Max Planck Institute of Economics, Strategic Interaction Group.
    14. Steve Agnew & Neil Harrison, 2017. "The Role of Gender, Cognitive Attributes and Personality on Willingness to Take Risks," Business and Economic Research, Macrothink Institute, vol. 7(1), pages 1-16, June.
    15. Friedman, Dan & Sunder, Shyam, 2011. "Risky Curves: From Unobservable Utility to Observable Opportunity Sets," Santa Cruz Department of Economics, Working Paper Series qt36q158jt, Department of Economics, UC Santa Cruz.
    16. Florian Artinger & Filippos Exadaktylos & Hannes Koppel & Lauri Sääksvuori, 2010. "Applying Quadratic Scoring Rule transparently in multiple choice settings: A note," ThE Papers 10/01, Department of Economic Theory and Economic History of the University of Granada..
    17. Etchart-Vincent, Nathalie, 2007. "Expérimentation de laboratoire et économie : contre quelques idées reçues et faux problèmes," L'Actualité Economique, Société Canadienne de Science Economique, vol. 83(1), pages 91-116, mars.
    18. Pedro Rey Biel, 2005. "Equilibrium PLay and Best Response to (Stated) Beliefs in Constant Sum Games," Experimental 0506003, University Library of Munich, Germany.
    19. Nagore Iriberri & Pedro Rey‐Biel, 2013. "Elicited beliefs and social information in modified dictator games: What do dictators believe other dictators do?," Quantitative Economics, Econometric Society, vol. 4(3), pages 515-547, November.
    20. Simon Gächter & Elke Renner, 2010. "The effects of (incentivized) belief elicitation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(3), pages 364-377, September.

    More about this item

    Keywords

    beliefs; elicit; induce; probability; risk;
    All these keywords.

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jrisku:v:30:y:2005:i:2:p:169-188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.