IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp3517.html
   My bibliography  Save this paper

Belief Elicitation in Experiments: Is there a Hedging Problem?

Author

Listed:
  • Blanco, Mariana

    (Universidad del Rosario)

  • Engelmann, Dirk

    (Royal Holloway, University of London)

  • Koch, Alexander K.

    (Aarhus University)

  • Normann, Hans-Theo

    (Goethe University Frankfurt)

Abstract

Belief elicitation in economics experiments usually relies on paying subjects according to the accuracy of stated beliefs in addition to payments for other decisions. Such incentives, however, allow risk-averse subjects to hedge with their stated beliefs against adverse outcomes of other decisions in the experiment. This raises two questions: (i) can we trust the existing belief elicitation results, (ii) can we avoid potential hedging confounds? Our results instill confidence regarding both issues. We propose an experimental design that eliminates hedging opportunities, and use this to test for the empirical relevance of hedging effects in the lab. We find no evidence for hedging, comparing the standard “hedging-prone” belief elicitation treatment to a “hedging-proof” design in a sequential prisoners’ dilemma game. Our findings are strengthened by the absence of hedging even in an additional non-belief elicitation treatment using a financial investment frame, where hedging arguably would be most natural.

Suggested Citation

  • Blanco, Mariana & Engelmann, Dirk & Koch, Alexander K. & Normann, Hans-Theo, 2008. "Belief Elicitation in Experiments: Is there a Hedging Problem?," IZA Discussion Papers 3517, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp3517
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp3517.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Terrance Hurley & Jason Shogren, 2005. "An Experimental Comparison of Induced and Elicited Beliefs," Journal of Risk and Uncertainty, Springer, vol. 30(2), pages 169-188, January.
    2. Siegfried Berninghaus & Werner Güth & M. Vittoria Levati & Jianying Qiu, 2006. "Satisficing in sales competition: experimental evidence," Papers on Strategic Interaction 2006-32, Max Planck Institute of Economics, Strategic Interaction Group.
    3. Falk, Armin & Fischbacher, Urs, 2006. "A theory of reciprocity," Games and Economic Behavior, Elsevier, vol. 54(2), pages 293-315, February.
    4. Miguel A. Costa-Gomes & Georg Weizsäcker, 2008. "Stated Beliefs and Play in Normal-Form Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 729-762.
    5. Clark, Kenneth & Sefton, Martin, 2001. "The Sequential Prisoner's Dilemma: Evidence on Reciprocation," Economic Journal, Royal Economic Society, vol. 111(468), pages 51-68, January.
    6. Edi Karni, 2009. "A Mechanism for Eliciting Probabilities," Econometrica, Econometric Society, vol. 77(2), pages 603-606, March.
    7. Simon Gächter & Elke Renner, 2010. "The effects of (incentivized) belief elicitation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(3), pages 364-377, September.
    8. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    9. Dufwenberg, Martin & Kirchsteiger, Georg, 2004. "A theory of sequential reciprocity," Games and Economic Behavior, Elsevier, vol. 47(2), pages 268-298, May.
    10. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    11. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    12. Dirk Engelmann & Martin Strobel, 2000. "The False Consensus Effect Disappears if Representative Information and Monetary Incentives Are Given," Experimental Economics, Springer;Economic Science Association, vol. 3(3), pages 241-260, December.
    13. Erev, Ido & Bornstein, Gary & Wallsten, Thomas S., 1993. "The Negative Effect of Probability Assessments on Decision Quality," Organizational Behavior and Human Decision Processes, Elsevier, vol. 55(1), pages 78-94, June.
    14. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    15. Dirk Engelmann & Martin Strobel, 2004. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments," American Economic Review, American Economic Association, vol. 94(4), pages 857-869, September.
    16. Huck, Steffen & Weizsacker, Georg, 2002. "Do players correctly estimate what others do? : Evidence of conservatism in beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 47(1), pages 71-85, January.
    17. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    18. Nathaniel T. Wilcox & Nick Feltovich, 2000. "Thinking Like a Game Theorist: Comment," Monash Economics Working Papers archive-30, Monash University, Department of Economics.
    19. Isaac, R Mark & James, Duncan, 2000. "Just Who Are You Calling Risk Averse?," Journal of Risk and Uncertainty, Springer, vol. 20(2), pages 177-187, March.
    20. Rey-Biel, Pedro, 2009. "Equilibrium play and best response to (stated) beliefs in normal form games," Games and Economic Behavior, Elsevier, vol. 65(2), pages 572-585, March.
    21. Bhatt, Meghana & Camerer, Colin F., 2005. "Self-referential thinking and equilibrium as states of mind in games: fMRI evidence," Games and Economic Behavior, Elsevier, vol. 52(2), pages 424-459, August.
    22. Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-845, July.
    23. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    24. Olivier Armantier & Nicolas Treich, 2009. "Subjective Probabilities In Games: An Application To The Overbidding Puzzle," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(4), pages 1079-1102, November.
    25. R. D. Boschloo, 1970. "Raised conditional level of significance for the 2 × 2‐table when testing the equality of two probabilities," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 24(1), pages 1-9, March.
    26. Mariana Blanco & Dirk Engelmann & Alexander Koch & Hans-Theo Normann, 2010. "Belief elicitation in experiments: is there a hedging problem?," Experimental Economics, Springer;Economic Science Association, vol. 13(4), pages 412-438, December.
    27. Bhattacharya, Sudipto & Pfleiderer, Paul, 1985. "Delegated portfolio management," Journal of Economic Theory, Elsevier, vol. 36(1), pages 1-25, June.
    28. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    29. Franklin Allen, 1987. "Notes--Discovering Personal Probabilities When Utility Functions are Unknown," Management Science, INFORMS, vol. 33(4), pages 542-544, April.
    30. Blanco, Mariana & Engelmann, Dirk & Normann, Hans Theo, 2011. "A within-subject analysis of other-regarding preferences," Games and Economic Behavior, Elsevier, vol. 72(2), pages 321-338, June.
    31. Bolle, Friedel & Ockenfels, Peter, 1990. "Prisoners' Dilemma as a game with incomplete information," Journal of Economic Psychology, Elsevier, vol. 11(1), pages 69-84, March.
    32. Daniel Friedman & Shyam Sunder, 2011. "Risky Curves: From Unobservable Utility to Observable Opportunity Sets," Cowles Foundation Discussion Papers 1819, Cowles Foundation for Research in Economics, Yale University.
    33. Beattie, Jane & Loomes, Graham, 1997. "The Impact of Incentives upon Risky Choice Experiments," Journal of Risk and Uncertainty, Springer, vol. 14(2), pages 155-168, March.
    34. Shlomo Benartzi, 2001. "Excessive Extrapolation and the Allocation of 401(k) Accounts to Company Stock," Journal of Finance, American Finance Association, vol. 56(5), pages 1747-1764, October.
    35. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
    36. Croson, Rachel T. A., 2000. "Thinking like a game theorist: factors affecting the frequency of equilibrium play," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 299-314, March.
    37. Gerlinde Fellner & Boris Maciejovsky, "undated". "The Equity Home Bias: Contrasting An Institutional With A Behavioral Explanation," Papers on Strategic Interaction 2003-03, Max Planck Institute of Economics, Strategic Interaction Group.
    38. Karni, Edi, 1999. "Elicitation of Subjective Probabilities When Preferences Are State-Dependent," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 479-486, May.
    39. Guerra, Gerardo & John Zizzo, Daniel, 2004. "Trust responsiveness and beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 55(1), pages 25-30, September.
    40. Holt, Charles A, 1986. "Preference Reversals and the Independence Axiom," American Economic Review, American Economic Association, vol. 76(3), pages 508-515, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blanco, Mariana & Engelmann, Dirk & Koch, Alexander K. & Normann, Hans-Theo, 2014. "Preferences and beliefs in a sequential social dilemma: a within-subjects analysis," Games and Economic Behavior, Elsevier, vol. 87(C), pages 122-135.
    2. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    3. Dhaene, Geert & Bouckaert, Jan, 2010. "Sequential reciprocity in two-player, two-stage games: An experimental analysis," Games and Economic Behavior, Elsevier, vol. 70(2), pages 289-303, November.
    4. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    5. Anna Conte & M. Levati, 2014. "Use of data on planned contributions and stated beliefs in the measurement of social preferences," Theory and Decision, Springer, vol. 76(2), pages 201-223, February.
    6. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    7. Sandra Ludwig & Julia Nafziger, 2011. "Beliefs about overconfidence," Theory and Decision, Springer, vol. 70(4), pages 475-500, April.
    8. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    9. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    10. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    11. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.
    12. Nagore Iriberri & Pedro Rey‐Biel, 2013. "Elicited beliefs and social information in modified dictator games: What do dictators believe other dictators do?," Quantitative Economics, Econometric Society, vol. 4(3), pages 515-547, November.
    13. Blanco, Mariana & Engelmann, Dirk & Normann, Hans Theo, 2011. "A within-subject analysis of other-regarding preferences," Games and Economic Behavior, Elsevier, vol. 72(2), pages 321-338, June.
    14. Kaushik Basu & Leonardo Becchetti & Luca Stanca, 2011. "Experiments with the Traveler’s Dilemma: welfare, strategic choice and implicit collusion," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 37(4), pages 575-595, October.
    15. Kurt A. Ackermann & Ryan O. Murphy, 2019. "Explaining Cooperative Behavior in Public Goods Games: How Preferences and Beliefs Affect Contribution Levels," Games, MDPI, vol. 10(1), pages 1-34, March.
    16. Ozan Aksoy & Jeroen Weesie, 2013. "Hierarchical Bayesian Analysis of Biased Beliefs and Distributional Other-Regarding Preferences," Games, MDPI, vol. 4(1), pages 1-23, February.
    17. Lejarraga, Tomás & Lucena, Abel & Rubí-Barceló, Antoni, 2020. "Beliefs estimated from choices in Proposer-Responder Games," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 442-459.
    18. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    19. Thöni, Christian & Gächter, Simon, 2015. "Peer effects and social preferences in voluntary cooperation: A theoretical and experimental analysis," Journal of Economic Psychology, Elsevier, vol. 48(C), pages 72-88.
    20. Anna Conte & M. Vittoria Levati & Natalia Montinari, 2019. "Experience in public goods experiments," Theory and Decision, Springer, vol. 86(1), pages 65-93, February.

    More about this item

    Keywords

    methods; hedging; belief elicitation; experimental economics;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp3517. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.