IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-02563136.html
   My bibliography  Save this paper

Central tendency bias in belief elicitation

Author

Listed:
  • Paolo Crosetto

    (GAEL - Laboratoire d'Economie Appliquée de Grenoble - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement - UGA - Université Grenoble Alpes - Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology - UGA - Université Grenoble Alpes)

  • Antonio Filippin

    (UNIMI - Università degli Studi di Milano = University of Milan)

  • Peter Katuščák

    (RWTH - Rheinisch-Westfälische Technische Hochschule Aachen University)

  • John Smith

    (Rutgers University [Camden] - Rutgers - Rutgers University System)

Abstract

We conduct an experiment in which subjects participate in a first-price auction against an automaton that bids randomly in a given range. The subjects first place a bid in the auction. They are then given an incentivized elicitation of their beliefs of the opponent's bid. Despite having been told that the bid of the opponent is drawn from a uniform distribution, we find that a majority of subjects report beliefs that have a peak in the interior of the range. This result is robust across seven different experimental treatments. While not expected at the outset, these single-peaked beliefs have precedence in the experimental psychology judgments literature. Our results suggest that an elicitation of probability beliefs can result in responses that are more concentrated than the objectively known or induced truth. We provide indicative evidence that such individual belief reports can be rationalized by well-defined subjective beliefs that differ from the objective truth. Our findings offer an explanation for the conservatism and overprecision biases in Bayesian updating. Finally, our findings suggest that probabilistic forecasts of uncertain events might have less variance than the actual events.

Suggested Citation

  • Paolo Crosetto & Antonio Filippin & Peter Katuščák & John Smith, 2020. "Central tendency bias in belief elicitation," Post-Print hal-02563136, HAL.
  • Handle: RePEc:hal:journl:hal-02563136
    DOI: 10.1016/j.joep.2020.102273
    Note: View the original document on HAL open archive server: https://hal.science/hal-02563136
    as

    Download full text from publisher

    File URL: https://hal.science/hal-02563136/document
    Download Restriction: no

    File URL: https://libkey.io/10.1016/j.joep.2020.102273?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    2. Daniel J. Benjamin & Matthew Rabin & Collin Raymond, 2016. "A Model of Nonbelief in the Law of Large Numbers," Journal of the European Economic Association, European Economic Association, vol. 14(2), pages 515-544.
    3. Steffen Andersen & John Fountain & Glenn Harrison & E. Rutström, 2014. "Estimating subjective probabilities," Journal of Risk and Uncertainty, Springer, vol. 48(3), pages 207-229, June.
    4. Mariana Blanco & Dirk Engelmann & Alexander Koch & Hans-Theo Normann, 2010. "Belief elicitation in experiments: is there a hedging problem?," Experimental Economics, Springer;Economic Science Association, vol. 13(4), pages 412-438, December.
    5. Jianying Qiu & Utz Weitzel, 2016. "Experimental evidence on valuation with multiple priors," Journal of Risk and Uncertainty, Springer, vol. 53(1), pages 55-74, August.
    6. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    7. James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
    8. Stekler, H O, 1975. "Why do Forecasters Underestimate?," Economic Inquiry, Western Economic Association International, vol. 13(3), pages 445-449, September.
    9. Theo Offerman & Joep Sonnemans & Gijs Van De Kuilen & Peter P. Wakker, 2009. "A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes ," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1461-1489.
    10. Andrew Schotter & Isabel Trevino, 2014. "Belief Elicitation in the Laboratory," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 103-128, August.
    11. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    12. Charness, Gary & Karni, Edi & Levin, Dan, 2010. "On the conjunction fallacy in probability judgment: New experimental evidence regarding Linda," Games and Economic Behavior, Elsevier, vol. 68(2), pages 551-556, March.
    13. Zizzo, Daniel John & Stolarz-Fantino, Stephanie & Wen, Julie & Fantino, Edmund, 2000. "A violation of the monotonicity axiom: experimental evidence on the conjunction fallacy," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 263-276, March.
    14. Edi Karni, 2009. "A Mechanism for Eliciting Probabilities," Econometrica, Econometric Society, vol. 77(2), pages 603-606, March.
    15. Tanjim Hossain & Ryo Okui, 2013. "The Binarized Scoring Rule," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(3), pages 984-1001.
    16. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    17. Duffy, Sean & Gussman, Steven & Smith, John, 2019. "Judgments of length in the economics laboratory: Are there brains in choice?," MPRA Paper 93126, University Library of Munich, Germany.
    18. He, Xue Dong & Xiao, Di, 2017. "Processing consistency in non-Bayesian inference," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 90-104.
    19. Franklin Allen, 1987. "Notes--Discovering Personal Probabilities When Utility Functions are Unknown," Management Science, INFORMS, vol. 33(4), pages 542-544, April.
    20. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    21. Avinatan Hassidim & Déborah Marciano & Assaf Romm & Ran I. Shorrer, 2017. "The Mechanism Is Truthful, Why Aren't You?," American Economic Review, American Economic Association, vol. 107(5), pages 220-224, May.
    22. Grether, David M., 1992. "Testing bayes rule and the representativeness heuristic: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 31-57, January.
    23. Gary Charness & Edi Karni & Dan Levin, 2007. "Individual and group decision making under risk: An experimental study of Bayesian updating and violations of first-order stochastic dominance," Journal of Risk and Uncertainty, Springer, vol. 35(2), pages 129-148, October.
    24. Duffy, Sean & Smith, John, 2019. "Omitted-variable bias and other matters in the defense of the category adjustment model: A reply to Crawford (2019)," MPRA Paper 94959, University Library of Munich, Germany.
    25. Arad, Ayala & Rubinstein, Ariel, 2012. "Multi-dimensional iterative reasoning in action: The case of the Colonel Blotto game," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 571-585.
    26. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    27. Fairley, Kim & Parelman, Jacob M. & Jones, Matt & Carter, R. McKell, 2019. "Risky health choices and the Balloon Economic Risk Protocol," Journal of Economic Psychology, Elsevier, vol. 73(C), pages 15-33.
    28. Duffy, Sean & Smith, John, 2020. "Omitted-variable bias and other matters in the defense of the category adjustment model: A comment on Crawford (2019)," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    29. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    30. Smyth, David J & Ash, J C K, 1981. "The Underestimation of Forecasts and the Variability of Predictions and Outcomes," Bulletin of Economic Research, Wiley Blackwell, vol. 33(1), pages 37-44, May.
    31. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    32. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd & Ulm, Eric R., 2017. "Scoring rules for subjective probability distributions," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 430-448.
    33. repec:cup:judgdm:v:10:y:2015:i:5:p:456-468 is not listed on IDEAS
    34. Yaakov Kareev & Sharon Arnon & Reut Horwitz-Zeliger, 2002. "On the Misperception of Variability," Discussion Paper Series dp285, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sean Duffy & John Smith, 2020. "On the category adjustment model: another look at Huttenlocher, Hedges, and Vevea (2000)," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 19(1), pages 163-193, June.
    2. Folli, Dominik & Wolff, Irenaeus, 2022. "Biases in belief reports," Journal of Economic Psychology, Elsevier, vol. 88(C).
    3. Øivind Schøyen, 2024. "Suspicious minds and views of fairness," Theory and Decision, Springer, vol. 97(1), pages 67-88, August.
    4. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    5. Hartwig, Fredrik & Landström, Mats & Sörqvist, Patrik, 2022. "Averaging bias in firm acquisition processes," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 96(C).
    6. Collins, Sean M. & James, Duncan, 2024. "Hidden in plain sight: Payoffs, probability, space, and time in isomorphic tasks," Games and Economic Behavior, Elsevier, vol. 145(C), pages 117-136.
    7. Irenaeus Wolff, 2023. "Heuristic Centered-Belief Players," TWI Research Paper Series 128, Thurgauer Wirtschaftsinstitut, Universität Konstanz.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eyting, Markus & Schmidt, Patrick, 2021. "Belief elicitation with multiple point predictions," European Economic Review, Elsevier, vol. 135(C).
    2. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    3. Kai Barron, 2021. "Belief updating: does the ‘good-news, bad-news’ asymmetry extend to purely financial domains?," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 31-58, March.
    4. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    5. Li Hao & Daniel Houser, 2012. "Belief elicitation in the presence of naïve respondents: An experimental study," Journal of Risk and Uncertainty, Springer, vol. 44(2), pages 161-180, April.
    6. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    7. Markus Eyting & Patrick Schmidt, 2019. "Belief Elicitation with Multiple Point Predictions," Working Papers 1818, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz, revised 16 Nov 2020.
    8. Theo Offerman & Asa B. Palley, 2016. "Lossed in translation: an off-the-shelf method to recover probabilistic beliefs from loss-averse agents," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 1-30, March.
    9. de Haan, Thomas, 2020. "Eliciting belief distributions using a random two-level partitioning of the state space," Working Papers in Economics 1/20, University of Bergen, Department of Economics.
    10. Ingrid Burfurd & Tom Wilkening, 2022. "Cognitive heterogeneity and complex belief elicitation," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 557-592, April.
    11. Olivier L'Haridon & Craig S. Webb & Horst Zank, 2021. "An Effective and Simple Tool for Measuring Loss Aversion," Economics Discussion Paper Series 2107, Economics, The University of Manchester.
    12. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2016. "In search of good probability assessors: an experimental comparison of elicitation rules for confidence judgments," Theory and Decision, Springer, vol. 80(3), pages 363-387, March.
    13. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    14. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2014. "Eliciting subjective probabilities with binary lotteries," Journal of Economic Behavior & Organization, Elsevier, vol. 101(C), pages 128-140.
    15. Alexander Coutts, 2019. "Good news and bad news are still news: experimental evidence on belief updating," Experimental Economics, Springer;Economic Science Association, vol. 22(2), pages 369-395, June.
    16. Arthur Carvalho & Stanko Dimitrov & Kate Larson, 2018. "On proper scoring rules and cumulative prospect theory," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 6(3), pages 343-376, November.
    17. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    18. Folli, Dominik & Wolff, Irenaeus, 2022. "Biases in belief reports," Journal of Economic Psychology, Elsevier, vol. 88(C).
    19. Karl Schlag & James Tremewan, 2021. "Simple belief elicitation: An experimental evaluation," Journal of Risk and Uncertainty, Springer, vol. 62(2), pages 137-155, April.
    20. Tsakas, Elias, 2018. "Robust scoring rules," Research Memorandum 023, Maastricht University, Graduate School of Business and Economics (GSBE).

    More about this item

    Keywords

    Belief elicitation; Quadratic scoring rule; Overprecision; Conservatism;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-02563136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.