IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v53y2007i11p1731-1744.html
   My bibliography  Save this article

Coherence and Consistency of Investors' Probability Judgments

Author

Listed:
  • David V. Budescu

    (Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, Illinois 61820)

  • Ning Du

    (School of Accountancy and Management Information Systems, DePaul University, Chicago, Illinois 60604)

Abstract

This study investigates the quality of direct probability judgments and quantile estimates with a focus on calibration and consistency. The two response modes use different measures of miscalibration, so it is difficult to directly compare their relative (in)accuracy. We employed a more refined within-subject design in which decision makers (DMs) used both response modes to make judgments about a random sample of stocks accompanied by identical information to facilitate comparison between the two judgment methods. DMs judged the probabilities that the stocks will reach a certain threshold, provided lower and upper bounds of these forecasts, and estimated median, 50%, 70%, and 90% confidence intervals of their future prices. We found that the judgments were internally consistent and coherent, but in most cases they were slightly miscalibrated. We used several new methods of analysis that allow for more precise and reliable comparison between the two response modes. We inferred point probability estimates for the target events from the confidence intervals and analyzed them by the same methods applied to binary judgments. Interestingly, when we quantified miscalibration in identical fashion for both methods we did not find evidence of differential levels of miscalibration for the probability judgments and the confidence intervals. We discuss the theoretical and practical implications of these results.

Suggested Citation

  • David V. Budescu & Ning Du, 2007. "Coherence and Consistency of Investors' Probability Judgments," Management Science, INFORMS, vol. 53(11), pages 1731-1744, November.
  • Handle: RePEc:inm:ormnsc:v:53:y:2007:i:11:p:1731-1744
    DOI: 10.1287/mnsc.1070.0727
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1070.0727
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.1070.0727?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Klayman, Joshua & Soll, Jack B. & Gonzalez-Vallejo, Claudia & Barlas, Sema, 1999. "Overconfidence: It Depends on How, What, and Whom You Ask, , , , , , , , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 79(3), pages 216-247, September.
    2. Markus Glaser & Thomas Langer & Martin Weber, 2007. "On the Trend Recognition and Forecasting Ability of Professional Traders," Decision Analysis, INFORMS, vol. 4(4), pages 176-193, December.
    3. Kirchler, Erich & Maciejovsky, Boris, 2002. "Simultaneous Over- and Underconfidence: Evidence from Experimental Asset Markets," Journal of Risk and Uncertainty, Springer, vol. 25(1), pages 65-85, July.
    4. Barberis, Nicholas & Thaler, Richard, 2003. "A survey of behavioral finance," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 18, pages 1053-1128, Elsevier.
    5. G.M. Constantinides & M. Harris & R. M. Stulz (ed.), 2003. "Handbook of the Economics of Finance," Handbook of the Economics of Finance, Elsevier, edition 1, volume 1, number 1.
    6. Kuhn, Kristine M. & Budescu, David V., 1996. "The Relative Importance of Probabilities, Outcomes, and Vagueness in Hazard Risk Decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 68(3), pages 301-317, December.
    7. G.M. Constantinides & M. Harris & R. M. Stulz (ed.), 2003. "Handbook of the Economics of Finance," Handbook of the Economics of Finance, Elsevier, edition 1, volume 1, number 2.
    8. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    9. Brad M. Barber & Terrance Odean, 2000. "Trading Is Hazardous to Your Wealth: The Common Stock Investment Performance of Individual Investors," Journal of Finance, American Finance Association, vol. 55(2), pages 773-806, April.
    10. Brad M. Barber & Terrance Odean, 2002. "Online Investors: Do the Slow Die First?," The Review of Financial Studies, Society for Financial Studies, vol. 15(2), pages 455-488, March.
    11. Soll, Jack B., 1996. "Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological Structure," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(2), pages 117-137, February.
    12. Budescu, David V. & Kuhn, Kristine M. & Kramer, Karen M. & Johnson, Timothy R., 2002. "Modeling certainty equivalents for imprecise gambles," Organizational Behavior and Human Decision Processes, Elsevier, vol. 88(2), pages 748-768, July.
    13. Ning Du & David V. Budescu, 2005. "The Effects of Imprecise Probabilities and Outcomes in Evaluating Investment Options," Management Science, INFORMS, vol. 51(12), pages 1791-1803, December.
    14. Juslin, Peter, 1994. "The Overconfidence Phenomenon as a Consequence of Informal Experimenter-Guided Selection of Almanac Items," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(2), pages 226-246, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Markus Glaser & Martin Weber, 2007. "Overconfidence and trading volume," The Geneva Papers on Risk and Insurance Theory, Springer;International Association for the Study of Insurance Economics (The Geneva Association), vol. 32(1), pages 1-36, June.
    2. Ning Du & David V. Budescu, 2005. "The Effects of Imprecise Probabilities and Outcomes in Evaluating Investment Options," Management Science, INFORMS, vol. 51(12), pages 1791-1803, December.
    3. Langnickel, Ferdinand & Zeisberger, Stefan, 2016. "Do we measure overconfidence? A closer look at the interval production task," Journal of Economic Behavior & Organization, Elsevier, vol. 128(C), pages 121-133.
    4. Hales, Jeffrey, 2009. "Are investors really willing to agree to disagree? An experimental investigation of how disagreement and attention to disagreement affect trading behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(2), pages 230-241, March.
    5. Vivien Lespagnol & Juliette Rouchier, 2018. "Trading Volume and Price Distortion: An Agent-Based Model with Heterogenous Knowledge of Fundamentals," Post-Print hal-02084910, HAL.
    6. Pontiff, Jeffrey, 2006. "Costly arbitrage and the myth of idiosyncratic risk," Journal of Accounting and Economics, Elsevier, vol. 42(1-2), pages 35-52, October.
    7. Dennis Dittrich & Werner Guth & Boris Maciejovsky, 2005. "Overconfidence in investment decisions: An experimental approach," The European Journal of Finance, Taylor & Francis Journals, vol. 11(6), pages 471-491.
    8. Menkhoff, Lukas & Nikiforow, Marina, 2009. "Professionals' endorsement of behavioral finance: Does it impact their perception of markets and themselves?," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 318-329, August.
    9. Michailova, Julija, 2010. "Overconfidence, Risk Aversion and Individual Financial Decisions in Experimental Asset Markets," MPRA Paper 53114, University Library of Munich, Germany, revised Jan 2014.
    10. Li, Yuanzhi & Zhong, Zhaodong (Ken), 2013. "Investing in Chapter 11 stocks: Trading, value, and performance," Journal of Financial Markets, Elsevier, vol. 16(1), pages 33-60.
    11. Sautner, Zacharias & Weber, Martin, 2005. "Stock options and employee behavior," Papers 05-26, Sonderforschungsbreich 504.
    12. Christoph Huber & Julia Rose, 2019. "Do individual attitudes towards imprecision survive in experimental asset markets?," Working Papers 2019-06, Faculty of Economics and Statistics, Universität Innsbruck.
    13. Leitner, Stephan & Rausch, Alexandra & Behrens, Doris A., 2017. "Distributed investment decisions and forecasting errors: An analysis based on a multi-agent simulation model," European Journal of Operational Research, Elsevier, vol. 258(1), pages 279-294.
    14. Dorota Skała, 2008. "Overconfidence in Psychology and Finance – an Interdisciplinary Literature Review," Bank i Kredyt, Narodowy Bank Polski, vol. 39(4), pages 33-50.
    15. Glaser, Markus & Langer, Thomas & Weber, Martin, 2005. "Overconfidence of Professionals and Lay Men: Individual Differences Within and Between Tasks?," Sonderforschungsbereich 504 Publications 05-25, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    16. Fellner, Gerlinde & Guth, Werner & Maciejovsky, Boris, 2004. "Illusion of expertise in portfolio decisions: an experimental approach," Journal of Economic Behavior & Organization, Elsevier, vol. 55(3), pages 355-376, November.
    17. Pereira Reichhardt, Joaquín & Iqbal, Tabassum, 2014. "Investment Decisions: Are we fully-Rational?," MPRA Paper 57686, University Library of Munich, Germany.
    18. Lambert, Jérôme & Bessière, Véronique & N’Goala, Gilles, 2012. "Does expertise influence the impact of overconfidence on judgment, valuation and investment decision?," Journal of Economic Psychology, Elsevier, vol. 33(6), pages 1115-1128.
    19. Menkhoff, Lukas & Schmeling, Maik & Schmidt, Ulrich, 2013. "Overconfidence, experience, and professionalism: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 92-101.
    20. Menkhoff, Lukas & Schmidt, Ulrich & Brozynski, Torsten, 2006. "The impact of experience on risk taking, overconfidence, and herding of fund managers: Complementary survey evidence," European Economic Review, Elsevier, vol. 50(7), pages 1753-1766, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:53:y:2007:i:11:p:1731-1744. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.