IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v69y2023i5p2713-2732.html
   My bibliography  Save this article

Herding in Probabilistic Forecasts

Author

Listed:
  • Yanwei Jia

    (Department of Industrial Engineering and Operations Research, Columbia University, New York, New York 10027)

  • Jussi Keppo

    (Department of Analytics and Operations, NUS Business School, National University of Singapore, 119245 Singapore)

  • Ville Satopää

    (Technology and Operations Management, INSEAD, Fontainebleau 77300, France)

Abstract

Decision makers often ask experts to forecast a future state. Experts, however, can be biased. In the economics and psychology literature, one extensively studied behavioral bias is called herding. Under strong levels of herding, disclosure of public information may lower forecasting accuracy. This result, however, is derived only for point forecasts. In this paper, we consider experts’ probabilistic forecasts under herding, find a closed-form expression for the first two moments of a unique equilibrium forecast, and show that the experts report too similar locations and inflate the variance of their forecasts because of herding. Furthermore, we show that the negative externality of public information no longer holds. In addition to reacting to new information as expected, probabilistic forecasts contain more information about the experts’ full beliefs and interpersonal structure. This facilitates model estimation. To this end, we consider a one-shot setting with one forecast per expert and show that our model is identifiable up to an infinite number of solutions based on point forecasts but up to two solutions based on probabilistic forecasts. We then provide a Bayesian estimation procedure for these two solutions and apply it to economic forecasting data collected by the European Central Bank and the Federal Reserve Bank of Philadelphia. We find that, on average, the experts invest around 19% of their efforts into making similar forecasts. The level of herding shows an increasing trend from 1999 to 2007 but drops sharply during the financial crisis of 2007–2009 and then rises again until 2019.

Suggested Citation

  • Yanwei Jia & Jussi Keppo & Ville Satopää, 2023. "Herding in Probabilistic Forecasts," Management Science, INFORMS, vol. 69(5), pages 2713-2732, May.
  • Handle: RePEc:inm:ormnsc:v:69:y:2023:i:5:p:2713-2732
    DOI: 10.1287/mnsc.2022.4487
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2022.4487
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2022.4487?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Marco Cipriani & Antonio Guarino, 2014. "Estimating a Structural Model of Herd Behavior in Financial Markets," American Economic Review, American Economic Association, vol. 104(1), pages 224-251, January.
    2. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    3. Giampiero M. Gallo & Clive W.J. Granger & Yongil Jeon, 2002. "Copycats and Common Swings: The Impact of the Use of Forecasts in Information Sets," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-2.
    4. George-Marios Angeletos & Alessandro Pavan, 2004. "Transparency of Information and Coordination in Economies with Investment Complementarities," American Economic Review, American Economic Association, vol. 94(2), pages 91-98, May.
    5. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    6. Dirk Bergemann & Stephen Morris, 2013. "Robust Predictions in Games With Incomplete Information," Econometrica, Econometric Society, vol. 81(4), pages 1251-1308, July.
    7. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W., 1992. "The impact of institutional trading on stock prices," Journal of Financial Economics, Elsevier, vol. 32(1), pages 23-43, August.
    8. Bajari, Patrick & Hong, Han & Krainer, John & Nekipelov, Denis, 2010. "Estimating Static Models of Strategic Interactions," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 469-482.
    9. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    10. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    11. Camille Cornand & Frank Heinemann, 2008. "Optimal Degree of Public Information Dissemination," Economic Journal, Royal Economic Society, vol. 118(528), pages 718-742, April.
    12. Gianna Boero & Jeremy Smith & KennethF. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    13. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    14. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    15. Xiao, Ruli, 2018. "Identification and estimation of incomplete information games with multiple equilibria," Journal of Econometrics, Elsevier, vol. 203(2), pages 328-343.
    16. Phillip E. Pfeifer & Yael Grushka-Cockayne & Kenneth C. Lichtendahl, 2014. "The Promise of Prediction Contests," The American Statistician, Taylor & Francis Journals, vol. 68(4), pages 264-270, November.
    17. repec:cup:judgdm:v:9:y:2014:i:3:p:259-273 is not listed on IDEAS
    18. Lamont, Owen A., 2002. "Macroeconomic forecasts and microeconomic forecasters," Journal of Economic Behavior & Organization, Elsevier, vol. 48(3), pages 265-280, July.
    19. Michael Woodford, 2005. "Central bank communication and policy effectiveness," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, issue Aug, pages 399-474.
    20. Judith Chevalier & Glenn Ellison, 1999. "Career Concerns of Mutual Fund Managers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 389-432.
    21. Ashiya, Masahiro & Doi, Takero, 2001. "Herd behavior of Japanese economists," Journal of Economic Behavior & Organization, Elsevier, vol. 46(3), pages 343-346, November.
    22. Russ Wermers, 1999. "Mutual Fund Herding and the Impact on Stock Prices," Journal of Finance, American Finance Association, vol. 54(2), pages 581-622, April.
    23. Emir Shuford & Arthur Albert & H. Edward Massengill, 1966. "Admissible probability measurement procedures," Psychometrika, Springer;The Psychometric Society, vol. 31(2), pages 125-145, June.
    24. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    25. repec:cwl:cwldpp:1821rrr is not listed on IDEAS
    26. George-Marios Angeletos & Alessandro Pavan, 2007. "Efficient Use of Information and Social Value of Information," Econometrica, Econometric Society, vol. 75(4), pages 1103-1142, July.
    27. Stephen Morris & Hyun Song Shin & Hui Tong, 2006. "Social Value of Public Information: Morris and Shin (2002) Is Actually Pro-Transparency, Not Con: Reply," American Economic Review, American Economic Association, vol. 96(1), pages 453-455, March.
    28. Grinblatt, Mark & Titman, Sheridan & Wermers, Russ, 1995. "Momentum Investment Strategies, Portfolio Performance, and Herding: A Study of Mutual Fund Behavior," American Economic Review, American Economic Association, vol. 85(5), pages 1088-1105, December.
    29. Jonathan G. James & Phillip Lawler, 2011. "Optimal Policy Intervention and the Social Value of Public Information," American Economic Review, American Economic Association, vol. 101(4), pages 1561-1574, June.
    30. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    31. Raffaella Giacomini & Vasiliki Skreta & Javier Turen, 2020. "Heterogeneity, Inattention, and Bayesian Updates," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(1), pages 282-309, January.
    32. Lones Smith & Peter Sorensen, 2000. "Pathological Outcomes of Observational Learning," Econometrica, Econometric Society, vol. 68(2), pages 371-398, March.
    33. Ville A. Satopää & Robin Pemantle & Lyle H. Ungar, 2016. "Modeling Probability Forecasts via Information Diversity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1623-1633, October.
    34. Oliver Kim & Steve C. Lim & Kenneth W. Shaw, 2001. "The Inefficiency of the Mean Analyst Forecast as a Summary Forecast of Earnings," Journal of Accounting Research, Wiley Blackwell, vol. 39(2), pages 329-335, September.
    35. Michael P. Clements, 2015. "Do US Macroeconomic Forecasters Exaggerate their Differences?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(8), pages 649-660, December.
    36. In-Uck Park & Mike W. Peacey & Marcus R. Munafò, 2014. "Modelling the effects of subjective and objective decision making in scientific peer review," Nature, Nature, vol. 506(7486), pages 93-96, February.
    37. Lars E. O. Svensson, 2006. "Social Value of Public Information: Comment: Morris and Shin (2002) Is Actually Pro-Transparency, Not Con," American Economic Review, American Economic Association, vol. 96(1), pages 448-452, March.
    38. Tilmann Gneiting, 2008. "Editorial: Probabilistic forecasting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 319-321, April.
    39. Robert L. Winkler, 1981. "Combining Probability Distributions from Dependent Information Sources," Management Science, INFORMS, vol. 27(4), pages 479-488, April.
    40. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
    41. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    42. Michael B. Clement & Senyo Y. Tse, 2005. "Financial Analyst Characteristics and Herding Behavior in Forecasting," Journal of Finance, American Finance Association, vol. 60(1), pages 307-341, February.
    43. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    44. Asa B. Palley & Jack B. Soll, 2019. "Extracting the Wisdom of Crowds When Information Is Shared," Management Science, INFORMS, vol. 67(5), pages 2291-2309, May.
    45. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    46. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    47. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Phillip E. Pfeifer, 2013. "The Wisdom of Competitive Crowds," Operations Research, INFORMS, vol. 61(6), pages 1383-1398, December.
    48. Kenneth F. Wallis, 2005. "Combining Density and Interval Forecasts: A Modest Proposal," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 983-994, December.
    49. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    50. Stephen Morris & Hyun Song Shin, 2002. "Social Value of Public Information," American Economic Review, American Economic Association, vol. 92(5), pages 1521-1534, December.
    51. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    52. Camille Cornand & Frank Heinemann, 2008. "Optimal Degree of Public Information Dissemination," Economic Journal, Royal Economic Society, vol. 118(528), pages 718-742, April.
    53. Harrison Hong & Jeffrey D. Kubik, 2003. "Analyzing the Analysts: Career Concerns and Biased Earnings Forecasts," Journal of Finance, American Finance Association, vol. 58(1), pages 313-351, February.
    54. Ui, Takashi & Yoshizawa, Yasunori, 2015. "Characterizing social value of information," Journal of Economic Theory, Elsevier, vol. 158(PB), pages 507-535.
    55. Aradillas-Lopez, Andres, 2010. "Semiparametric estimation of a simultaneous game with incomplete information," Journal of Econometrics, Elsevier, vol. 157(2), pages 409-431, August.
    56. Arnold Polanski & Evarist Stoja, 2010. "Incorporating higher moments into value-at-risk forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(6), pages 523-535.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Takashi Ui, 2022. "Optimal and Robust Disclosure of Public Information," Papers 2203.16809, arXiv.org, revised Apr 2022.
    2. Arato, Hiroki & Hori, Takeo & Nakamura, Tomoya, 2021. "Endogenous information acquisition and the partial announcement policy," Information Economics and Policy, Elsevier, vol. 55(C).
    3. Ui, Takashi & Yoshizawa, Yasunori, 2015. "Characterizing social value of information," Journal of Economic Theory, Elsevier, vol. 158(PB), pages 507-535.
    4. Takashi Ui, 2022. "Optimal and Robust Disclosure of Public Information," Working Papers on Central Bank Communication 039, University of Tokyo, Graduate School of Economics.
    5. Romain Baeriswyl & Camille Cornand & Bruno Ziliotto, 2020. "Observing and Shaping the Market: The Dilemma of Central Banks," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 52(8), pages 1973-2005, December.
    6. Colombo, Luca & Femminis, Gianluca, 2014. "Optimal policy intervention, constrained obfuscation and the social value of public information," Economics Letters, Elsevier, vol. 123(2), pages 224-226.
    7. Hiroki Arato & Tomoya Nakamura, 2013. "Endogenous Alleviation of Overreaction Problem by Aggregate Information Announcement," The Japanese Economic Review, Japanese Economic Association, vol. 64(3), pages 319-336, September.
    8. Camille Cornand & Frank Heinemann, 2014. "Measuring agents’ reaction to private and public information in games with strategic complementarities," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 61-77, March.
    9. Hirshleifer, David & Teoh, Siew Hong, 2008. "Thought and Behavior Contagion in Capital Markets," MPRA Paper 9164, University Library of Munich, Germany.
    10. Ui, Takashi, 2014. "The social value of public information with convex costs of information acquisition," Economics Letters, Elsevier, vol. 125(2), pages 249-252.
    11. Jonathan G James & Phillip Lawler, 2017. "Optimal Transparency and Policy Intervention with Heterogeneous Signals and Information Stickiness," Manchester School, University of Manchester, vol. 85(5), pages 577-600, September.
    12. Meixing Dai & Moïse Sidiropoulos, 2017. "How multiplicative uncertainty affects the tradeoff between information disclosure and stabilisation policy?," Working Papers of BETA 2017-15, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    13. Ui, Takashi & 宇井, 貴志, 2014. "The Social Value of Public Information with Convex Costs of Information Acquisition," Discussion Papers 2014-05, Graduate School of Economics, Hitotsubashi University.
    14. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    15. Jonathan G. James & Phillip Lawler, 2015. "Heterogeneous private sector information, central bank disclosure, and stabilization policy," Southern Economic Journal, John Wiley & Sons, vol. 82(2), pages 620-634, October.
    16. Hüning, Hendrik & Meub, Lukas, 2015. "Optimal public information dissemination: Introducing observational learning into a generalized beauty contest," HWWI Research Papers 169, Hamburg Institute of International Economics (HWWI).
    17. Marinovic, Iván & Ottaviani, Marco & Sorensen, Peter, 2013. "Forecasters’ Objectives and Strategies," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 690-720, Elsevier.
    18. Elnaboulsi, J.C. & Daher, W. & Sağlam, Y., 2018. "On the social value of publicly disclosed information and environmental regulation," Resource and Energy Economics, Elsevier, vol. 54(C), pages 1-22.
    19. Candian, Giacomo, 2021. "Central bank transparency, exchange rates, and demand imbalances," Journal of Monetary Economics, Elsevier, vol. 119(C), pages 90-107.
    20. Myatt, David P. & Wallace, Chris, 2014. "Central bank communication design in a Lucas-Phelps economy," Journal of Monetary Economics, Elsevier, vol. 63(C), pages 64-79.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:69:y:2023:i:5:p:2713-2732. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.