IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v40y2024i1p285-301.html
   My bibliography  Save this article

Bayesian herd detection for dynamic data

Author

Listed:
  • Keppo, Jussi
  • Satopää, Ville A.

Abstract

This article analyzes multiple agents who forecast an underlying dynamic state based on streams of (partially overlapping) information. Each agent minimizes a convex combination of their forecasting error and deviation from the other agents’ forecasts. As a result, the agents exhibit herding behavior, a bias well-recognized in the economics and psychology literature. Our first contribution is a general framework for analyzing agents’ forecasts under different levels of herding. The underlying state dynamics can be non-linear with seasonality, trends, shocks, or other time series components. Our second contribution describes how models within our framework can be estimated from data. We apply our estimation procedure to surveys of equity price forecasts and find that the agents concentrate 37% of their efforts on making similar forecasts on average. However, there is substantial variation in the level of herding over time; even though herding fell substantially during the 2007–2008 financial crisis, it rose after the crisis.

Suggested Citation

  • Keppo, Jussi & Satopää, Ville A., 2024. "Bayesian herd detection for dynamic data," International Journal of Forecasting, Elsevier, vol. 40(1), pages 285-301.
  • Handle: RePEc:eee:intfor:v:40:y:2024:i:1:p:285-301
    DOI: 10.1016/j.ijforecast.2023.03.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207023000328
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2023.03.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marco Cipriani & Antonio Guarino, 2014. "Estimating a Structural Model of Herd Behavior in Financial Markets," American Economic Review, American Economic Association, vol. 104(1), pages 224-251, January.
    2. Ottaviani, Marco & Sorensen, Peter Norman, 2006. "The strategy of professional forecasting," Journal of Financial Economics, Elsevier, vol. 81(2), pages 441-466, August.
    3. Duffie, Darrell & Malamud, Semyon & Manso, Gustavo, 2014. "Information percolation in segmented markets," Journal of Economic Theory, Elsevier, vol. 153(C), pages 1-32.
    4. Dirk Bergemann & Stephen Morris, 2013. "Robust Predictions in Games With Incomplete Information," Econometrica, Econometric Society, vol. 81(4), pages 1251-1308, July.
    5. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W., 1992. "The impact of institutional trading on stock prices," Journal of Financial Economics, Elsevier, vol. 32(1), pages 23-43, August.
    6. Jin Yeub Kim & Yongjun Kim & Myungkyu Shim, 2019. "Do Financial Analysts Herd?," Working papers 2019rwp-161, Yonsei University, Yonsei Economics Research Institute.
    7. Matan Harel & Elchanan Mossel & Philipp Strack & Omer Tamuz, 2021. "Rational Groupthink," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(1), pages 621-668.
      • Matan Harel & Elchanan Mossel & Philipp Strack & Omer Tamuz, 2014. "Rational Groupthink," Papers 1412.7172, arXiv.org, revised Jun 2020.
    8. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    9. Venkatesh Bala & Sanjeev Goyal, 1998. "Learning from Neighbours," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 595-621.
    10. Fama, Eugene F & French, Kenneth R, 1988. "Permanent and Temporary Components of Stock Prices," Journal of Political Economy, University of Chicago Press, vol. 96(2), pages 246-273, April.
    11. Darrell Duffie & Gaston Giroux & Gustavo Manso, 2010. "Information Percolation," American Economic Journal: Microeconomics, American Economic Association, vol. 2(1), pages 100-111, February.
    12. David V. Budescu & Eva Chen, 2015. "Identifying Expertise to Extract the Wisdom of Crowds," Management Science, INFORMS, vol. 61(2), pages 267-280, February.
    13. Xavier Vives, 1993. "How Fast do Rational Agents Learn?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(2), pages 329-347.
    14. Phillip E. Pfeifer & Yael Grushka-Cockayne & Kenneth C. Lichtendahl, 2014. "The Promise of Prediction Contests," The American Statistician, Taylor & Francis Journals, vol. 68(4), pages 264-270, November.
    15. William T. Gavin & Kevin L. Kliesen, 2008. "Forecasting inflation and output: comparing data-rich models with simple rules," Review, Federal Reserve Bank of St. Louis, vol. 90(May), pages 175-192.
    16. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    17. repec:cwl:cwldpp:1821rrr is not listed on IDEAS
    18. Lones Smith & Peter Norman Sørensen & Jianrong Tian, 2021. "Informational Herding, Optimal Experimentation, and Contrarianism [The Market for “Lemons”: Quality Uncertainty and the Market Mechanism]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(5), pages 2527-2554.
    19. Ashiya, Masahiro & Doi, Takero, 2001. "Herd behavior of Japanese economists," Journal of Economic Behavior & Organization, Elsevier, vol. 46(3), pages 343-346, November.
    20. Lamont, Owen A., 2002. "Macroeconomic forecasts and microeconomic forecasters," Journal of Economic Behavior & Organization, Elsevier, vol. 48(3), pages 265-280, July.
    21. Parikh, Rohit & Krasucki, Paul, 1990. "Communication, consensus, and knowledge," Journal of Economic Theory, Elsevier, vol. 52(1), pages 178-189, October.
    22. Gigerenzer, Gerd, 2018. "The Bias Bias in Behavioral Economics," Review of Behavioral Economics, now publishers, vol. 5(3-4), pages 303-336, December.
    23. Raffaella Giacomini & Vasiliki Skreta & Javier Turen, 2020. "Heterogeneity, Inattention, and Bayesian Updates," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(1), pages 282-309, January.
    24. Narasimhan Jegadeesh & Woojin Kim, 2010. "Do Analysts Herd? An Analysis of Recommendations and Market Reactions," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 901-937, February.
    25. Darrell Duffie & Semyon Malamud & Gustavo Manso, 2009. "Information Percolation With Equilibrium Search Dynamics," Econometrica, Econometric Society, vol. 77(5), pages 1513-1574, September.
    26. Lones Smith & Peter Sorensen, 2000. "Pathological Outcomes of Observational Learning," Econometrica, Econometric Society, vol. 68(2), pages 371-398, March.
    27. Trueman, Brett, 1994. "Analyst Forecasts and Herding Behavior," The Review of Financial Studies, Society for Financial Studies, vol. 7(1), pages 97-124.
    28. Ville A. Satopää & Robin Pemantle & Lyle H. Ungar, 2016. "Modeling Probability Forecasts via Information Diversity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1623-1633, October.
    29. Pavel Atanasov & Phillip Rescober & Eric Stone & Samuel A. Swift & Emile Servan-Schreiber & Philip Tetlock & Lyle Ungar & Barbara Mellers, 2017. "Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls," Management Science, INFORMS, vol. 63(3), pages 691-706, March.
    30. Michael B. Clement & Senyo Y. Tse, 2005. "Financial Analyst Characteristics and Herding Behavior in Forecasting," Journal of Finance, American Finance Association, vol. 60(1), pages 307-341, February.
    31. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Phillip E. Pfeifer, 2013. "The Wisdom of Competitive Crowds," Operations Research, INFORMS, vol. 61(6), pages 1383-1398, December.
    32. Harrison Hong & Jeffrey D. Kubik & Amit Solomon, 2000. "Security Analysts' Career Concerns and Herding of Earnings Forecasts," RAND Journal of Economics, The RAND Corporation, vol. 31(1), pages 121-144, Spring.
    33. Andrew W. Lo, A. Craig MacKinlay, 1988. "Stock Market Prices do not Follow Random Walks: Evidence from a Simple Specification Test," The Review of Financial Studies, Society for Financial Studies, vol. 1(1), pages 41-66.
    34. Jussi Keppo & Lones Smith & Dmitry Davydov, 2008. "Optimal Electoral Timing: Exercise Wisely and You May Live Longer -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(2), pages 597-628.
    35. J W Taylor, 2003. "Short-term electricity demand forecasting using double seasonal exponential smoothing," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 799-805, August.
    36. Scharfstein, David S & Stein, Jeremy C, 1990. "Herd Behavior and Investment," American Economic Review, American Economic Association, vol. 80(3), pages 465-479, June.
    37. David M. Cutler & James M. Poterba & Lawrence H. Summers, 1991. "Speculative Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(3), pages 529-546.
    38. Gale, Douglas & Kariv, Shachar, 2003. "Bayesian learning in social networks," Games and Economic Behavior, Elsevier, vol. 45(2), pages 329-346, November.
    39. Michael P. Clements, 2018. "Do Macroforecasters Herd?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(2-3), pages 265-292, March.
    40. Bou{g}açhan Çelen & Shachar Kariv & Andrew Schotter, 2010. "An Experimental Test of Advice and Social Learning," Management Science, INFORMS, vol. 56(10), pages 1687-1701, October.
    41. repec:cup:judgdm:v:9:y:2014:i:3:p:259-273 is not listed on IDEAS
    42. Russ Wermers, 1999. "Mutual Fund Herding and the Impact on Stock Prices," Journal of Finance, American Finance Association, vol. 54(2), pages 581-622, April.
    43. Darrell Duffie & Gustavo Manso, 2007. "Information Percolation in Large Markets," American Economic Review, American Economic Association, vol. 97(2), pages 203-209, May.
    44. Grinblatt, Mark & Titman, Sheridan & Wermers, Russ, 1995. "Momentum Investment Strategies, Portfolio Performance, and Herding: A Study of Mutual Fund Behavior," American Economic Review, American Economic Association, vol. 85(5), pages 1088-1105, December.
    45. Michael Egesdal & Zhenyu Lai & Che‐Lin Su, 2015. "Estimating dynamic discrete‐choice games of incomplete information," Quantitative Economics, Econometric Society, vol. 6(3), pages 567-597, November.
    46. Oliver Kim & Steve C. Lim & Kenneth W. Shaw, 2001. "The Inefficiency of the Mean Analyst Forecast as a Summary Forecast of Earnings," Journal of Accounting Research, Wiley Blackwell, vol. 39(2), pages 329-335, September.
    47. Prendergast, Canice & Stole, Lars, 1996. "Impetuous Youngsters and Jaded Old-Timers: Acquiring a Reputation for Learning," Journal of Political Economy, University of Chicago Press, vol. 104(6), pages 1105-1134, December.
    48. Atanasov, Pavel & Witkowski, Jens & Ungar, Lyle & Mellers, Barbara & Tetlock, Philip, 2020. "Small steps to accuracy: Incremental belief updaters are better forecasters," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 19-35.
    49. Asa B. Palley & Jack B. Soll, 2019. "Extracting the Wisdom of Crowds When Information Is Shared," Management Science, INFORMS, vol. 67(5), pages 2291-2309, May.
    50. John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, February.
    51. Zwiebel, Jeffrey, 1995. "Corporate Conservatism and Relative Compensation," Journal of Political Economy, University of Chicago Press, vol. 103(1), pages 1-25, February.
    52. Stephen Morris & Hyun Song Shin, 2002. "Social Value of Public Information," American Economic Review, American Economic Association, vol. 92(5), pages 1521-1534, December.
    53. Holger Sieg & Chamna Yoon, 2017. "Estimating Dynamic Games of Electoral Competition to Evaluate Term Limits in US Gubernatorial Elections," American Economic Review, American Economic Association, vol. 107(7), pages 1824-1857, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yanwei Jia & Jussi Keppo & Ville Satopää, 2023. "Herding in Probabilistic Forecasts," Management Science, INFORMS, vol. 69(5), pages 2713-2732, May.
    2. Hirshleifer, David & Teoh, Siew Hong, 2008. "Thought and Behavior Contagion in Capital Markets," MPRA Paper 9164, University Library of Munich, Germany.
    3. Marinovic, Iván & Ottaviani, Marco & Sorensen, Peter, 2013. "Forecasters’ Objectives and Strategies," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 690-720, Elsevier.
    4. David Hirshleifer & Siew Hong Teoh, 2003. "Herd Behaviour and Cascading in Capital Markets: a Review and Synthesis," European Financial Management, European Financial Management Association, vol. 9(1), pages 25-66, March.
    5. Matan Harel & Elchanan Mossel & Philipp Strack & Omer Tamuz, 2021. "Rational Groupthink," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(1), pages 621-668.
      • Matan Harel & Elchanan Mossel & Philipp Strack & Omer Tamuz, 2014. "Rational Groupthink," Papers 1412.7172, arXiv.org, revised Jun 2020.
    6. Bizer, Kilian & Meub, Lukas & Proeger, Till & Spiwoks, Markus, 2014. "Strategic coordination in forecasting: An experimental study," University of Göttingen Working Papers in Economics 195, University of Goettingen, Department of Economics.
    7. Taufeeq Ajaz & Anoop S. Kumar, 2018. "Herding In Crypto-Currency Markets," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 13(02), pages 1-15, June.
    8. Puput Tri Komalasari & Marwan Asri & Bernardinus M. Purwanto & Bowo Setiyono, 2022. "Herding behaviour in the capital market: What do we know and what is next?," Management Review Quarterly, Springer, vol. 72(3), pages 745-787, September.
    9. Clarke, Jonathan & Subramanian, Ajay, 2006. "Dynamic forecasting behavior by analysts: Theory and evidence," Journal of Financial Economics, Elsevier, vol. 80(1), pages 81-113, April.
    10. Cesare Fracassi, 2017. "Corporate Finance Policies and Social Networks," Management Science, INFORMS, vol. 63(8), pages 2420-2438, August.
    11. Menkhoff, Lukas & Schmidt, Ulrich & Brozynski, Torsten, 2006. "The impact of experience on risk taking, overconfidence, and herding of fund managers: Complementary survey evidence," European Economic Review, Elsevier, vol. 50(7), pages 1753-1766, October.
    12. Marco Ottaviani & Peter Norman Sorensen, 2002. "Professional Advice: The Theory of Reputational Cheap Talk," Discussion Papers 02-05, University of Copenhagen. Department of Economics.
    13. Dang, Ha V. & Lin, Mi, 2016. "Herd mentality in the stock market: On the role of idiosyncratic participants with heterogeneous information," International Review of Financial Analysis, Elsevier, vol. 48(C), pages 247-260.
    14. Wang, Peiwen & Chen, Minghua & Wu, Ji & Yan, Yuanyun, 2023. "Do peer effects matter in bank risk? Some cross-country evidence," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 88(C).
    15. Cai, Fang & Han, Song & Li, Dan & Li, Yi, 2019. "Institutional herding and its price impact: Evidence from the corporate bond market," Journal of Financial Economics, Elsevier, vol. 131(1), pages 139-167.
    16. Deng, Xin & Hung, Shengmin & Qiao, Zheng, 2018. "Mutual fund herding and stock price crashes," Journal of Banking & Finance, Elsevier, vol. 94(C), pages 166-184.
    17. Sylvain Marsat, 2006. "Does The Consensus Prevail? Experimental Evidence," Working Papers hal-02156562, HAL.
    18. Marius Popescu & Zhaojin Xu, 2018. "Mutual fund herding and reputational concerns," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 42(3), pages 550-565, July.
    19. Po-Jung Chen, 2016. "The Effects of Analysts’ Herding on Traders: Evidence from the Taiwan Stock Market," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 23(2), pages 203-227, June.
    20. Lin, Mei-Chen, 2018. "The impact of aggregate uncertainty on herding in analysts' stock recommendations," International Review of Financial Analysis, Elsevier, vol. 57(C), pages 90-105.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:40:y:2024:i:1:p:285-301. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.