IDEAS home Printed from https://ideas.repec.org/a/eee/eecrev/v80y2015icp16-35.html
   My bibliography  Save this article

A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data

Author

Listed:
  • Dovern, Jonas

Abstract

This paper documents multivariate forecast disagreement among professional forecasters and discusses implications for models of heterogeneous expectation formation. Disagreement varies over time and is positively correlated with general (economic) uncertainty. The degree to which individual forecasters disagree with the average forecast tends to persist over time. Models of heterogeneous expectation formation can be modified by introducing heterogeneous signal-to-noise ratios to match this feature. Furthermore, disagreement about correlations of different macroeconomic variables is high on average. In general, multivariate forecast data can be used more effectively than it has been to estimate models with heterogeneous expectations and to test the mechanisms used to generate disagreement in these models.

Suggested Citation

  • Dovern, Jonas, 2015. "A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data," European Economic Review, Elsevier, vol. 80(C), pages 16-35.
    • Handle: RePEc:eee:eecrev:v:80:y:2015:i:c:p:16-35
    DOI: 10.1016/j.euroecorev.2015.08.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0014292115001257
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.euroecorev.2015.08.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    2. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    3. Reis, Ricardo, 2006. "Inattentive consumers," Journal of Monetary Economics, Elsevier, vol. 53(8), pages 1761-1800, November.
    4. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    5. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    6. Kurz, Mordecai, 1994. "On the Structure and Diversity of Rational Beliefs," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 4(6), pages 877-900, October.
    7. Bartosz Mackowiak & Mirko Wiederholt, 2009. "Optimal Sticky Prices under Rational Inattention," American Economic Review, American Economic Association, vol. 99(3), pages 769-803, June.
    8. Hans Christian Müller-Dröge & Tara M. Sinclair & H.O. Stekler, 2014. "Evaluating Forecasts of a Vector of Variables: a German Forecasting Competition," CAMA Working Papers 2014-55, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    9. Kandel, Eugene & Pearson, Neil D, 1995. "Differential Interpretation of Public Signals and Trade in Speculative Markets," Journal of Political Economy, University of Chicago Press, vol. 103(4), pages 831-872, August.
    10. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    11. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    12. Ralf Fendel & Eliza M. Lis & Jan‐Christoph Rülke, 2011. "Do professional forecasters believe in the Phillips curve? evidence from the G7 countries," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(2), pages 268-287, March.
    13. Kristoffer P. Nimark, 2014. "Man-Bites-Dog Business Cycles," American Economic Review, American Economic Association, vol. 104(8), pages 2320-2367, August.
    14. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    15. Jonas Dovern & Ulrich Fritsche & Jiri Slacalek, 2012. "Disagreement Among Forecasters in G7 Countries," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1081-1096, November.
    16. Fushang Liu & Kajal Lahiri, 2006. "Modelling multi-period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219.
    17. Wändi Bruine De Bruin & Charles F. Manski & Giorgio Topa & Wilbert van der Klaauw, 2011. "Measuring consumer uncertainty about future inflation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 454-478, April.
    18. Batchelor, Roy & Dua, Pami, 1991. "Blue Chip Rationality Tests," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 23(4), pages 692-705, November.
    19. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    20. Ball, Laurence & Jalles, João Tovar & Loungani, Prakash, 2015. "Do forecasters believe in Okun’s Law? An assessment of unemployment and output forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 176-184.
    21. LeBaron, Blake, 2006. "Agent-based Computational Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 24, pages 1187-1233, Elsevier.
    22. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    23. Dovern, Jonas, 2013. "When are GDP forecasts updated? Evidence from a large international panel," Economics Letters, Elsevier, vol. 120(3), pages 521-524.
    24. Hommes, Cars H., 2006. "Heterogeneous Agent Models in Economics and Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 23, pages 1109-1186, Elsevier.
    25. Ricardo Reis, 2006. "Inattentive Producers," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(3), pages 793-821.
    26. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    27. Leonardo Melosi, 2014. "Estimating Models with Dispersed Information," American Economic Journal: Macroeconomics, American Economic Association, vol. 6(1), pages 1-31, January.
    28. Unknown, 2008. "2008 Editorial Committee," Journal of the ASFMRA, American Society of Farm Managers and Rural Appraisers, vol. 2008, pages 1-1.
    29. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    30. Tilmann Gneiting, 2008. "Editorial: Probabilistic forecasting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 319-321, April.
    31. Lucas, Robert Jr., 1972. "Expectations and the neutrality of money," Journal of Economic Theory, Elsevier, vol. 4(2), pages 103-124, April.
    32. Christopher D. Carroll, 2003. "Macroeconomic Expectations of Households and Professional Forecasters," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 269-298.
    33. Lena Draeger & Michael J. Lamla, 2015. "Disagreement à la Taylor: Evidence from Survey Microdata," KOF Working papers 15-380, KOF Swiss Economic Institute, ETH Zurich.
    34. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    35. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    36. Patton, Andrew J. & Timmermann, Allan, 2010. "Why do forecasters disagree? Lessons from the term structure of cross-sectional dispersion," Journal of Monetary Economics, Elsevier, vol. 57(7), pages 803-820, October.
    37. Guido Lorenzoni, 2009. "A Theory of Demand Shocks," American Economic Review, American Economic Association, vol. 99(5), pages 2050-2084, December.
    38. Ng, Serena & Lewbel, Arthur, 2008. "Editors' Report 2007," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 557-557.
    39. Chanont Banternghansa & Michael W. McCracken, 2009. "Forecast disagreement among FOMC members," Working Papers 2009-059, Federal Reserve Bank of St. Louis.
    40. Frenkel, Michael & Lis, Eliza M. & Rülke, Jan-Christoph, 2011. "Has the economic crisis of 2007-2009 changed the expectation formation process in the Euro area?," Economic Modelling, Elsevier, vol. 28(4), pages 1808-1814, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. An, Zidong & Zheng, Xinye, 2023. "Diligent forecasters can make accurate predictions despite disagreeing with the consensus," Economic Modelling, Elsevier, vol. 125(C).
    2. Jonas Dovern & Matthias Hartmann, 2017. "Forecast performance, disagreement, and heterogeneous signal-to-noise ratios," Empirical Economics, Springer, vol. 53(1), pages 63-77, August.
    3. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    4. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    5. Dovern, Jonas, 2014. "A Multivariate Analysis of Forecast Disagreement: Confronting Models of Disagreement with SPF Data," Working Papers 0571, University of Heidelberg, Department of Economics.
    6. Manzan, Sebastiano, 2021. "Are professional forecasters Bayesian?," Journal of Economic Dynamics and Control, Elsevier, vol. 123(C).
    7. Gabriel Caldas Montes & Caio Ferrari Ferreira, 2019. "Does monetary policy credibility mitigate the effects of uncertainty about exchange rate on uncertainties about both inflation and interest rate?," International Economics and Economic Policy, Springer, vol. 16(4), pages 649-678, October.
    8. Raffaella Giacomini & Vasiliki Skreta & Javier Turen, 2015. "Models, Inattention and Expectation Updates," Discussion Papers 1602, Centre for Macroeconomics (CFM).
    9. Gaurav Kumar Singh & Tathagata Bandyopadhyay, 2024. "Determinants of disagreement: Learning from inflation expectations survey of households," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 326-343, March.
    10. George-Marios Angeletos & Chen Lian, 2016. "Incomplete Information in Macroeconomics: Accommodating Frictions in Coordination," NBER Working Papers 22297, National Bureau of Economic Research, Inc.
    11. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    12. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    13. Falck, Elisabeth & Hoffmann, Mathias & Hürtgen, Patrick, 2017. "Disagreement and monetary policy," Discussion Papers 29/2017, Deutsche Bundesbank.
    14. Falck, E. & Hoffmann, M. & Hürtgen, P., 2021. "Disagreement about inflation expectations and monetary policy transmission," Journal of Monetary Economics, Elsevier, vol. 118(C), pages 15-31.
    15. Michael J. Lamla & Thomas Maag, 2012. "The Role of Media for Inflation Forecast Disagreement of Households and Professional Forecasters," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1325-1350, October.
    16. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    17. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    18. Yongchen Zhao, 2022. "Uncertainty and disagreement of inflation expectations: Evidence from household‐level qualitative survey responses," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(4), pages 810-828, July.
    19. Dovern, Jonas & Müller, Lena Sophia & Wohlrabe, Klaus, 2023. "Local information and firm expectations about aggregates," Journal of Monetary Economics, Elsevier, vol. 138(C), pages 1-13.
    20. Stefano Eusepi & Richard Crump & Emanuel Moench & Philippe Andrade, 2014. "Noisy Information and Fundamental Disagreement," 2014 Meeting Papers 797, Society for Economic Dynamics.

    More about this item

    Keywords

    Macroeconomic expectation; Forecast; Imperfect information; Survey data; Disagreement;
    All these keywords.

    JEL classification:

    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eecrev:v:80:y:2015:i:c:p:16-35. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eer .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.