IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc16/145925.html
   My bibliography  Save this paper

Forecast Performance, Disagreement, and Heterogeneous Signal-to-Noise Ratios

Author

Listed:
  • Hartmann, Matthias
  • Dovern, Jonas

Abstract

We propose an imperfect information model for the expectations of macroeconomic forecasters that explains differences in average disagreement levels across forecasters by means of cross sectional heterogeneity in the variance of private noise signals. We show that the forecaster-specific signal-to-noise ratios determine both the average individual disagreement level and an individuals' forecast performance: forecasters with very noisy signals deviate strongly from the average forecasts and report forecasts with low accuracy. We take the model to the data by empirically testing for this implied correlation. Evidence based on data from the Surveys of Professional Forecasters for the US and for the Euro Area supports the model for short- and medium-run forecasts but rejects it based on its implications for long-run forecasts.

Suggested Citation

  • Hartmann, Matthias & Dovern, Jonas, 2016. "Forecast Performance, Disagreement, and Heterogeneous Signal-to-Noise Ratios," VfS Annual Conference 2016 (Augsburg): Demographic Change 145925, Verein für Socialpolitik / German Economic Association.
    • Handle: RePEc:zbw:vfsc16:145925
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/145925/1/VfS_2016_pid_7067.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    2. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    3. William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, July.
    4. Kristoffer P. Nimark, 2014. "Man-Bites-Dog Business Cycles," American Economic Review, American Economic Association, vol. 104(8), pages 2320-2367, August.
    5. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    6. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    7. Kajal Lahiri & Antony Davies & Xuguang Sheng, 2010. "Analyzing Three-Dimensional Panel Data of Forecasts," Discussion Papers 10-07, University at Albany, SUNY, Department of Economics.
    8. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    9. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    10. Guido Lorenzoni, 2009. "A Theory of Demand Shocks," American Economic Review, American Economic Association, vol. 99(5), pages 2050-2084, December.
    11. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    12. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    13. Fushang Liu & Kajal Lahiri, 2006. "Modelling multi-period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219.
    14. Dovern, Jonas, 2015. "A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data," European Economic Review, Elsevier, vol. 80(C), pages 16-35.
    15. Davies, Anthony & Lahiri, Kajal, 1995. "A new framework for analyzing survey forecasts using three-dimensional panel data," Journal of Econometrics, Elsevier, vol. 68(1), pages 205-227, July.
    16. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    17. Dovern, Jonas, 2013. "When are GDP forecasts updated? Evidence from a large international panel," Economics Letters, Elsevier, vol. 120(3), pages 521-524.
    18. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    19. Leonardo Melosi, 2014. "Estimating Models with Dispersed Information," American Economic Journal: Macroeconomics, American Economic Association, vol. 6(1), pages 1-31, January.
    20. Harris, Milton & Raviv, Artur, 1993. "Differences of Opinion Make a Horse Race," Review of Financial Studies, Society for Financial Studies, vol. 6(3), pages 473-506.
    21. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ahrens, Steffen & Lustenhouwer, Joep & Tettamanzi, Michele, 2017. "The Stabilizing Role of Forward Guidance: A Macro Experiment," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168063, Verein für Socialpolitik / German Economic Association.
    2. Ruttachai Seelajaroen & Pornanong Budsaratragoon & Boonlert Jitmaneeroj, 2020. "Do monetary policy transparency and central bank communication reduce interest rate disagreement?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(3), pages 368-393, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dovern, Jonas, 2015. "A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data," European Economic Review, Elsevier, vol. 80(C), pages 16-35.
    2. Czudaj, Robert L., 2022. "Heterogeneity of beliefs and information rigidity in the crude oil market: Evidence from survey data," European Economic Review, Elsevier, vol. 143(C).
    3. Raffaella Giacomini & Vasiliki Skreta & Javier Turen, 2015. "Models, Inattention and Expectation Updates," Discussion Papers 1602, Centre for Macroeconomics (CFM).
    4. Michael Clements, 2016. "Are Macro-Forecasters Essentially The Same? An Analysis of Disagreement, Accuracy and Efficiency," ICMA Centre Discussion Papers in Finance icma-dp2016-08, Henley Business School, University of Reading.
    5. An, Zidong & Zheng, Xinye, 2023. "Diligent forecasters can make accurate predictions despite disagreeing with the consensus," Economic Modelling, Elsevier, vol. 125(C).
    6. de Mendonça, Helder Ferreira & Vereda, Luciano & Araujo, Mateus de Azevedo, 2022. "What type of information calls the attention of forecasters? Evidence from survey data in an emerging market," Journal of International Money and Finance, Elsevier, vol. 129(C).
    7. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    8. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    9. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    10. Paul Hubert, 2014. "FOMC Forecasts as a Focal Point for Private Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(7), pages 1381-1420, October.
    11. Cole, Stephen J. & Milani, Fabio, 2021. "Heterogeneity in individual expectations, sentiment, and constant-gain learning," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 627-650.
    12. Tomasz Łyziak & Xuguang Simon Sheng, 2023. "Disagreement in Consumer Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 55(8), pages 2215-2241, December.
    13. Frédérique Bec & Raouf Boucekkine & Caroline Jardet, 2023. "Why Are Inflation Forecasts Sticky? Theory and Application to France and Germany," International Journal of Central Banking, International Journal of Central Banking, vol. 19(4), pages 215-249, October.
    14. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    15. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    16. Stefano Eusepi & Richard Crump & Emanuel Moench & Philippe Andrade, 2014. "Noisy Information and Fundamental Disagreement," 2014 Meeting Papers 797, Society for Economic Dynamics.
    17. Leonardo Melosi, 2017. "Signalling Effects of Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 853-884.
    18. Gaurav Kumar Singh & Tathagata Bandyopadhyay, 2024. "Determinants of disagreement: Learning from inflation expectations survey of households," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 326-343, March.
    19. George-Marios Angeletos & Chen Lian, 2016. "Incomplete Information in Macroeconomics: Accommodating Frictions in Coordination," NBER Working Papers 22297, National Bureau of Economic Research, Inc.
    20. Michael P Clements, 2014. "Assessing the Evidence of Macro- Forecaster Herding: Forecasts of Inflation and Output Growth," ICMA Centre Discussion Papers in Finance icma-dp2014-12, Henley Business School, University of Reading.

    More about this item

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • D80 - Microeconomics - - Information, Knowledge, and Uncertainty - - - General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc16:145925. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.