IDEAS home Printed from https://ideas.repec.org/p/fip/fednsr/808.html
   My bibliography  Save this paper

The behavior of uncertainty and disagreement and their roles in economic prediction: a panel analysis

Author

Listed:
  • Robert W. Rich
  • Joseph Tracy

Abstract

This paper examines point and density forecasts from the European Central Bank?s Survey of Professional Forecasters. We derive individual uncertainty measures along with individual point- and density-based measures of disagreement. We also explore the relationship between uncertainty and disagreement, as well as their roles in respondents? forecast performance and forecast revisions. We observe substantial heterogeneity in respondents? uncertainty and disagreement. In addition, there is little co-movement between uncertainty and disagreement, and forecast performance shows a more robust inverse relationship with disagreement than with uncertainty. Further, forecast revisions display a more meaningful association with disagreement than with uncertainty: Those respondents displaying higher levels of disagreement revise their point and density forecasts by a larger amount.

Suggested Citation

  • Robert W. Rich & Joseph Tracy, 2017. "The behavior of uncertainty and disagreement and their roles in economic prediction: a panel analysis," Staff Reports 808, Federal Reserve Bank of New York.
    • Handle: RePEc:fip:fednsr:808
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/research/staff_reports/sr808.html
    File Function: Summary
    Download Restriction: no
    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr808.pdf?la=en
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Manuel Amador & Pierre-Olivier Weill, 2010. "Learning from Prices: Public Communication and Welfare," Journal of Political Economy, University of Chicago Press, vol. 118(5), pages 866-907.
    2. Nicholas Bloom & Max Floetotto & Nir Jaimovich & Itay Saporta†Eksten & Stephen J. Terry, 2018. "Really Uncertain Business Cycles," Econometrica, Econometric Society, vol. 86(3), pages 1031-1065, May.
    3. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    4. Antonello D’Agostino & Kieran Mcquinn & Karl Whelan, 2012. "Are Some Forecasters Really Better Than Others?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(4), pages 715-732, June.
    5. Geoff Kenny & Thomas Kostka & Federico Masera, 2014. "How Informative are the Subjective Density Forecasts of Macroeconomists?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(3), pages 163-185, April.
    6. Stefania D'Amico & Athanasios Orphanides, 2008. "Uncertainty and disagreement in economic forecasting," Finance and Economics Discussion Series 2008-56, Board of Governors of the Federal Reserve System (U.S.).
    7. Garcí­a, Juan Angel, 2003. "An introduction to the ECB's survey of professional forecasters," Occasional Paper Series 8, European Central Bank.
    8. John Y. Campbell, 2000. "Asset Pricing at the Millennium," Journal of Finance, American Finance Association, vol. 55(4), pages 1515-1567, August.
    9. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2007. "The ECB survey of professional forecasters (SPF) – A review after eight years’ experience," Occasional Paper Series 59, European Central Bank.
    10. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    11. Engle, Robert F, 1983. "Estimates of the Variance of U.S. Inflation Based upon the ARCH Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 15(3), pages 286-301, August.
    12. Juan Angel Garcia, 2003. "An introduction to the ECB’s survey of professional forecasters," Occasional Paper Series 08, European Central Bank.
    13. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    14. Wändi Bruine De Bruin & Charles F. Manski & Giorgio Topa & Wilbert van der Klaauw, 2011. "Measuring consumer uncertainty about future inflation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 454-478, April.
    15. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    16. Patton, Andrew J. & Timmermann, Allan, 2010. "Why do forecasters disagree? Lessons from the term structure of cross-sectional dispersion," Journal of Monetary Economics, Elsevier, vol. 57(7), pages 803-820, October.
    17. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    18. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    19. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    20. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    21. Arroyo, Javier & Maté, Carlos, 2009. "Forecasting histogram time series with k-nearest neighbours methods," International Journal of Forecasting, Elsevier, vol. 25(1), pages 192-207.
    22. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2015. "The Measurement and Characteristics of Professional Forecasters' Uncertainty," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(7), pages 1029-1046, November.
    23. Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
    24. Stephen Morris & Hyun Song Shin, 2002. "Social Value of Public Information," American Economic Review, American Economic Association, vol. 92(5), pages 1521-1534, December.
    25. Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Breach, Tomas & D’Amico, Stefania & Orphanides, Athanasios, 2020. "The term structure and inflation uncertainty," Journal of Financial Economics, Elsevier, vol. 138(2), pages 388-414.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Rich & Joseph Tracy, 2021. "A Closer Look at the Behavior of Uncertainty and Disagreement: Micro Evidence from the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(1), pages 233-253, February.
    2. Manzan, Sebastiano, 2021. "Are professional forecasters Bayesian?," Journal of Economic Dynamics and Control, Elsevier, vol. 123(C).
    3. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    4. repec:zbw:bofrdp:037 is not listed on IDEAS
    5. Glas, Alexander, 2020. "Five dimensions of the uncertainty–disagreement linkage," International Journal of Forecasting, Elsevier, vol. 36(2), pages 607-627.
    6. Ambrocio, Gene, 2017. "The real effects of overconfidence and fundamental uncertainty shocks," Research Discussion Papers 37/2017, Bank of Finland.
    7. Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
    8. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    9. Sheen, Jeffrey & Wang, Ben Zhe, 2021. "Measuring macroeconomic disagreement – A mixed frequency approach," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 547-566.
    10. repec:zbw:bofrdp:2017_037 is not listed on IDEAS
    11. Casey, Eddie, 2021. "Are professional forecasters overconfident?," International Journal of Forecasting, Elsevier, vol. 37(2), pages 716-732.
    12. Luca Rossi, 2020. "Indicators of uncertainty: a brief user’s guide," Questioni di Economia e Finanza (Occasional Papers) 564, Bank of Italy, Economic Research and International Relations Area.
    13. Wojciech Charemza & Carlos Diaz Vela & Svetlana Makarova, 2013. "Inflation fan charts, monetary policy and skew normal distribution," Discussion Papers in Economics 13/06, Division of Economics, School of Business, University of Leicester.
    14. Glas, Alexander & Hartmann, Matthias, 2016. "Inflation uncertainty, disagreement and monetary policy: Evidence from the ECB Survey of Professional Forecasters," Journal of Empirical Finance, Elsevier, vol. 39(PB), pages 215-228.
    15. Andrade, P. & Ghysels, E. & Idier, J., 2012. "Tails of Inflation Forecasts and Tales of Monetary Policy," Working papers 407, Banque de France.
    16. Hartmann, Matthias & Herwartz, Helmut & Ulm, Maren, 2017. "A comparative assessment of alternative ex ante measures of inflation uncertainty," International Journal of Forecasting, Elsevier, vol. 33(1), pages 76-89.
    17. Michael Clements & Robert W. Rich & Joseph Tracy, 2024. "An Investigation into the Uncertainty Revision Process of Professional Forecasters," Working Papers 24-19, Federal Reserve Bank of Cleveland.
    18. Zohar, Osnat, 2024. "Cyclicality of uncertainty and disagreement," Journal of Monetary Economics, Elsevier, vol. 143(C).
    19. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    20. Paloviita, Maritta & Virén, Matti, 2014. "Analysis of forecast errors in micro-level survey data," Research Discussion Papers 8/2014, Bank of Finland.
    21. Krüger, Fabian & Nolte, Ingmar, 2016. "Disagreement versus uncertainty: Evidence from distribution forecasts," Journal of Banking & Finance, Elsevier, vol. 72(S), pages 172-186.
    22. Li, You & Tay, Anthony, 2021. "The role of macroeconomic and policy uncertainty in density forecast dispersion," Journal of Macroeconomics, Elsevier, vol. 67(C).

    More about this item

    Keywords

    uncertainty; disagreement; ECB-SPF; density forecasts; point forecasts; forecast accuracy; forecast revisions;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C20 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - General
    • C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednsr:808. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.