IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v29y2013i3p367-377.html
   My bibliography  Save this article

On the use of cross-sectional measures of forecast uncertainty

Author

Listed:
  • Driver, Ciaran
  • Trapani, Lorenzo
  • Urga, Giovanni

Abstract

This paper investigates the role of cross-sectional dependence among private forecasters, assessing its impact on the measurement and use of the forecasting uncertainty. We determine the circumstances under which cross-sectional measures of uncertainty (such as the disagreement across forecasters) are valid proxies for private information, and analyse the impact of distributional assumptions on private signals. In particular, we explore the role played by cross dependence among forecasters, arising from factors such as partially shared private information. We validate the theory through a Monte Carlo exercise, which reinforces our findings, as well as through an application to US nonfarm payroll data.

Suggested Citation

  • Driver, Ciaran & Trapani, Lorenzo & Urga, Giovanni, 2013. "On the use of cross-sectional measures of forecast uncertainty," International Journal of Forecasting, Elsevier, vol. 29(3), pages 367-377.
  • Handle: RePEc:eee:intfor:v:29:y:2013:i:3:p:367-377
    DOI: 10.1016/j.ijforecast.2012.11.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207012001720
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2012.11.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    2. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    3. Pesaran, M. Hashem & Weale, Martin, 2006. "Survey Expectations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 14, pages 715-776, Elsevier.
    4. Jonas Dovern & Ulrich Fritsche & Jiri Slacalek, 2012. "Disagreement Among Forecasters in G7 Countries," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1081-1096, November.
    5. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
    6. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    7. Kenny, Geoff & Genre, Véronique & Meyler, Aidan & Timmermann, Allan, 2010. "Combining the forecasts in the ECB survey of professional forecasters: can anything beat the simple average?," Working Paper Series 1277, European Central Bank.
    8. Scharfstein, David S & Stein, Jeremy C, 1990. "Herd Behavior and Investment," American Economic Review, American Economic Association, vol. 80(3), pages 465-479, June.
    9. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    10. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    11. Gregory, Allan W & Smith, Gregor W & Yetman, James, 2001. "Testing for Forecast Consensus," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 34-43, January.
    12. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    13. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    14. O'brien, Patricia C., 1988. "Analysts' forecasts as earnings expectations," Journal of Accounting and Economics, Elsevier, vol. 10(1), pages 53-83, January.
    15. Chamley,Christophe P., 2004. "Rational Herds," Cambridge Books, Cambridge University Press, number 9780521530927.
    16. Clark, Todd E. & McCracken, Michael W., 2006. "The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1127-1148, August.
    17. Fischer, PE & Verrecchia, RE, 1998. "Correlated forecast errors," Journal of Accounting Research, Wiley Blackwell, vol. 36(1), pages 91-110.
    18. Engle, Robert F, 1983. "Estimates of the Variance of U.S. Inflation Based upon the ARCH Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 15(3), pages 286-301, August.
    19. Chamley,Christophe P., 2004. "Rational Herds," Cambridge Books, Cambridge University Press, number 9780521824019.
    20. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    21. Stein, Jeremy C., 2003. "Agency, information and corporate investment," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 2, pages 111-165, Elsevier.
    22. Patton, Andrew J. & Timmermann, Allan, 2010. "Why do forecasters disagree? Lessons from the term structure of cross-sectional dispersion," Journal of Monetary Economics, Elsevier, vol. 57(7), pages 803-820, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nikolay Iskrev & Pedro Pires Ribeiro & Sandra Gomes, 2021. "Euro area inflation expectations during the COVID-19 pandemic," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    2. Constantin Bürgi & Tara M. Sinclair, 2021. "What does forecaster disagreement tell us about the state of the economy?," Applied Economics Letters, Taylor & Francis Journals, vol. 28(1), pages 49-53, January.
    3. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    4. Atalla, Tarek & Joutz, Fred & Pierru, Axel, 2016. "Does disagreement among oil price forecasters reflect volatility? Evidence from the ECB surveys," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1178-1192.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    2. Pincheira-Brown, Pablo & Selaive, Jorge & Nolazco, Jose Luis, 2019. "Forecasting inflation in Latin America with core measures," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1060-1071.
    3. Firmin Doko Tchatoka & Qazi Haque, 2023. "On bootstrapping tests of equal forecast accuracy for nested models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1844-1864, November.
    4. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
    5. repec:zbw:bofrdp:037 is not listed on IDEAS
    6. Malte Knüppel & Fabian Krüger, 2022. "Forecast uncertainty, disagreement, and the linear pool," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 23-41, January.
    7. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    8. Ekaterini Panopoulou & Nikitas Pittis & Sarantis Kalyvitis, 2010. "Looking far in the past: revisiting the growth-returns nexus with non-parametric tests," Empirical Economics, Springer, vol. 38(3), pages 743-766, June.
    9. Krüger, Fabian & Nolte, Ingmar, 2016. "Disagreement versus uncertainty: Evidence from distribution forecasts," Journal of Banking & Finance, Elsevier, vol. 72(S), pages 172-186.
    10. Pincheira, Pablo & Hardy, Nicolas, 2022. "Correlation Based Tests of Predictability," MPRA Paper 112014, University Library of Munich, Germany.
    11. Ambrocio, Gene, 2017. "The real effects of overconfidence and fundamental uncertainty shocks," Research Discussion Papers 37/2017, Bank of Finland.
    12. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    13. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    14. Andrade, P. & Ghysels, E. & Idier, J., 2012. "Tails of Inflation Forecasts and Tales of Monetary Policy," Working papers 407, Banque de France.
    15. Conrad, Christian & Hartmann, Matthias, 2014. "Cross-sectional evidence on the relation between monetary policy, macroeconomic conditions and low-frequency inflation uncertainty," Working Papers 0574, University of Heidelberg, Department of Economics.
    16. Atalla, Tarek & Joutz, Fred & Pierru, Axel, 2016. "Does disagreement among oil price forecasters reflect volatility? Evidence from the ECB surveys," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1178-1192.
    17. Fernando Nascimento de Oliveira & Wagner Piazza Gaglianone, 2020. "Expectations anchoring indexes for Brazil using Kalman filter: Exploring signals of inflation anchoring in the long term," International Economics, CEPII research center, issue 163, pages 72-91.
    18. Riané de Bruyn & Rangan Gupta & Lardo Stander, 2013. "Testing the Monetary Model for Exchange Rate Determination in South Africa: Evidence from 101 Years of Data," Contemporary Economics, University of Economics and Human Sciences in Warsaw., vol. 7(1), March.
    19. Hartmann, Matthias & Herwartz, Helmut & Ulm, Maren, 2017. "A comparative assessment of alternative ex ante measures of inflation uncertainty," International Journal of Forecasting, Elsevier, vol. 33(1), pages 76-89.
    20. Robert W. Rich & Joseph Tracy, 2017. "The behavior of uncertainty and disagreement and their roles in economic prediction: a panel analysis," Staff Reports 808, Federal Reserve Bank of New York.
    21. Christian Grimme & Steffen Henzel & Elisabeth Wieland, 2014. "Inflation uncertainty revisited: a proposal for robust measurement," Empirical Economics, Springer, vol. 47(4), pages 1497-1523, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:29:y:2013:i:3:p:367-377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.