IDEAS home Printed from https://ideas.repec.org/p/bno/worpap/2009_19.html
   My bibliography  Save this paper

Evaluating ensemble density combination - forecasting GDP and inflation

Author

Listed:
  • Karsten R. Gerdrup

    () (Norges Bank (Central Bank of Norway))

  • Anne Sofie Jore

    () (Norges Bank (Central Bank of Norway))

  • Christie Smith

    (Reserve Bank of New Zealand)

  • Leif Anders Thorsrud

    () (Norges Bank (Central Bank of Norway))

Abstract

Forecast combination has become popular in central banks as a means to improve forecasts and to alleviate the risk of selecting poor models. However, if a model suite is populated with many similar models, then the weight attached to other independent models may be lower than warranted by their performance. One way to mitigate this problem is to group similar models into distinct `ensembles'. Using the original suite of models in Norges Bank's system for averaging models (SAM), we evaluate whether forecast performance can be improved by combining ensemble densities, rather than combining individual model densities directly. We evaluate performance both in terms of point forecasts and density forecasts, and test whether the densities are well-calibrated. We find encouraging results for combining ensembles.

Suggested Citation

  • Karsten R. Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2009. "Evaluating ensemble density combination - forecasting GDP and inflation," Working Paper 2009/19, Norges Bank.
    • Handle: RePEc:bno:worpap:2009_19
    as

    Download full text from publisher

    File URL: http://www.norges-bank.no/en/Published/Papers/Working-Papers/2009/WP-200919/
    Download Restriction: no

    References listed on IDEAS

    as
    1. Hilde C. Bjørnland & Karsten Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2012. "Does Forecast Combination Improve Norges Bank Inflation Forecasts?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 163-179, April.
    2. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    3. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    4. Dr. James Mitchell, 2009. "Macro Modelling with Many Models," National Institute of Economic and Social Research (NIESR) Discussion Papers 337, National Institute of Economic and Social Research.
    5. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    6. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, Elsevier.
    7. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, Elsevier.
    8. Wolden Bache, Ida & Sofie Jore, Anne & Mitchell, James & Vahey, Shaun P., 2011. "Combining VAR and DSGE forecast densities," Journal of Economic Dynamics and Control, Elsevier, vol. 35(10), pages 1659-1670, October.
    9. repec:nsr:niesrd:337 is not listed on IDEAS
    10. Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
    11. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    12. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    13. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    14. Knut Aastveit & Tørres Trovik, 2012. "Nowcasting norwegian GDP: the role of asset prices in a small open economy," Empirical Economics, Springer, vol. 42(1), pages 95-119, February.
    15. Robert L. Winkler, 1981. "Combining Probability Distributions from Dependent Information Sources," Management Science, INFORMS, vol. 27(4), pages 479-488, April.
    16. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    17. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    18. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    19. Troy D. Matheson, 2006. "Factor Model Forecasts for New Zealand," International Journal of Central Banking, International Journal of Central Banking, vol. 2(2), May.
    20. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    21. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR 'Fan' Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    22. Amisano, Gianni & Geweke, John, 2008. "Comparing and evaluating Bayesian predictive distributions of assets returns," Working Paper Series 969, European Central Bank.
    23. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    24. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
    25. Ang, Andrew & Piazzesi, Monika & Wei, Min, 2006. "What does the yield curve tell us about GDP growth?," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 359-403.
    26. Ida Wolden Bache & James Mitchell & Francesco Ravazzolo & Shaun P. Vahey, 2009. "Macro modelling with many models," Working Paper 2009/15, Norges Bank.
    27. Robert T. Clemen, 1987. "Combining Overlapping Information," Management Science, INFORMS, vol. 33(3), pages 373-380, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    2. Skrove Falch, Nina & Nymoen, Ragnar, 2011. "The accuracy of a forecast targeting central bank," Economics - The Open-Access, Open-Assessment E-Journal, Kiel Institute for the World Economy (IfW), vol. 5, pages 1-36.

    More about this item

    Keywords

    forecasting; density combination; model combination; clustering; ensemble density; pits.;

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bno:worpap:2009_19. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://edirc.repec.org/data/nbgovno.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.