Advanced Search
MyIDEAS: Login to save this paper or follow this series

Forecasting with Many Models: Model Confidence Sets and Forecast Combination

Contents:

Author Info

  • Jon D. Samuels
  • Rodrigo Sekkel
Registered author(s):

    Abstract

    A longstanding finding in the forecasting literature is that averaging forecasts from different models often improves upon forecasts based on a single model, with equal weight averaging working particularly well. This paper analyzes the effects of trimming the set of models prior to averaging. We compare different trimming schemes and propose a new one based on Model Confidence Sets that take into account the statistical significance of historical out-of-sample forecasting performance. In an empirical application of forecasting U.S. macroeconomic indicators, we find significant gains in out-of-sample forecast accuracy from our proposed trimming method.

    Download Info

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
    File URL: http://www.bankofcanada.ca/wp-content/uploads/2013/04/wp2013-11.pdf
    Download Restriction: no

    Bibliographic Info

    Paper provided by Bank of Canada in its series Working Papers with number 13-11.

    as in new window
    Length: 50 pages
    Date of creation: 2013
    Date of revision:
    Handle: RePEc:bca:bocawp:13-11

    Contact details of provider:
    Postal: 234 Wellington Street, Ottawa, Ontario, K1A 0G9, Canada
    Phone: 613 782-8845
    Fax: 613 782-8874
    Web page: http://www.bank-banque-canada.ca/

    Related research

    Keywords: Econometric and statistical methods;

    Find related papers by JEL classification:

    This paper has been announced in the following NEP Reports:

    References

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
    as in new window
    1. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    2. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, School of Economics and Management, University of Aarhus.
    3. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    4. Hilde C. Bjørnland & Karsten Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2009. "Does forecast combination improve Norges Bank inflation forecasts?," Working Paper 2009/01, Norges Bank.
    5. Ben S. Bernanke & Jean Boivin, 2001. "Monetary Policy in a Data-Rich Environment," NBER Working Papers 8379, National Bureau of Economic Research, Inc.
    6. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, 09.
    7. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    8. Jon Faust & Simon Gilchrist & Jonathan H. Wright & Egon Zakrajsek, 2011. "Credit Spreads as Predictors of Real-Time Economic Activity: A Bayesian Model-Averaging Approach," NBER Working Papers 16725, National Bureau of Economic Research, Inc.
    9. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
    10. Carmen Fernandez & Eduardo Ley & Mark Steel, 2001. "Model uncertainty in cross-country growth regressions," Econometrics 0110002, EconWPA.
    11. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    12. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
    13. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
    14. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as in new window

    Cited by:
    1. Julieta Fuentes & Pilar Poncela & Julio Rodríguez, 2014. "Selecting and combining experts from survey forecasts," Statistics and Econometrics Working Papers ws140905, Universidad Carlos III, Departamento de Estadística y Econometría.

    Lists

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    Statistics

    Access and download statistics

    Corrections

    When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:13-11. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.