IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/10451.html
   My bibliography  Save this paper

Predictive gains from forecast combinations using time-varying model weights

Author

Listed:
  • Ravazzolo, F.
  • van Dijk, H.K.
  • Verbeek, M.J.C.M.

Abstract

Several frequentist and Bayesian model averaging schemes, including a new one that simultaneously allows for parameter uncertainty, model uncertainty and time varying model weights, are compared in terms of forecast accuracy over a set of simulation experiments. Artificial data are generated, characterized by low predictability, structural instability, and fat tails, which is typical for many financial-economic time series. Sensitivity of results with respect to misspecification of the number of included predictors and the number of included models is explored. Given the set up of our experiments, time varying model weight schemes outperform other averaging schemes in terms of predictive gains both when the correlation among individual forecasts is low and the underlying data generating process is subject to structural locations shifts. In an empirical application using returns on the S&P 500 index, time varying model weights provide improved forecasts with substantial economic gains in an investment strategy including transaction costs.

Suggested Citation

  • Ravazzolo, F. & van Dijk, H.K. & Verbeek, M.J.C.M., 2007. "Predictive gains from forecast combinations using time-varying model weights," Econometric Institute Research Papers EI 2007-26, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  • Handle: RePEc:ems:eureir:10451
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/10451/ei2007-26_rev2.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Harvey, Andrew C. & Trimbur, Thomas M. & Van Dijk, Herman K., 2007. "Trends and cycles in economic time series: A Bayesian approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 618-649, October.
    2. Guidolin, Massimo & Timmermann, Allan, 2009. "Forecasts of US short-term interest rates: A flexible forecast combination approach," Journal of Econometrics, Elsevier, vol. 150(2), pages 297-311, June.
    3. Marquering, Wessel & Verbeek, Marno, 2004. "The Economic Value of Predicting Stock Index Returns and Volatility," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(2), pages 407-429, June.
    4. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
    5. Rodney Strachan & Herman K. van Dijk, "undated". "Bayesian Model Averaging in Vector Autoregressive Processes with an Investigation of Stability of the US Great Ratios and Risk of a Liquidity Trap in the USA, UK and Japan," MRG Discussion Paper Series 1407, School of Economics, University of Queensland, Australia.
    6. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    7. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    8. Ravazzolo, F. & van Dijk, D.J.C. & Paap, R. & Franses, Ph.H.B.F., 2006. "Bayesian Model Averaging in the Presence of Structural Breaks," Econometric Institute Research Papers EI 2006-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. French, Kenneth R. & Schwert, G. William & Stambaugh, Robert F., 1987. "Expected stock returns and volatility," Journal of Financial Economics, Elsevier, vol. 19(1), pages 3-29, September.
    10. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    11. K. J. Martijn Cremers, 2002. "Stock Return Predictability: A Bayesian Model Selection Perspective," Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1223-1249.
    12. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    13. Sven Bouman & Ben Jacobsen, 2002. "The Halloween Indicator, "Sell in May and Go Away": Another Puzzle," American Economic Review, American Economic Association, vol. 92(5), pages 1618-1635, December.
    14. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    3. Lennart Hoogerheide & Richard Kleijn & Francesco Ravazzolo & Herman K. Van Dijk & Marno Verbeek, 2010. "Forecast accuracy and economic gains from Bayesian model averaging using time-varying weights," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 251-269.
    4. de Pooter, M.D. & Ravazzolo, F. & Segers, R. & van Dijk, H.K., 2008. "Bayesian near-boundary analysis in basic macroeconomic time series models," Econometric Institute Research Papers EI 2008-13, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    5. David Bolder & Yuliya Romanyuk, 2008. "Combining Canadian Interest-Rate Forecasts," Staff Working Papers 08-34, Bank of Canada.
    6. A.S.M. Arroyo & A. de Juan Fern¨¢ndez, 2014. "Split-then-Combine Method for out-of-sample Combinations of Forecasts," Journal of Business Administration Research, Journal of Business Administration Research, Sciedu Press, vol. 3(1), pages 19-37, April.
    7. Emilian Dobrescu, 2014. "A Hybrid Forecasting Approach," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 16(35), pages 390-390, February.
    8. Eric J. Bartelsman & Zoltan Wolf, 2014. "Forecasting Aggregate Productivity Using Information from Firm-Level Data," The Review of Economics and Statistics, MIT Press, vol. 96(4), pages 745-755, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lennart Hoogerheide & Richard Kleijn & Francesco Ravazzolo & Herman K. Van Dijk & Marno Verbeek, 2010. "Forecast accuracy and economic gains from Bayesian model averaging using time-varying weights," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 251-269.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. De Pooter, Michiel & Ravazzolo, Francesco & van Dijk, Dick, 2006. "Predicting the term structure of interest rates incorporating parameter uncertainty, model uncertainty and macroeconomic information," MPRA Paper 2512, University Library of Munich, Germany, revised 03 Mar 2007.
    4. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    5. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    6. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    7. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    8. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
    9. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    10. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    11. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    12. Chun Liu & John M. Maheu, 2009. "Forecasting realized volatility: a Bayesian model-averaging approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 709-733.
    13. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.
    14. Jonathan H. Wright, 2009. "Forecasting US inflation by Bayesian model averaging," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 131-144.
    15. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    16. David Bolder & Yuliya Romanyuk, 2008. "Combining Canadian Interest-Rate Forecasts," Staff Working Papers 08-34, Bank of Canada.
    17. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    18. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    19. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    20. Hyun Hak Kim & Norman Swanson, 2013. "Mining Big Data Using Parsimonious Factor and Shrinkage Methods," Departmental Working Papers 201316, Rutgers University, Department of Economics.

    More about this item

    Keywords

    Bayesian model averaging; forecast combination; stock return predictability; time-varying weight combination;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:10451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.