IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v40y2021i4p686-699.html
   My bibliography  Save this article

An approach to increasing forecast‐combination accuracy through VAR error modeling

Author

Listed:
  • Till Weigt
  • Bernd Wilfling

Abstract

We consider a situation in which the forecaster has available M individual forecasts of a univariate target variable. We propose a 3‐step procedure designed to exploit the interrelationships among the M forecast‐error series (estimated from a large time‐varying parameter VAR model of the errors, using past observations) with the aim of obtaining more accurate predictions of future forecast errors. The refined future forecast‐error predictions are then used to obtain M new individual forecasts that are adapted to the information from the estimated VAR. The adapted M individual forecasts are ultimately combined and any potential accuracy gains from the adapted combination forecasts analyzed. We evaluate our approach in an out‐of‐sample forecasting analysis, using a well‐established 7‐country data set on output growth. Our 3‐step procedure yields substantial accuracy gains (in terms of loss reductions of up to 18%) for the simple average and three time‐varying‐parameter combination forecasts.

Suggested Citation

  • Till Weigt & Bernd Wilfling, 2021. "An approach to increasing forecast‐combination accuracy through VAR error modeling," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(4), pages 686-699, July.
  • Handle: RePEc:wly:jforec:v:40:y:2021:i:4:p:686-699
    DOI: 10.1002/for.2733
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2733
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2733?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," LIDAM Discussion Papers CORE 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    5. Dimitris Korobilis, 2013. "Var Forecasting Using Bayesian Variable Selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 204-230, March.
    6. Koop, Gary & Korobilis, Dimitris, 2016. "Model uncertainty in Panel Vector Autoregressive models," European Economic Review, Elsevier, vol. 81(C), pages 115-131.
    7. Fabio Canova & Matteo Ciccarelli, 2009. "Estimating Multicountry Var Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(3), pages 929-959, August.
    8. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    9. Christiane Baumeister & Lutz Kilian, 2015. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
    10. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    11. Onorante, Luca & Raftery, Adrian E., 2016. "Dynamic model averaging in large model spaces using dynamic Occam׳s window," European Economic Review, Elsevier, vol. 81(C), pages 2-14.
    12. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    13. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    14. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    15. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    16. Reichlin, Lucrezia & Giannone, Domenico & De Mol, Christine, 2006. "Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components?," CEPR Discussion Papers 5829, C.E.P.R. Discussion Papers.
    17. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    18. LeSage, James P & Magura, Michael, 1992. "A Mixture-Model Approach to Combining Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 445-452, October.
    19. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    20. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    21. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    22. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
    23. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    24. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    25. George, Edward I. & Sun, Dongchu & Ni, Shawn, 2008. "Bayesian stochastic search for VAR model restrictions," Journal of Econometrics, Elsevier, vol. 142(1), pages 553-580, January.
    26. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    27. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    28. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    29. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    30. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    31. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    32. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Verena Monschang & Bernd Wilfling, 2022. "A procedure for upgrading linear-convex combination forecasts with an application to volatility prediction," CQE Working Papers 9722, Center for Quantitative Economics (CQE), University of Muenster.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    2. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    3. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.
    4. Gary Koop, 2012. "Using VARs and TVP-VARs with Many Macroeconomic Variables," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 4(3), pages 143-167, September.
    5. Michael S. Smith & Shaun P. Vahey, 2016. "Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 416-434, July.
    6. Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Adaptive hierarchical priors for high-dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 212(1), pages 241-271.
    7. Miranda-Agrippino, Silvia & Ricco, Giovanni, 2018. "Bayesian Vector Autoregressions," The Warwick Economics Research Paper Series (TWERPS) 1159, University of Warwick, Department of Economics.
    8. Korobilis, Dimitris, 2016. "Prior selection for panel vector autoregressions," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 110-120.
    9. Koop, Gary & Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Bayesian compressed vector autoregressions," Journal of Econometrics, Elsevier, vol. 210(1), pages 135-154.
    10. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    11. repec:hal:spmain:info:hdl:2441/27od5pb99881folvtfs8s3k16l is not listed on IDEAS
    12. Korobilis, Dimitris, 2015. "Prior selection for panel vector autoregressions," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-73, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    13. Pestova, Anna & Mamonov, Mikhail, 2019. "Should we care? : The economic effects of financial sanctions on the Russian economy," BOFIT Discussion Papers 13/2019, Bank of Finland, Institute for Economies in Transition.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Gunter, Ulrich & Önder, Irem, 2016. "Forecasting city arrivals with Google Analytics," Annals of Tourism Research, Elsevier, vol. 61(C), pages 199-212.
    16. repec:zbw:bofitp:2019_013 is not listed on IDEAS
    17. Cross, Jamie L. & Hou, Chenghan & Poon, Aubrey, 2020. "Macroeconomic forecasting with large Bayesian VARs: Global-local priors and the illusion of sparsity," International Journal of Forecasting, Elsevier, vol. 36(3), pages 899-915.
    18. Gary Koop & Dimitris Korobilis, 2019. "Forecasting with High‐Dimensional Panel VARs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(5), pages 937-959, October.
    19. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    20. George Kapetanios & Massimiliano Marcellino & Fabrizio Venditti, 2019. "Large time‐varying parameter VARs: A nonparametric approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1027-1049, November.
    21. Joshua C. C. Chan, 2019. "Large Bayesian vector autoregressions," CAMA Working Papers 2019-19, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    22. Inske Pirschel & Maik H. Wolters, 2018. "Forecasting with large datasets: compressing information before, during or after the estimation?," Empirical Economics, Springer, vol. 55(2), pages 573-596, September.

    More about this item

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:40:y:2021:i:4:p:686-699. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.