IDEAS home Printed from https://ideas.repec.org/p/dkn/econwp/eco_2011_1.html
   My bibliography  Save this paper

Improving forecasting performance by window and model averaging

Author

Listed:
  • Prasad S Bhattacharya

    ()

  • Dimitrios D Thomakos

    ()

Abstract

This study presents extensive results on the benefits of rolling window and model averaging. Building on the recent work on rolling window averaging by Pesaran et al (2010, 2009) and on exchange rate forecasting by Molodtsova and Papell (2009), we explore whether rolling window averaging can be considered beneficial on a priori grounds. We investigate whether rolling window averaging can improve the performance of model averaging, especially when ‘simpler’ models are used. The analysis provides strong support for rolling window averaging, outperforming the best window forecasts more than 50% of the time across all rolling windows. Furthermore, rolling window averaging smoothes out the forecast path, improves robustness, and minimizes the pitfalls associated with potential structural breaks.

Suggested Citation

  • Prasad S Bhattacharya & Dimitrios D Thomakos, 2011. "Improving forecasting performance by window and model averaging," Economics Series 2011_1, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
  • Handle: RePEc:dkn:econwp:eco_2011_1
    as

    Download full text from publisher

    File URL: http://www.deakin.edu.au/buslaw/aef/workingpapers/papers/2011_1.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
    2. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    3. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    4. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
    5. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    6. Lucio Sarno & Giorgio Valente, 2009. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 786-830, June.
    7. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    8. Charles Engel & Kenneth D. West, 2005. "Exchange Rates and Fundamentals," Journal of Political Economy, University of Chicago Press, vol. 113(3), pages 485-517, June.
    9. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 642-675, October.
    10. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," Review of Economic Studies, Oxford University Press, pages 669-705.
    11. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using VECX* Models: An Exercise in Forecast Combination Across Modelsand Observation Windows," Working Papers 2008-03, Swiss National Bank.
    12. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    13. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    14. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    15. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Rejoinder to comments on forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 703-715, October.
    16. Rapach, David E. & Wohar, Mark E., 2002. "Testing the monetary model of exchange rate determination: new evidence from a century of data," Journal of International Economics, Elsevier, vol. 58(2), pages 359-385, December.
    17. Athanasopoulos, George & Vahid, Farshid, 2008. "VARMA versus VAR for Macroeconomic Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 237-252, April.
    18. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    19. Papell, David H., 2006. "The Panel Purchasing Power Parity Puzzle," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(2), pages 447-467, March.
    20. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    21. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740, June.
    22. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    23. Andrew Patton & Dimitris Politis & Halbert White, 2009. "Correction to “Automatic Block-Length Selection for the Dependent Bootstrap” by D. Politis and H. White," Econometric Reviews, Taylor & Francis Journals, vol. 28(4), pages 372-375.
    24. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, December.
    25. Groen, Jan J J, 2005. "Exchange Rate Predictability and Monetary Fundamentals in a Small Multi-country Panel," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 495-516, June.
    26. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, Elsevier.
    27. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    28. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    29. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, vol. 77(2), pages 167-180, April.
    30. Mark, Nelson C. & Sul, Donggyu, 2001. "Nominal exchange rates and monetary fundamentals: Evidence from a small post-Bretton woods panel," Journal of International Economics, Elsevier, vol. 53(1), pages 29-52, February.
    31. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
    32. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    33. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    34. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    35. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using Vecx* Models: an Exercise in Forecast Combination Across Models and Observation Windows," National Institute Economic Review, National Institute of Economic and Social Research, vol. 203(1), pages 91-108, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fotis Papailias & Dimitrios Thomakos, 2015. "Covariance averaging for improved estimation and portfolio allocation," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 29(1), pages 31-59, February.

    More about this item

    Keywords

    Exchange rate forecasting; inflation forecasting; output growth forecasting; rolling window; model averaging; short horizon; robustness.;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • F31 - International Economics - - International Finance - - - Foreign Exchange
    • F47 - International Economics - - Macroeconomic Aspects of International Trade and Finance - - - Forecasting and Simulation: Models and Applications
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dkn:econwp:eco_2011_1. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xueli Tang). General contact details of provider: http://edirc.repec.org/data/bsdeaau.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.