Advanced Search
MyIDEAS: Login to save this paper or follow this series

Improving forecasting performance by window and model averaging

Contents:

Author Info

  • Prasad S Bhattacharya

    ()

  • Dimitrios D Thomakos

    ()

Abstract

We present results from an extensive study on the benefits of rolling window and model averaging. Building on the recent work on rolling window averaging by Pesaran et al (2010, 2009) and on exchange rate forecasting by Molodtsova and Papell (2009), we explore whether rolling window averaging can be considered beneficial on a priori grounds, that is whether researchers can use it to improve forecasting performance and to avoid ‘window mining’ in short horizons. In addition, we investigate whether rolling window averaging can improve the performance of model averaging, especially when ‘simpler’ models are being used. Our results provide strong support for rolling window averaging, outperforming the best window forecasts more than 50% of the time across all rolling windows considered – with the outperformance being statistically significant. Furthermore, rolling window averaging smoothes out the forecast path and improves robustness of the forecasting model, thus minimizing the pitfalls associated with potential structural breaks. An illustrative simulation supports the proposed improvement with the double averaging approach. Afterwards the technique is applied in three datasets: exchange rates for 12 OECD countries, US inflation rate and US output growth rate. For exchange rates, we use the dataset of Molodtsova and Papell (2009) and replicate their analysis by considering rolling window and model averaging. The results reveal rolling window averaging can further improve the performance of the models and, in addition, when combined with model averaging brings forth the forecasting ability of ‘simpler’ economic models of exchange rates. With respect to US inflation and output growth forecasting, we again find that rolling window averaging outperforms the best individual window forecasts by more than 50% of the time, with significant differences from the benchmarks, and helps in model averaging by bringing forth the predictive power of economic variables in parsimonious models.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://cama.crawford.anu.edu.au/pdf/working-papers/2011/052011.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University in its series CAMA Working Papers with number 2011-05.

as in new window
Length: 38 pages
Date of creation: Mar 2011
Date of revision:
Handle: RePEc:een:camaaa:2011-05

Contact details of provider:
Postal: Crawford Building, Lennox Crossing, Building #132, Canberra ACT 0200
Phone: +61 2 6125 4705
Fax: +61 2 6125 5448
Email:
Web page: http://cama.crawford.anu.edu.au
More information through EDIRC

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, 05.
  2. Graham Elliott & Allan Timmermann, 2008. "Economic Forecasting," Journal of Economic Literature, American Economic Association, American Economic Association, vol. 46(1), pages 3-56, March.
  3. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, School of Economics and Management, University of Aarhus.
  4. Gourinchas, Pierre-Olivier & Rey, Hélène, 2005. "International Financial Adjustment," CEPR Discussion Papers, C.E.P.R. Discussion Papers 4923, C.E.P.R. Discussion Papers.
  5. Todd E. Clark & Kenneth D. West, 2004. "Using out-of-sample mean squared prediction errors to test the Martingale difference hypothesis," Research Working Paper, Federal Reserve Bank of Kansas City RWP 04-03, Federal Reserve Bank of Kansas City.
  6. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, American Economic Association, vol. 41(3), pages 788-829, September.
  7. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, American Economic Association, vol. 85(1), pages 201-18, March.
  8. Giacomini, Raffaella & Rossi, Barbara, 2006. "Detecting and predicting forecast breakdowns," Working Paper Series, European Central Bank 0638, European Central Bank.
  9. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
  10. Charles Engel & Kenneth D. West, 2003. "Exchange rates and fundamentals," Proceedings, Federal Reserve Bank of San Francisco, Federal Reserve Bank of San Francisco, issue Mar.
  11. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 20(2), pages 147-62, April.
  12. M. Hashem Pesaran & Til Schuermann & L. Vanessa Smith, 2008. "Forecasting Economic and Financial Variables with Global VARs," CESifo Working Paper Series 2263, CESifo Group Munich.
  13. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, Elsevier, vol. 129(1-2), pages 183-217.
  14. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, Elsevier, vol. 44(2), pages 293-335, October.
  15. Athanasopoulos, George & Vahid, Farshid, 2008. "VARMA versus VAR for Macroeconomic Forecasting," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 26, pages 237-252, April.
  16. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, Elsevier, vol. 77(2), pages 167-180, April.
  17. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
  18. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, Royal Economic Society, vol. 7(1), pages 1-31, 06.
  19. James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues, Federal Reserve Bank of Chicago 94-13, Federal Reserve Bank of Chicago.
  20. Andrew Ang & Geert Bekaert & Min Wei, 2005. "Do Macro Variables, Asset Markets or Surveys Forecast Inflation Better?," NBER Working Papers 11538, National Bureau of Economic Research, Inc.
  21. Cheung, Yin-Wong & Chinn, Menzie David & Garcia Pascual, Antonio, 2003. "Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?," Santa Cruz Department of Economics, Working Paper Series qt12z9x4c5, Department of Economics, UC Santa Cruz.
  22. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
  23. Andrew Patton & Dimitris Politis & Halbert White, 2009. "Correction to “Automatic Block-Length Selection for the Dependent Bootstrap” by D. Politis and H. White," Econometric Reviews, Taylor & Francis Journals, Taylor & Francis Journals, vol. 28(4), pages 372-375.
  24. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, Blackwell Publishing, vol. 39(s1), pages 3-33, 02.
  25. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, Taylor & Francis Journals, vol. 23(1), pages 53-70.
  26. Mark, Nelson C. & Sul, Donggyu, 2001. "Nominal exchange rates and monetary fundamentals: Evidence from a small post-Bretton woods panel," Journal of International Economics, Elsevier, Elsevier, vol. 53(1), pages 29-52, February.
  27. Lucio Sarno & Giorgio Valente, 2009. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," Journal of the European Economic Association, MIT Press, MIT Press, vol. 7(4), pages 786-830, 06.
  28. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using Vecx* Models: an Exercise in Forecast Combination Across Models and Observation Windows," National Institute Economic Review, National Institute of Economic and Social Research, National Institute of Economic and Social Research, vol. 203(1), pages 91-108, January.
  29. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Rejoinder to comments on forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, Elsevier, vol. 25(4), pages 703-715, October.
  30. Groen, Jan J J, 2005. "Exchange Rate Predictability and Monetary Fundamentals in a Small Multi-country Panel," Journal of Money, Credit and Banking, Blackwell Publishing, Blackwell Publishing, vol. 37(3), pages 495-516, June.
  31. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, Elsevier, vol. 13(3), pages 274-315, June.
  32. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, Elsevier, vol. 5(4), pages 559-583.
  33. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 13(3), pages 253-63, July.
  34. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
  35. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
  36. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, Elsevier, vol. 137(1), pages 134-161, March.
  37. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, Elsevier, vol. 14(1-2), pages 3-24, February.
  38. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  39. Papell, David H., 2006. "The Panel Purchasing Power Parity Puzzle," Journal of Money, Credit and Banking, Blackwell Publishing, Blackwell Publishing, vol. 38(2), pages 447-467, March.
  40. Rapach, David E. & Wohar, Mark E., 2002. "Testing the monetary model of exchange rate determination: new evidence from a century of data," Journal of International Economics, Elsevier, Elsevier, vol. 58(2), pages 359-385, December.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Dimitrios D. Thomakos & Fotis Papailias, 2013. "Covariance Averaging for Improved Estimation and Portfolio Allocation," Working Paper Series, The Rimini Centre for Economic Analysis 66_13, The Rimini Centre for Economic Analysis.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:een:camaaa:2011-05. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Cama Admin).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.