IDEAS home Printed from https://ideas.repec.org/p/een/camaaa/2011-05.html
   My bibliography  Save this paper

Improving forecasting performance by window and model averaging

Author

Listed:
  • Prasad S Bhattacharya
  • Dimitrios D Thomakos

Abstract

This study presents extensive results on the benefits of rolling window and model averaging. Building on the recent work on rolling window averaging by Pesaran et al (2010, 2009) and on exchange rate forecasting by Molodtsova and Papell (2009), we explore whether rolling window averaging can be considered beneficial on a priori grounds. We investigate whether rolling window averaging can improve the performance of model averaging, especially when 'simpler' models are used. The analysis provides strong support for rolling window averaging, outperforming the best window forecasts more than 50% of the time across all rolling windows. Furthermore, rolling window averaging smoothes out the forecast path, improves robustness, and minimizes the pitfalls associated with potential structural breaks.

Suggested Citation

  • Prasad S Bhattacharya & Dimitrios D Thomakos, 2011. "Improving forecasting performance by window and model averaging," CAMA Working Papers 2011-05, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
  • Handle: RePEc:een:camaaa:2011-05
    as

    Download full text from publisher

    File URL: https://cama.crawford.anu.edu.au/sites/default/files/publication/cama_crawford_anu_edu_au/2021-06/5_bhattacharya_thomakos_2011.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lucio Sarno & Giorgio Valente, 2009. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 786-830, June.
    2. Charles Engel & Kenneth D. West, 2005. "Exchange Rates and Fundamentals," Journal of Political Economy, University of Chicago Press, vol. 113(3), pages 485-517, June.
    3. Assenmacher-Wesche, Katrin & Pesaran, M. Hashem, 2008. "Forecasting the Swiss economy using VECX models: An exercise in forecast combination across models and observation windows," National Institute Economic Review, Cambridge University Press, vol. 203, pages 91-108, January.
    4. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    5. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    6. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    7. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    8. Mark, Nelson C. & Sul, Donggyu, 2001. "Nominal exchange rates and monetary fundamentals: Evidence from a small post-Bretton woods panel," Journal of International Economics, Elsevier, vol. 53(1), pages 29-52, February.
    9. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 669-705.
    10. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 642-675, October.
    11. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    12. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    13. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    14. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    15. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    16. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    17. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, October.
    18. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, vol. 77(2), pages 167-180, April.
    19. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    20. Athanasopoulos, George & Vahid, Farshid, 2008. "VARMA versus VAR for Macroeconomic Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 237-252, April.
    21. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
    22. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    23. Rapach, David E. & Wohar, Mark E., 2002. "Testing the monetary model of exchange rate determination: new evidence from a century of data," Journal of International Economics, Elsevier, vol. 58(2), pages 359-385, December.
    24. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    25. Andrew Patton & Dimitris Politis & Halbert White, 2009. "Correction to “Automatic Block-Length Selection for the Dependent Bootstrap” by D. Politis and H. White," Econometric Reviews, Taylor & Francis Journals, vol. 28(4), pages 372-375.
    26. Groen, Jan J J, 2005. "Exchange Rate Predictability and Monetary Fundamentals in a Small Multi-country Panel," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 495-516, June.
    27. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    28. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    29. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
    30. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    31. Katrin Assenmacher-Wesche & M. Hashem Pesaran, 2008. "Forecasting the Swiss Economy Using Vecx* Models: an Exercise in Forecast Combination Across Models and Observation Windows," National Institute Economic Review, National Institute of Economic and Social Research, vol. 203(1), pages 91-108, January.
    32. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    33. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Rejoinder to comments on forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 703-715, October.
    34. Papell, David H., 2006. "The Panel Purchasing Power Parity Puzzle," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(2), pages 447-467, March.
    35. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    36. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    37. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fotis Papailias & Dimitrios Thomakos, 2015. "Covariance averaging for improved estimation and portfolio allocation," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 29(1), pages 31-59, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    3. Wu, Jyh-Lin & Wang, Yi-Chiuan, 2013. "Fundamentals, forecast combinations and nominal exchange-rate predictability," International Review of Economics & Finance, Elsevier, vol. 25(C), pages 129-145.
    4. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    5. Ren, Yu & Liang, Xuanxuan & Wang, Qin, 2021. "Short-term exchange rate forecasting: A panel combination approach," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 73(C).
    6. Lasha Kavtaradze & Manouchehr Mokhtari, 2018. "Factor Models And Time†Varying Parameter Framework For Forecasting Exchange Rates And Inflation: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 302-334, April.
    7. Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2018. "On The Sources Of Uncertainty In Exchange Rate Predictability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(1), pages 329-357, February.
    8. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    9. Byrne, Joseph P. & Korobilis, Dimitris & Ribeiro, Pinho J., 2016. "Exchange rate predictability in a changing world," Journal of International Money and Finance, Elsevier, vol. 62(C), pages 1-24.
    10. Engel, Charles, 2014. "Exchange Rates and Interest Parity," Handbook of International Economics, in: Gopinath, G. & Helpman, . & Rogoff, K. (ed.), Handbook of International Economics, edition 1, volume 4, chapter 0, pages 453-522, Elsevier.
    11. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    12. Daniel Andrés Jaimes Cárdenas & jair Ojeda Joya, 2010. "Reglas de Taylor y previsibilidad fuera de muestra de la tasa de cambio en Latinoamérica," BORRADORES DE ECONOMIA 007308, BANCO DE LA REPÚBLICA.
    13. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    14. Galimberti, Jaqueson K. & Moura, Marcelo L., 2013. "Taylor rules and exchange rate predictability in emerging economies," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 1008-1031.
    15. Jamali, Ibrahim & Yamani, Ehab, 2019. "Out-of-sample exchange rate predictability in emerging markets: Fundamentals versus technical analysis," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 61(C), pages 241-263.
    16. Byrne, Joseph P. & Korobilis, Dimitris & Ribeiro, Pinho J., 2014. "On the Sources of Uncertainty in Exchange Rate Predictability," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-24, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    17. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2010. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," NBER International Seminar on Macroeconomics, University of Chicago Press, vol. 6(1), pages 125-173.
    18. Jiahan Li & Ilias Tsiakas & Wei Wang, 2015. "Predicting Exchange Rates Out of Sample: Can Economic Fundamentals Beat the Random Walk?," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 13(2), pages 293-341.
    19. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    20. Amat, Christophe & Michalski, Tomasz & Stoltz, Gilles, 2018. "Fundamentals and exchange rate forecastability with simple machine learning methods," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 1-24.

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • F31 - International Economics - - International Finance - - - Foreign Exchange
    • F47 - International Economics - - Macroeconomic Aspects of International Trade and Finance - - - Forecasting and Simulation: Models and Applications
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:een:camaaa:2011-05. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cama Admin (email available below). General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.