IDEAS home Printed from https://ideas.repec.org/p/upf/upfgen/1435.html
   My bibliography  Save this paper

Rolling window selection for out-of-sample forecasting with time-varying parameters

Author

Abstract

While forecasting is a common practice in academia, government and business alike, practitioners are often left wondering how to choose the sample for estimating forecasting models. When we forecast inflation in 2018, for example, should we use the last 30 years of data or the last 10 years of data? There is strong evidence of structural changes in economic time series, and the forecasting performance is often quite sensitive to the choice of such window size. In this paper, we develop a novel method for selecting the estimation window size for forecasting. Specifically, we propose to choose the optimal window size that minimizes the forecaster's quadratic loss function, and we prove the asymptotic validity of our approach. Our Monte Carlo experiments show that our method performs quite well under various types of structural changes. When applied to forecasting US real output growth and inflation, the proposed method tends to improve upon conventional methods, especially for output growth.

Suggested Citation

  • Atsushi Inoue & Lu Jin & Barbara Rossi, 2014. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Economics Working Papers 1435, Department of Economics and Business, Universitat Pompeu Fabra, revised Apr 2016.
  • Handle: RePEc:upf:upfgen:1435
    as

    Download full text from publisher

    File URL: https://econ-papers.upf.edu/papers/1435.pdf
    File Function: Whole Paper
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    2. Hartmut Egger & Udo Kreickemeier & Jens Wrona, 2017. "Offshoring Domestic Jobs," World Scientific Book Chapters,in: International Trade and Labor Markets Welfare, Inequality and Unemployment, chapter 2, pages 27-70 World Scientific Publishing Co. Pte. Ltd..
    3. Christian Broda & David E. Weinstein, 2006. "Globalization and the Gains From Variety," The Quarterly Journal of Economics, Oxford University Press, vol. 121(2), pages 541-585.
    4. Richard Meese & Kenneth Rogoff, 1983. "The Out-of-Sample Failure of Empirical Exchange Rate Models: Sampling Error or Misspecification?," NBER Chapters,in: Exchange Rates and International Macroeconomics, pages 67-112 National Bureau of Economic Research, Inc.
    5. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    6. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 669-705.
    7. David H. Autor & David Dorn & Gordon H. Hanson, 2013. "The China Syndrome: Local Labor Market Effects of Import Competition in the United States," American Economic Review, American Economic Association, vol. 103(6), pages 2121-2168, October.
    8. Arnaud Costinot & Jonathan Vogel & Su Wang, 2013. "An Elementary Theory of Global Supply Chains," Review of Economic Studies, Oxford University Press, vol. 80(1), pages 109-144.
    9. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    10. Suqin Ge & Dennis Tao Yang, 2014. "Changes In China'S Wage Structure," Journal of the European Economic Association, European Economic Association, vol. 12(2), pages 300-336, April.
    11. Robert C. Feenstra & Gene M. Grossman & Douglas A. Irwin (ed.), 1996. "The Political Economy of Trade Policy: Papers in Honor of Jagdish Bhagwati," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061864, March.
    12. Alireza Naghavi & Gianmarco Ottaviano, 2009. "Offshoring and product innovation," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 38(3), pages 517-532, March.
    13. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    14. Yu-Chin Chen & Kenneth S. Rogoff & Barbara Rossi, 2010. "Can Exchange Rates Forecast Commodity Prices?," The Quarterly Journal of Economics, Oxford University Press, vol. 125(3), pages 1145-1194.
    15. Domenico Ferraro & Kenneth S. Rogoff & Barbara Rossi, 2011. "Can oil prices forecast exchange rates?," Working Papers 11-34, Federal Reserve Bank of Philadelphia.
    16. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    17. Pasquale Della Corte & Lucio Sarno & Giulia Sestieri, 2012. "The Predictive Information Content of External Imbalances for Exchange Rate Returns: How Much Is It Worth?," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 100-115, February.
    18. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    19. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    20. Kiley, Michael T, 1999. "The Supply of Skilled Labour and Skill-Biased Technological Progress," Economic Journal, Royal Economic Society, vol. 109(458), pages 708-724, October.
    21. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2010. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," NBER International Seminar on Macroeconomics, University of Chicago Press, vol. 6(1), pages 125-173.
    22. Acemoglu, Daron & Gancia, Gino & Zilibotti, Fabrizio, 2012. "Competing engines of growth: Innovation and standardization," Journal of Economic Theory, Elsevier, vol. 147(2), pages 570-601.3.
    23. Costas Arkolakis & Natalia Ramondo & Andrés Rodríguez-Clare & Stephen Yeaple, 2018. "Innovation and Production in the Global Economy," American Economic Review, American Economic Association, vol. 108(8), pages 2128-2173, August.
    24. Pierre-Olivier Gourinchas & Olivier Jeanne, 2006. "The Elusive Gains from International Financial Integration," Review of Economic Studies, Oxford University Press, vol. 73(3), pages 715-741.
    25. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    26. Abadir,Karim M. & Magnus,Jan R., 2005. "Matrix Algebra," Cambridge Books, Cambridge University Press, number 9780521537469, July - De.
    27. Carriero, A. & Kapetanios, G. & Marcellino, M., 2009. "Forecasting exchange rates with a large Bayesian VAR," International Journal of Forecasting, Elsevier, vol. 25(2), pages 400-417.
    28. Cai, Zongwu, 2007. "Trending time-varying coefficient time series models with serially correlated errors," Journal of Econometrics, Elsevier, vol. 136(1), pages 163-188, January.
    29. Lee Branstetter & Kamal Saggi, 2011. "Intellectual Property Rights, Foreign Direct Investment and Industrial Development," Economic Journal, Royal Economic Society, vol. 121(555), pages 1161-1191, September.
    30. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    31. Arnaud Costinot & Jonathan Vogel, 2010. "Matching and Inequality in the World Economy," Journal of Political Economy, University of Chicago Press, vol. 118(4), pages 747-786, August.
    32. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    33. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    34. Giraitis, Liudas & Kapetanios, George & Price, Simon, 2013. "Adaptive forecasting in the presence of recent and ongoing structural change," Journal of Econometrics, Elsevier, vol. 177(2), pages 153-170.
    35. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    36. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    37. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
    38. Gene M. Grossman & Esteban Rossi-Hansberg, 2008. "Trading Tasks: A Simple Theory of Offshoring," American Economic Review, American Economic Association, vol. 98(5), pages 1978-1997, December.
    39. Felix Tintelnot, 2017. "Global Production with Export Platforms," The Quarterly Journal of Economics, Oxford University Press, vol. 132(1), pages 157-209.
    40. Bin Chen & Yongmiao Hong, 2012. "Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression," Econometrica, Econometric Society, vol. 80(3), pages 1157-1183, May.
    41. Daron Acemoglu, 1998. "Why Do New Technologies Complement Skills? Directed Technical Change and Wage Inequality," The Quarterly Journal of Economics, Oxford University Press, vol. 113(4), pages 1055-1089.
    42. Acemoglu, Daron & Autor, David, 2011. "Skills, Tasks and Technologies: Implications for Employment and Earnings," Handbook of Labor Economics, Elsevier.
    43. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    44. Angus Chu & Guido Cozzi & Yuichi Furukawa, 2015. "Effects of Economic Development in China on Skill-Biased Technical Change in the US," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 18(2), pages 227-242, April.
    45. Sheng, Liugang & Yang, Dennis T., 2017. "Offshoring and Wage Inequality: Theory and Evidence from China," IZA Discussion Papers 10924, Institute of Labor Economics (IZA).
    46. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
    47. repec:ucp:jpolec:doi:10.1086/693373 is not listed on IDEAS
    48. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    49. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
    50. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    51. Tanya Molodtsova & David H. Papell, 2013. "Taylor Rule Exchange Rate Forecasting during the Financial Crisis," NBER International Seminar on Macroeconomics, University of Chicago Press, vol. 9(1), pages 55-97.
    52. Dinopoulos, Elias & Segerstrom, Paul, 2010. "Intellectual property rights, multinational firms and economic growth," Journal of Development Economics, Elsevier, vol. 92(1), pages 13-27, May.
    53. Baldwin, Richard & Robert-Nicoud, Frédéric, 2014. "Trade-in-goods and trade-in-tasks: An integrating framework," Journal of International Economics, Elsevier, vol. 92(1), pages 51-62.
    54. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    55. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    56. Mathias Thoenig & Thierry Verdier, 2003. "A Theory of Defensive Skill-Biased Innovation and Globalization," American Economic Review, American Economic Association, vol. 93(3), pages 709-728, June.
    57. Stanislav Anatolyev & Victor Kitov, 2007. "Using All Observations when Forecasting under Structural Breaks," Finnish Economic Papers, Finnish Economic Association, vol. 20(2), pages 166-176, Autumn.
    58. Wolff, Christian C P, 1987. "Time-Varying Parameters and the Out-of-Sample Forecasting Performance of Structural Exchange Rate Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 5(1), pages 87-97, January.
    59. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2, May.
    60. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, vol. 77(2), pages 167-180, April.
    61. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    62. repec:cup:cbooks:9780521822893 is not listed on IDEAS
    63. Faust, Jon & Rogers, John H. & H. Wright, Jonathan, 2003. "Exchange rate forecasting: the errors we've really made," Journal of International Economics, Elsevier, vol. 60(1), pages 35-59, May.
    64. Marron, James Stephen & Härdle, Wolfgang, 1986. "Random approximations to some measures of accuracy in nonparametric curve estimation," Journal of Multivariate Analysis, Elsevier, vol. 20(1), pages 91-113, October.
    65. Ariel Burstein & Jonathan Vogel, 2017. "International Trade, Technology, and the Skill Premium," Journal of Political Economy, University of Chicago Press, vol. 125(5), pages 1356-1412.
    66. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    67. Lu, Zudi & Linton, Oliver, 2007. "Local Linear Fitting Under Near Epoch Dependence," Econometric Theory, Cambridge University Press, vol. 23(01), pages 37-70, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Artur Tarassow, 2017. "Forecasting growth of U.S. aggregate and household-sector M2 after 2000 using economic uncertainty measures," Macroeconomics and Finance Series 201702, University of Hamburg, Department of Socioeconomics.
    2. repec:wsi:afexxx:v:13:y:2018:i:02:n:s2010495218500057 is not listed on IDEAS
    3. repec:eee:renene:v:135:y:2019:i:c:p:1270-1290 is not listed on IDEAS
    4. repec:eee:dyncon:v:93:y:2018:i:c:p:203-217 is not listed on IDEAS
    5. Elena Deryugina & Alexey Ponomarenko & Anna Rozhkova, 2018. "When are credit gap estimates reliable?," Bank of Russia Working Paper Series wps34, Bank of Russia.
    6. repec:eee:ecmode:v:68:y:2018:i:c:p:506-513 is not listed on IDEAS
    7. Carlo Fezzi & Luca Mosetti, 2018. "Size matters: Estimation sample length and electricity price forecasting accuracy," DEM Working Papers 2018/10, Department of Economics and Management.
    8. repec:eee:eneeco:v:72:y:2018:i:c:p:321-330 is not listed on IDEAS
    9. Fernández-Rodríguez, Fernando & Gómez-Puig, Marta & Sosvilla-Rivero, Simón, 2015. "Volatility spillovers in EMU sovereign bond markets," International Review of Economics & Finance, Elsevier, vol. 39(C), pages 337-352.
    10. Davide De Gaetano, 2017. "Forecasting With Garch Models Under Structural Breaks: An Approach Based On Combinations Across Estimation Windows," Departmental Working Papers of Economics - University 'Roma Tre' 0219, Department of Economics - University Roma Tre.
    11. repec:eee:phsmap:v:501:y:2018:i:c:p:78-85 is not listed on IDEAS
    12. repec:eee:empfin:v:48:y:2018:i:c:p:198-220 is not listed on IDEAS
    13. repec:eee:ecmode:v:76:y:2019:i:c:p:319-329 is not listed on IDEAS
    14. Franses, Ph.H.B.F. & Janssens, E., 2017. "This time it is different! Or not?," Econometric Institute Research Papers EI2017-25, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    15. Xu, Xiu & Mihoci, Andrija & Härdle, Wolfgang Karl, 2018. "lCARE - localizing conditional autoregressive expectiles," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 198-220.

    More about this item

    Keywords

    Macroeconomic forecasting; parameter instability; nonparametric estimation; bandwidth selection.;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:upf:upfgen:1435. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://www.econ.upf.edu/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.