IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/1703.html
   My bibliography  Save this paper

Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy

Author

Listed:
  • van Dijk, D.J.C.
  • Franses, Ph.H.B.F.

Abstract

Nonlinear time series models have become fashionable tools to describe and forecast a variety of economic time series. A closer look at reported empirical studies, however, reveals that these models apparently fit well in-sample, but rarely show a substantial improvement in out-of-sample forecasts, at least over linear models. One of the many possible reasons for this finding is that inappropriate model selection criteria and forecast evaluation criteria are used. In this paper we therefore propose a novel criterion, which we believe does more justice to the very nature of nonlinear models. Simulations show that our criterion outperforms currently used criteria, in the sense that the true nonlinear model is more often found to perform better in out-of-sample forecasting than a benchmark linear model. An empirical illustration for US GDP emphasizes its relevance.

Suggested Citation

  • van Dijk, D.J.C. & Franses, Ph.H.B.F., 2003. "Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy," Econometric Institute Research Papers EI 2003-10, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  • Handle: RePEc:ems:eureir:1703
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/1703/feweco20030326134908.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Raffaella Giacomini, 2002. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods," Boston College Working Papers in Economics 583, Boston College Department of Economics.
    5. De Gooijer, Jan G. & Kumar, Kuldeep, 1992. "Some recent developments in non-linear time series modelling, testing, and forecasting," International Journal of Forecasting, Elsevier, vol. 8(2), pages 135-156, October.
    6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    7. Clements, Michael P & Smith, Jeremy, 1999. "A Monte Carlo Study of the Forecasting Performance of Empirical SETAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 123-141, March-Apr.
    8. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    9. Michael P. Clements & Hans-Martin Krolzig, 1998. "A comparison of the forecast performance of Markov-switching and threshold autoregressive models of US GNP," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 47-75.
    10. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    11. Van Dijk, Dick & Franses, Philip Hans & Lucas, Andre, 1999. "Testing for Smooth Transition Nonlinearity in the Presence of Outliers," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 217-235, April.
    12. Diebold, Francis X. & Nason, James A., 1990. "Nonparametric exchange rate prediction?," Journal of International Economics, Elsevier, vol. 28(3-4), pages 315-332, May.
    13. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
    14. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    15. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    16. Clements, Michael P. & Smith, Jeremy, 2001. "Evaluating forecasts from SETAR models of exchange rates," Journal of International Money and Finance, Elsevier, vol. 20(1), pages 133-148, February.
    17. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    18. Pesaran, M. Hashem & Potter, Simon M., 1997. "A floor and ceiling model of US output," Journal of Economic Dynamics and Control, Elsevier, vol. 21(4-5), pages 661-695, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2015. "Was the recent downturn in US real GDP predictable?," Applied Economics, Taylor & Francis Journals, vol. 47(28), pages 2985-3007, June.
    2. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    3. Rossi, Barbara & Sekhposyan, Tatevik, 2013. "Conditional predictive density evaluation in the presence of instabilities," Journal of Econometrics, Elsevier, vol. 177(2), pages 199-212.
    4. Costas Milas & Ruthira Naraidoo, 2009. "Financial Market Conditions, Real Time, Nonlinearity and European Central Bank Monetary Policy: In-Sample and Out-of-Sample Assessment," Working Papers 200923, University of Pretoria, Department of Economics.
    5. Balcilar, Mehmet & Katzke, Nico & Gupta, Rangan, 2017. "Do precious metal prices help in forecasting South African inflation?," The North American Journal of Economics and Finance, Elsevier, vol. 40(C), pages 63-72.
    6. Guidolin, Massimo & Thornton, Daniel L., 2018. "Predictions of short-term rates and the expectations hypothesis," International Journal of Forecasting, Elsevier, vol. 34(4), pages 636-664.
    7. Fok, Dennis & van Dijk, Dick & Franses, Philip Hans, 2005. "Forecasting aggregates using panels of nonlinear time series," International Journal of Forecasting, Elsevier, vol. 21(4), pages 785-794.
    8. Milas, Costas & Naraidoo, Ruthira, 2012. "Financial conditions and nonlinearities in the European Central Bank (ECB) reaction function: In-sample and out-of-sample assessment," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 173-189, January.
    9. Avino, Davide & Nneji, Ogonna, 2014. "Are CDS spreads predictable? An analysis of linear and non-linear forecasting models," International Review of Financial Analysis, Elsevier, vol. 34(C), pages 262-274.
    10. Guidolin, Massimo & Hyde, Stuart & McMillan, David & Ono, Sadayuki, 2009. "Non-linear predictability in stock and bond returns: When and where is it exploitable?," International Journal of Forecasting, Elsevier, vol. 25(2), pages 373-399.
    11. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Working Papers 415, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    12. repec:eee:quaeco:v:69:y:2018:i:c:p:245-259 is not listed on IDEAS
    13. Milas, Costas & Rothman, Philip, 2008. "Out-of-sample forecasting of unemployment rates with pooled STVECM forecasts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 101-121.
    14. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 1210, University of Nevada, Las Vegas , Department of Economics.
    15. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    16. Mili, Mehdi & Sahut, Jean-Michel & Teulon, Frédéric, 2012. "Non linear and asymmetric linkages between real growth in the Euro area and global financial market conditions: New evidence," Economic Modelling, Elsevier, vol. 29(3), pages 734-741.
    17. Aye, Goodness C. & Balcilar, Mehmet & Gupta, Rangan & Majumdar, Anandamayee, 2015. "Forecasting aggregate retail sales: The case of South Africa," International Journal of Production Economics, Elsevier, vol. 160(C), pages 66-79.
    18. Rapach, David E. & Wohar, Mark E., 2006. "The out-of-sample forecasting performance of nonlinear models of real exchange rate behavior," International Journal of Forecasting, Elsevier, vol. 22(2), pages 341-361.
    19. Balcilar, Mehmet & Gupta, Rangan & van Eyden, Reneé & Thompson, Kirsten & Majumdar, Anandamayee, 2018. "Comparing the forecasting ability of financial conditions indices: The case of South Africa," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 245-259.
    20. Florackis, Chris & Giorgioni, Gianluigi & Kostakis, Alexandros & Milas, Costas, 2014. "On stock market illiquidity and real-time GDP growth," Journal of International Money and Finance, Elsevier, vol. 44(C), pages 210-229.
    21. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.

    More about this item

    Keywords

    forecast evaluation; forecasting; model selection; nonlinearity;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:1703. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (RePub). General contact details of provider: http://edirc.repec.org/data/feeurnl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.