IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/1703.html
   My bibliography  Save this paper

Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy

Author

Listed:
  • van Dijk, D.J.C.
  • Franses, Ph.H.B.F.

Abstract

Nonlinear time series models have become fashionable tools to describe and forecast a variety of economic time series. A closer look at reported empirical studies, however, reveals that these models apparently fit well in-sample, but rarely show a substantial improvement in out-of-sample forecasts, at least over linear models. One of the many possible reasons for this finding is that inappropriate model selection criteria and forecast evaluation criteria are used. In this paper we therefore propose a novel criterion, which we believe does more justice to the very nature of nonlinear models. Simulations show that our criterion outperforms currently used criteria, in the sense that the true nonlinear model is more often found to perform better in out-of-sample forecasting than a benchmark linear model. An empirical illustration for US GDP emphasizes its relevance.

Suggested Citation

  • van Dijk, D.J.C. & Franses, Ph.H.B.F., 2003. "Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy," Econometric Institute Research Papers EI 2003-10, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  • Handle: RePEc:ems:eureir:1703
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/1703/feweco20030326134908.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clements, Michael P & Smith, Jeremy, 1999. "A Monte Carlo Study of the Forecasting Performance of Empirical SETAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 123-141, March-Apr.
    2. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    3. Diebold, Francis X. & Nason, James A., 1990. "Nonparametric exchange rate prediction?," Journal of International Economics, Elsevier, vol. 28(3-4), pages 315-332, May.
    4. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    5. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    6. Pesaran, M. Hashem & Potter, Simon M., 1997. "A floor and ceiling model of US output," Journal of Economic Dynamics and Control, Elsevier, vol. 21(4-5), pages 661-695, May.
    7. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    8. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    9. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
    10. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    11. Giacomini, Raffaella, 2002. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods," University of California at San Diego, Economics Working Paper Series qt59s2g5j5, Department of Economics, UC San Diego.
    12. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    13. De Gooijer, Jan G. & Kumar, Kuldeep, 1992. "Some recent developments in non-linear time series modelling, testing, and forecasting," International Journal of Forecasting, Elsevier, vol. 8(2), pages 135-156, October.
    14. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    15. Van Dijk, Dick & Franses, Philip Hans & Lucas, Andre, 1999. "Testing for Smooth Transition Nonlinearity in the Presence of Outliers," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 217-235, April.
    16. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    17. Michael P. Clements & Hans-Martin Krolzig, 1998. "A comparison of the forecast performance of Markov-switching and threshold autoregressive models of US GNP," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 47-75.
    18. Clements, Michael P. & Smith, Jeremy, 2001. "Evaluating forecasts from SETAR models of exchange rates," Journal of International Money and Finance, Elsevier, vol. 20(1), pages 133-148, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Balcilar, Mehmet & Katzke, Nico & Gupta, Rangan, 2017. "Do precious metal prices help in forecasting South African inflation?," The North American Journal of Economics and Finance, Elsevier, vol. 40(C), pages 63-72.
    2. Avino, Davide & Nneji, Ogonna, 2014. "Are CDS spreads predictable? An analysis of linear and non-linear forecasting models," International Review of Financial Analysis, Elsevier, vol. 34(C), pages 262-274.
    3. Aye, Goodness C. & Balcilar, Mehmet & Gupta, Rangan & Majumdar, Anandamayee, 2015. "Forecasting aggregate retail sales: The case of South Africa," International Journal of Production Economics, Elsevier, vol. 160(C), pages 66-79.
    4. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 1210, University of Nevada, Las Vegas , Department of Economics.
    5. Rossi, Barbara & Sekhposyan, Tatevik, 2013. "Conditional predictive density evaluation in the presence of instabilities," Journal of Econometrics, Elsevier, vol. 177(2), pages 199-212.
    6. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2015. "Was the recent downturn in US real GDP predictable?," Applied Economics, Taylor & Francis Journals, vol. 47(28), pages 2985-3007, June.
    7. Florackis, Chris & Giorgioni, Gianluigi & Kostakis, Alexandros & Milas, Costas, 2014. "On stock market illiquidity and real-time GDP growth," Journal of International Money and Finance, Elsevier, vol. 44(C), pages 210-229.
    8. Barbara Rossi & Tatevik Sekhposyan, 2014. "Alternative tests for correct specification of conditional predictive densities," Economics Working Papers 1416, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2017.
    9. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Working Papers 415, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    10. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.
    11. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    12. Fok, Dennis & van Dijk, Dick & Franses, Philip Hans, 2005. "Forecasting aggregates using panels of nonlinear time series," International Journal of Forecasting, Elsevier, vol. 21(4), pages 785-794.
    13. Costas Milas & Ruthira Naraidoo, 2009. "Financial Market Conditions, Real Time, Nonlinearity and European Central Bank Monetary Policy: In-Sample and Out-of-Sample Assessment," Working Papers 200923, University of Pretoria, Department of Economics.
    14. Milas, Costas & Rothman, Philip, 2008. "Out-of-sample forecasting of unemployment rates with pooled STVECM forecasts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 101-121.
    15. Milas, Costas & Naraidoo, Ruthira, 2012. "Financial conditions and nonlinearities in the European Central Bank (ECB) reaction function: In-sample and out-of-sample assessment," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 173-189, January.
    16. Guidolin, Massimo & Hyde, Stuart & McMillan, David & Ono, Sadayuki, 2009. "Non-linear predictability in stock and bond returns: When and where is it exploitable?," International Journal of Forecasting, Elsevier, vol. 25(2), pages 373-399.
    17. Mili, Mehdi & Sahut, Jean-Michel & Teulon, Frédéric, 2012. "Non linear and asymmetric linkages between real growth in the Euro area and global financial market conditions: New evidence," Economic Modelling, Elsevier, vol. 29(3), pages 734-741.
    18. Rapach, David E. & Wohar, Mark E., 2006. "The out-of-sample forecasting performance of nonlinear models of real exchange rate behavior," International Journal of Forecasting, Elsevier, vol. 22(2), pages 341-361.

    More about this item

    Keywords

    forecast evaluation; forecasting; model selection; nonlinearity;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:1703. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (RePub). General contact details of provider: http://edirc.repec.org/data/feeurnl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.