IDEAS home Printed from
   My bibliography  Save this article

Improving robust model selection tests for dynamic models


  • Hwan-sik Choi
  • Nicholas M. Kiefer


We propose an improved model selection test for dynamic models using a new asymptotic approximation to the sampling distribution of a new test statistic. The model selection test is applicable to dynamic models with very general selection criteria and estimation methods. Since our test statistic does not assume the exact form of a true model, the test is essentially non-parametric once competing models are estimated. For the unknown serial correlation in data, we use a Heteroscedasticity & Autocorrelation-Consistent (HAC) variance estimator, and the sampling distribution of the test statistic is approximated by the fixed-b asymptotic approximation. The asymptotic approximation depends on kernel functions and bandwidth parameters used in HAC estimators. We compare the finite sample performance of the new test with the bootstrap methods as well as with the standard normal approximations, and show that the fixed-b asymptotics and the bootstrap methods are markedly superior to the standard normal approximation for a moderate sample size for time series data. An empirical application for foreign exchange rate forecasting models is presented, and the result shows the normal approximation to the distribution of the test statistic considered appears to overstate the data's ability to distinguish between two competing models. Copyright The Author(s). Journal compilation Royal Economic Society 2010.

Suggested Citation

  • Hwan-sik Choi & Nicholas M. Kiefer, 2010. "Improving robust model selection tests for dynamic models," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 177-204, July.
  • Handle: RePEc:ect:emjrnl:v:13:y:2010:i:2:p:177-204

    Download full text from publisher

    File URL:
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    1. Christian Francq & Michel Roussignol & Jean-Michel Zakoïan, 1998. "Conditional Heteroskedasticity Driven by Hidden Markov Chains," Working Papers 98-45, Center for Research in Economics and Statistics.
    2. Francq, Christian & Zako an, Jean-Michel, 2002. "Comments On The Paper By Minxian Yang:," Econometric Theory, Cambridge University Press, vol. 18(03), pages 815-818, June.
    3. Gray, Stephen F., 1996. "Modeling the conditional distribution of interest rates as a regime-switching process," Journal of Financial Economics, Elsevier, vol. 42(1), pages 27-62, September.
    4. Dhiman Das & B.Hark Yoo, 2004. "A Bayesian MCMC Algorithm for Markov Switching GARCH models," Econometric Society 2004 North American Summer Meetings 179, Econometric Society.
    5. Jan Henneke & Svetlozar Rachev & Frank Fabozzi & Metodi Nikolov, 2011. "MCMC-based estimation of Markov Switching ARMA-GARCH models," Applied Economics, Taylor & Francis Journals, vol. 43(3), pages 259-271.
    6. Dueker, Michael J, 1997. "Markov Switching in GARCH Processes and Mean-Reverting Stock-Market Volatility," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 26-34, January.
    7. Dhiman Das, 2004. "A Bayesian algorithm for a Markov Switching GARCH model," Computing in Economics and Finance 2004 30, Society for Computational Economics.
    8. Abramson, Ari & Cohen, Israel, 2007. "On The Stationarity Of Markov-Switching Garch Processes," Econometric Theory, Cambridge University Press, vol. 23(03), pages 485-500, June.
    9. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(4), pages 493-530.
    10. Bollen, Nicolas P. B. & Gray, Stephen F. & Whaley, Robert E., 2000. "Regime switching in foreign exchange rates: Evidence from currency option prices," Journal of Econometrics, Elsevier, vol. 94(1-2), pages 239-276.
    11. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    12. Yang, Minxian, 2000. "Some Properties Of Vector Autoregressive Processes With Markov-Switching Coefficients," Econometric Theory, Cambridge University Press, vol. 16(01), pages 23-43, February.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Kruse, Robinson & Leschinski, Christian & Will, Michael, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," Hannover Economic Papers (HEP) dp-571, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    2. Matei Demetrescu & Christoph Hanck & Robinson Kruse, 2016. "Fixed-b Inference in the Presence of Time-Varying Volatility," CREATES Research Papers 2016-01, Department of Economics and Business Economics, Aarhus University.
    3. Andreas Alfons & Wolfgang Baaske & Peter Filzmoser & Wolfgang Mader & Roland Wieser, 2011. "Robust variable selection with application to quality of life research," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 20(1), pages 65-82, March.
    4. Choi, Hwan-sik & Jeong, Minsoo & Park, Joon Y., 2014. "An asymptotic analysis of likelihood-based diffusion model selection using high frequency data," Journal of Econometrics, Elsevier, vol. 178(P3), pages 539-557.
    5. Choi, Hwan-sik, 2016. "Information theory for maximum likelihood estimation of diffusion models," Journal of Econometrics, Elsevier, vol. 191(1), pages 110-128.

    More about this item


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ect:emjrnl:v:13:y:2010:i:2:p:177-204. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.