IDEAS home Printed from https://ideas.repec.org/p/qmw/qmwecw/490.html
   My bibliography  Save this paper

Non-Nested Models and the Likelihood Ratio Statistic: A Comparison of Simulation and Bootstrap Based Tests

Author

Listed:
  • George Kapetanios

    (Queen Mary, University of London)

  • Melvyn Weeks

    (University of Cambridge)

Abstract

We consider an alternative use of simulation in the context of using the Likelihood-Ratio statistic to test non-nested models. To date simulation has been used to estimate the Kullback-Leibler measure of closeness between two densities, which in turn 'mean adjusts' the Likelihood-Ratio statistic. Given that this adjustment is still based upon asymptotic arguments, an alternative procedure is to utilise bootstrap procedures to construct the empirical density. To our knowledge this study represents the first comparison of the properties of bootstrap and simulation-based tests applied to non-nested tests. More specifically, the design of experiments allows us to comment on the relative performance of these two testing frameworks across models with varying degrees of nonlinearity. In this respect although the primary focus of the paper is upon the relative evaluation of simulation and bootstrap-based nonnested procedures in testing across a class of nonlinear threshold models, the inclusion of a similar analysis of the more standard linear/log-linear models provides a point of comparison.

Suggested Citation

  • George Kapetanios & Melvyn Weeks, 2003. "Non-Nested Models and the Likelihood Ratio Statistic: A Comparison of Simulation and Bootstrap Based Tests," Working Papers 490, Queen Mary University of London, School of Economics and Finance.
  • Handle: RePEc:qmw:qmwecw:490
    as

    Download full text from publisher

    File URL: https://www.qmul.ac.uk/sef/media/econ/research/workingpapers/2003/items/wp490.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    2. Kilian, L., 1998. "Pitfalls in Constructing Bootstrap Confidence Intervals for Asymptotically Pivotal Statistics," Papers 98-04, Michigan - Center for Research on Economic & Social Theory.
    3. Hashem Pesaran, M. & Pesaran, Bahram, 1993. "A simulation approach to the problem of computing Cox's statistic for testing nonnested models," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 377-392.
    4. Godfrey, Leslie G & McAleer, Michael & McKenzie, Colin R, 1988. "Variable Addition and LaGrange Multiplier Tests for Linear and Logarithmic Regression Models," The Review of Economics and Statistics, MIT Press, vol. 70(3), pages 492-503, August.
    5. Potter, Simon M, 1995. "A Nonlinear Approach to US GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(2), pages 109-125, April-Jun.
    6. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    7. Horowitz, J. L., 1995. "Bootstrap Methods In Econometrics: Theory And Numerical Performance," SFB 373 Discussion Papers 1995,63, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    8. Ernst R. Berndt & Bronwyn H. Hall & Robert E. Hall & Jerry A. Hausman, 1974. "Estimation and Inference in Nonlinear Structural Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 4, pages 653-665, National Bureau of Economic Research, Inc.
    9. Gwyn Aneuryn-Evans & Angus Deaton, 1980. "Testing Linear versus Logarithmic Regression Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 275-291.
    10. N. Coulibaly & B. Wade Brorsen, 1999. "Monte carlo sampling approach to testing nonnested hypothesis: monte carlo results," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 195-209.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. George Kapetanios & Yongcheol Shin, 2011. "Testing the Null Hypothesis of Nonstationary Long Memory Against the Alternative Hypothesis of a Nonlinear Ergodic Model," Econometric Reviews, Taylor & Francis Journals, vol. 30(6), pages 620-645.
    2. Park, Seong C. & Brorsen, B. Wade & Stoecker, Arthur L. & Hattey, Jeffory A., 2012. "Forage Response to Swine Effluent: A Cox Nonnested Test of Alternative Functional Forms Using a Fast Double Bootstrap," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 44(4), pages 593-606, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kapetanios, G. & Weeks, M., 2003. "Non-nested Models and the likelihood Ratio Statistic: A Comparison of Simulation and Bootstrap-based Tests," Cambridge Working Papers in Economics 0308, Faculty of Economics, University of Cambridge.
    2. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    3. Davidson, R. & MacKinnon & J.G., 1999. "Artificial Regressions," G.R.E.Q.A.M. 99a04, Universite Aix-Marseille III.
    4. Dameus, Alix & Brorsen, B. Wade & Sukhdial, Kullapapruk Piewthongngam & Richter, Francisca G.-C., 2001. "Aids Versus Rotterdam: A Cox Nonnested Test With Parametric Bootstrap," 2001 Annual meeting, August 5-8, Chicago, IL 20453, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    5. McAleer, Michael, 1994. "Sherlock Holmes and the Search for Truth: A Diagnostic Tale," Journal of Economic Surveys, Wiley Blackwell, vol. 8(4), pages 317-370, December.
    6. Kaitibie, Simeon & Nganje, William E. & Brorsen, B. Wade & Epplin, Francis M., 2003. "Optimal Grazing Pressure Under Output Price And Production Uncertainty With Alternative Functional Forms," 2003 Annual meeting, July 27-30, Montreal, Canada 22020, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    7. Anne Morrison Piehl & Suzanne J. Cooper & Anthony A. Braga & David M. Kennedy, 2003. "Testing for Structural Breaks in the Evaluation of Programs," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 550-558, August.
    8. Ahmed, Walid M.A., 2018. "On the interdependence of natural gas and stock markets under structural breaks," The Quarterly Review of Economics and Finance, Elsevier, vol. 67(C), pages 149-161.
    9. Hamilton, James D., 1996. "Specification testing in Markov-switching time-series models," Journal of Econometrics, Elsevier, vol. 70(1), pages 127-157, January.
    10. Russell Davidson & Victoria Zinde‐Walsh, 2017. "Advances in specification testing," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1595-1631, December.
    11. Monfardini, Chiara, 2003. "An illustration of Cox's non-nested testing procedure for logit and probit models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 425-444, March.
    12. J. M. C. Santos Silva, 2001. "A score test for non-nested hypotheses with applications to discrete data models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 577-597.
    13. Park, Seong C. & Brorsen, B. Wade & Stoecker, Arthur L. & Hattey, Jeffory A., 2012. "Forage Response to Swine Effluent: A Cox Nonnested Test of Alternative Functional Forms Using a Fast Double Bootstrap," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 44(4), pages 593-606, November.
    14. Marzio Galeotti & Alessandro Lanza, 1999. "Desperately Seeking (Environmental) Kuznets," Working Papers 1999.2, Fondazione Eni Enrico Mattei.
    15. Javier Pereda, 2009. "Estimación de la curva de rendimiento para el Perú y su uso para el análisis monetario," Monetaria, CEMLA, vol. 0(3), pages 413-450, octubre-d.
    16. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    17. Gary Koop & Simon M. Potter, 2007. "A flexible approach to parametric inference in nonlinear time series models," Staff Reports 285, Federal Reserve Bank of New York.
    18. Yu, Ping & Phillips, Peter C.B., 2018. "Threshold regression with endogeneity," Journal of Econometrics, Elsevier, vol. 203(1), pages 50-68.
    19. Chen, Yi-Ting & Kuan, Chung-Ming, 2002. "The pseudo-true score encompassing test for non-nested hypotheses," Journal of Econometrics, Elsevier, vol. 106(2), pages 271-295, February.
    20. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2002. "Estimation and model selection based inference in single and multiple threshold models," Journal of Econometrics, Elsevier, vol. 110(2), pages 319-352, October.

    More about this item

    Keywords

    Non-nested tests; Simulation-based inference; Bootstrap tests; Nonlinear threshold models;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qmw:qmwecw:490. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nicholas Owen (email available below). General contact details of provider: https://edirc.repec.org/data/deqmwuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.