IDEAS home Printed from https://ideas.repec.org/p/ubc/pmicro/vadim_marmer-2008-13.html
   My bibliography  Save this paper

Optimal Comparison of Misspecified Moment Restriction Models under a Chosen Measure of Fit

Author

Listed:
  • Marmer, Vadim
  • Otsu, Taisuke

Abstract

Suppose that the econometrician is interested in comparing two misspecified moment restriction models, where the comparison is performed in terms of some chosen measure of fit. This paper is concerned with describing an optimal test of the Vuong (1989) and Rivers and Vuong (2002) type null hypothesis that the two models are equivalent under the given measure of fit (the ranking may vary for different measures). We adopt the generalized Neyman-Pearson optimality criterion, which focuses on the decay rates of the type I and II error probabilities under fixed non-local alternatives, and derive an optimal but practically infeasible test. Then, as an illustration, by considering the model comparison hypothesis defined by the weighted Euclidean norm of moment restrictions, we propose a feasible approximate test statistic to the optimal one and study its asymptotic properties. Local power properties, one-sided test, and comparison under the generalized empirical likelihood-based measure of fit are also investigated. A simulation study illustrates that our approximate test is more powerful than the Rivers-Vuong test.

Suggested Citation

  • Marmer, Vadim & Otsu, Taisuke, 2008. "Optimal Comparison of Misspecified Moment Restriction Models under a Chosen Measure of Fit," Microeconomics.ca working papers vadim_marmer-2008-13, Vancouver School of Economics, revised 25 Jul 2011.
  • Handle: RePEc:ubc:pmicro:vadim_marmer-2008-13
    as

    Download full text from publisher

    File URL: http://microeconomics.ca/vadim_marmer/ELdisc27.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Watson, Mark W, 1993. "Measures of Fit for Calibrated Models," Journal of Political Economy, University of Chicago Press, vol. 101(6), pages 1011-1041, December.
    3. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    4. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    5. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    6. Hall, Alastair R. & Inoue, Atsushi, 2003. "The large sample behaviour of the generalized method of moments estimator in misspecified models," Journal of Econometrics, Elsevier, vol. 114(2), pages 361-394, June.
    7. Guggenberger, Patrik & Smith, Richard J., 2005. "Generalized Empirical Likelihood Estimators And Tests Under Partial, Weak, And Strong Identification," Econometric Theory, Cambridge University Press, vol. 21(4), pages 667-709, August.
    8. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    9. Maasoumi, Esfandiar & Phillips, Peter C. B., 1982. "On the behavior of inconsistent instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 183-201, August.
    10. Ramalho, Joaquim J. S. & Smith, Richard J., 2002. "Generalized empirical likelihood non-nested tests," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 99-125, March.
    11. Hall, Alastair R. & Pelletier, Denis, 2011. "Nonnested Testing In Models Estimated Via Generalized Method Of Moments," Econometric Theory, Cambridge University Press, vol. 27(2), pages 443-456, April.
    12. Bates, Charles & White, Halbert, 1985. "A Unified Theory of Consistent Estimation for Parametric Models," Econometric Theory, Cambridge University Press, vol. 1(2), pages 151-178, August.
    13. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    14. Smith, Richard J, 1992. "Non-nested.Tests for Competing Models Estimated by Generalized Method of Moments," Econometrica, Econometric Society, vol. 60(4), pages 973-980, July.
    15. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    16. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    17. Hansen, Lars Peter & Jagannathan, Ravi, 1997. "Assessing Specification Errors in Stochastic Discount Factor Models," Journal of Finance, American Finance Association, vol. 52(2), pages 557-590, June.
    18. Raymond Kan & Cesare Robotti, 2009. "Model Comparison Using the Hansen-Jagannathan Distance," Review of Financial Studies, Society for Financial Studies, vol. 22(9), pages 3449-3490, September.
    19. Yuichi Kitamura, 2001. "Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 69(6), pages 1661-1672, November.
    20. Domowitz, Ian & White, Halbert, 1982. "Misspecified models with dependent observations," Journal of Econometrics, Elsevier, vol. 20(1), pages 35-58, October.
    21. Kitamura, Yuichi & Stutzer, Michael, 2002. "Connections between entropic and linear projections in asset pricing estimation," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 159-174, March.
    22. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    23. Corradi, Valentina & Swanson, Norman R., 2007. "Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data," Journal of Econometrics, Elsevier, vol. 136(2), pages 699-723, February.
    24. James G. MacKinnon, 1983. "Model Specification Tests Against Non-Nested Alternatives," Working Paper 573, Economics Department, Queen's University.
    25. Singleton, Kenneth J., 1985. "Testing specifications of economic agents' intertemporal optimum problems in the presence of alternative models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 391-413.
    26. Raymond Kan & Cesare Robotti & Jay Shanken, 2013. "Pricing Model Performance and the Two‐Pass Cross‐Sectional Regression Methodology," Journal of Finance, American Finance Association, vol. 68(6), pages 2617-2649, December.
    27. Smith, Richard J, 1997. "Alternative Semi-parametric Likelihood Approaches to Generalised Method of Moments Estimation," Economic Journal, Royal Economic Society, vol. 107(441), pages 503-519, March.
    28. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    29. Dridi, Ramdan & Guay, Alain & Renault, Eric, 2007. "Indirect inference and calibration of dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 136(2), pages 397-430, February.
    30. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
    31. Gourieroux, Christian & Holly, Alberto & Monfort, Alain, 1982. "Likelihood Ratio Test, Wald Test, and Kuhn-Tucker Test in Linear Models with Inequality Constraints on the Regression Parameters," Econometrica, Econometric Society, vol. 50(1), pages 63-80, January.
    32. Leininger, Wolfgang, 1984. "A generalization of the 'maximum theorem'," Economics Letters, Elsevier, vol. 15(3-4), pages 309-313.
    33. Hendry, David F., 1979. "The behaviour of inconsistent instrumental variables estimators in dynamic systems with autocorrelated errors," Journal of Econometrics, Elsevier, vol. 9(3), pages 295-314, February.
    34. Yuichi Kitamura & Andres Santos & Azeem M. Shaikh, 2012. "On the Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 80(1), pages 413-423, January.
    35. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2008. "Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models," Journal of Econometrics, Elsevier, vol. 146(1), pages 92-106, September.
    36. Ghysels, Eric & Hall, Alastair, 1990. "Testing nonnested Euler conditions with quadrature-based methods of approximation," Journal of Econometrics, Elsevier, vol. 46(3), pages 273-308, December.
    37. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    2. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    3. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 40278, University Library of Munich, Germany.
    4. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian model: A formal test of backward- and forward-looking behavior," Economics Working Papers 2012-07, Christian-Albrechts-University of Kiel, Department of Economics.
    5. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 39669, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    2. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    3. Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2012. "Comparison of misspecified calibrated models: The minimum distance approach," Journal of Econometrics, Elsevier, vol. 169(1), pages 131-138.
    4. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    5. Otsu, Taisuke & Seo, Myung Hwan & Whang, Yoon-Jae, 2012. "Testing for non-nested conditional moment restrictions using unconditional empirical likelihood," Journal of Econometrics, Elsevier, vol. 167(2), pages 370-382.
    6. Nikolay Gospodinov & Raymond Kan & Cesare Robotti, 2018. "Asymptotic variance approximations for invariant estimators in uncertain asset-pricing models," Econometric Reviews, Taylor & Francis Journals, vol. 37(7), pages 695-718, August.
    7. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    8. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    9. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    10. Raymond Kan & Cesare Robotti & Jay Shanken, 2013. "Pricing Model Performance and the Two‐Pass Cross‐Sectional Regression Methodology," Journal of Finance, American Finance Association, vol. 68(6), pages 2617-2649, December.
    11. Richard Smith, 2005. "Weak instruments and empirical likelihood: a discussion of the papers by DWK Andrews and JH Stock and Y Kitamura," CeMMAP working papers CWP13/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Gospodinov, Nikolay & Kan, Raymond & Robotti, Cesare, 2013. "Chi-squared tests for evaluation and comparison of asset pricing models," Journal of Econometrics, Elsevier, vol. 173(1), pages 108-125.
    13. Almeida, Caio & Garcia, René, 2012. "Assessing misspecified asset pricing models with empirical likelihood estimators," Journal of Econometrics, Elsevier, vol. 170(2), pages 519-537.
    14. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," Review of Economic Studies, Oxford University Press, vol. 74(4), pages 1059-1087.
    15. Yu‐Chin Hsu & Xiaoxia Shi, 2017. "Model‐selection tests for conditional moment restriction models," Econometrics Journal, Royal Economic Society, vol. 20(1), pages 52-85, February.
    16. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    17. Xue-Zhong He & Youwei Li, 2017. "The adaptiveness in stock markets: testing the stylized facts in the DAX 30," Journal of Evolutionary Economics, Springer, vol. 27(5), pages 1071-1094, November.
    18. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    19. Ríos-Rull, José-Víctor & Schorfheide, Frank & Fuentes-Albero, Cristina & Kryshko, Maxym & Santaeulàlia-Llopis, Raül, 2012. "Methods versus substance: Measuring the effects of technology shocks," Journal of Monetary Economics, Elsevier, vol. 59(8), pages 826-846.
    20. Patrick Gagliardini & Diego Ronchetti, 2020. "Comparing Asset Pricing Models by the Conditional Hansen-Jagannathan Distance," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 18(2), pages 333-394.

    More about this item

    Keywords

    Moment restriction; Model comparison; Misspecification; Generalized Neyman-Pearson optimality; Empirical likelihood; GMM;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ubc:pmicro:vadim_marmer-2008-13. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.economics.ubc.ca/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Maureen Chin (email available below). General contact details of provider: http://www.economics.ubc.ca/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.