IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2211.11915.html
   My bibliography  Save this paper

A Misuse of Specification Tests

Author

Listed:
  • Naoya Sueishi

Abstract

Empirical researchers often perform model specification tests, such as the Hausman test and the overidentifying restrictions test, to confirm the validity of estimators rather than the validity of models. This paper examines the effectiveness of specification pretests in finding invalid estimators. We study the local asymptotic properties of test statistics and estimators and show that locally unbiased specification tests cannot determine whether asymptotically efficient estimators are asymptotically biased. The main message of the paper is that correct specification and valid estimation are different issues. Correct specification is neither necessary nor sufficient for asymptotically unbiased estimation under local overidentification.

Suggested Citation

  • Naoya Sueishi, 2022. "A Misuse of Specification Tests," Papers 2211.11915, arXiv.org.
    • Handle: RePEc:arx:papers:2211.11915
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2211.11915
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    4. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    5. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    6. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    7. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    8. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    9. Komunjer, Ivana & Ragusa, Giuseppe, 2016. "Existence And Characterization Of Conditional Density Projections," Econometric Theory, Cambridge University Press, vol. 32(4), pages 947-987, August.
    10. Parente, Paulo M.D.C. & Santos Silva, J.M.C., 2012. "A cautionary note on tests of overidentifying restrictions," Economics Letters, Elsevier, vol. 115(2), pages 314-317.
    11. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    12. Newey, Whitney K, 1985. "Maximum Likelihood Specification Testing and Conditional Moment Tests," Econometrica, Econometric Society, vol. 53(5), pages 1047-1070, September.
    13. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    14. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    15. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    16. Guggenberger, Patrik, 2010. "The Impact Of A Hausman Pretest On The Asymptotic Size Of A Hypothesis Test," Econometric Theory, Cambridge University Press, vol. 26(2), pages 369-382, April.
    17. Kabaila, Paul, 1995. "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, Cambridge University Press, vol. 11(3), pages 537-549, June.
    18. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    19. Patrik Guggenberger & Gitanjali Kumar, 2012. "On the size distortion of tests after an overidentifying restrictions pretest," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1138-1160, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," School of Economics and Public Policy Working Papers 2020-05, University of Adelaide, School of Economics and Public Policy.
    2. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    3. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    4. Doko Tchatoka, Firmin & Dufour, Jean-Marie, 2020. "Exogeneity tests, incomplete models, weak identification and non-Gaussian distributions: Invariance and finite-sample distributional theory," Journal of Econometrics, Elsevier, vol. 218(2), pages 390-418.
    5. Hwang, Jungbin & Kang, Byunghoon & Lee, Seojeong, 2022. "A doubly corrected robust variance estimator for linear GMM," Journal of Econometrics, Elsevier, vol. 229(2), pages 276-298.
    6. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Working Papers 2020-06, Brown University, Department of Economics.
    7. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    8. Timothy Christensen & Benjamin Connault, 2023. "Counterfactual Sensitivity and Robustness," Econometrica, Econometric Society, vol. 91(1), pages 263-298, January.
    9. Doko Tchatoka, Firmin Sabro, 2012. "Specification Tests with Weak and Invalid Instruments," MPRA Paper 40185, University Library of Munich, Germany.
    10. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    11. Andrei Zeleneev & Kirill Evdokimov, 2023. "Simple estimation of semiparametric models with measurement errors," CeMMAP working papers 10/23, Institute for Fiscal Studies.
    12. Kirill S. Evdokimov & Andrei Zeleneev, 2023. "Simple Estimation of Semiparametric Models with Measurement Errors," Papers 2306.14311, arXiv.org, revised Mar 2024.
    13. Thomas H. Jørgensen, 2023. "Sensitivity to Calibrated Parameters," The Review of Economics and Statistics, MIT Press, vol. 105(2), pages 474-481, March.
    14. Hidehiko Ichimura & Whitney K. Newey, 2022. "The influence function of semiparametric estimators," Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
    15. Ketz, Philipp, 2019. "Testing overidentifying restrictions with a restricted parameter space," Economics Letters, Elsevier, vol. 185(C).
    16. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    17. Kiviet, Jan F., 2020. "Testing the impossible: Identifying exclusion restrictions," Journal of Econometrics, Elsevier, vol. 218(2), pages 294-316.
    18. Paulo Parente & Richard Smith, 2012. "Exogeneity in semiparametric moment condition models," CeMMAP working papers CWP30/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Jondeau, Eric & Le Bihan, Hervé, 2008. "Examining bias in estimators of linear rational expectations models under misspecification," Journal of Econometrics, Elsevier, vol. 143(2), pages 375-395, April.
    20. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2211.11915. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.