IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2211.11915.html

On the Informativeness of Specification Tests for Estimator Validity

Author

Listed:
  • Naoya Sueishi

Abstract

Empirical researchers often use model specification tests, such as Hausman tests and overidentifying restrictions tests, to assess the validity of estimators rather than the correctness of models. This paper examines the extent to which such tests are informative about the presence of asymptotic bias in estimators. Under a local misspecification framework, we show that the directions of local deviation from a benchmark distribution to which locally unbiased specification tests have nontrivial power are orthogonal to those that induce asymptotic bias in asymptotically efficient estimators. Consequently, specification tests generally provide limited information about estimator validity unless researchers impose additional untestable assumptions on the form of misspecification. We further demonstrate that, when used as estimator selection rules, Hausman tests can lead to the choice of inefficient estimators that exhibit asymptotic bias, even when efficient estimators remain asymptotically unbiased. These findings highlight fundamental limitations in using specification tests to guide estimator choice.

Suggested Citation

  • Naoya Sueishi, 2022. "On the Informativeness of Specification Tests for Estimator Validity," Papers 2211.11915, arXiv.org, revised Jun 2026.
  • Handle: RePEc:arx:papers:2211.11915
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2211.11915
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    4. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    5. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    6. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    7. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    8. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    9. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    10. Guggenberger, Patrik, 2010. "The Impact Of A Hausman Pretest On The Asymptotic Size Of A Hypothesis Test," Econometric Theory, Cambridge University Press, vol. 26(2), pages 369-382, April.
    11. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    12. Kabaila, Paul, 1995. "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, Cambridge University Press, vol. 11(3), pages 537-549, June.
    13. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    14. Patrik Guggenberger & Gitanjali Kumar, 2012. "On the size distortion of tests after an overidentifying restrictions pretest," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1138-1160, November.
    15. Jerry Hausman, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    16. Komunjer, Ivana & Ragusa, Giuseppe, 2016. "Existence And Characterization Of Conditional Density Projections," Econometric Theory, Cambridge University Press, vol. 32(4), pages 947-987, August.
    17. Parente, Paulo M.D.C. & Santos Silva, J.M.C., 2012. "A cautionary note on tests of overidentifying restrictions," Economics Letters, Elsevier, vol. 115(2), pages 314-317.
    18. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    19. Newey, Whitney K, 1985. "Maximum Likelihood Specification Testing and Conditional Moment Tests," Econometrica, Econometric Society, vol. 53(5), pages 1047-1070, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," Adelaide Economics Working Papers 2020-05, Adelaide University, School of Economics.
    2. Doko Tchatoka, Firmin & Dufour, Jean-Marie, 2025. "Exogeneity tests and weak identification in IV regressions: Asymptotic theory and point estimation," Journal of Econometrics, Elsevier, vol. 248(C).
    3. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    4. Doko Tchatoka, Firmin & Wang, Wenjie, 2024. "Weak-Identification-Robust Bootstrap Tests after Pretesting for Exogeneity," MPRA Paper 123060, University Library of Munich, Germany.
    5. Hui Chen & Winston Wei Dou & Leonid Kogan, 2024. "Measuring “Dark Matter” in Asset Pricing Models," Journal of Finance, American Finance Association, vol. 79(2), pages 843-902, April.
    6. Doko Tchatoka, Firmin & Wang, Wenjie, 2025. "Identification-Robust Two-Stage Bootstrap Tests with Pretesting for Exogeneity," MPRA Paper 125017, University Library of Munich, Germany.
    7. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    8. Reca Sarfati & Vod Vilfort, 2026. "Integrating Diagnostic Checks into Estimation," Papers 2604.16690, arXiv.org.
    9. Doko Tchatoka, Firmin & Dufour, Jean-Marie, 2020. "Exogeneity tests, incomplete models, weak identification and non-Gaussian distributions: Invariance and finite-sample distributional theory," Journal of Econometrics, Elsevier, vol. 218(2), pages 390-418.
    10. Hwang, Jungbin & Kang, Byunghoon & Lee, Seojeong, 2022. "A doubly corrected robust variance estimator for linear GMM," Journal of Econometrics, Elsevier, vol. 229(2), pages 276-298.
    11. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    12. Timothy Christensen & Benjamin Connault, 2023. "Counterfactual Sensitivity and Robustness," Econometrica, Econometric Society, vol. 91(1), pages 263-298, January.
    13. Doko Tchatoka, Firmin Sabro, 2012. "Specification Tests with Weak and Invalid Instruments," MPRA Paper 40185, University Library of Munich, Germany.
    14. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    15. Andrei Zeleneev & Kirill Evdokimov, 2023. "Simple estimation of semiparametric models with measurement errors," CeMMAP working papers 10/23, Institute for Fiscal Studies.
    16. Kirill S. Evdokimov & Andrei Zeleneev, 2023. "Simple Estimation of Semiparametric Models with Measurement Errors," Papers 2306.14311, arXiv.org, revised Nov 2025.
    17. Thomas H. Jørgensen, 2023. "Sensitivity to Calibrated Parameters," The Review of Economics and Statistics, MIT Press, vol. 105(2), pages 474-481, March.
    18. Ketz, Philipp, 2019. "Testing overidentifying restrictions with a restricted parameter space," Economics Letters, Elsevier, vol. 185(C).
    19. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    20. Kiviet, Jan F., 2020. "Testing the impossible: Identifying exclusion restrictions," Journal of Econometrics, Elsevier, vol. 218(2), pages 294-316.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2211.11915. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.