IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.01161.html

Data-Driven Tuning in Kernel Specification Tests: Selection Asymptotics, Validity, and Power

Author

Listed:
  • Yuhao Li

Abstract

We develop model checks for conditional moment restrictions whose tuning parameters, the kernel bandwidth and the regularization level, are selected by cross-validation. The tests regress the estimated residuals on the covariates via kernel ridge regression (KRR), yielding a coefficient function in a reproducing kernel Hilbert space (RKHS) that vanishes under the null and is nonzero for any misspecification not annihilated by the Neyman projection. Our central contribution is a complete asymptotic theory of the data-driven tuning parameter: its limit law under the null, under fixed alternatives, and under local alternatives, and bootstrap size control under sample splitting with no convergence of the selector required. An exact energy identity shows that cross-validation maximizes the signal captured by the test (its noncentrality) and, absent signal, shrinks its noise floor. The tests are consistent against fixed alternatives, achieve $n^{-1/2}$-rate sensitivity to local alternatives, and use Neyman-orthogonal projections so the model is never re-estimated within bootstrap resamples. Simulations show size close to nominal without user-chosen tuning, power comparable to the kernel conditional moment (KCM) test at its best kernel parameter, and robustness where fixed kernel parameters fail in higher dimensions. Three empirical applications illustrate the diagnostic role of the tests; we recommend a $15$--$20\%$ selection share for the sample-splitting protocol.

Suggested Citation

  • Yuhao Li, 2025. "Data-Driven Tuning in Kernel Specification Tests: Selection Asymptotics, Validity, and Power," Papers 2505.01161, arXiv.org, revised Sep 2026.
  • Handle: RePEc:arx:papers:2505.01161
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2505.01161
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "Rejoinder on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 442-447, September.
    2. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    3. Sant’Anna, Pedro H.C. & Song, Xiaojun, 2019. "Specification tests for the propensity score," Journal of Econometrics, Elsevier, vol. 210(2), pages 379-404.
    4. Wooldridge, Jeffrey M., 1990. "A Unified Approach to Robust, Regression-Based Specification Tests," Econometric Theory, Cambridge University Press, vol. 6(1), pages 17-43, March.
    5. Newey, Whitney K, 1985. "Maximum Likelihood Specification Testing and Conditional Moment Tests," Econometrica, Econometric Society, vol. 53(5), pages 1047-1070, September.
    6. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    7. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    8. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    9. John Xu Zheng, 1996. "A consistent test of functional form via nonparametric estimation techniques," Journal of Econometrics, Elsevier, vol. 75(2), pages 263-289, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paulo Parente & Richard Smith, 2012. "Exogeneity in semiparametric moment condition models," CeMMAP working papers 30/12, Institute for Fiscal Studies.
    2. Cui Rui & Li Yuhao & Song Xiaojun, 2025. "Finite-Sample Distortion in Kernel Specification Tests: A Perturbation Analysis of Empirical Directional Components," Papers 2506.04900, arXiv.org, revised Oct 2025.
    3. Sun, Shuang & Song, Zening & Song, Xiaojun, 2025. "Unified specification tests in partially linear time series models," Computational Statistics & Data Analysis, Elsevier, vol. 203(C).
    4. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    5. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    6. Juhl, Ted & Sosa-Escudero, Walter, 2014. "Testing for heteroskedasticity in fixed effects models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 484-494.
    7. Yongzhen Feng & Jie Li & Xiaojun Song, 2025. "Testing linearity in semi-functional partially linear regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 34(3), pages 786-814, September.
    8. Amengual, Dante & Fiorentini, Gabriele & Sentana, Enrique, 2024. "Specification tests for non-Gaussian structural vector autoregressions," Journal of Econometrics, Elsevier, vol. 244(2).
    9. Xu Guo & Gao-Rong Li & Michael McAleer & Wing-Keung Wong, 2018. "Specification Testing of Production in a Stochastic Frontier Model," Sustainability, MDPI, vol. 10(9), pages 1-10, August.
    10. Xu Guo & Wangli Xu & Lixing Zhu, 2015. "Model checking for parametric regressions with response missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 229-259, April.
    11. Skeels, Christopher L. & Vella, Francis, 1999. "A Monte Carlo investigation of the sampling behavior of conditional moment tests in Tobit and Probit models," Journal of Econometrics, Elsevier, vol. 92(2), pages 275-294, October.
    12. Cuizhen Niu & Lixing Zhu, 2018. "A robust adaptive-to-model enhancement test for parametric single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1013-1045, October.
    13. Liangjun Su & Yundong Tu & Aman Ullah, 2015. "Testing Additive Separability of Error Term in Nonparametric Structural Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 1057-1088, December.
    14. Smith, Richard J., 2011. "Gel Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1192-1235, December.
    15. Junmin Liu & Deli Zhu & Luoyao Yu & Xuehu Zhu, 2023. "Specification testing of partially linear single-index models: a groupwise dimension reduction-based adaptive-to-model approach," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 232-262, March.
    16. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    17. Yi-Ting Chen, 2016. "Testing for Granger Causality in Moments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(2), pages 265-288, April.
    18. Tae-Hwy Lee & Zhou Xi & Ru Zhang, 2013. "Testing for Neglected Nonlinearity Using Regularized Artificial Neural Networks," Working Papers 201422, University of California at Riverside, Department of Economics, revised Apr 2012.
    19. Lejeune, Bernard, 2009. "A diagnostic m-test for distributional specification of parametric conditional heteroscedasticity models for financial data," Journal of Empirical Finance, Elsevier, vol. 16(3), pages 507-523, June.
    20. Montes-Rojas, Gabriel & Sosa-Escudero, Walter, 2011. "Robust tests for heteroskedasticity in the one-way error components model," Journal of Econometrics, Elsevier, vol. 160(2), pages 300-310, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.01161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.