IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.01161.html
   My bibliography  Save this paper

Model Checks in a Kernel Ridge Regression Framework

Author

Listed:
  • Yuhao Li

Abstract

We propose new reproducing kernel-based tests for model checking in conditional moment restriction models. By regressing estimated residuals on kernel functions via kernel ridge regression (KRR), we obtain a coefficient function in a reproducing kernel Hilbert space (RKHS) that is zero if and only if the model is correctly specified. We introduce two classes of test statistics: (i) projection-based tests, using RKHS inner products to capture global deviations, and (ii) random location tests, evaluating the KRR estimator at randomly chosen covariate points to detect local departures. The tests are consistent against fixed alternatives and sensitive to local alternatives at the $n^{-1/2}$ rate. When nuisance parameters are estimated, Neyman orthogonality projections ensure valid inference without repeated estimation in bootstrap samples. The random location tests are interpretable and can visualize model misspecification. Simulations show strong power and size control, especially in higher dimensions, outperforming existing methods.

Suggested Citation

  • Yuhao Li, 2025. "Model Checks in a Kernel Ridge Regression Framework," Papers 2505.01161, arXiv.org.
  • Handle: RePEc:arx:papers:2505.01161
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.01161
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "Rejoinder on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 442-447, September.
    2. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    3. Sant’Anna, Pedro H.C. & Song, Xiaojun, 2019. "Specification tests for the propensity score," Journal of Econometrics, Elsevier, vol. 210(2), pages 379-404.
    4. Wooldridge, Jeffrey M., 1990. "A Unified Approach to Robust, Regression-Based Specification Tests," Econometric Theory, Cambridge University Press, vol. 6(1), pages 17-43, March.
    5. Newey, Whitney K, 1985. "Maximum Likelihood Specification Testing and Conditional Moment Tests," Econometrica, Econometric Society, vol. 53(5), pages 1047-1070, September.
    6. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    7. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    8. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    9. John Xu Zheng, 1996. "A consistent test of functional form via nonparametric estimation techniques," Journal of Econometrics, Elsevier, vol. 75(2), pages 263-289, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paulo Parente & Richard Smith, 2012. "Exogeneity in semiparametric moment condition models," CeMMAP working papers 30/12, Institute for Fiscal Studies.
    2. Sun, Shuang & Song, Zening & Song, Xiaojun, 2025. "Unified specification tests in partially linear time series models," Computational Statistics & Data Analysis, Elsevier, vol. 203(C).
    3. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    4. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    5. Juhl, Ted & Sosa-Escudero, Walter, 2014. "Testing for heteroskedasticity in fixed effects models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 484-494.
    6. Amengual, Dante & Fiorentini, Gabriele & Sentana, Enrique, 2024. "Specification tests for non-Gaussian structural vector autoregressions," Journal of Econometrics, Elsevier, vol. 244(2).
    7. Xu Guo & Gao-Rong Li & Michael McAleer & Wing-Keung Wong, 2018. "Specification Testing of Production in a Stochastic Frontier Model," Sustainability, MDPI, vol. 10(9), pages 1-10, August.
    8. Xu Guo & Wangli Xu & Lixing Zhu, 2015. "Model checking for parametric regressions with response missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 229-259, April.
    9. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    10. Montes-Rojas, Gabriel & Sosa-Escudero, Walter, 2011. "Robust tests for heteroskedasticity in the one-way error components model," Journal of Econometrics, Elsevier, vol. 160(2), pages 300-310, February.
    11. Skeels, Christopher L. & Vella, Francis, 1999. "A Monte Carlo investigation of the sampling behavior of conditional moment tests in Tobit and Probit models," Journal of Econometrics, Elsevier, vol. 92(2), pages 275-294, October.
    12. Cuizhen Niu & Lixing Zhu, 2018. "A robust adaptive-to-model enhancement test for parametric single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1013-1045, October.
    13. Liangjun Su & Yundong Tu & Aman Ullah, 2015. "Testing Additive Separability of Error Term in Nonparametric Structural Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 1057-1088, December.
    14. Smith, Richard J., 2011. "Gel Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1192-1235, December.
    15. Yi-Ting Chen & Zhongjun Qu, 2015. "M Tests with a New Normalization Matrix," Econometric Reviews, Taylor & Francis Journals, vol. 34(5), pages 617-652, May.
    16. Junmin Liu & Deli Zhu & Luoyao Yu & Xuehu Zhu, 2023. "Specification testing of partially linear single-index models: a groupwise dimension reduction-based adaptive-to-model approach," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 232-262, March.
    17. Yi-Ting Chen, 2016. "Testing for Granger Causality in Moments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(2), pages 265-288, April.
    18. Tae-Hwy Lee & Zhou Xi & Ru Zhang, 2013. "Testing for Neglected Nonlinearity Using Regularized Artificial Neural Networks," Working Papers 201422, University of California at Riverside, Department of Economics, revised Apr 2012.
    19. Lejeune, Bernard, 2009. "A diagnostic m-test for distributional specification of parametric conditional heteroscedasticity models for financial data," Journal of Empirical Finance, Elsevier, vol. 16(3), pages 507-523, June.
    20. Guo, Xu & Song, Lianlian & Fang, Yun & Zhu, Lixing, 2019. "Model checking for general linear regression with nonignorable missing response," Computational Statistics & Data Analysis, Elsevier, vol. 138(C), pages 1-12.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.01161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.