IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v101y2010i5p1067-1078.html
   My bibliography  Save this article

Estimating the error distribution in nonparametric multiple regression with applications to model testing

Author

Listed:
  • Neumeyer, Natalie
  • Van Keilegom, Ingrid

Abstract

In this paper we consider the estimation of the error distribution in a heteroscedastic nonparametric regression model with multivariate covariates. As estimator we consider the empirical distribution function of residuals, which are obtained from multivariate local polynomial fits of the regression and variance functions, respectively. Weak convergence of the empirical residual process to a Gaussian process is proved. We also consider various applications for testing model assumptions in nonparametric multiple regression. The model tests obtained are able to detect local alternatives that converge to zero at an n-1/2-rate, independent of the covariate dimension. We consider in detail a test for additivity of the regression function.

Suggested Citation

  • Neumeyer, Natalie & Van Keilegom, Ingrid, 2010. "Estimating the error distribution in nonparametric multiple regression with applications to model testing," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1067-1078, May.
    • Handle: RePEc:eee:jmvana:v:101:y:2010:i:5:p:1067-1078
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(10)00022-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Einmahl, John H.J. & Van Keilegom, Ingrid, 2008. "Specification tests in nonparametric regression," Journal of Econometrics, Elsevier, vol. 143(1), pages 88-102, March.
    2. Gozalo, Pedro L. & Linton, Oliver B., 2001. "Testing additivity in generalized nonparametric regression models with estimated parameters," Journal of Econometrics, Elsevier, vol. 104(1), pages 1-48, August.
    3. Hardle, W. & Tsybakov, A., 1997. "Local polynomial estimators of the volatility function in nonparametric autoregression," Journal of Econometrics, Elsevier, vol. 81(1), pages 223-242, November.
    4. Holger Dette & Juan Carlos Pardo‐Fernández & Ingrid Van Keilegom, 2009. "Goodness‐of‐Fit Tests for Multiplicative Models with Dependent Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 782-799, December.
    5. Natalie Neumeyer & Stefan Sperlich, 2006. "Comparison of Separable Components in Different Samples," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(3), pages 477-501, September.
    6. Pardo-Fernández, Juan Carlos, 2007. "Comparison of error distributions in nonparametric regression," Statistics & Probability Letters, Elsevier, vol. 77(3), pages 350-356, February.
    7. Yang, Lijian & Park, Byeong U. & Xue, Lan & Hardle, Wolfgang, 2006. "Estimation and Testing for Varying Coefficients in Additive Models With Marginal Integration," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1212-1227, September.
    8. Michael G. Akritas & Ingrid Van Keilegom, 2001. "Non‐parametric Estimation of the Residual Distribution," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(3), pages 549-567, September.
    9. Holger Dette & Natalie Neumeyer & Ingrid Van Keilegom, 2007. "A new test for the parametric form of the variance function in non‐parametric regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 903-917, November.
    10. Ingrid Keilegom & Wenceslao González Manteiga & César Sánchez Sellero, 2008. "Goodness-of-fit tests in parametric regression based on the estimation of the error distribution," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 401-415, August.
    11. Müller Ursula U. & Schick Anton & Wefelmeyer Wolfgang, 2007. "Estimating the error distribution function in semiparametric regression," Statistics & Risk Modeling, De Gruyter, vol. 25(1/2007), pages 1-18, January.
    12. Elias Masry, 1996. "Multivariate Local Polynomial Regression For Time Series:Uniform Strong Consistency And Rates," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(6), pages 571-599, November.
    13. Natalie Neumeyer, 2009. "Smooth Residual Bootstrap for Empirical Processes of Non‐parametric Regression Residuals," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(2), pages 204-228, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Florens, Jean-Pierre & Simar, Léopold & Van Keilegom, Ingrid, 2014. "Frontier estimation in nonparametric location-scale models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 456-470.
    2. Neumeyer, Natalie & Noh, Hohsuk & Van Keilegom, Ingrid, 2014. "Heteroscedastic semiparametric transformation models: estimation and testing for validity," LIDAM Discussion Papers ISBA 2014047, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    3. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    4. Feve, Frederique & Florens, Jean-Pierre & Van Keilegom, Ingrid, 2012. "Estimation of conditional ranks and tests of exogeneity in nonparametric nonseparable models," LIDAM Discussion Papers ISBA 2012036, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    5. Jun Zhang & Zhenghui Feng & Xiaoguang Wang, 2018. "A constructive hypothesis test for the single-index models with two groups," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1077-1114, October.
    6. Babii, Andrii & Florens, Jean-Pierre, 2017. "Are unobservables separable?," TSE Working Papers 17-802, Toulouse School of Economics (TSE).
    7. Neumeyer, Natalie, 2009. "Testing independence in nonparametric regression," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1551-1566, August.
    8. Holger Dette & Juan Carlos Pardo‐Fernández & Ingrid Van Keilegom, 2009. "Goodness‐of‐Fit Tests for Multiplicative Models with Dependent Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 782-799, December.
    9. Natalie Neumeyer, 2009. "Smooth Residual Bootstrap for Empirical Processes of Non‐parametric Regression Residuals," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(2), pages 204-228, June.
    10. Melanie Birke & Natalie Neumeyer, 2013. "Testing Monotonicity of Regression Functions – An Empirical Process Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(3), pages 438-454, September.
    11. Colling, Benjamin & Van Keilegom, Ingrid, 2016. "Goodness-of-fit tests in semiparametric transformation models using the integrated regression function," LIDAM Discussion Papers ISBA 2016031, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    12. Gu, Lijie & Wang, Suojin & Yang, Lijian, 2021. "Smooth simultaneous confidence band for the error distribution function in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    13. Escanciano, Juan Carlos & Pardo-Fernandez, Juan Carlos & Van Keilegom, Ingrid, 2015. "Asymptotic distribution-free tests for semiparametric regressions," LIDAM Discussion Papers ISBA 2015001, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    14. Heuchenne, Cédric & Van Keilegom, Ingrid, 2010. "Goodness-of-fit tests for the error distribution in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 54(8), pages 1942-1951, August.
    15. Colling, Benjamin & Van Keilegom, Ingrid, 2017. "Goodness-of-fit tests in semiparametric transformation models using the integrated regression function," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 10-30.
    16. Pardo-Fernandez, Juan Carlos & Jimenez-Gamero, Maria Dolores & El Ghouch, Anouar, 2013. "A nonparametric ANOVA-type test for regression curves based on characteristic functions," LIDAM Discussion Papers ISBA 2013022, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    17. Hušková, Marie & Meintanis, Simos G. & Pretorius, Charl, 2020. "Tests for validity of the semiparametric heteroskedastic transformation model," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    18. Portier, François & Segers, Johan, 2018. "On the weak convergence of the empirical conditional copula under a simplifying assumption," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 160-181.
    19. Sankar, Subhra & Bergsma, Wicher & Dassios, Angelos, 2017. "Testing independence of covariates and errors in nonparametric regression," LSE Research Online Documents on Economics 83780, London School of Economics and Political Science, LSE Library.
    20. Einmahl, John H.J. & Van Keilegom, Ingrid, 2008. "Specification tests in nonparametric regression," Journal of Econometrics, Elsevier, vol. 143(1), pages 88-102, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:101:y:2010:i:5:p:1067-1078. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.