IDEAS home Printed from https://ideas.repec.org/a/bla/anzsta/v62y2020i4p467-484.html
   My bibliography  Save this article

Efficient error variance estimation in non‐parametric regression

Author

Listed:
  • Zhijian Li
  • Wei Lin

Abstract

Error variance estimation plays a key role in the analysis of homogeneous non‐parametric regression models. For a random design model, most methods in the literature for error variance estimation assume the independence between the predictor variable X and the error ε. In this work, we derive the optimal semi‐parametric efficiency bound for the error variance σ2=var(ϵ) without such an independence assumption. A residual‐based efficient estimator for σ2 is proposed and its asymptotic normality is established. An extensive simulation study is conducted, which shows that our proposed estimator works very favourably against competitors. A simple real‐data example is also presented.

Suggested Citation

  • Zhijian Li & Wei Lin, 2020. "Efficient error variance estimation in non‐parametric regression," Australian & New Zealand Journal of Statistics, Australian Statistical Publishing Association Inc., vol. 62(4), pages 467-484, December.
    • Handle: RePEc:bla:anzsta:v:62:y:2020:i:4:p:467-484
    DOI: 10.1111/anzs.12311
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/anzs.12311
    Download Restriction: no
    File URL: https://libkey.io/10.1111/anzs.12311?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    2. Patrick Royston & Douglas G. Altman, 1994. "Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric Modelling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 43(3), pages 429-453, September.
    3. WenWu Wang & Lu Lin & Li Yu, 2017. "Optimal variance estimation based on lagged second-order difference in nonparametric regression," Computational Statistics, Springer, vol. 32(3), pages 1047-1063, September.
    4. Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
    5. Wang, WenWu & Yu, Ping, 2017. "Asymptotically optimal differenced estimators of error variance in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 105(C), pages 125-143.
    6. Tiejun Tong & Yuedong Wang, 2005. "Estimating residual variance in nonparametric regression using least squares," Biometrika, Biometrika Trust, vol. 92(4), pages 821-830, December.
    7. Jichang Du & Anton Schick, 2009. "A covariate-matched estimator of the error variance in nonparametric regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(3), pages 263-285.
    8. H. Dette & A. Munk & T. Wagner, 1998. "Estimating the variance in nonparametric regression—what is a reasonable choice?," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(4), pages 751-764.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sayanti Guha Majumdar & Anil Rai & Dwijesh Chandra Mishra, 2023. "Estimation of Error Variance in Genomic Selection for Ultrahigh Dimensional Data," Agriculture, MDPI, vol. 13(4), pages 1-16, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, WenWu & Yu, Ping, 2017. "Asymptotically optimal differenced estimators of error variance in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 105(C), pages 125-143.
    2. Yuejin Zhou & Yebin Cheng & Wenlin Dai & Tiejun Tong, 2018. "Optimal difference-based estimation for partially linear models," Computational Statistics, Springer, vol. 33(2), pages 863-885, June.
    3. Peter Hall & Joel L. Horowitz, 2013. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 29/13, Institute for Fiscal Studies.
    4. Ieva Axt & Roland Fried, 2020. "On variance estimation under shifts in the mean," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(3), pages 417-457, September.
    5. Wenlin Dai & Tiejun Tong, 2014. "Variance estimation in nonparametric regression with jump discontinuities," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(3), pages 530-545, March.
    6. Kyungchul Song, 2009. "Efficient Estimation of Average Treatment Effects under Treatment-Based Sampling," PIER Working Paper Archive 09-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    7. Peter Hall & Joel L. Horowitz, 2012. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 14/12, Institute for Fiscal Studies.
    8. WenWu Wang & Lu Lin & Li Yu, 2017. "Optimal variance estimation based on lagged second-order difference in nonparametric regression," Computational Statistics, Springer, vol. 32(3), pages 1047-1063, September.
    9. Davide Viviano & Jelena Bradic, 2020. "Fair Policy Targeting," Papers 2005.12395, arXiv.org, revised Jun 2022.
    10. Noémi Kreif & Richard Grieve & Iván Díaz & David Harrison, 2015. "Evaluation of the Effect of a Continuous Treatment: A Machine Learning Approach with an Application to Treatment for Traumatic Brain Injury," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1213-1228, September.
    11. Proto, Eugenio & Rustichini, Aldo, 2012. "Life Satisfaction, Household Income and Personality Traits," CAGE Online Working Paper Series 86, Competitive Advantage in the Global Economy (CAGE).
    12. Aboubacar Amiri & Baba Thiam, 2018. "Regression estimation by local polynomial fitting for multivariate data streams," Statistical Papers, Springer, vol. 59(2), pages 813-843, June.
    13. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    14. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    15. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    16. Christel Faes & Marc Aerts & Helena Geys & Geert Molenberghs, 2007. "Model Averaging Using Fractional Polynomials to Estimate a Safe Level of Exposure," Risk Analysis, John Wiley & Sons, vol. 27(1), pages 111-123, February.
    17. Adrian Adermon & Mikael Lindahl & Daniel Waldenström, 2018. "Intergenerational Wealth Mobility and the Role of Inheritance: Evidence from Multiple Generations," Economic Journal, Royal Economic Society, vol. 128(612), pages 482-513, July.
    18. Geweke, John & Petrella, Lea, 2014. "Likelihood-based inference for regular functions with fractional polynomial approximations," Journal of Econometrics, Elsevier, vol. 183(1), pages 22-30.
    19. Franklin, Simon, 2020. "Enabled to work: The impact of government housing on slum dwellers in South Africa," Journal of Urban Economics, Elsevier, vol. 118(C).
    20. Nishiyama, Yoshihiko & Hitomi, Kohtaro & Kawasaki, Yoshinori & Jeong, Kiho, 2011. "A consistent nonparametric test for nonlinear causality—Specification in time series regression," Journal of Econometrics, Elsevier, vol. 165(1), pages 112-127.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:anzsta:v:62:y:2020:i:4:p:467-484. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=1369-1473 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.