IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v75y2000i2p219-244.html

Design Adaptive Nearest Neighbor Regression Estimation

Author

Listed:
  • Guerre, Emmanuel

Abstract

This paper deals with nonparametric regression estimation under arbitrary sampling with an unknown distribution. The effect of the distribution of the design, which is a nuisance parameter, can be eliminated by conditioning. An upper bound for the conditional mean squared error of k-NN estimates leads us to consider an optimal number of neighbors, which is a random function of the sampling. The corresponding estimate can be used for nonasymptotic inference and is also consistent under a minimal recurrence condition. Some deterministic equivalents are found for the random rate of convergence of this optimal estimate, for deterministic and random designs with vanishing or diverging densities. The proposed estimate is rate optimal for standard designs.

Suggested Citation

  • Guerre, Emmanuel, 2000. "Design Adaptive Nearest Neighbor Regression Estimation," Journal of Multivariate Analysis, Elsevier, vol. 75(2), pages 219-244, November.
    • Handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(00)91901-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Yakowitz, Sid, 1993. "Nearest neighbor regression estimation for null-recurrent Markov time series," Stochastic Processes and their Applications, Elsevier, vol. 48(2), pages 311-318, November.
    2. Gyorfi, Laszlo & Lugosi, Gabor, 1992. "Kernel density estimation from ergodic sample is not universally consistent," Computational Statistics & Data Analysis, Elsevier, vol. 14(4), pages 437-442, November.
    3. Spokoiny, Vladimir G., 1998. "Estimation of a function with discontinuities via local polynomial fit with an adaptive window choice," SFB 373 Discussion Papers 1998,1, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    4. Hardle, Wolfgang & Tsybakov, A. B., 1993. "How sensitive are average derivatives?," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 31-48, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guerre, 2004. "Design-Adaptive Pointwise Nonparametric Regression Estimation For Recurrent Markov Time Series," Econometrics 0411007, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Casini, Alessandro & Perron, Pierre, 2024. "Change-point analysis of time series with evolutionary spectra," Journal of Econometrics, Elsevier, vol. 242(2).
    2. Karlsen, Hans Arnfinn & Tjostheim, Dag, 1998. "Nonparametric estimation in null recurrent times series," SFB 373 Discussion Papers 1998,50, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    3. Xia, Yingcun & Härdle, Wolfgang Karl & Linton, Oliver, 2009. "Optimal smoothing for a computationally and statistically efficient single index estimator," SFB 649 Discussion Papers 2009-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    4. Goldenshluger, Alexander, 2002. "Density Deconvolution in the Circular Structural Model," Journal of Multivariate Analysis, Elsevier, vol. 81(2), pages 360-375, May.
    5. Čížek, Pavel & Koo, Chao Hui, 2021. "Jump-preserving varying-coefficient models for nonlinear time series," Econometrics and Statistics, Elsevier, vol. 19(C), pages 58-96.
    6. Algoet, Paul & Györfi, László, 1999. "Strong Universal Pointwise Consistency of Some Regression Function Estimates," Journal of Multivariate Analysis, Elsevier, vol. 71(1), pages 125-144, October.
    7. Tue Gørgens, 1999. "Semiparametric Estimation of Single-Index Transition Intensities," Discussion Papers 99-25, University of Copenhagen. Department of Economics.
    8. repec:hum:wpaper:sfb649dp2006-036 is not listed on IDEAS
    9. Linton, Oliver, 2002. "Edgeworth approximations for semiparametric instrumental variable estimators and test statistics," Journal of Econometrics, Elsevier, vol. 106(2), pages 325-368, February.
    10. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    11. Wolfgang K. Härdle & Nikolaus Hautsch & Andrija Mihoci, 2015. "Local Adaptive Multiplicative Error Models for High‐Frequency Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 529-550, June.
    12. Gao, Jiti & Gijbels, Irene & Van Bellegem, Sebastien, 2008. "Nonparametric simultaneous testing for structural breaks," Journal of Econometrics, Elsevier, vol. 143(1), pages 123-142, March.
    13. Vincent Guigues, 2012. "Nonparametric multivariate breakpoint detection for the means, variances, and covariances of a discrete time stochastic process," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(4), pages 857-882, December.
    14. Girard, Stéphane & Guillou, Armelle & Stupfler, Gilles, 2013. "Frontier estimation with kernel regression on high order moments," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 172-189.
    15. Arjen Hussem & Casper Ewijk & Harry Rele & Albert Wong, 2016. "The Ability to Pay for Long-Term Care in the Netherlands: A Life-cycle Perspective," De Economist, Springer, vol. 164(2), pages 209-234, June.
    16. Härdle, Wolfgang Karl & Mihoci, Andrija & Ting, Christopher Hian-Ann, 2014. "Adaptive order flow forecasting with multiplicative error models," SFB 649 Discussion Papers 2014-035, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    17. Kim, Peter T. & Koo, Ja-Yong & Park, Heon Jin, 2004. "Sharp minimaxity and spherical deconvolution for super-smooth error distributions," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 384-392, August.
    18. Emmanuel Guerre, 2004. "Design-Adaptive Pointwise Nonparametric Regression Estimation for Recurrent Markov Time Series," Working Papers 2004-22, Center for Research in Economics and Statistics.
    19. Kyungchul Song, 2009. "Two-Step Extremum Estimation with Estimated Single-Indices," PIER Working Paper Archive 09-012, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    20. Nishiyama, Y., 2004. "Minimum normal approximation error bandwidth selection for averaged derivatives," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 64(1), pages 53-61.
    21. Xiu Xu & Andrija Mihoci & Wolfgang Karl Hardle, 2020. "lCARE -- localizing Conditional AutoRegressive Expectiles," Papers 2009.13215, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.