IDEAS home Printed from https://ideas.repec.org/p/hum/wpaper/sfb649dp2006-036.html
   My bibliography  Save this paper

Spatial aggregation of local likelihood estimates with applications to classification

Author

Listed:
  • Denis Belomestny
  • Vladimir Spokoiny

Abstract

This paper presents a new method for spatially adaptive local likelihood estimation which applies to a broad class of nonparametric models, including the Gaussian, Poisson and binary response models. The main idea of themethod is given a sequence of local likelihood estimates (``weak´´ estimates),to construct a new aggregated estimate whose pointwise risk is of order of the smallest risk among all ``weak´´ estimates. We also propose a new approach towards selecting the parameters of the procedure by providing the prescribed behavior of the resulting estimate in the simple parametric situation. We establish a number of important theoretical results concerning the optimality of the aggregated estimate. In particular, our ``oracle´´ results claims that its risk is up to some logarithmic multiplier equal to the smallest risk for the given family of estimates. The performance of the procedure is illustrated by application to the classification problem. A numerical study demonstrates its nice performance in simulated and real life examples.

Suggested Citation

  • Denis Belomestny & Vladimir Spokoiny, 2006. "Spatial aggregation of local likelihood estimates with applications to classification," SFB 649 Discussion Papers SFB649DP2006-036, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  • Handle: RePEc:hum:wpaper:sfb649dp2006-036
    as

    Download full text from publisher

    File URL: http://sfb649.wiwi.hu-berlin.de/papers/pdf/SFB649DP2006-036.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Spokoiny, Vladimir G., 1998. "Estimation of a function with discontinuities via local polynomial fit with an adaptive window choice," SFB 373 Discussion Papers 1998,1, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mstislav Elagin, 2008. "Locally adaptive estimation methods with application to univariate time series," Papers 0812.0449, arXiv.org.
    2. Ying Chen & Bo Li, 2017. "An Adaptive Functional Autoregressive Forecast Model to Predict Electricity Price Curves," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 371-388, July.
    3. Ying Chen & Wolfgang Härdle & Uta Pigorsch, 2009. "Localized Realized Volatility Modelling," SFB 649 Discussion Papers SFB649DP2009-003, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    4. Denis Belomestny & Grigori Milstein & Vladimir Spokoiny, 2009. "Regression methods in pricing American and Bermudan options using consumption processes," Quantitative Finance, Taylor & Francis Journals, vol. 9(3), pages 315-327.
    5. Ying Chen & Wolfgang Härdle & Vladimir Spokoiny, 2006. "GHICA - Risk Analysis with GH Distributions and Independent Components," SFB 649 Discussion Papers SFB649DP2006-078, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    6. Dedy Dwi Prastyo & Wolfgang Karl Härdle, 2014. "Localising Forward Intensities for Multiperiod Corporate Default," SFB 649 Discussion Papers SFB649DP2014-040, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessandro Casini & Pierre Perron, 2021. "Change-Point Analysis of Time Series with Evolutionary Spectra," Papers 2106.02031, arXiv.org, revised Jun 2021.
    2. Čížek, Pavel & Koo, Chao Hui, 2021. "Jump-preserving varying-coefficient models for nonlinear time series," Econometrics and Statistics, Elsevier, vol. 19(C), pages 58-96.
    3. Gao, Jiti & Gijbels, Irene & Van Bellegem, Sebastien, 2008. "Nonparametric simultaneous testing for structural breaks," Journal of Econometrics, Elsevier, vol. 143(1), pages 123-142, March.
    4. Vincent Guigues, 2012. "Nonparametric multivariate breakpoint detection for the means, variances, and covariances of a discrete time stochastic process," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(4), pages 857-882, December.
    5. Bruno Spilak & Wolfgang Karl Härdle, 2022. "Tail-Risk Protection: Machine Learning Meets Modern Econometrics," Springer Books, in: Cheng-Few Lee & Alice C. Lee (ed.), Encyclopedia of Finance, edition 0, chapter 92, pages 2177-2211, Springer.
    6. Xiu Xu & Andrija Mihoci & Wolfgang Karl Hardle, 2020. "lCARE -- localizing Conditional AutoRegressive Expectiles," Papers 2009.13215, arXiv.org.
    7. Irène Gijbels & Alexandre Lambert & Peihua Qiu, 2007. "Jump-Preserving Regression and Smoothing using Local Linear Fitting: A Compromise," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 59(2), pages 235-272, June.
    8. Xu, Xiu & Mihoci, Andrija & Härdle, Wolfgang Karl, 2018. "lCARE - localizing conditional autoregressive expectiles," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 198-220.
    9. Wolfgang Karl Härdle & Andrija Mihoci & Christopher Hian-Ann Ting, 2014. "Adaptive Order Flow Forecasting with Multiplicative Error Models," SFB 649 Discussion Papers SFB649DP2014-035, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    10. Fengler, Matthias & Okhrin, Ostap, 2012. "Realized Copula," Economics Working Paper Series 1214, University of St. Gallen, School of Economics and Political Science.
    11. Porter, Jack & Yu, Ping, 2015. "Regression discontinuity designs with unknown discontinuity points: Testing and estimation," Journal of Econometrics, Elsevier, vol. 189(1), pages 132-147.
    12. Klochkov, Yegor & Härdle, Wolfgang Karl & Xu, Xiu, 2019. "Localizing Multivariate CAViaR," IRTG 1792 Discussion Papers 2019-007, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    13. Fengler, Matthias R. & Okhrin, Ostap, 2016. "Managing risk with a realized copula parameter," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 131-152.
    14. Wolfgang K. Härdle & Nikolaus Hautsch & Andrija Mihoci, 2015. "Local Adaptive Multiplicative Error Models for High‐Frequency Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 529-550, June.
    15. Andrija Mihoci & Christopher Hian-Ann Ting & Meng-Jou Lu & Kainat Khowaja, 2022. "Adaptive order flow forecasting with multiplicative error models," Digital Finance, Springer, vol. 4(1), pages 89-108, March.
    16. Dedy Dwi Prastyo & Wolfgang Karl Härdle, 2014. "Localising Forward Intensities for Multiperiod Corporate Default," SFB 649 Discussion Papers SFB649DP2014-040, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    17. Cizek, P. & Haerdle, W. & Spokoiny, V., 2007. "Adaptive Pointwise Estimation in Time-Inhomogeneous Time-Series Models," Discussion Paper 2007-35, Tilburg University, Center for Economic Research.
    18. Steland Ansgar, 2003. "Jump-preserving monitoring of dependent time series using pilot estimators," Statistics & Risk Modeling, De Gruyter, vol. 21(4/2003), pages 343-366, April.
    19. Koo, Chao, 2018. "Essays on functional coefficient models," Other publications TiSEM ba87b8a5-3c55-40ec-967d-9, Tilburg University, School of Economics and Management.
    20. Giammarino, Flavia & Barrieu, Pauline, 2009. "A semiparametric model for the systematic factors of portfolio credit risk premia," Journal of Empirical Finance, Elsevier, vol. 16(4), pages 655-670, September.

    More about this item

    Keywords

    adaptive weights; local likelihood; exponential family; classification;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hum:wpaper:sfb649dp2006-036. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RDC-Team (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.