IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v97y2006i9p2023-2033.html
   My bibliography  Save this article

Nonlinear regression modeling via regularized wavelets and smoothing parameter selection

Author

Listed:
  • Fujii, Toru
  • Konishi, Sadanori

Abstract

We introduce regularized wavelet-based methods for nonlinear regression modeling when design points are not equally spaced. A crucial issue in the model building process is a choice of tuning parameters that control the smoothness of a fitted curve. We derive model selection criteria from an information-theoretic and also Bayesian approaches. Monte Carlo simulations are conducted to examine the performance of the proposed wavelet-based modeling technique.

Suggested Citation

  • Fujii, Toru & Konishi, Sadanori, 2006. "Nonlinear regression modeling via regularized wavelets and smoothing parameter selection," Journal of Multivariate Analysis, Elsevier, vol. 97(9), pages 2023-2033, October.
    • Handle: RePEc:eee:jmvana:v:97:y:2006:i:9:p:2023-2033
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(06)00085-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sadanori Konishi, 2004. "Bayesian information criteria and smoothing parameter selection in radial basis function networks," Biometrika, Biometrika Trust, vol. 91(1), pages 27-43, March.
    2. Marianna Pensky & Brani Vidakovic, 2001. "On Non-Equally Spaced Wavelet Regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(4), pages 681-690, December.
    3. Antoniadis, Anestis & Dinh Tuan Pham, 1998. "Wavelet regression for random or irregular design," Computational Statistics & Data Analysis, Elsevier, vol. 28(4), pages 353-369, October.
    4. Antoniadis A. & Fan J., 2001. "Regularization of Wavelet Approximations," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 939-967, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hidetoshi Matsui & Takamitsu Araki & Sadanori Konishi, 2011. "Multiclass Functional Discriminant Analysis and Its Application to Gesture Recognition," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 227-243, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoniadis, Anestis & Sapatinas, Theofanis, 2003. "Wavelet methods for continuous-time prediction using Hilbert-valued autoregressive processes," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 133-158, October.
    2. Michael Levine, 2019. "Robust functional estimation in the multivariate partial linear model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 743-770, August.
    3. Amato, Umberto & Antoniadis, Anestis & De Feis, Italia & Goude, Yannig & Lagache, Audrey, 2021. "Forecasting high resolution electricity demand data with additive models including smooth and jagged components," International Journal of Forecasting, Elsevier, vol. 37(1), pages 171-185.
    4. Kleijnen, Jack P. C., 2005. "An overview of the design and analysis of simulation experiments for sensitivity analysis," European Journal of Operational Research, Elsevier, vol. 164(2), pages 287-300, July.
    5. Shuichi Kawano, 2014. "Selection of tuning parameters in bridge regression models via Bayesian information criterion," Statistical Papers, Springer, vol. 55(4), pages 1207-1223, November.
    6. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    7. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    8. Joel L. Horowitz & Jian Huang, 2012. "Penalized estimation of high-dimensional models under a generalized sparsity condition," CeMMAP working papers 17/12, Institute for Fiscal Studies.
    9. Le Zhang & Qiang Yang, 2020. "Investigation of the Design and Fault Prediction Method for an Abrasive Particle Sensor Used in Wind Turbine Gearbox," Energies, MDPI, vol. 13(2), pages 1-13, January.
    10. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    11. Matthieu Garcin & Dominique Guegan, 2015. "Optimal wavelet shrinkage of a noisy dynamical system with non-linear noise impact," Documents de travail du Centre d'Economie de la Sorbonne 15085, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    12. Sophie Lambert-Lacroix & Laurent Zwald, 2016. "The adaptive BerHu penalty in robust regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(3), pages 487-514, September.
    13. Joel L. Horowitz & Jian Huang, 2012. "Penalized estimation of high-dimensional models under a generalized sparsity condition," CeMMAP working papers CWP17/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Chen, Ying & Niu, Linlin & Chen, Ray-Bing & He, Qiang, 2019. "Sparse-Group Independent Component Analysis with application to yield curves prediction," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 76-89.
    15. Sumanjay Dutta & Shashi Jain, 2023. "Precision versus Shrinkage: A Comparative Analysis of Covariance Estimation Methods for Portfolio Allocation," Papers 2305.11298, arXiv.org.
    16. Saman Banafti & Tae-Hwy Lee, 2022. "Inferential Theory for Granular Instrumental Variables in High Dimensions," Papers 2201.06605, arXiv.org, revised Sep 2023.
    17. Hidetoshi Matsui & Takamitsu Araki & Sadanori Konishi, 2011. "Multiclass Functional Discriminant Analysis and Its Application to Gesture Recognition," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 227-243, July.
    18. Hee-Seok Oh & Donghoh Kim & Youngjo Lee, 2009. "Cross-validated wavelet shrinkage," Computational Statistics, Springer, vol. 24(3), pages 497-512, August.
    19. Chun Park & Inyoung Kim, 2015. "Efficient resolution and basis functions selection in wavelet regression," Computational Statistics, Springer, vol. 30(4), pages 957-986, December.
    20. Kim, Donghoh & Oh, Hee-Seok, 2006. "CVTresh: R Package for Level-Dependent Cross-Validation Thresholding," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 15(i10).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:97:y:2006:i:9:p:2023-2033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.