IDEAS home Printed from https://ideas.repec.org/p/cte/wsrepe/24607.html
   My bibliography  Save this paper

A general framework for prediction in penalized regression

Author

Listed:
  • Carballo González, Alba
  • Durbán Reguera, María Luz
  • Lee, Dae-Jin

Abstract

We present several methods for prediction of new observations in penalized regression using different methodologies, based on the methods proposed in: i) Currie et al. (2004), ii) Gilmour et al. (2004) and iii) Sacks et al. (1989). We extend the method introduced by Currie et al. (2004) to consider the prediction of new observations in the mixed model framework. In the context of penalties based on differences between adjacent coefficients (Eilers & Marx (1996)), the equivalence of the different methods is shown. We demonstrate several properties of the new coefficients in terms of the order of the penalty. We also introduce the concept memory of a P-spline, this new idea gives us information on how much past information we are using to predict. The methodology and the concept of memory of a P-spline are illustrated with three real data sets, two of them on the yearly mortality rates of Spanish men and other on rental prices.

Suggested Citation

  • Carballo González, Alba & Durbán Reguera, María Luz & Lee, Dae-Jin, 2017. "A general framework for prediction in penalized regression," DES - Working Papers. Statistics and Econometrics. WS 24607, Universidad Carlos III de Madrid. Departamento de Estadística.
  • Handle: RePEc:cte:wsrepe:24607
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/24607/ws201711.pdf?sequence=1
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gilmour, Arthur & Cullis, Brian & Welham, Sue & Gogel, Beverley & Thompson, Robin, 2004. "An efficient computing strategy for prediction in mixed linear models," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 571-586, January.
    2. G. Yi & J. Q. Shi & T. Choi, 2011. "Penalized Gaussian Process Regression and Classification for High-Dimensional Nonlinear Data," Biometrics, The International Biometric Society, vol. 67(4), pages 1285-1294, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carballo González, Alba & Durbán Reguera, María Luz & Lee, Dae-Jin, 2019. "Out-of-sample prediction in multidimensional P-spline models," DES - Working Papers. Statistics and Econometrics. WS 28630, Universidad Carlos III de Madrid. Departamento de Estadística.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Junshu Bao & Timothy Hanson & Garnett P. McMillan & Kristin Knight, 2017. "Assessment of DPOAE test-retest difference curves via hierarchical Gaussian processes," Biometrics, The International Biometric Society, vol. 73(1), pages 334-343, March.
    2. Songhao Wang & Szu Hui Ng & William Benjamin Haskell, 2022. "A Multilevel Simulation Optimization Approach for Quantile Functions," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 569-585, January.
    3. Lee, Dae-Jin & Durbán, María, 2012. "Seasonal modulation mixed models for time series forecasting," DES - Working Papers. Statistics and Econometrics. WS ws122519, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Zhao, Kaifeng & Lian, Heng, 2016. "The Expectation–Maximization approach for Bayesian quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 96(C), pages 1-11.
    5. Adriano T. Mastrodomenico & C. Cole Hendrix & Frederick E. Below, 2018. "Nitrogen Use Efficiency and the Genetic Variation of Maize Expired Plant Variety Protection Germplasm," Agriculture, MDPI, vol. 8(1), pages 1-17, January.
    6. Brian R. Cullis & Alison B. Smith & Nicole A. Cocks & David G. Butler, 2020. "The Design of Early-Stage Plant Breeding Trials Using Genetic Relatedness," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(4), pages 553-578, December.
    7. El-Bassiouni, M. Y. & Charif, H. A., 2004. "Testing a null variance ratio in mixed models with zero degrees of freedom for error," Computational Statistics & Data Analysis, Elsevier, vol. 46(4), pages 707-719, July.
    8. Ugarte, M.D. & Goicoa, T. & Militino, A.F. & Durbán, M., 2009. "Spline smoothing in small area trend estimation and forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3616-3629, August.
    9. Emi Tanaka, 2020. "Simple outlier detection for a multi‐environmental field trial," Biometrics, The International Biometric Society, vol. 76(4), pages 1374-1382, December.
    10. Pringle, M.J. & Baxter, S.J. & Marchant, B.P. & Lark, R.M., 2008. "Spatial analysis of the error in a model of soil nitrogen," Ecological Modelling, Elsevier, vol. 211(3), pages 453-467.

    More about this item

    Keywords

    Prediction;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:wsrepe:24607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://portal.uc3m.es/portal/page/portal/dpto_estadistica .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.