IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v22y2013i2p251-277.html
   My bibliography  Save this article

Penalized spline approaches for functional logit regression

Author

Listed:
  • M. Aguilera-Morillo
  • Ana Aguilera
  • Manuel Escabias
  • Mariano Valderrama

Abstract

The problem of multicollinearity associated with the estimation of a functional logit model can be solved by using as predictor variables a set of functional principal components. The functional parameter estimated by functional principal component logit regression is often nonsmooth and then difficult to interpret. To solve this problem, different penalized spline estimations of the functional logit model are proposed in this paper. All of them are based on smoothed functional PCA and/or a discrete penalty in the log-likelihood criterion in terms of B-spline expansions of the sample curves and the functional parameter. The ability of these smoothing approaches to provide an accurate estimation of the functional parameter and their classification performance with respect to unpenalized functional PCA and LDA-PLS are evaluated via simulation and application to real data. Leave-one-out cross-validation and generalized cross-validation are adapted to select the smoothing parameter and the number of principal components or basis functions associated with the considered approaches. Copyright Sociedad de Estadística e Investigación Operativa 2013

Suggested Citation

  • M. Aguilera-Morillo & Ana Aguilera & Manuel Escabias & Mariano Valderrama, 2013. "Penalized spline approaches for functional logit regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 251-277, June.
  • Handle: RePEc:spr:testjl:v:22:y:2013:i:2:p:251-277
    DOI: 10.1007/s11749-012-0307-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11749-012-0307-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11749-012-0307-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Harezlak, Jaroslaw & Coull, Brent A. & Laird, Nan M. & Magari, Shannon R. & Christiani, David C., 2007. "Penalized solutions to functional regression problems," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4911-4925, June.
    2. Escabias, M. & Aguilera, A.M. & Valderrama, M.J., 2007. "Functional PLS logit regression model," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4891-4902, June.
    3. Cardot, Hervé & Sarda, Pacal, 2005. "Estimation in generalized linear models for functional data via penalized likelihood," Journal of Multivariate Analysis, Elsevier, vol. 92(1), pages 24-41, January.
    4. Cristian Preda & Gilbert Saporta & Caroline Lévéder, 2007. "PLS classification of functional data," Computational Statistics, Springer, vol. 22(2), pages 223-235, July.
    5. Aguilera, Ana M. & Escabias, Manuel & Valderrama, Mariano J., 2008. "Discussion of different logistic models with functional data. Application to Systemic Lupus Erythematosus," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 151-163, September.
    6. Gareth M. James, 2002. "Generalized linear models with functional predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 411-432, August.
    7. Cardot, Herve & Crambes, Christophe & Kneip, Alois & Sarda, Pascal, 2007. "Smoothing splines estimators in functional linear regression with errors-in-variables," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4832-4848, June.
    8. Ferraty, F. & Vieu, P., 2003. "Curves discrimination: a nonparametric functional approach," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 161-173, October.
    9. Francisco Ocaña & Ana Aguilera & Manuel Escabias, 2007. "Computational considerations in functional principal component analysis," Computational Statistics, Springer, vol. 22(3), pages 449-465, September.
    10. Reiss, Philip T. & Ogden, R. Todd, 2007. "Functional Principal Component Regression and Functional Partial Least Squares," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 984-996, September.
    11. van der Linde, Angelika, 2008. "Variational Bayesian functional PCA," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 517-533, December.
    12. S. le Cessie & J. C. van Houwelingen, 1992. "Ridge Estimators in Logistic Regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(1), pages 191-201, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Román Salmerón Gómez & Ainara Rodríguez Sánchez & Catalina García García & José García Pérez, 2020. "The VIF and MSE in Raise Regression," Mathematics, MDPI, vol. 8(4), pages 1-28, April.
    2. Harold A. Hernández-Roig & M. Carmen Aguilera-Morillo & Rosa E. Lillo, 2021. "Functional Modeling of High-Dimensional Data: A Manifold Learning Approach," Mathematics, MDPI, vol. 9(4), pages 1-22, February.
    3. Christian Acal & Manuel Escabias & Ana M. Aguilera & Mariano J. Valderrama, 2021. "COVID-19 Data Imputation by Multiple Function-on-Function Principal Component Regression," Mathematics, MDPI, vol. 9(11), pages 1-23, May.
    4. Aguilera-Morillo, M. Carmen & Aguilera, Ana M. & Jiménez-Molinos, Francisco & Roldán, Juan B., 2019. "Stochastic modeling of Random Access Memories reset transitions," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 159(C), pages 197-209.
    5. Ana Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    6. Marc Vidal & Mattia Rosso & Ana M. Aguilera, 2021. "Bi-Smoothed Functional Independent Component Analysis for EEG Artifact Removal," Mathematics, MDPI, vol. 9(11), pages 1-17, May.
    7. Matsui, Hidetoshi, 2014. "Variable and boundary selection for functional data via multiclass logistic regression modeling," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 176-185.
    8. Kazakevičiūtė, Agne & Olivo, Malini, 2017. "Point separation in logistic regression on Hilbert space-valued variables," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 84-88.
    9. Maria Ruiz-Medina & Rosa Espejo & Elvira Romano, 2014. "Spatial functional normal mixed effect approach for curve classification," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(3), pages 257-285, September.
    10. Ana M. Aguilera & Manuel Escabias & Francisco A. Ocaña & Mariano J. Valderrama, 2015. "Functional Wavelet-Based Modelling of Dependence Between Lupus and Stress," Methodology and Computing in Applied Probability, Springer, vol. 17(4), pages 1015-1028, December.
    11. Aguilera Morillo, María del Carmen & Durbán, María & Aguilera, Ana M., 2015. "Penalized functional spatial regression," DES - Working Papers. Statistics and Econometrics. WS 21206, Universidad Carlos III de Madrid. Departamento de Estadística.
    12. Ana M. Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    13. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Febrero-Bande, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 35-40, March.
    2. Mousavi, Seyed Nourollah & Sørensen, Helle, 2017. "Multinomial functional regression with wavelets and LASSO penalization," Econometrics and Statistics, Elsevier, vol. 1(C), pages 150-166.
    3. Aguilera, Ana M. & Escabias, Manuel & Valderrama, Mariano J., 2008. "Forecasting binary longitudinal data by a functional PC-ARIMA model," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 3187-3197, February.
    4. Manuel Febrero-Bande, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 35-40, March.
    5. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    6. Ana M. Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    7. Aguilera, Ana M. & Escabias, Manuel & Valderrama, Mariano J., 2008. "Discussion of different logistic models with functional data. Application to Systemic Lupus Erythematosus," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 151-163, September.
    8. Ana Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    9. Manuel Escabias & Ana Aguilera & M. Aguilera-Morillo, 2014. "Functional PCA and Base-Line Logit Models," Journal of Classification, Springer;The Classification Society, vol. 31(3), pages 296-324, October.
    10. Jonathan E. Gellar & Elizabeth Colantuoni & Dale M. Needham & Ciprian M. Crainiceanu, 2014. "Variable-Domain Functional Regression for Modeling ICU Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1425-1439, December.
    11. Ufuk Beyaztas & Han Lin Shang, 2021. "A partial least squares approach for function-on-function interaction regression," Computational Statistics, Springer, vol. 36(2), pages 911-939, June.
    12. Ciarleglio, Adam & Todd Ogden, R., 2016. "Wavelet-based scalar-on-function finite mixture regression models," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 86-96.
    13. Fabrizio Maturo & Rosanna Verde, 2023. "Supervised classification of curves via a combined use of functional data analysis and tree-based methods," Computational Statistics, Springer, vol. 38(1), pages 419-459, March.
    14. Kazakevičiūtė, Agne & Olivo, Malini, 2017. "Point separation in logistic regression on Hilbert space-valued variables," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 84-88.
    15. Tomasz Górecki & Mirosław Krzyśko & Waldemar Wołyński, 2015. "Classification Problems Based On Regression Models For Multi-Dimensional Functional Data," Statistics in Transition New Series, Polish Statistical Association, vol. 16(1), pages 97-110, March.
    16. Ahmedou, Aziza & Marion, Jean-Marie & Pumo, Besnik, 2016. "Generalized linear model with functional predictors and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 313-324.
    17. Mirosław Krzyśko & Tomasz Górecki & Waldemar Wołyński, 2015. "Classification problems based on regression models for multi-dimensional functional data," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 16(1), pages 97-110, May.
    18. Ahmed, M.S. & Attouch, M.K. & Dabo-Niang, S., 2018. "Binary functional linear models under choice-based sampling," Econometrics and Statistics, Elsevier, vol. 7(C), pages 134-152.
    19. Sudaraka Tholkage & Qi Zheng & Karunarathna B. Kulasekera, 2022. "Conditional Kaplan–Meier Estimator with Functional Covariates for Time-to-Event Data," Stats, MDPI, vol. 5(4), pages 1-17, November.
    20. Ferraty, Frédéric & Vieu, Philippe, 2009. "Additive prediction and boosting for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1400-1413, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:22:y:2013:i:2:p:251-277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.