IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i2p711-721.html
   My bibliography  Save this article

Neural networks for clustered and longitudinal data using mixed effects models

Author

Listed:
  • Francesca Mandel
  • Riddhi Pratim Ghosh
  • Ian Barnett

Abstract

Although most statistical methods for the analysis of longitudinal data have focused on retrospective models of association, new advances in mobile health data have presented opportunities for predicting future health status by leveraging an individual's behavioral history alongside data from similar patients. Methods that incorporate both individual‐level and sample‐level effects are critical to using these data to its full predictive capacity. Neural networks are powerful tools for prediction, but many assume input observations are independent even when they are clustered or correlated in some way, such as in longitudinal data. Generalized linear mixed models (GLMM) provide a flexible framework for modeling longitudinal data but have poor predictive power particularly when the data are highly nonlinear. We propose a generalized neural network mixed model that replaces the linear fixed effect in a GLMM with the output of a feed‐forward neural network. The model simultaneously accounts for the correlation structure and complex nonlinear relationship between input variables and outcomes, and it utilizes the predictive power of neural networks. We apply this approach to predict depression and anxiety levels of schizophrenic patients using longitudinal data collected from passive smartphone sensor data.

Suggested Citation

  • Francesca Mandel & Riddhi Pratim Ghosh & Ian Barnett, 2023. "Neural networks for clustered and longitudinal data using mixed effects models," Biometrics, The International Biometric Society, vol. 79(2), pages 711-721, June.
  • Handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:711-721
    DOI: 10.1111/biom.13615
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13615
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13615?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Langer, Sophie, 2021. "Approximating smooth functions by deep neural networks with sigmoid activation function," Journal of Multivariate Analysis, Elsevier, vol. 182(C).
    2. Kohn, Robert & Nguyen, Nghia & Nott, David & Tran, Minh-Ngoc, 2017. "Random Effects Models with Deep Neural Network Basis Functions: Methodology and Computation," Working Papers 2123/17877, University of Sydney Business School, Discipline of Business Analytics.
    3. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    4. X. Lin & D. Zhang, 1999. "Inference in generalized additive mixed modelsby using smoothing splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 381-400, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    2. Zhaoxing Gao & Ruey S. Tsay, 2021. "Divide-and-Conquer: A Distributed Hierarchical Factor Approach to Modeling Large-Scale Time Series Data," Papers 2103.14626, arXiv.org.
    3. Jun Yan & Jian Huang, 2012. "Model Selection for Cox Models with Time-Varying Coefficients," Biometrics, The International Biometric Society, vol. 68(2), pages 419-428, June.
    4. Ye, Ya-Fen & Shao, Yuan-Hai & Deng, Nai-Yang & Li, Chun-Na & Hua, Xiang-Yu, 2017. "Robust Lp-norm least squares support vector regression with feature selection," Applied Mathematics and Computation, Elsevier, vol. 305(C), pages 32-52.
    5. Jorge Tovar & Andrés Clavijo & Julián Cárdenas, 2017. "A strategy to predict association football players’ passing skills," Documentos CEDE 15821, Universidad de los Andes, Facultad de Economía, CEDE.
    6. Guillaume Sagnol & Edouard Pauwels, 2019. "An unexpected connection between Bayes A-optimal designs and the group lasso," Statistical Papers, Springer, vol. 60(2), pages 565-584, April.
    7. Diego Vidaurre & Concha Bielza & Pedro Larrañaga, 2013. "A Survey of L1 Regression," International Statistical Review, International Statistical Institute, vol. 81(3), pages 361-387, December.
    8. Bakalli, Gaetan & Guerrier, Stéphane & Scaillet, Olivier, 2023. "A penalized two-pass regression to predict stock returns with time-varying risk premia," Journal of Econometrics, Elsevier, vol. 237(2).
    9. Shuichi Kawano, 2014. "Selection of tuning parameters in bridge regression models via Bayesian information criterion," Statistical Papers, Springer, vol. 55(4), pages 1207-1223, November.
    10. Peng, Heng & Lu, Ying, 2012. "Model selection in linear mixed effect models," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 109-129.
    11. Yize Zhao & Matthias Chung & Brent A. Johnson & Carlos S. Moreno & Qi Long, 2016. "Hierarchical Feature Selection Incorporating Known and Novel Biological Information: Identifying Genomic Features Related to Prostate Cancer Recurrence," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1427-1439, October.
    12. G. Aneiros & P. Vieu, 2016. "Sparse nonparametric model for regression with functional covariate," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 839-859, October.
    13. Tan Guo & Lei Zhang & Xiaoheng Tan & Liu Yang & Zhiwei Guo & Fupeng Wei, 2019. "CoLR: Classification-Oriented Local Representation for Image Recognition," Complexity, Hindawi, vol. 2019, pages 1-17, June.
    14. He Jiang, 2023. "Robust forecasting in spatial autoregressive model with total variation regularization," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(2), pages 195-211, March.
    15. Wongsa-art, Pipat & Kim, Namhyun & Xia, Yingcun & Moscone, Francesco, 2024. "Varying coefficient panel data models and methods under correlated error components: Application to disparities in mental health services in England," Regional Science and Urban Economics, Elsevier, vol. 106(C).
    16. Daowen Zhang, 2004. "Generalized Linear Mixed Models with Varying Coefficients for Longitudinal Data," Biometrics, The International Biometric Society, vol. 60(1), pages 8-15, March.
    17. Zhang, Daowen & Davidian, Marie, 2004. "Likelihood and conditional likelihood inference for generalized additive mixed models for clustered data," Journal of Multivariate Analysis, Elsevier, vol. 91(1), pages 90-106, October.
    18. Belomestny, Denis & Goldman, Artur & Naumov, Alexey & Samsonov, Sergey, 2024. "Theoretical guarantees for neural control variates in MCMC," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 220(C), pages 382-405.
    19. Dong, C. & Li, S., 2021. "Specification Lasso and an Application in Financial Markets," Cambridge Working Papers in Economics 2139, Faculty of Economics, University of Cambridge.
    20. Lam, Clifford, 2008. "Estimation of large precision matrices through block penalization," LSE Research Online Documents on Economics 31543, London School of Economics and Political Science, LSE Library.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:711-721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.