IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v81y2016i1p102-134.html
   My bibliography  Save this article

Fitting Nonlinear Ordinary Differential Equation Models with Random Effects and Unknown Initial Conditions Using the Stochastic Approximation Expectation–Maximization (SAEM) Algorithm

Author

Listed:
  • Sy-Miin Chow
  • Zhaohua Lu
  • Andrew Sherwood
  • Hongtu Zhu

Abstract

The past decade has evidenced the increased prevalence of irregularly spaced longitudinal data in social sciences. Clearly lacking, however, are modeling tools that allow researchers to fit dynamic models to irregularly spaced data, particularly data that show nonlinearity and heterogeneity in dynamical structures. We consider the issue of fitting multivariate nonlinear differential equation models with random effects and unknown initial conditions to irregularly spaced data. A stochastic approximation expectation–maximization algorithm is proposed and its performance is evaluated using a benchmark nonlinear dynamical systems model, namely, the Van der Pol oscillator equations. The empirical utility of the proposed technique is illustrated using a set of 24-h ambulatory cardiovascular data from 168 men and women. Pertinent methodological challenges and unresolved issues are discussed. Copyright The Psychometric Society 2016

Suggested Citation

  • Sy-Miin Chow & Zhaohua Lu & Andrew Sherwood & Hongtu Zhu, 2016. "Fitting Nonlinear Ordinary Differential Equation Models with Random Effects and Unknown Initial Conditions Using the Stochastic Approximation Expectation–Maximization (SAEM) Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 81(1), pages 102-134, March.
    • Handle: RePEc:spr:psycho:v:81:y:2016:i:1:p:102-134
    DOI: 10.1007/s11336-014-9431-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-014-9431-z
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11336-014-9431-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    2. Ming Gao Gu & Hong‐Tu Zhu, 2001. "Maximum likelihood estimation for spatial models by Markov chain Monte Carlo stochastic approximation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 339-355.
    3. Lee, Sik-Yum & Song, Xin-Yuan, 2003. "Maximum likelihood estimation and model comparison of nonlinear structural equation models with continuous and polytomous variables," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 125-142, October.
    4. Johan Oud & Robert Jansen, 2000. "Continuous time state space modeling of panel data by means of sem," Psychometrika, Springer;The Psychometric Society, vol. 65(2), pages 199-215, June.
    5. Geweke, John & Tanizaki, Hisashi, 2001. "Bayesian estimation of state-space models using the Metropolis-Hastings algorithm within Gibbs sampling," Computational Statistics & Data Analysis, Elsevier, vol. 37(2), pages 151-170, August.
    6. Sy-Miin Chow & John R. Nesselroade, 2004. "General Slowing or Decreased Inhibition? Mathematical Models of Age Differences in Cognitive Functioning," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 59(3), pages 101-109.
    7. Alexandros Beskos & Omiros Papaspiliopoulos & Gareth O. Roberts & Paul Fearnhead, 2006. "Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 333-382, June.
    8. Dembo, A. & Zeitouni, O., 1986. "Parameter estimation of partially observed continuous time stochastic processes via the EM algorithm," Stochastic Processes and their Applications, Elsevier, vol. 23(1), pages 91-113, October.
    9. Singer, Hermann, 1995. "Analytical Score Function for Irregularly Sampled Continuous Time Stochastic Processes with Control Variables and Missing Values," Econometric Theory, Cambridge University Press, vol. 11(4), pages 721-735, August.
    10. William Meredith & John Tisak, 1990. "Latent curve analysis," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 107-122, March.
    11. Sik-Yum Lee & Xin-Yuan Song, 2003. "Maximum Likelihood Estimation and Model Comparison for Mixtures of Structural Equation Models with Ignorable Missing Data," Journal of Classification, Springer;The Classification Society, vol. 20(2), pages 221-255, September.
    12. J. O. Ramsay & G. Hooker & D. Campbell & J. Cao, 2007. "Parameter estimation for differential equations: a generalized smoothing approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 741-796, November.
    13. Sy-Miin Chow & Guangjian Zhang, 2013. "Nonlinear Regime-Switching State-Space (RSSS) Models," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 740-768, October.
    14. Isambi Mbalawata & Simo Särkkä & Heikki Haario, 2013. "Parameter estimation in stochastic differential equations with Markov chain Monte Carlo and non-linear Kalman filtering," Computational Statistics, Springer, vol. 28(3), pages 1195-1223, June.
    15. Kuhn, E. & Lavielle, M., 2005. "Maximum likelihood estimation in nonlinear mixed effects models," Computational Statistics & Data Analysis, Elsevier, vol. 49(4), pages 1020-1038, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Siliang Zhang & Yunxiao Chen, 2022. "Computation for Latent Variable Model Estimation: A Unified Stochastic Proximal Framework," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1473-1502, December.
    2. Sy-Miin Chow & Lu Ou & Arridhana Ciptadi & Emily B. Prince & Dongjun You & Michael D. Hunter & James M. Rehg & Agata Rozga & Daniel S. Messinger, 2018. "Representing Sudden Shifts in Intensive Dyadic Interaction Data Using Differential Equation Models with Regime Switching," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 476-510, June.
    3. Zhao-Hua Lu & Sy-Miin Chow & Nilam Ram & Pamela M. Cole, 2019. "Zero-Inflated Regime-Switching Stochastic Differential Equation Models for Highly Unbalanced Multivariate, Multi-Subject Time-Series Data," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 611-645, June.
    4. Zhang, Siliang & Chen, Yunxiao, 2022. "Computation for latent variable model estimation: a unified stochastic proximal framework," LSE Research Online Documents on Economics 114489, London School of Economics and Political Science, LSE Library.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sy-Miin Chow & Lu Ou & Arridhana Ciptadi & Emily B. Prince & Dongjun You & Michael D. Hunter & James M. Rehg & Agata Rozga & Daniel S. Messinger, 2018. "Representing Sudden Shifts in Intensive Dyadic Interaction Data Using Differential Equation Models with Regime Switching," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 476-510, June.
    2. Zhao-Hua Lu & Sy-Miin Chow & Nilam Ram & Pamela M. Cole, 2019. "Zero-Inflated Regime-Switching Stochastic Differential Equation Models for Highly Unbalanced Multivariate, Multi-Subject Time-Series Data," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 611-645, June.
    3. Hermann Singer, 2011. "Continuous-discrete state-space modeling of panel data with nonlinear filter algorithms," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 375-413, December.
    4. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    5. Johan Oud & Manuel Voelkle, 2014. "Do missing values exist? Incomplete data handling in cross-national longitudinal studies by means of continuous time modeling," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(6), pages 3271-3288, November.
    6. Yanling Li & Zita Oravecz & Shuai Zhou & Yosef Bodovski & Ian J. Barnett & Guangqing Chi & Yuan Zhou & Naomi P. Friedman & Scott I. Vrieze & Sy-Miin Chow, 2022. "Bayesian Forecasting with a Regime-Switching Zero-Inflated Multilevel Poisson Regression Model: An Application to Adolescent Alcohol Use with Spatial Covariates," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 376-402, June.
    7. Sy-Miin Chow & Jungmin Lee & Abe D. Hofman & Han L. J. Maas & Dennis K. Pearl & Peter C. M. Molenaar, 2022. "Control Theory Forecasts of Optimal Training Dosage to Facilitate Children’s Arithmetic Learning in a Digital Educational Application," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 559-592, June.
    8. John McArdle, 2011. "Longitudinal dynamic analyses of cognition in the health and retirement study panel," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 453-480, December.
    9. Siem Jan Koopman & Marius Ooms & André Lucas & Kees van Montfort & Victor Van Der Geest, 2008. "Estimating systematic continuous‐time trends in recidivism using a non‐Gaussian panel data model," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 62(1), pages 104-130, February.
    10. Ahn, Kwang Woo & Chan, Kung-Sik, 2014. "Approximate conditional least squares estimation of a nonlinear state-space model via an unscented Kalman filter," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 243-254.
    11. Delle Monache, Davide & Petrella, Ivan, 2019. "Efficient matrix approach for classical inference in state space models," Economics Letters, Elsevier, vol. 181(C), pages 22-27.
    12. J. O. Ramsay & G. Hooker & D. Campbell & J. Cao, 2007. "Parameter estimation for differential equations: a generalized smoothing approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 741-796, November.
    13. Commenges, D. & Jolly, D. & Drylewicz, J. & Putter, H. & Thiébaut, R., 2011. "Inference in HIV dynamics models via hierarchical likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 446-456, January.
    14. Umberto Picchini & Andrea De Gaetano & Susanne Ditlevsen, 2010. "Stochastic Differential Mixed‐Effects Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(1), pages 67-90, March.
    15. Bin Zhu & Peter X.-K. Song & Jeremy M.G. Taylor, 2011. "Stochastic Functional Data Analysis: A Diffusion Model-Based Approach," Biometrics, The International Biometric Society, vol. 67(4), pages 1295-1304, December.
    16. Michael D. Hunter & Haya Fatimah & Marina A. Bornovalova, 2022. "Two Filtering Methods of Forecasting Linear and Nonlinear Dynamics of Intensive Longitudinal Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 477-505, June.
    17. Paul Fearnhead & Vasilieos Giagos & Chris Sherlock, 2014. "Inference for reaction networks using the linear noise approximation," Biometrics, The International Biometric Society, vol. 70(2), pages 457-466, June.
    18. Sy‐Miin Chow & Guangjian Zhang, 2008. "Continuous‐time modelling of irregularly spaced panel data using a cubic spline model," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 62(1), pages 131-154, February.
    19. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    20. Anders Skrondal & Sophia Rabe‐Hesketh, 2007. "Latent Variable Modelling: A Survey," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 712-745, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:81:y:2016:i:1:p:102-134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.