IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v69y2007i5p741-796.html
   My bibliography  Save this article

Parameter estimation for differential equations: a generalized smoothing approach

Author

Listed:
  • J. O. Ramsay
  • G. Hooker
  • D. Campbell
  • J. Cao

Abstract

Summary. We propose a new method for estimating parameters in models that are defined by a system of non‐linear differential equations. Such equations represent changes in system outputs by linking the behaviour of derivatives of a process to the behaviour of the process itself. Current methods for estimating parameters in differential equations from noisy data are computationally intensive and often poorly suited to the realization of statistical objectives such as inference and interval estimation. The paper describes a new method that uses noisy measurements on a subset of variables to estimate the parameters defining a system of non‐linear differential equations. The approach is based on a modification of data smoothing methods along with a generalization of profiled estimation. We derive estimates and confidence intervals, and show that these have low bias and good coverage properties respectively for data that are simulated from models in chemical engineering and neurobiology. The performance of the method is demonstrated by using real world data from chemistry and from the progress of the autoimmune disease lupus.

Suggested Citation

  • J. O. Ramsay & G. Hooker & D. Campbell & J. Cao, 2007. "Parameter estimation for differential equations: a generalized smoothing approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 741-796, November.
  • Handle: RePEc:bla:jorssb:v:69:y:2007:i:5:p:741-796
    DOI: 10.1111/j.1467-9868.2007.00610.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9868.2007.00610.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9868.2007.00610.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. J. O. Ramsay, 1998. "Estimating smooth monotone functions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 365-375.
    2. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    3. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    4. Lang Li & Xihong Lin & Morton B. Brown & Suneel Gupta & Kyung-Hoon Lee, 2004. "A Population Pharmacokinetic Model with Time-Dependent Covariates Measured with Errors," Biometrics, The International Biometric Society, vol. 60(2), pages 451-460, June.
    5. Alexandros Beskos & Omiros Papaspiliopoulos & Gareth O. Roberts & Paul Fearnhead, 2006. "Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 333-382, June.
    6. Yangxin Huang & Dacheng Liu & Hulin Wu, 2006. "Hierarchical Bayesian Methods for Estimation of Parameters in a Longitudinal HIV Dynamic System," Biometrics, The International Biometric Society, vol. 62(2), pages 413-423, June.
    7. Lang Li & Morton B. Brown & Kyung-Hoon Lee & Suneel Gupta, 2002. "Estimation and Inference for a Spline-Enhanced Population Pharmacokinetic Model," Biometrics, The International Biometric Society, vol. 58(3), pages 601-611, September.
    8. Yangxin Huang & Hulin Wu, 2006. "A Bayesian approach for estimating antiviral efficacy in HIV dynamic models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 33(2), pages 155-174.
    9. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    10. Hermann Singer, 1993. "Continuous‐Time Dynamical Systems With Sampled Data, Errors Of Measurement And Unobserved Components," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(5), pages 527-545, September.
    11. de Valpine P., 2004. "Monte Carlo State-Space Likelihoods by Weighted Posterior Kernel Density Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 523-536, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    2. Liu, Baisen & Wang, Liangliang & Nie, Yunlong & Cao, Jiguo, 2019. "Bayesian inference of mixed-effects ordinary differential equations models using heavy-tailed distributions," Computational Statistics & Data Analysis, Elsevier, vol. 137(C), pages 233-246.
    3. Hermann Singer, 2011. "Continuous-discrete state-space modeling of panel data with nonlinear filter algorithms," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 375-413, December.
    4. Creal, Drew D. & Wu, Jing Cynthia, 2015. "Estimation of affine term structure models with spanned or unspanned stochastic volatility," Journal of Econometrics, Elsevier, vol. 185(1), pages 60-81.
    5. Hulin Wu & Hongqi Xue & Arun Kumar, 2012. "Numerical Discretization-Based Estimation Methods for Ordinary Differential Equation Models via Penalized Spline Smoothing with Applications in Biomedical Research," Biometrics, The International Biometric Society, vol. 68(2), pages 344-352, June.
    6. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    7. Smith, Michael Stanley & Maneesoonthorn, Worapree, 2018. "Inversion copulas from nonlinear state space models with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 34(3), pages 389-407.
    8. Rutger Jan Lange, 2020. "Bellman filtering for state-space models," Tinbergen Institute Discussion Papers 20-052/III, Tinbergen Institute, revised 19 May 2021.
    9. Zhang, Tingting & Sun, Yinge & Li, Huazhang & Yan, Guofen & Tanabe, Seiji & Miao, Ruizhong & Wang, Yaotian & Caffo, Brian S. & Quigg, Mark S., 2020. "Bayesian inference of a directional brain network model for intracranial EEG data," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    10. Hanwen Huang, 2022. "Bayesian multi‐level mixed‐effects model for influenza dynamics," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1978-1995, November.
    11. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    12. Creal, Drew D. & Tsay, Ruey S., 2015. "High dimensional dynamic stochastic copula models," Journal of Econometrics, Elsevier, vol. 189(2), pages 335-345.
    13. Qiu, Xing & Xu, Tao & Soltanalizadeh, Babak & Wu, Hulin, 2022. "Identifiability analysis of linear ordinary differential equation systems with a single trajectory," Applied Mathematics and Computation, Elsevier, vol. 430(C).
    14. Sy-Miin Chow & Zhaohua Lu & Andrew Sherwood & Hongtu Zhu, 2016. "Fitting Nonlinear Ordinary Differential Equation Models with Random Effects and Unknown Initial Conditions Using the Stochastic Approximation Expectation–Maximization (SAEM) Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 81(1), pages 102-134, March.
    15. Charles S. Bos, 2008. "Model-based Estimation of High Frequency Jump Diffusions with Microstructure Noise and Stochastic Volatility," Tinbergen Institute Discussion Papers 08-011/4, Tinbergen Institute.
    16. Chau, Thi Tuyet Trang & Ailliot, Pierre & Monbet, Valérie, 2021. "An algorithm for non-parametric estimation in state–space models," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    17. Giles Hooker, 2009. "Forcing Function Diagnostics for Nonlinear Dynamics," Biometrics, The International Biometric Society, vol. 65(3), pages 928-936, September.
    18. Olivier David & Aurélie Garnier & Catherine Larédo & Jane Lecomte, 2010. "Estimation of Plant Demographic Parameters from Stage-Structured Censuses," Biometrics, The International Biometric Society, vol. 66(3), pages 875-882, September.
    19. Hanwen Huang & Andreas Handel & Xiao Song, 2020. "A Bayesian approach to estimate parameters of ordinary differential equation," Computational Statistics, Springer, vol. 35(3), pages 1481-1499, September.
    20. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:69:y:2007:i:5:p:741-796. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.