IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v173y2022ics0167947322000639.html
   My bibliography  Save this article

Dynamical modeling for non-Gaussian data with high-dimensional sparse ordinary differential equations

Author

Listed:
  • Nanshan, Muye
  • Zhang, Nan
  • Xun, Xiaolei
  • Cao, Jiguo

Abstract

Ordinary differential equations (ODE) have been widely used for modeling dynamical complex systems. For high-dimensional ODE models where the number of differential equations is large, it remains challenging to estimate the ODE parameters and to identify the sparse structure of the ODE models. Most existing methods exploit the least-square based approach and are only applicable to Gaussian observations. However, as discrete data are ubiquitous in applications, it is of practical importance to develop dynamic modeling for non-Gaussian observations. New methods and algorithms are developed for both parameter estimation and sparse structure identification in high-dimensional linear ODE systems. First, the high-dimensional generalized profiling method is proposed as a likelihood-based approach with ODE fidelity and sparsity-inducing regularization, along with efficient computation based on parameter cascading. Second, two versions of the two-step collocation methods are extended to the non-Gaussian set-up by incorporating the iteratively reweighted least squares technique. Simulations show that the profiling procedure has excellent performance in latent process and derivative fitting and ODE parameter estimation, while the two-step collocation approach excels in identifying the sparse structure of the ODE system. The usefulness of the proposed methods is also demonstrated by analyzing three real datasets from Google trends, stock market sectors, and yeast cell cycle studies.

Suggested Citation

  • Nanshan, Muye & Zhang, Nan & Xun, Xiaolei & Cao, Jiguo, 2022. "Dynamical modeling for non-Gaussian data with high-dimensional sparse ordinary differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
  • Handle: RePEc:eee:csdana:v:173:y:2022:i:c:s0167947322000639
    DOI: 10.1016/j.csda.2022.107483
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947322000639
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2022.107483?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Shizhe Chen & Ali Shojaie & Daniela M. Witten, 2017. "Network Reconstruction From High-Dimensional Ordinary Differential Equations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1697-1707, October.
    3. Hongyu Miao & Hulin Wu & Hongqi Xue, 2014. "Generalized Ordinary Differential Equation Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1672-1682, December.
    4. Hulin Wu & Tao Lu & Hongqi Xue & Hua Liang, 2014. "Sparse Additive Ordinary Differential Equations for Dynamic Gene Regulatory Network Modeling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 700-716, June.
    5. Peter Hall & Yanyuan Ma, 2014. "Quick and easy one-step parameter estimation in differential equations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(4), pages 735-748, September.
    6. Wang, Hansheng & Leng, Chenlei, 2008. "A note on adaptive group lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5277-5286, August.
    7. Ming Yuan & Yi Lin, 2007. "Model selection and estimation in the Gaussian graphical model," Biometrika, Biometrika Trust, vol. 94(1), pages 19-35.
    8. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    9. Leqin Wu & Xing Qiu & Ya-xiang Yuan & Hulin Wu, 2019. "Parameter Estimation and Variable Selection for Big Systems of Linear Ordinary Differential Equations: A Matrix-Based Approach," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 657-667, April.
    10. Jiguo Cao & James Ramsay, 2007. "Parameter cascades and profiling in functional data analysis," Computational Statistics, Springer, vol. 22(3), pages 335-351, September.
    11. Yuan, Ming & Kendziorski, Christina, 2006. "Hidden Markov Models for Microarray Time Course Data in Multiple Biological Conditions," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1323-1332, December.
    12. Nicolas J-B. Brunel & Quentin Clairon & Florence d'Alché-Buc, 2014. "Parametric Estimation of Ordinary Differential Equations With Orthogonality Conditions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 173-185, March.
    13. Shawn J. Cokus & Suhua Feng & Xiaoyu Zhang & Zugen Chen & Barry Merriman & Christian D. Haudenschild & Sriharsa Pradhan & Stanley F. Nelson & Matteo Pellegrini & Steven E. Jacobsen, 2008. "Shotgun bisulphite sequencing of the Arabidopsis genome reveals DNA methylation patterning," Nature, Nature, vol. 452(7184), pages 215-219, March.
    14. P. Tseng & S. Yun, 2009. "Block-Coordinate Gradient Descent Method for Linearly Constrained Nonsmooth Separable Optimization," Journal of Optimization Theory and Applications, Springer, vol. 140(3), pages 513-535, March.
    15. Arend Voorman & Ali Shojaie & Daniela Witten, 2014. "Graph estimation with joint additive models," Biometrika, Biometrika Trust, vol. 101(1), pages 85-101.
    16. Liang, Hua & Wu, Hulin, 2008. "Parameter Estimation for Differential Equation Models Using a Framework of Measurement Error in Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1570-1583.
    17. J. O. Ramsay & G. Hooker & D. Campbell & J. Cao, 2007. "Parameter estimation for differential equations: a generalized smoothing approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 741-796, November.
    18. Carey, M. & Ramsay, J.O., 2021. "Fast stable parameter estimation for linear dynamical systems," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    19. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shizhe Chen & Ali Shojaie & Daniela M. Witten, 2017. "Network Reconstruction From High-Dimensional Ordinary Differential Equations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1697-1707, October.
    2. Pei Wang & Shunjie Chen & Sijia Yang, 2022. "Recent Advances on Penalized Regression Models for Biological Data," Mathematics, MDPI, vol. 10(19), pages 1-24, October.
    3. Baisen Liu & Liangliang Wang & Yunlong Nie & Jiguo Cao, 2021. "Semiparametric Mixed-Effects Ordinary Differential Equation Models with Heavy-Tailed Distributions," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(3), pages 428-445, September.
    4. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    5. Lam, Clifford, 2008. "Estimation of large precision matrices through block penalization," LSE Research Online Documents on Economics 31543, London School of Economics and Political Science, LSE Library.
    6. Fei Jin & Lung-fei Lee, 2018. "Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices," Econometrics, MDPI, vol. 6(1), pages 1-24, February.
    7. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    8. Lichun Wang & Yuan You & Heng Lian, 2015. "Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models," Statistical Papers, Springer, vol. 56(3), pages 819-828, August.
    9. Justin B. Post & Howard D. Bondell, 2013. "Factor Selection and Structural Identification in the Interaction ANOVA Model," Biometrics, The International Biometric Society, vol. 69(1), pages 70-79, March.
    10. Jin, Fei & Lee, Lung-fei, 2018. "Irregular N2SLS and LASSO estimation of the matrix exponential spatial specification model," Journal of Econometrics, Elsevier, vol. 206(2), pages 336-358.
    11. Jonathan Boss & Alexander Rix & Yin‐Hsiu Chen & Naveen N. Narisetty & Zhenke Wu & Kelly K. Ferguson & Thomas F. McElrath & John D. Meeker & Bhramar Mukherjee, 2021. "A hierarchical integrative group least absolute shrinkage and selection operator for analyzing environmental mixtures," Environmetrics, John Wiley & Sons, Ltd., vol. 32(8), December.
    12. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    13. Hu, Jianhua & Liu, Xiaoqian & Liu, Xu & Xia, Ningning, 2022. "Some aspects of response variable selection and estimation in multivariate linear regression," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    14. Caiya Zhang & Yanbiao Xiang, 2016. "On the oracle property of adaptive group Lasso in high-dimensional linear models," Statistical Papers, Springer, vol. 57(1), pages 249-265, March.
    15. Bang, Sungwan & Jhun, Myoungshic, 2012. "Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 813-826.
    16. Guo, Xiao & Zhang, Hai & Wang, Yao & Wu, Jiang-Lun, 2015. "Model selection and estimation in high dimensional regression models with group SCAD," Statistics & Probability Letters, Elsevier, vol. 103(C), pages 86-92.
    17. Mu Niu & Benn Macdonald & Simon Rogers & Maurizio Filippone & Dirk Husmeier, 2018. "Statistical inference in mechanistic models: time warping for improved gradient matching," Computational Statistics, Springer, vol. 33(2), pages 1091-1123, June.
    18. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.
    19. Lu, Xun & Su, Liangjun, 2016. "Shrinkage estimation of dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 190(1), pages 148-175.
    20. Zhao, Peixin & Xue, Liugen, 2010. "Variable selection for semiparametric varying coefficient partially linear errors-in-variables models," Journal of Multivariate Analysis, Elsevier, vol. 101(8), pages 1872-1883, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:173:y:2022:i:c:s0167947322000639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.