IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v178y2020ics0047259x19303252.html
   My bibliography  Save this article

Updating of the Gaussian graphical model through targeted penalized estimation

Author

Listed:
  • van Wieringen, Wessel N.
  • Stam, Koen A.
  • Peeters, Carel F.W.
  • van de Wiel, Mark A.

Abstract

Updating of the Gaussian graphical model via shrinkage estimation is studied. This shrinkage is towards a nonzero parameter value representing prior quantitative information. Once new data become available, the previously estimated parameter needs updating. Shrinkage provides the means to this end, using the latter as a shrinkage target to acquire an updated estimate. The process of iteratively updating the Gaussian graphical model in shrinkage fashion is shown to yield an improved fit and an asymptotically unbiased and consistent estimator. The workings of updating via shrinkage are elucidated by linking it to Bayesian updating and through the inheritance by the update of eigen-properties of the previous estimate. The effect of shrinkage on the moments and loss of the estimator are pointed out. Practical issues possibly hampering updating are identified and solutions outlined. The presented updating procedure is illustrated through the reconstruction of a gene–gene interaction network using transcriptomic data.

Suggested Citation

  • van Wieringen, Wessel N. & Stam, Koen A. & Peeters, Carel F.W. & van de Wiel, Mark A., 2020. "Updating of the Gaussian graphical model through targeted penalized estimation," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
    • Handle: RePEc:eee:jmvana:v:178:y:2020:i:c:s0047259x19303252
    DOI: 10.1016/j.jmva.2020.104621
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X19303252
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2020.104621?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. van Wieringen, Wessel N. & Peeters, Carel F.W., 2016. "Ridge estimation of inverse covariance matrices from high-dimensional data," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 284-303.
    3. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    4. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    5. Jian Guo & Elizaveta Levina & George Michailidis & Ji Zhu, 2011. "Joint estimation of multiple graphical models," Biometrika, Biometrika Trust, vol. 98(1), pages 1-15.
    6. Shizhe Chen & Daniela M. Witten & Ali Shojaie, 2015. "Selection and estimation for mixed graphical models," Biometrika, Biometrika Trust, vol. 102(1), pages 47-64.
    7. van Wieringen, Wessel N., 2017. "On the mean squared error of the ridge estimator of the covariance and precision matrix," Statistics & Probability Letters, Elsevier, vol. 123(C), pages 88-92.
    8. Wessel N. van Wieringen & Carel F. W. Peeters & Renee X. de Menezes & Mark A. van de Wiel, 2018. "Testing for pathway (in)activation by using Gaussian graphical models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 67(5), pages 1419-1436, November.
    9. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    10. Yang Ni & Peter Müller & Yitan Zhu & Yuan Ji, 2018. "Heterogeneous reciprocal graphical models," Biometrics, The International Biometric Society, vol. 74(2), pages 606-615, June.
    11. Patrick Danaher & Pei Wang & Daniela M. Witten, 2014. "The joint graphical lasso for inverse covariance estimation across multiple classes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(2), pages 373-397, March.
    12. Efron, Bradley, 2004. "Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 96-104, January.
    13. Christine Peterson & Francesco C. Stingo & Marina Vannucci, 2015. "Bayesian Inference of Multiple Gaussian Graphical Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 159-174, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Qingzhao & Ma, Shuangge & Huang, Yuan, 2021. "Promote sign consistency in the joint estimation of precision matrices," Computational Statistics & Data Analysis, Elsevier, vol. 159(C).
    2. Belli, Edoardo, 2022. "Smoothly adaptively centered ridge estimator," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    3. Huangdi Yi & Qingzhao Zhang & Cunjie Lin & Shuangge Ma, 2022. "Information‐incorporated Gaussian graphical model for gene expression data," Biometrics, The International Biometric Society, vol. 78(2), pages 512-523, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wessel N. van Wieringen & Carel F. W. Peeters & Renee X. de Menezes & Mark A. van de Wiel, 2018. "Testing for pathway (in)activation by using Gaussian graphical models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 67(5), pages 1419-1436, November.
    2. Mehran Aflakparast & Mathisca de Gunst & Wessel van Wieringen, 2020. "Analysis of Twitter data with the Bayesian fused graphical lasso," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-28, July.
    3. Zongliang Hu & Zhishui Hu & Kai Dong & Tiejun Tong & Yuedong Wang, 2021. "A shrinkage approach to joint estimation of multiple covariance matrices," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(3), pages 339-374, April.
    4. Lin Zhang & Andrew DiLernia & Karina Quevedo & Jazmin Camchong & Kelvin Lim & Wei Pan, 2021. "A random covariance model for bi‐level graphical modeling with application to resting‐state fMRI data," Biometrics, The International Biometric Society, vol. 77(4), pages 1385-1396, December.
    5. Yang Ni & Veerabhadran Baladandayuthapani & Marina Vannucci & Francesco C. Stingo, 2022. "Bayesian graphical models for modern biological applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 197-225, June.
    6. Yang Ni & Peter Müller & Yitan Zhu & Yuan Ji, 2018. "Heterogeneous reciprocal graphical models," Biometrics, The International Biometric Society, vol. 74(2), pages 606-615, June.
    7. Christine B. Peterson & Nathan Osborne & Francesco C. Stingo & Pierrick Bourgeat & James D. Doecke & Marina Vannucci, 2020. "Bayesian modeling of multiple structural connectivity networks during the progression of Alzheimer's disease," Biometrics, The International Biometric Society, vol. 76(4), pages 1120-1132, December.
    8. Azam Kheyri & Andriette Bekker & Mohammad Arashi, 2022. "High-Dimensional Precision Matrix Estimation through GSOS with Application in the Foreign Exchange Market," Mathematics, MDPI, vol. 10(22), pages 1-19, November.
    9. Zhixiang Lin & Tao Wang & Can Yang & Hongyu Zhao, 2017. "On joint estimation of Gaussian graphical models for spatial and temporal data," Biometrics, The International Biometric Society, vol. 73(3), pages 769-779, September.
    10. Ikeda, Yuki & Kubokawa, Tatsuya & Srivastava, Muni S., 2016. "Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 95-108.
    11. Aaron Hudson & Ali Shojaie, 2022. "Covariate-Adjusted Inference for Differential Analysis of High-Dimensional Networks," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(1), pages 345-388, June.
    12. Pedro Duarte Silva, A., 2011. "Two-group classification with high-dimensional correlated data: A factor model approach," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2975-2990, November.
    13. Elin Shaddox & Francesco C. Stingo & Christine B. Peterson & Sean Jacobson & Charmion Cruickshank-Quinn & Katerina Kechris & Russell Bowler & Marina Vannucci, 2018. "A Bayesian Approach for Learning Gene Networks Underlying Disease Severity in COPD," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 10(1), pages 59-85, April.
    14. Lee, Kyoungjae & Cao, Xuan, 2022. "Bayesian joint inference for multiple directed acyclic graphs," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    15. Kevin H. Lee & Qian Chen & Wayne S. DeSarbo & Lingzhou Xue, 2022. "Estimating Finite Mixtures of Ordinal Graphical Models," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 83-106, March.
    16. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    17. Avagyan, Vahe & Alonso Fernández, Andrés Modesto & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    18. Dong Liu & Changwei Zhao & Yong He & Lei Liu & Ying Guo & Xinsheng Zhang, 2023. "Simultaneous cluster structure learning and estimation of heterogeneous graphs for matrix‐variate fMRI data," Biometrics, The International Biometric Society, vol. 79(3), pages 2246-2259, September.
    19. Alessandro Casa & Andrea Cappozzo & Michael Fop, 2022. "Group-Wise Shrinkage Estimation in Penalized Model-Based Clustering," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 648-674, November.
    20. Christian Bongiorno, 2020. "Bootstraps Regularize Singular Correlation Matrices," Working Papers hal-02536278, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:178:y:2020:i:c:s0047259x19303252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.