IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1011355.html
   My bibliography  Save this article

Ensemble inference of unobserved infections in networks using partial observations

Author

Listed:
  • Renquan Zhang
  • Jilei Tai
  • Sen Pei

Abstract

Undetected infections fuel the dissemination of many infectious agents. However, identification of unobserved infectious individuals remains challenging due to limited observations of infections and imperfect knowledge of key transmission parameters. Here, we use an ensemble Bayesian inference method to infer unobserved infections using partial observations. The ensemble inference method can represent uncertainty in model parameters and update model states using all ensemble members collectively. We perform extensive experiments in both model-generated and real-world networks in which individuals have differential but unknown transmission rates. The ensemble method outperforms several alternative approaches for a variety of network structures and observation rates, despite that the model is mis-specified. Additionally, the computational complexity of this algorithm scales almost linearly with the number of nodes in the network and the number of observations, respectively, exhibiting the potential to apply to large-scale networks. The inference method may support decision-making under uncertainty and be adapted for use for other dynamical models in networks.Author summary: Mathematical models in networks can be used to infer unobserved infections and support decision-making in outbreak control and management. However, a major challenge in the operational use of these models is model misspecification–whether models can reliably represent the real-world disease transmission process. As we can only observe part of the transmission process, mathematical models are inherently misspecified due to the uncertainty in the model structure and parameters. A reliable modeling method, therefore, should be robust to such uncertainty and imperfect knowledge of the transmission dynamics to support real-time decision-making. In this study, we used an ensemble inference method to infer unobserved infections using partial observations. We considered the condition where individuals have differential but unknown transmission rates as an example of model uncertainty mirroring the situation encountered in real-world settings. We found the ensemble inference can robustly infer unobserved infections using partial observations with uncertainty in model parameters, although the distribution of parameters is mis-specified. The ensemble inference algorithm presents a general framework for inference of spreading dynamics in networks and may contribute to the toolbox supporting operational epidemic control in the face of model uncertainty and limited observation.

Suggested Citation

  • Renquan Zhang & Jilei Tai & Sen Pei, 2023. "Ensemble inference of unobserved infections in networks using partial observations," PLOS Computational Biology, Public Library of Science, vol. 19(8), pages 1-18, August.
  • Handle: RePEc:plo:pcbi00:1011355
    DOI: 10.1371/journal.pcbi.1011355
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1011355
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011355&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1011355?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthias Katzfuss & Jonathan R. Stroud & Christopher K. Wikle, 2016. "Understanding the Ensemble Kalman Filter," The American Statistician, Taylor & Francis Journals, vol. 70(4), pages 350-357, October.
    2. Sen Pei & Xian Teng & Paul Lewis & Jeffrey Shaman, 2021. "Optimizing respiratory virus surveillance networks using uncertainty propagation," Nature Communications, Nature, vol. 12(1), pages 1-10, December.
    3. Sen Pei & Sasikiran Kandula & Jaime Cascante Vega & Wan Yang & Steffen Foerster & Corinne Thompson & Jennifer Baumgartner & Shama Desai Ahuja & Kathleen Blaney & Jay K. Varma & Theodore Long & Jeffrey, 2022. "Contact tracing reveals community transmission of COVID-19 in New York City," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Turnbull, Kathryn & Nemeth, Christopher & Nunes, Matthew & McCormick, Tyler, 2023. "Sequential estimation of temporally evolving latent space network models," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    2. Emmanuel Kipchumba Korir & Jane Aduda & Thomas Mageto, 2020. "Forecasting Electricity Prices Using Ensemble Kalman Filter," Journal of Statistical and Econometric Methods, SCIENPRESS Ltd, vol. 9(1), pages 1-2.
    3. Böhl, Gregor & Strobel, Felix, 2020. "US business cycle dynamics at the zero lower bound," IMFS Working Paper Series 143, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).
    4. Boehl, Gregor & Strobel, Felix, 2024. "The empirical performance of the financial accelerator since 2008," Journal of Economic Dynamics and Control, Elsevier, vol. 167(C).
    5. Shasha Yang & Anjie Jin & Wen Nie & Cong Liu & Yu Li, 2022. "Research on SSA-LSTM-Based Slope Monitoring and Early Warning Model," Sustainability, MDPI, vol. 14(16), pages 1-16, August.
    6. Michael D. Hunter & Haya Fatimah & Marina A. Bornovalova, 2022. "Two Filtering Methods of Forecasting Linear and Nonlinear Dynamics of Intensive Longitudinal Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 477-505, June.
    7. Renquan Zhang & Jilei Tai & Qing Yao & Wan Yang & Kai Ruggeri & Jeffrey Shaman & Sen Pei, 2025. "Behavior-driven forecasts of neighborhood-level COVID-19 spread in New York City," PLOS Computational Biology, Public Library of Science, vol. 21(4), pages 1-21, April.
    8. Chen, Yewen & Chang, Xiaohui & Luo, Fangzhi & Huang, Hui, 2023. "Additive dynamic models for correcting numerical model outputs," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    9. Milan Christian Wet & Ilse Botha, 2022. "Constructing and Characterising the Aggregate South African Financial Cycle: A Markov Regime-Switching Approach," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 18(1), pages 37-67, March.
    10. Boehl, Gregor & Strobel, Felix, 2024. "Estimation of DSGE models with the effective lower bound," Journal of Economic Dynamics and Control, Elsevier, vol. 158(C).
    11. Milan Christian de Wet, 2021. "Modelling the Australasian Financial Cycle: A Markov-Regime Switching Approach," International Journal of Business and Economic Sciences Applied Research (IJBESAR), Democritus University of Thrace (DUTH), Kavala Campus, Greece, vol. 14(1), pages 69-79, June.
    12. Ting Fung Ma & Fangfang Wang & Jun Zhu & Anthony R. Ives & Katarzyna E. Lewińska, 2023. "Scalable Semiparametric Spatio-temporal Regression for Large Data Analysis," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 28(2), pages 279-298, June.
    13. Böhl, Gregor, 2022. "Endogenous Money, Excess Reserves and Unconventional Monetary Policy," VfS Annual Conference 2022 (Basel): Big Data in Economics 264141, Verein für Socialpolitik / German Economic Association.
    14. Matthias Katzfuss, 2017. "A Multi-Resolution Approximation for Massive Spatial Datasets," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 201-214, January.
    15. Jonathan Rougier & Aoibheann Brady & Jonathan Bamber & Stephen Chuter & Sam Royston & Bramha Dutt Vishwakarma & Richard Westaway & Yann Ziegler, 2023. "The scope of the Kalman filter for spatio‐temporal applications in environmental science," Environmetrics, John Wiley & Sons, Ltd., vol. 34(1), February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1011355. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.