IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-38625-z.html
   My bibliography  Save this article

A positive statistical benchmark to assess network agreement

Author

Listed:
  • Bingjie Hao

    (Northwestern University)

  • István A. Kovács

    (Northwestern University
    Northwestern Institute on Complex Systems, Northwestern University)

Abstract

Current computational methods for validating experimental network datasets compare overlap, i.e., shared links, with a reference network using a negative benchmark. However, this fails to quantify the level of agreement between the two networks. To address this, we propose a positive statistical benchmark to determine the maximum possible overlap between networks. Our approach can efficiently generate this benchmark in a maximum entropy framework and provides a way to assess whether the observed overlap is significantly different from the best-case scenario. We introduce a normalized overlap score, Normlap, to enhance comparisons between experimental networks. As an application, we compare molecular and functional networks, resulting in an agreement network of human as well as yeast network datasets. The Normlap score can improve the comparison between experimental networks by providing a computational alternative to network thresholding and validation.

Suggested Citation

  • Bingjie Hao & István A. Kovács, 2023. "A positive statistical benchmark to assess network agreement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38625-z
    DOI: 10.1038/s41467-023-38625-z
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-38625-z
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-38625-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter Uetz & Loic Giot & Gerard Cagney & Traci A. Mansfield & Richard S. Judson & James R. Knight & Daniel Lockshon & Vaibhav Narayan & Maithreyan Srinivasan & Pascale Pochart & Alia Qureshi-Emili & Y, 2000. "A comprehensive analysis of protein–protein interactions in Saccharomyces cerevisiae," Nature, Nature, vol. 403(6770), pages 623-627, February.
    2. Anne-Claude Gavin & Markus Bösche & Roland Krause & Paola Grandi & Martina Marzioch & Andreas Bauer & Jörg Schultz & Jens M. Rick & Anne-Marie Michon & Cristina-Maria Cruciat & Marita Remor & Christia, 2002. "Functional organization of the yeast proteome by systematic analysis of protein complexes," Nature, Nature, vol. 415(6868), pages 141-147, January.
    3. Katja Luck & Dae-Kyum Kim & Luke Lambourne & Kerstin Spirohn & Bridget E. Begg & Wenting Bian & Ruth Brignall & Tiziana Cafarelli & Francisco J. Campos-Laborie & Benoit Charloteaux & Dongsic Choi & At, 2020. "A reference map of the human binary protein interactome," Nature, Nature, vol. 580(7803), pages 402-408, April.
    4. Soon Gang Choi & Julien Olivet & Patricia Cassonnet & Pierre-Olivier Vidalain & Katja Luck & Luke Lambourne & Kerstin Spirohn & Irma Lemmens & Mélanie Dos Santos & Caroline Demeret & Louis Jones & Sud, 2019. "Maximizing binary interactome mapping with a minimal number of assays," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    5. Nevan J. Krogan & Gerard Cagney & Haiyuan Yu & Gouqing Zhong & Xinghua Guo & Alexandr Ignatchenko & Joyce Li & Shuye Pu & Nira Datta & Aaron P. Tikuisis & Thanuja Punna & José M. Peregrín-Alvarez & Mi, 2006. "Global landscape of protein complexes in the yeast Saccharomyces cerevisiae," Nature, Nature, vol. 440(7084), pages 637-643, March.
    6. Anne-Claude Gavin & Patrick Aloy & Paola Grandi & Roland Krause & Markus Boesche & Martina Marzioch & Christina Rau & Lars Juhl Jensen & Sonja Bastuck & Birgit Dümpelfeld & Angela Edelmann & Marie-Ann, 2006. "Proteome survey reveals modularity of the yeast cell machinery," Nature, Nature, vol. 440(7084), pages 631-636, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jie Zhao & Xiujuan Lei & Fang-Xiang Wu, 2017. "Predicting Protein Complexes in Weighted Dynamic PPI Networks Based on ICSC," Complexity, Hindawi, vol. 2017, pages 1-11, August.
    2. Erica W. Carter & Orlene Guerra Peraza & Nian Wang, 2023. "The protein interactome of the citrus Huanglongbing pathogen Candidatus Liberibacter asiaticus," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    3. Hong-Wen Tang & Kerstin Spirohn & Yanhui Hu & Tong Hao & István A. Kovács & Yue Gao & Richard Binari & Donghui Yang-Zhou & Kenneth H. Wan & Joel S. Bader & Dawit Balcha & Wenting Bian & Benjamin W. Bo, 2023. "Next-generation large-scale binary protein interaction network for Drosophila melanogaster," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    4. Patrick Bryant & Gabriele Pozzati & Wensi Zhu & Aditi Shenoy & Petras Kundrotas & Arne Elofsson, 2022. "Predicting the structure of large protein complexes using AlphaFold and Monte Carlo tree search," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    5. Abdolhosseini-Qomi, Amir Mahdi & Yazdani, Naser & Asadpour, Masoud, 2020. "Overlapping communities and the prediction of missing links in multiplex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 554(C).
    6. Ghulam Muhiuddin & Sovan Samanta & Abdulrahman F. Aljohani & Abeer M. Alkhaibari, 2023. "A Study on Graph Centrality Measures of Different Diseases Due to DNA Sequencing," Mathematics, MDPI, vol. 11(14), pages 1-18, July.
    7. Diego Esposito & Jane Dudley-Fraser & Acely Garza-Garcia & Katrin Rittinger, 2022. "Divergent self-association properties of paralogous proteins TRIM2 and TRIM3 regulate their E3 ligase activity," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    8. Maik Müller & Fabienne Gräbnitz & Niculò Barandun & Yang Shen & Fabian Wendt & Sebastian N. Steiner & Yannik Severin & Stefan U. Vetterli & Milon Mondal & James R. Prudent & Raphael Hofmann & Marc Oos, 2021. "Light-mediated discovery of surfaceome nanoscale organization and intercellular receptor interaction networks," Nature Communications, Nature, vol. 12(1), pages 1-17, December.
    9. Pisanu Buphamalai & Tomislav Kokotovic & Vanja Nagy & Jörg Menche, 2021. "Network analysis reveals rare disease signatures across multiple levels of biological organization," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    10. Shuai Qiao & Chia-Wei Lee & Dawafuti Sherpa & Jakub Chrustowicz & Jingdong Cheng & Maximilian Duennebacke & Barbara Steigenberger & Ozge Karayel & Duc Tung Vu & Susanne Gronau & Matthias Mann & Floria, 2022. "Cryo-EM structures of Gid12-bound GID E3 reveal steric blockade as a mechanism inhibiting substrate ubiquitylation," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    11. Xu-Wen Wang & Lorenzo Madeddu & Kerstin Spirohn & Leonardo Martini & Adriano Fazzone & Luca Becchetti & Thomas P. Wytock & István A. Kovács & Olivér M. Balogh & Bettina Benczik & Mátyás Pétervári & Be, 2023. "Assessment of community efforts to advance network-based prediction of protein–protein interactions," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    12. Jens S. Andersen & Aaran Vijayakumaran & Christopher Godbehere & Esben Lorentzen & Vito Mennella & Kenneth Bødtker Schou, 2024. "Uncovering structural themes across cilia microtubule inner proteins with implications for human cilia function," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    13. Cheoljun Choi & Yujin L. Jeong & Koung-Min Park & Minji Kim & Sangseob Kim & Honghyun Jo & Sumin Lee & Heeseong Kim & Garam Choi & Yoon Ha Choi & Je Kyung Seong & Sik Namgoong & Yeonseok Chung & Young, 2024. "TM4SF19-mediated control of lysosomal activity in macrophages contributes to obesity-induced inflammation and metabolic dysfunction," Nature Communications, Nature, vol. 15(1), pages 1-21, December.
    14. Yesheng Fu & Lei Li & Xin Zhang & Zhikang Deng & Ying Wu & Wenzhe Chen & Yuchen Liu & Shan He & Jian Wang & Yuping Xie & Zhiwei Tu & Yadi Lyu & Yange Wei & Shujie Wang & Chun-Ping Cui & Cui Hua Liu & , 2024. "Systematic HOIP interactome profiling reveals critical roles of linear ubiquitination in tissue homeostasis," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    15. Patrick Bryant & Gabriele Pozzati & Arne Elofsson, 2022. "Improved prediction of protein-protein interactions using AlphaFold2," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    16. Gergo Gogl & Boglarka Zambo & Camille Kostmann & Alexandra Cousido-Siah & Bastien Morlet & Fabien Durbesson & Luc Negroni & Pascal Eberling & Pau Jané & Yves Nominé & Andras Zeke & Søren Østergaard & , 2022. "Quantitative fragmentomics allow affinity mapping of interactomes," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    17. Shilin Sun & Hua Tian & Runze Wang & Zehua Zhang, 2023. "Biomedical Interaction Prediction with Adaptive Line Graph Contrastive Learning," Mathematics, MDPI, vol. 11(3), pages 1-14, February.
    18. Adrià Fernández-Torras & Miquel Duran-Frigola & Martino Bertoni & Martina Locatelli & Patrick Aloy, 2022. "Integrating and formatting biomedical data as pre-calculated knowledge graph embeddings in the Bioteque," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    19. Florin Ratajczak & Mitchell Joblin & Marcel Hildebrandt & Martin Ringsquandl & Pascal Falter-Braun & Matthias Heinig, 2023. "Speos: an ensemble graph representation learning framework to predict core gene candidates for complex diseases," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    20. Michael A. Skinnider & Mopelola O. Akinlaja & Leonard J. Foster, 2023. "Mapping protein states and interactions across the tree of life with co-fractionation mass spectrometry," Nature Communications, Nature, vol. 14(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38625-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.