IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0112022.html
   My bibliography  Save this article

Network-Driven Reputation in Online Scientific Communities

Author

Listed:
  • Hao Liao
  • Rui Xiao
  • Giulio Cimini
  • Matúš Medo

Abstract

The ever-increasing quantity and complexity of scientific production have made it difficult for researchers to keep track of advances in their own fields. This, together with growing popularity of online scientific communities, calls for the development of effective information filtering tools. We propose here an algorithm which simultaneously computes reputation of users and fitness of papers in a bipartite network representing an online scientific community. Evaluation on artificially-generated data and real data from the Econophysics Forum is used to determine the method's best-performing variants. We show that when the input data is extended to a multilayer network including users, papers and authors and the algorithm is correspondingly modified, the resulting performance improves on multiple levels. In particular, top papers have higher citation count and top authors have higher h-index than top papers and top authors chosen by other algorithms. We finally show that our algorithm is robust against persistent authors (spammers) which makes the method readily applicable to the existing online scientific communities.

Suggested Citation

  • Hao Liao & Rui Xiao & Giulio Cimini & Matúš Medo, 2014. "Network-Driven Reputation in Online Scientific Communities," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-18, December.
    • Handle: RePEc:plo:pone00:0112022
    DOI: 10.1371/journal.pone.0112022
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0112022
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0112022&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0112022?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chen, P. & Xie, H. & Maslov, S. & Redner, S., 2007. "Finding scientific gems with Google’s PageRank algorithm," Journal of Informetrics, Elsevier, vol. 1(1), pages 8-15.
    2. Daniel E. Acuna & Stefano Allesina & Konrad P. Kording, 2012. "Predicting scientific success," Nature, Nature, vol. 489(7415), pages 201-202, September.
    3. Vincent Larivière & Éric Archambault & Yves Gingras, 2008. "Long‐term variations in the aging of scientific literature: From exponential growth to steady‐state science (1900–2004)," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(2), pages 288-296, January.
    4. Tao Zhou & Matúš Medo & Giulio Cimini & Zi-Ke Zhang & Yi-Cheng Zhang, 2011. "Emergence of Scale-Free Leadership Structure in Social Recommender Systems," PLOS ONE, Public Library of Science, vol. 6(7), pages 1-6, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leilei Wu & Zhuoming Ren & Xiao-Long Ren & Jianlin Zhang & Linyuan Lü, 2018. "Eliminating the Effect of Rating Bias on Reputation Systems," Complexity, Hindawi, vol. 2018, pages 1-11, February.
    2. B Ian Hutchins & Xin Yuan & James M Anderson & George M Santangelo, 2016. "Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level," PLOS Biology, Public Library of Science, vol. 14(9), pages 1-25, September.
    3. Ikuesan Richard Adeyemi & Shukor Abd Razak & Mazleena Salleh & Hein S Venter, 2016. "Observing Consistency in Online Communication Patterns for User Re-Identification," PLOS ONE, Public Library of Science, vol. 11(12), pages 1-27, December.
    4. Linhong Xu & Kun Ding & Yuan Lin & Chunbo Zhang, 2023. "Does citation polarity help evaluate the quality of academic papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 4065-4087, July.
    5. Guan-Nan Wang & Hui Gao & Lian Chen & Dennis N A Mensah & Yan Fu, 2015. "Predicting Positive and Negative Relationships in Large Social Networks," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-14, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petersen, Alexander M. & Pan, Raj K. & Pammolli, Fabio & Fortunato, Santo, 2019. "Methods to account for citation inflation in research evaluation," Research Policy, Elsevier, vol. 48(7), pages 1855-1865.
    2. Su, Cheng & Pan, YunTao & Zhen, YanNing & Ma, Zheng & Yuan, JunPeng & Guo, Hong & Yu, ZhengLu & Ma, CaiFeng & Wu, YiShan, 2011. "PrestigeRank: A new evaluation method for papers and journals," Journal of Informetrics, Elsevier, vol. 5(1), pages 1-13.
    3. Jiang Wu, 2013. "Geographical knowledge diffusion and spatial diversity citation rank," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 181-201, January.
    4. Zhang, Shouxu & Xie, Duosi & Yan, Weisheng, 2017. "Decentralized event-triggered consensus control strategy for leader–follower networked systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 498-508.
    5. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    6. Young-Ho Eom & Dima L Shepelyansky, 2013. "Highlighting Entanglement of Cultures via Ranking of Multilingual Wikipedia Articles," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-10, October.
    7. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    8. Letchford, Adrian & Preis, Tobias & Moat, Helen Susannah, 2016. "The advantage of simple paper abstracts," Journal of Informetrics, Elsevier, vol. 10(1), pages 1-8.
    9. Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Liu, Kailiang & Xu, Zhitong & Chen, Chun-houh & Nakano, Junji & Honda, Keisuke, 2023. "Article’s scientific prestige: Measuring the impact of individual articles in the web of science," Journal of Informetrics, Elsevier, vol. 17(1).
    10. Fiala, Dalibor, 2012. "Time-aware PageRank for bibliographic networks," Journal of Informetrics, Elsevier, vol. 6(3), pages 370-388.
    11. Hyungjo Hur & Maryam A Andalib & Julie A Maurer & Joshua D Hawley & Navid Ghaffarzadegan, 2017. "Recent trends in the U.S. Behavioral and Social Sciences Research (BSSR) workforce," PLOS ONE, Public Library of Science, vol. 12(2), pages 1-18, February.
    12. Diana Hicks & Julia Melkers & Kimberley R. Isett, 2019. "A characterization of professional media and its links to research," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 827-843, May.
    13. Shahd Al-Janabi & Lee Wei Lim & Luca Aquili, 2021. "Development of a tool to accurately predict UK REF funding allocation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8049-8062, September.
    14. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    15. Rodrigo Dorantes-Gilardi & Aurora A. Ramírez-Álvarez & Diana Terrazas-Santamaría, 2023. "Is there a differentiated gender effect of collaboration with super-cited authors? Evidence from junior researchers in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2317-2336, April.
    16. Wang, Jingjing & Xu, Shuqi & Mariani, Manuel S. & Lü, Linyuan, 2021. "The local structure of citation networks uncovers expert-selected milestone papers," Journal of Informetrics, Elsevier, vol. 15(4).
    17. Andreas Reinstaller & Peter Reschenhofer, 2017. "Using PageRank in the analysis of technological progress through patents: an illustration for biotechnological inventions," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1407-1438, December.
    18. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    19. Fahimnia, Behnam & Sarkis, Joseph & Davarzani, Hoda, 2015. "Green supply chain management: A review and bibliometric analysis," International Journal of Production Economics, Elsevier, vol. 162(C), pages 101-114.
    20. Linyuan Lü & Yi-Cheng Zhang & Chi Ho Yeung & Tao Zhou, 2011. "Leaders in Social Networks, the Delicious Case," PLOS ONE, Public Library of Science, vol. 6(6), pages 1-9, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0112022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.