IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v6y2018i2p21-d143319.html
   My bibliography  Save this article

“As-You-Go” Instead of “After-the-Fact”: A Network Approach to Scholarly Communication and Evaluation

Author

Listed:
  • Chris H. J. Hartgerink

    (Mozilla Science Lab, Mountain View, CA, USA
    Department of Methodology and Statistics, Tilburg University, 5037 AB Tilburg, The Netherlands)

  • Marino Van Zelst

    (Department of Organization Studies, Tilburg University, 5037 AB Tilburg, The Netherlands)

Abstract

Scholarly research faces threats to its sustainability on multiple domains (access, incentives, reproducibility, inclusivity). We argue that “after-the-fact” research papers do not help and actually cause some of these threats because the chronology of the research cycle is lost in a research paper. We propose to give up the academic paper and propose a digitally native “as-you-go” alternative. In this design, modules of research outputs are communicated along the way and are directly linked to each other to form a network of outputs that can facilitate research evaluation. This embeds chronology in the design of scholarly communication and facilitates the recognition of more diverse outputs that go beyond the paper (e.g., code, materials). Moreover, using network analysis to investigate the relations between linked outputs could help align evaluation tools with evaluation questions. We illustrate how such a modular “as-you-go” design of scholarly communication could be structured and how network indicators could be computed to assist in the evaluation process, with specific use cases for funders, universities, and individual researchers.

Suggested Citation

  • Chris H. J. Hartgerink & Marino Van Zelst, 2018. "“As-You-Go” Instead of “After-the-Fact”: A Network Approach to Scholarly Communication and Evaluation," Publications, MDPI, vol. 6(2), pages 1-10, April.
  • Handle: RePEc:gam:jpubli:v:6:y:2018:i:2:p:21-:d:143319
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/6/2/21/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2304-6775/6/2/21/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vincent Larivière & Stefanie Haustein & Philippe Mongeon, 2015. "The Oligopoly of Academic Publishers in the Digital Era," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-15, June.
    2. Per O. Seglen, 1994. "Causal relationship between article citedness and journal impact," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 1-11, January.
    3. Per O. Seglen, 1992. "The skewness of science," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(9), pages 628-638, October.
    4. Gangan Prathap & S. Mini & P. Nishy, 2016. "Does high impact factor successfully predict future citations? An analysis using Peirce’s measure," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1043-1047, September.
    5. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    6. Martin Klein & Herbert Van de Sompel & Robert Sanderson & Harihar Shankar & Lyudmila Balakireva & Ke Zhou & Richard Tobin, 2014. "Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-39, December.
    7. Nosek, Brian A. & Ebersole, Charles R. & DeHaven, Alexander Carl & Mellor, David Thomas, 2018. "The Preregistration Revolution," OSF Preprints 2dxu5, Center for Open Science.
    8. Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hans van Dijk & Marino van Zelst, 2020. "Comfortably Numb? Researchers’ Satisfaction with the Publication System and a Proposal for Radical Change," Publications, MDPI, vol. 8(1), pages 1-20, March.
    2. Chris Hartgerink, 2019. "Verified, Shared, Modular, and Provenance Based Research Communication with the Dat Protocol," Publications, MDPI, vol. 7(2), pages 1-19, June.
    3. Amy L. Chapman & Christine Greenhow, 2019. "Citizen-Scholars: Social Media and the Changing Nature of Scholarship," Publications, MDPI, vol. 7(1), pages 1-9, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2023. "Correlating article citedness and journal impact: an empirical investigation by field on a large-scale dataset," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1877-1894, March.
    2. Michaela Strinzel & Josh Brown & Wolfgang Kaltenbrunner & Sarah Rijcke & Michael Hill, 2021. "Ten ways to improve academic CVs for fairer research assessment," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-4, December.
    3. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    4. Anthony F. J. Raan, 2012. "Properties of journal impact in relation to bibliometric research group performance indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 457-469, August.
    5. Péter Vinkler, 2009. "Introducing the Current Contribution Index for characterizing the recent, relevant impact of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(2), pages 409-420, May.
    6. Milojević, Staša & Radicchi, Filippo & Bar-Ilan, Judit, 2017. "Citation success index − An intuitive pair-wise journal comparison metric," Journal of Informetrics, Elsevier, vol. 11(1), pages 223-231.
    7. Loet Leydesdorff & Lutz Bornmann & Jonathan Adams, 2019. "The integrated impact indicator revisited (I3*): a non-parametric alternative to the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1669-1694, June.
    8. Tobias Kiesslich & Marlena Beyreis & Georg Zimmermann & Andreas Traweger, 2021. "Citation inequality and the Journal Impact Factor: median, mean, (does it) matter?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1249-1269, February.
    9. Bornmann, Lutz & Leydesdorff, Loet, 2017. "Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data," Journal of Informetrics, Elsevier, vol. 11(1), pages 164-175.
    10. Andrea Bonaccorsi & Cinzia Daraio & Stefano Fantoni & Viola Folli & Marco Leonetti & Giancarlo Ruocco, 2017. "Do social sciences and humanities behave like life and hard sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 607-653, July.
    11. Lutz Bornmann & Alexander Tekles & Loet Leydesdorff, 2019. "How well does I3 perform for impact measurement compared to other bibliometric indicators? The convergent validity of several (field-normalized) indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1187-1205, May.
    12. Gordon Rogers & Martin Szomszor & Jonathan Adams, 2020. "Sample size in bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 777-794, October.
    13. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    14. Thelwall, Mike & Fairclough, Ruth, 2015. "Geometric journal impact factors correcting for individual highly cited articles," Journal of Informetrics, Elsevier, vol. 9(2), pages 263-272.
    15. Chavarro, Diego & Tang, Puay & Ràfols, Ismael, 2017. "Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling," Research Policy, Elsevier, vol. 46(9), pages 1666-1680.
    16. Vieira, E.S. & Gomes, J.A.N.F., 2010. "Citations to scientific articles: Its distribution and dependence on the article features," Journal of Informetrics, Elsevier, vol. 4(1), pages 1-13.
    17. Lin Zhang & Ronald Rousseau & Gunnar Sivertsen, 2017. "Science deserves to be judged by its contents, not by its wrapping: Revisiting Seglen's work on journal impact and research evaluation," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-18, March.
    18. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    19. Siler, Kyle & Larivière, Vincent, 2022. "Who games metrics and rankings? Institutional niches and journal impact factor inflation," Research Policy, Elsevier, vol. 51(10).
    20. Christin Katharina Kreutz & Premtim Sahitaj & Ralf Schenkel, 2020. "Evaluating semantometrics from computer science publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2915-2954, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:6:y:2018:i:2:p:21-:d:143319. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.