IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v12y2018i1p101-112.html
   My bibliography  Save this article

Hidden connections: Network effects on editorial decisions in four computer science journals

Author

Listed:
  • Bravo, Giangiacomo
  • Farjam, Mike
  • Grimaldo Moreno, Francisco
  • Birukou, Aliaksandr
  • Squazzoni, Flaminio

Abstract

This paper aims to examine the influence of authors’ reputation on editorial bias in scholarly journals. By looking at eight years of editorial decisions in four computer science journals, including 7179 observations on 2913 submissions, we reconstructed author/referee-submission networks. For each submission, we looked at reviewer scores and estimated the reputation of submission authors by means of their network degree. By training a Bayesian network, we estimated the potential effect of scientist reputation on editorial decisions. Results showed that more reputed authors were less likely to be rejected by editors when they submitted papers receiving negative reviews. Although these four journals were comparable for scope and areas, we found certain journal specificities in their editorial process. Our findings suggest ways to examine the editorial process in relatively similar journals without recurring to in-depth individual data, which are rarely available from scholarly journals.

Suggested Citation

  • Bravo, Giangiacomo & Farjam, Mike & Grimaldo Moreno, Francisco & Birukou, Aliaksandr & Squazzoni, Flaminio, 2018. "Hidden connections: Network effects on editorial decisions in four computer science journals," Journal of Informetrics, Elsevier, vol. 12(1), pages 101-112.
    • Handle: RePEc:eee:infome:v:12:y:2018:i:1:p:101-112
    DOI: 10.1016/j.joi.2017.12.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157717303176
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2017.12.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Daniel, Hans-Dieter, 2009. "Extent of type I and type II errors in editorial decisions: A case study on Angewandte Chemie International Edition," Journal of Informetrics, Elsevier, vol. 3(4), pages 348-352.
    2. Niccolò Casnici & Francisco Grimaldo & Nigel Gilbert & Pierpaolo Dondio & Flaminio Squazzoni, 2017. "Assessing peer review by gauging the fate of rejected manuscripts: the case of the Journal of Artificial Societies and Social Simulation," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 533-546, October.
    3. Jessica Petersen & Fabian Hattke & Rick Vogel, 2017. "Editorial governance and journal impact: a study of management and business journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1593-1614, September.
    4. Vladimir Batagelj & Anuška Ferligoj & Flaminio Squazzoni, 2017. "The emergence of a field: a network analysis of research on peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 503-532, October.
    5. Francisco Grimaldo & Mario Paolucci, 2013. "A Simulation Of Disagreement For Control Of Rational Cheating In Peer Review," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 16(07), pages 1-24.
    6. Mutz, Rüdiger & Bornmann, Lutz & Daniel, Hans-Dieter, 2017. "Are there any frontiers of research performance? Efficiency measurement of funded research projects with the Bayesian stochastic frontier analysis for count data," Journal of Informetrics, Elsevier, vol. 11(3), pages 613-628.
    7. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    8. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    9. Squazzoni, Flaminio & Gandelli, Claudio, 2012. "Saint Matthew strikes again: An agent-based model of peer review and the scientific community structure," Journal of Informetrics, Elsevier, vol. 6(2), pages 265-275.
    10. Simone Righi & Károly Takács, 2017. "The miracle of peer review and development in science: an agent-based model," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 587-607, October.
    11. Zhenquan Lin & Shanci Hou & Jinshan Wu, 2016. "The correlation between editorial delay and the ratio of highly cited papers in Nature, Science and Physical Review Letters," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1457-1464, June.
    12. Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    13. Flaminio Squazzoni & Claudio Gandelli, 2013. "Opening the Black-Box of Peer Review: An Agent-Based Model of Scientist Behaviour," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 16(2), pages 1-3.
    14. Parolo, Pietro Della Briotta & Pan, Raj Kumar & Ghosh, Rumi & Huberman, Bernardo A. & Kaski, Kimmo & Fortunato, Santo, 2015. "Attention decay in science," Journal of Informetrics, Elsevier, vol. 9(4), pages 734-745.
    15. Emre Sarigöl & David Garcia & Ingo Scholtes & Frank Schweitzer, 2017. "Quantifying the effect of editor–author relations on manuscript handling times," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 609-631, October.
    16. Khaled Moustafa, 2015. "Is there bias in editorial choice? Yes," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 2249-2251, December.
    17. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2015. "The author–editor game," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 361-380, July.
    18. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    19. Flaminio Squazzoni & Francisco Grimaldo & Ana Marušić, 2017. "Publishing: Journals could share peer-review data," Nature, Nature, vol. 546(7658), pages 352-352, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Julián D. Cortés, 2022. "Identifying the dissension in management and business research in Latin America and the Caribbean via co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7111-7125, December.
    2. Bianchi, Federico & García-Costa, Daniel & Grimaldo, Francisco & Squazzoni, Flaminio, 2022. "Measuring the effect of reviewers on manuscript change: A study on a sample of submissions to Royal Society journals (2006–2017)," Journal of Informetrics, Elsevier, vol. 16(3).
    3. Petersen, Alexander M., 2019. "Megajournal mismanagement: Manuscript decision bias and anomalous editor activity at PLOS ONE," Journal of Informetrics, Elsevier, vol. 13(4).
    4. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    5. Federico Bianchi & Francisco Grimaldo & Giangiacomo Bravo & Flaminio Squazzoni, 2018. "The peer review game: an agent-based model of scientists facing resource constraints and institutional pressures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1401-1420, September.
    6. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    7. Kyle Siler & Philippe Vincent-Lamarre & Cassidy R Sugimoto & Vincent Larivière, 2022. "Cumulative advantage and citation performance of repeat authors in scholarly journals," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-17, April.
    8. Pilar Valderrama & Evaristo Jiménez-Contreras & Manuel Escabias & Mariano J. Valderrama, 2022. "Introducing a bibliometric index based on factor analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 509-522, January.
    9. Mengyi Sun & Jainabou Barry Danfa & Misha Teplitskiy, 2022. "Does double‐blind peer review reduce bias? Evidence from a top computer science conference," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(6), pages 811-819, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
    2. Federico Bianchi & Francisco Grimaldo & Giangiacomo Bravo & Flaminio Squazzoni, 2018. "The peer review game: an agent-based model of scientists facing resource constraints and institutional pressures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1401-1420, September.
    3. Francisco Grimaldo & Mario Paolucci & Jordi Sabater-Mir, 2018. "Reputation or peer review? The role of outliers," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1421-1438, September.
    4. Petersen, Alexander M., 2019. "Megajournal mismanagement: Manuscript decision bias and anomalous editor activity at PLOS ONE," Journal of Informetrics, Elsevier, vol. 13(4).
    5. Rüdiger Mutz & Tobias Wolbring & Hans-Dieter Daniel, 2017. "The effect of the “very important paper” (VIP) designation in Angewandte Chemie International Edition on citation impact: A propensity score matching analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2139-2153, September.
    6. Zhentao Liang & Jin Mao & Gang Li, 2023. "Bias against scientific novelty: A prepublication perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 99-114, January.
    7. Feliciani, Thomas & Morreau, Michael & Luo, Junwen & Lucas, Pablo & Shankar, Kalpana, 2022. "Designing grant-review panels for better funding decisions: Lessons from an empirically calibrated simulation model," Research Policy, Elsevier, vol. 51(4).
    8. Guy Madison & Knut Sundell, 2022. "Numbers of publications and citations for researchers in fields pertinent to the social services: a comparison of peer-reviewed journal publications across six disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 6029-6046, October.
    9. Akbaritabar, Aliakbar & Stephen, Dimity & Squazzoni, Flaminio, 2022. "A study of referencing changes in preprint-publication pairs across multiple fields," Journal of Informetrics, Elsevier, vol. 16(2).
    10. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    11. Rodriguez-Sánchez, Rosa & García, J.A. & Fdez-Valdivia, J., 2016. "Evolutionary games between authors and their editors," Applied Mathematics and Computation, Elsevier, vol. 273(C), pages 645-655.
    12. ederico Bianchi & Flaminio Squazzoni, 2022. "Can transparency undermine peer review? A simulation model of scientist behavior under open peer review [Reviewing Peer Review]," Science and Public Policy, Oxford University Press, vol. 49(5), pages 791-800.
    13. Monica Aniela Zaharie & Marco Seeber, 2018. "Are non-monetary rewards effective in attracting peer reviewers? A natural experiment," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1587-1609, December.
    14. Emre Sarigöl & David Garcia & Ingo Scholtes & Frank Schweitzer, 2017. "Quantifying the effect of editor–author relations on manuscript handling times," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 609-631, October.
    15. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    16. Zhao, Zhi-Dan & Chen, Jiahao & Lu, Yichuan & Zhao, Na & Jiang, Dazhi & Wang, Bing-Hong, 2021. "Dynamic patterns of open review process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
    17. Thomas Feliciani & Ramanathan Moorthy & Pablo Lucas & Kalpana Shankar, 2020. "Grade Language Heterogeneity in Simulation Models of Peer Review," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 23(3), pages 1-8.
    18. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    19. Jürgen Janger & Nicole Schmidt & Anna Strauss, 2019. "International Differences in Basic Research Grant Funding. A Systematic Comparison," WIFO Studies, WIFO, number 61664, Juni.
    20. Rodríguez Sánchez, Isabel & Makkonen, Teemu & Williams, Allan M., 2019. "Peer review assessment of originality in tourism journals: critical perspective of key gatekeepers," Annals of Tourism Research, Elsevier, vol. 77(C), pages 1-11.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:12:y:2018:i:1:p:101-112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.