IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v113y2017i1d10.1007_s11192-017-2310-5.html
   My bibliography  Save this article

Duration and quality of the peer review process: the author’s perspective

Author

Listed:
  • Janine Huisman

    (Radboud University
    SciRev Foundation)

  • Jeroen Smits

    (SciRev Foundation
    Radboud University)

Abstract

To gain insight into the duration and quality of the scientific peer review process, we analyzed data from 3500 review experiences submitted by authors to the SciRev.sc website. Aspects studied are duration of the first review round, total review duration, immediate rejection time, the number, quality, and difficulty of referee reports, the time it takes authors to revise and resubmit their manuscript, and overall quality of the experience. We find clear differences in these aspects between scientific fields, with Medicine, Public health, and Natural sciences showing the shortest durations and Mathematics and Computer sciences, Social sciences, Economics and Business, and Humanities the longest. One-third of journals take more than 2 weeks for an immediate (desk) rejection and one sixth even more than 4 weeks. This suggests that besides the time reviewers take, inefficient editorial processes also play an important role. As might be expected, shorter peer review processes and those of accepted papers are rated more positively by authors. More surprising is that peer review processes in the fields linked to long processes are rated highest and those in the fields linked to short processes lowest. Hence authors’ satisfaction is apparently influenced by their expectations regarding what is common in their field. Qualitative information provided by the authors indicates that editors can enhance author satisfaction by taking an independent position vis-à-vis reviewers and by communicating well with authors.

Suggested Citation

  • Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    • Handle: RePEc:spr:scient:v:113:y:2017:i:1:d:10.1007_s11192-017-2310-5
    DOI: 10.1007/s11192-017-2310-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2310-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2310-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    2. Ofer H. Azar, 2007. "The Slowdown In First‐Response Times Of Economics Journals: Can It Be Beneficial?," Economic Inquiry, Western Economic Association International, vol. 45(1), pages 179-187, January.
    3. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2016. "Why the referees’ reports I receive as an editor are so much better than the reports I receive as an author?," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 967-986, March.
    4. Peter Kareiva & Michelle Marvier & Sabrina West & Joy Hornisher, 2002. "Slow-moving journals hinder conservation efforts," Nature, Nature, vol. 420(6911), pages 15-15, November.
    5. In-Uck Park & Mike W. Peacey & Marcus R. Munafò, 2014. "Modelling the effects of subjective and objective decision making in scientific peer review," Nature, Nature, vol. 506(7486), pages 93-96, February.
    6. Gary D. Thompson & Satheesh V. Aradhyula & George Frisvold & Russell Tronstad, 2010. "Does Paying Referees Expedite Reviews? Results of a Natural Experiment," Southern Economic Journal, John Wiley & Sons, vol. 76(3), pages 678-692, January.
    7. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    8. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    9. Cherkashin, Ivan & Demidova, Svetlana & Imai, Susumu & Krishna, Kala, 2009. "The inside scoop: Acceptance and rejection at the journal of international economics," Journal of International Economics, Elsevier, vol. 77(1), pages 120-132, February.
    10. Ofer H. Azar, 2004. "Rejections and the importance of first response times," International Journal of Social Economics, Emerald Group Publishing, vol. 31(3), pages 259-274, March.
    11. Daniel S. Hamermesh, 1994. "Facts and Myths about Refereeing," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 153-163, Winter.
    12. Arie Y. Lewin, 2014. "The Peer-review Process: The Good, the Bad, the Ugly, and the Extraordinary," Management and Organization Review, The International Association for Chinese Management Research, vol. 10(2), pages 167-173, July.
    13. Lewin, Arie Y., 2014. "The Peer-review Process: The Good, the Bad, the Ugly, and the Extraordinary," Management and Organization Review, Cambridge University Press, vol. 10(02), pages 167-173, July.
    14. David J. Solomon & Bo-Christer Björk, 2012. "Publication fees in open access publishing: Sources of funding and factors influencing choice of journal," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(1), pages 98-107, January.
    15. Moizer, Peter, 2009. "Publishing in accounting journals: A fair game?," Accounting, Organizations and Society, Elsevier, vol. 34(2), pages 285-304, February.
    16. Marco Pautasso & Hanno Schäfer, 2010. "Peer review delay and selectivity in ecology journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 307-315, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Besim Bilalli & Rana Faisal Munir & Alberto Abelló, 2021. "A framework for assessing the peer review duration of journals: case study in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 545-563, January.
    2. Ofer H. Azar, 2006. "The Academic Review Process: How Can We Make it More Efficient?," The American Economist, Sage Publications, vol. 50(1), pages 37-50, March.
    3. Azar, Ofer H., 2008. "Evolution of social norms with heterogeneous preferences: A general model and an application to the academic review process," Journal of Economic Behavior & Organization, Elsevier, vol. 65(3-4), pages 420-435, March.
    4. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    5. Besancenot, Damien & Vranceanu, Radu, 2008. "Can incentives for research harm research? A business schools' tale," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(3), pages 1248-1265, June.
    6. David Card & Stefano DellaVigna, 2017. "What do Editors Maximize? Evidence from Four Leading Economics Journals," NBER Working Papers 23282, National Bureau of Economic Research, Inc.
    7. Justus Haucap & Nima Moshgbar & W. Benedikt Schmal, 2021. "The impact of the German 'DEAL' on competition in the academic publishing market," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 2027-2049, December.
    8. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    9. Minxian Zheng & Kuangji Zhao & Shikui Zhao & Yantong Zhang, 2020. "Effecting variables of journal’s ranking in forestry field," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 135-151, October.
    10. Estevao Alves-Silva & Ana Carolina Figueira Porto & Carine Firmino & Henrique Venancio Silva & Ingrid Becker & Liegy Resende & Livia Borges & Luana Pfeffer & Marcela Silvano & Melina Santos Galdiano &, 2016. "Are the impact factor and other variables related to publishing time in ecology journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1445-1453, September.
    11. Ofer H. Azar, 2005. "The Review Process in Economics: Is It Too Fast?," Southern Economic Journal, John Wiley & Sons, vol. 72(2), pages 482-491, October.
    12. Ofer Azar, 2003. "Rejections and the Importance of First Response Times (Or: How Many Rejections Do Others Receive?)," General Economics and Teaching 0309002, University Library of Munich, Germany.
    13. Yushan Hu & Ben G. Li, 2021. "The production economics of economics production," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(1), pages 228-255, February.
    14. Zhao, Zhi-Dan & Chen, Jiahao & Lu, Yichuan & Zhao, Na & Jiang, Dazhi & Wang, Bing-Hong, 2021. "Dynamic patterns of open review process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
    15. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    16. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    17. Jens Prüfer & David Zetland, 2010. "An auction market for journal articles," Public Choice, Springer, vol. 145(3), pages 379-403, December.
    18. Paul Sebo & Jean Pascal Fournier & Claire Ragot & Pierre-Henri Gorioux & François R. Herrmann & Hubert Maisonneuve, 2019. "Factors associated with publication speed in general medical journals: a retrospective study of bibliometric data," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1037-1058, May.
    19. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    20. Damien Besancenot & João Ricardo Faria & Franklin G. Mixon, 2017. "Academic Research and the Strategic Interaction of Scholars and Editors: A Two-Stage Game," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 19(01), pages 1-16, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:113:y:2017:i:1:d:10.1007_s11192-017-2310-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.