IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/k9ybz_v1.html
   My bibliography  Save this paper

Improving Peer Review in Economics: Stocktaking and Proposals

Author

Listed:
  • Charness, Gary
  • Dreber, Anna

    (Stockholm School of Economics)

  • Evans, Daniel
  • Gill, Adam
  • Toussaert, Severine

    (University of Oxford)

Abstract

Peer review is central to the lives of researchers. We conduct a survey on improving peer review to which we received responses from over 1,400 economists. The survey is the bedrock of this article, which was written to (i) document the current state of peer review and (ii) investigate concrete steps towards improving it. We offer a snapshot of the recent submission and peer review activity of respondents, detail the difficulties they report facing, and measure their attitudes about various challenges and possible proposals to address them. We hope that this report will provide fertile ground for the development and implementation of practical solutions for improving peer review in economics.

Suggested Citation

  • Charness, Gary & Dreber, Anna & Evans, Daniel & Gill, Adam & Toussaert, Severine, 2025. "Improving Peer Review in Economics: Stocktaking and Proposals," MetaArXiv k9ybz_v1, Center for Open Science.
    • Handle: RePEc:osf:metaar:k9ybz_v1
    DOI: 10.31219/osf.io/k9ybz_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/686fd4f25db5ad7200a6c75a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/k9ybz_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Squazzoni, Flaminio & Bravo, Giangiacomo & Takács, Károly, 2013. "Does incentive provision increase the quality of peer review? An experimental study," Research Policy, Elsevier, vol. 42(1), pages 287-294.
    2. Craig Freeman, 2000. "Do Economic Journals Obey Economic Prescriptions?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 17(4), pages 371-384, December.
    3. Cherkashin, Ivan & Svetlana, Demidova & Imai, Susumu & Krishna, Kala, 2008. "The Inside Scoop: Acceptance and Rejection at the Journal of International Economics," Queen's Economics Department Working Papers 273642, Queen's University - Department of Economics.
    4. Peter Coles & John Cawley & Phillip B. Levine & Muriel Niederle & Alvin E. Roth & John J. Siegfried, 2010. "The Job Market for New Economists: A Market Design Perspective," Journal of Economic Perspectives, American Economic Association, vol. 24(4), pages 187-206, Fall.
    5. Jens Prüfer & David Zetland, 2010. "An auction market for journal articles," Public Choice, Springer, vol. 145(3), pages 379-403, December.
    6. Eliot Abrams & Jonathan Libgober & John A. List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," NBER Working Papers 27250, National Bureau of Economic Research, Inc.
    7. Carl Mellström & Magnus Johannesson, 2008. "Crowding Out in Blood Donation: Was Titmuss Right?," Journal of the European Economic Association, MIT Press, vol. 6(4), pages 845-863, June.
    8. repec:plo:pone00:0217918 is not listed on IDEAS
    9. repec:plo:pbio00:0050107 is not listed on IDEAS
    10. Giangiacomo Bravo & Francisco Grimaldo & Emilia López-Iñesta & Bahar Mehmani & Flaminio Squazzoni, 2019. "The effect of publishing peer review reports on referee behavior in five scholarly journals," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    11. Ofer H. Azar, 2004. "Rejections and the importance of first response times," International Journal of Social Economics, Emerald Group Publishing, vol. 31(3), pages 259-274, March.
    12. Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2018. "Lower-rated publications do lower academics’ judgments of publication lists: Evidence from a survey experiment of economists," Journal of Economic Psychology, Elsevier, vol. 66(C), pages 33-44.
    13. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    14. Gary D. Thompson & Satheesh V. Aradhyula & George Frisvold & Russell Tronstad, 2010. "Does Paying Referees Expedite Reviews? Results of a Natural Experiment," Southern Economic Journal, John Wiley & Sons, vol. 76(3), pages 678-692, January.
    15. Christopher Cotton, 2013. "Submission Fees and Response Times in Academic Publishing," American Economic Review, American Economic Association, vol. 103(1), pages 501-509, February.
    16. Cherkashin, Ivan & Demidova, Svetlana & Imai, Susumu & Krishna, Kala, 2009. "The inside scoop: Acceptance and rejection at the journal of international economics," Journal of International Economics, Elsevier, vol. 77(1), pages 120-132, February.
    17. Monica Aniela Zaharie & Marco Seeber, 2018. "Are non-monetary rewards effective in attracting peer reviewers? A natural experiment," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1587-1609, December.
    18. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    19. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    20. Gary D. Thompson & Satheesh V. Aradhyula & George Frisvold & Russell Tronstad, 2010. "Does Paying Referees Expedite Reviews?: Results of a Natural Experiment," Southern Economic Journal, John Wiley & Sons, vol. 76(3), pages 678-692, January.
    21. Gary D. Thompson & Satheesh V. Aradhyula & George Frisvold & Russell Tronstad, 2010. "Does Paying Referees Expedite Reviews? Results of a Natural Experiment," Southern Economic Journal, Southern Economic Association, vol. 76(3), pages 678-692, January.
    22. Ofer H. Azar, 2004. "Rejections and the importance of first response times," International Journal of Social Economics, Emerald Group Publishing Limited, vol. 31(3), pages 259-274, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    2. García, J.A. & Montero-Parodi, J.J. & Rodriguez-Sánchez, Rosa & Fdez-Valdivia, J., 2023. "How to motivate a reviewer with a present bias to work harder," Journal of Informetrics, Elsevier, vol. 17(4).
    3. David Card & Stefano DellaVigna, 2017. "What do Editors Maximize? Evidence from Four Leading Economics Journals," NBER Working Papers 23282, National Bureau of Economic Research, Inc.
    4. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    5. Yushan Hu & Ben G. Li, 2021. "The production economics of economics production," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(1), pages 228-255, February.
    6. João Ricardo Faria & Rajeev K. Goel, 2016. "Academic Publication Uncertainty and Publishing Behavior: A Game-Theoretic Perspective," CESifo Working Paper Series 6176, CESifo.
    7. Zhao, Zhi-Dan & Chen, Jiahao & Lu, Yichuan & Zhao, Na & Jiang, Dazhi & Wang, Bing-Hong, 2021. "Dynamic patterns of open review process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
    8. Sascha Baghestanian & Sergey V. Popov, 2018. "On publication, refereeing and working hard," Canadian Journal of Economics, Canadian Economics Association, vol. 51(4), pages 1419-1459, November.
    9. Giuseppe Pernagallo, 2023. "Science in the mist: A model of asymmetric information for the research market," Metroeconomica, Wiley Blackwell, vol. 74(2), pages 390-415, May.
    10. Spiegel, Yossi & Toivanen, Otto, 2022. "From conference submission to publication and citations: Evidence from the EARIE conference," International Journal of Industrial Organization, Elsevier, vol. 84(C).
    11. Bayar, Onur & Chemmanur, Thomas J., 2021. "A model of the editorial process in academic journals," Research Policy, Elsevier, vol. 50(9).
    12. María Victoria Anauati & Sebastian Galiani & Ramiro H. G�lvez, 2018. "Differences in citation patterns across journal tiers in economics," Documentos de Trabajo 16701, The Latin American and Caribbean Economic Association (LACEA).
    13. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2020. "Differences In Citation Patterns Across Journal Tiers: The Case Of Economics," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1217-1232, July.
    14. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    15. Damien Besancenot & João Ricardo Faria & Franklin G. Mixon, 2017. "Academic Research and the Strategic Interaction of Scholars and Editors: A Two-Stage Game," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 19(01), pages 1-16, March.
    16. Besancenot Damien & Faria João R. & Huynh Kim V., 2014. "Congestion of Academic Journals Under Papers’ Imperfect Selection," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 14(3), pages 1145-1167, July.
    17. Konstantinos Metaxoglou, 2021. "Canadian Journal of Economics: A historic overview," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 54(3), pages 1418-1453, November.
    18. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    19. Louis de Mesnard, 2014. "On the marketization of the academic review process. (VF) Sur la marchandisation du processus de referee des revues académiques," Working Papers CREGO 1141001, Université de Bourgogne - CREGO EA7317 Centre de recherches en gestion des organisations.
    20. Sugimoto, Cassidy R. & Larivière, Vincent & Ni, Chaoqun & Cronin, Blaise, 2013. "Journal acceptance rates: A cross-disciplinary analysis of variability and relationships with journal measures," Journal of Informetrics, Elsevier, vol. 7(4), pages 897-906.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:k9ybz_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.