IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v102y2020i1p195-217.html
   My bibliography  Save this article

What Do Editors Maximize? Evidence from Four Economics Journals

Author

Listed:
  • David Card

    (University of California, Berkeley, and NBER)

  • Stefano DellaVigna

    (University of California, Berkeley, and NBER)

Abstract

We study editorial decisions using anonymized submissions matched to citations at four leading economics journals. We develop a benchmark model in which editors maximize the expected quality of accepted papers and citations are unbiased measures of quality. We then generalize the model to allow different quality thresholds, systematic gaps between citations and quality, and a direct impact of publication on citations. We find that referee recommendations are strong predictors of citations and that editors follow these recommendations closely. We document two deviations from the benchmark model. First, papers by highly published authors receive more citations, conditional on the referees' recommendations and publication status. Second, recommendations of highly published referees are equally predictive of future citations, yet editors give their views significantly more weight.

Suggested Citation

  • David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    • Handle: RePEc:tpr:restat:v:102:y:2020:i:1:p:195-217
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/rest_a_00839
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch, 2014. "Referee Recommendations," Review of Financial Studies, Society for Financial Studies, vol. 27(9), pages 2773-2804.
    2. Gordon B. Dahl & Andreas Ravndal Kostøl & Magne Mogstad, 2014. "Family Welfare Cultures," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1711-1752.
    3. Damien Besancenot & Kim Huynh & Radu Vranceanu, 2011. "A Matching Model of the Academic Publication Market," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 167(4), pages 708-725, December.
    4. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    5. Nicole Maestas & Kathleen J. Mullen & Alexander Strand, 2013. "Does Disability Insurance Receipt Discourage Work? Using Examiner Assignment to Estimate Causal Effects of SSDI Receipt," American Economic Review, American Economic Association, vol. 103(5), pages 1797-1829, August.
    6. Marshall H. Medoff, 2003. "Editorial Favoritism in Economics?," Southern Economic Journal, John Wiley & Sons, vol. 70(2), pages 425-434, October.
    7. Raj Chetty & Emmanuel Saez & Laszlo Sandor, 2014. "What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 169-188, Summer.
    8. Elisabeth Schulte & Mike Felgenhauer, 2017. "Preselection and expert advice," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(3), pages 693-714, August.
    9. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    10. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    11. Besancenot, Damien & Huynh, Kim & Vranceanu, Radu, 2009. "Desk rejection in an academic publication market model with matching frictions," ESSEC Working Papers DR 09008, ESSEC Research Center, ESSEC Business School.
    12. Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
    13. Jeffrey M. Wooldridge, 2015. "Control Function Methods in Applied Econometrics," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 420-445.
    14. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    15. Hofmeister Robert & Krapf Matthias, 2011. "How Do Editors Select Papers, and How Good are They at Doing It?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 11(1), pages 1-23, October.
    16. Brogaard, Jonathan & Engelberg, Joseph & Parsons, Christopher A., 2014. "Networks and productivity: Causal evidence from editor rotations," Journal of Financial Economics, Elsevier, vol. 111(1), pages 251-270.
    17. Cherkashin, Ivan & Demidova, Svetlana & Imai, Susumu & Krishna, Kala, 2009. "The inside scoop: Acceptance and rejection at the journal of international economics," Journal of International Economics, Elsevier, vol. 77(1), pages 120-132, February.
    18. Raymond Fisman & Jing Shi & Yongxiang Wang & Rong Xu, 2018. "Social Ties and Favoritism in Chinese Science," Journal of Political Economy, University of Chicago Press, vol. 126(3), pages 1134-1171.
    19. John Knowles & Nicola Persico & Petra Todd, 2001. "Racial Bias in Motor Vehicle Searches: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 109(1), pages 203-232, February.
    20. Glenn Ellison, 2011. "Is Peer Review In Decline?," Economic Inquiry, Western Economic Association International, vol. 49(3), pages 635-657, July.
    21. Daniel S. Hamermesh, 1994. "Facts and Myths about Refereeing," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 153-163, Winter.
    22. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    23. Marshall Medoff, 2006. "Evidence of a Harvard and Chicago Matthew Effect," Journal of Economic Methodology, Taylor & Francis Journals, vol. 13(4), pages 485-506.
    24. Danielle Li, 2017. "Expertise versus Bias in Evaluation: Evidence from the NIH," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 60-92, April.
    25. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    26. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    27. repec:wly:soecon:v:82:2:y:2015:p:430-452 is not listed on IDEAS
    28. Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Card & Stefano DellaVigna, 2017. "What do Editors Maximize? Evidence from Four Leading Economics Journals," NBER Working Papers 23282, National Bureau of Economic Research, Inc.
    2. Sascha Baghestanian & Sergey V. Popov, 2018. "On publication, refereeing and working hard," Canadian Journal of Economics, Canadian Economics Association, vol. 51(4), pages 1419-1459, November.
    3. Bayar, Onur & Chemmanur, Thomas J., 2021. "A model of the editorial process in academic journals," Research Policy, Elsevier, vol. 50(9).
    4. Besancenot Damien & Faria João R. & Huynh Kim V., 2014. "Congestion of Academic Journals Under Papers’ Imperfect Selection," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 14(3), pages 1145-1167, July.
    5. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    6. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    7. Si, Kao & Li, Yiwei & Ma, Chao & Guo, Feng, 2023. "Affiliation bias in peer review and the gender gap," Research Policy, Elsevier, vol. 52(7).
    8. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.
    9. Meyer, Matthias & Waldkirch, Rüdiger W. & Duscher, Irina & Just, Alexander, 2018. "Drivers of citations: An analysis of publications in “top” accounting journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 24-46.
    10. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2019. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics," Research Memorandum 029, Maastricht University, Graduate School of Business and Economics (GSBE).
    11. Ali Sina Önder & Sergey V. Popov & Sascha Schweitzer, 2021. "Leadership in Scholarship: Editors’ Appointments and the Profession’s Narrative," Working Papers in Economics & Finance 2021-05, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    12. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    13. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    14. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    15. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    16. Rui Dai & Lawrence Donohue & Qingyi (Freda) Drechsler & Wei Jiang, 2023. "Dissemination, Publication, and Impact of Finance Research: When Novelty Meets Conventionality," Review of Finance, European Finance Association, vol. 27(1), pages 79-141.
    17. Raffaele Miniaci & Michele Pezzoni, 2020. "Social connections and editorship in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(3), pages 1292-1317, August.
    18. Yushan Hu & Ben G. Li, 2021. "The production economics of economics production," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(1), pages 228-255, February.
    19. Azar Ofer H., 2015. "A Model of the Academic Review Process with Informed Authors," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 15(2), pages 865-889, April.
    20. Onder, Ali Sina & Popov, Sergey V & Schweitzer, Sascha, 2018. "Leadership in Scholarship: Editors' Influence on the Profession's Narrative," Cardiff Economics Working Papers E2018/2, Cardiff University, Cardiff Business School, Economics Section.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:102:y:2020:i:1:p:195-217. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.