IDEAS home Printed from https://ideas.repec.org/a/pal/easeco/v40y2014i2p274-281.html
   My bibliography  Save this article

An Investigation of Editorial Favoritism in the AER

Author

Listed:
  • Philip R P Coelho

    (Department of Economics, Whitinger Business Building, room 201 2000 W., University Ave., Muncie, IN 47306, USA. E-mails: 00prcoelho@bsu.edu; jmcclure@bsu.edu; damessh@gmail.com)

  • James E McClure

    (Department of Economics, Whitinger Business Building, room 201 2000 W., University Ave., Muncie, IN 47306, USA. E-mails: 00prcoelho@bsu.edu; jmcclure@bsu.edu; damessh@gmail.com)

  • Peter J Reilly

    (Department of Economics, Whitinger Business Building, room 201 2000 W., University Ave., Muncie, IN 47306, USA. E-mails: 00prcoelho@bsu.edu; jmcclure@bsu.edu; damessh@gmail.com)

Abstract

This paper contributes to a substantial literature assessing the credibility of academic research. We examine the hypothesis that selection procedures of journals favor submissions that cite journal insiders. Our tests use data from the American Economic Review (AER) and the number of citations to AER publications that appear in non-AER journals. We find that citations to AER-insiders in articles in the AER were statistically insignificant; however, increased frequency of citations in non-AER journals were positively (albeit statistically insignificant) related to references to AER insiders. The sign is precisely opposite of what one would expect if submissions were judged on criteria other than intellectual merit. The evidence is robust across specifications. Given our metric, sample, and procedures, we do not find any significant support for the hypothesis of editorial favoritism.

Suggested Citation

  • Philip R P Coelho & James E McClure & Peter J Reilly, 2014. "An Investigation of Editorial Favoritism in the AER," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 40(2), pages 274-281, March.
  • Handle: RePEc:pal:easeco:v:40:y:2014:i:2:p:274-281
    as

    Download full text from publisher

    File URL: http://www.palgrave-journals.com/eej/journal/v40/n2/pdf/eej201331a.pdf
    File Function: Link to full text PDF
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: http://www.palgrave-journals.com/eej/journal/v40/n2/full/eej201331a.html
    File Function: Link to full text HTML
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    2. Oswald, Andrew J., 2008. "Can We Test for Bias in Scientific Peer-Review?," IZA Discussion Papers 3665, Institute of Labor Economics (IZA).
    3. Leamer, Edward E, 1985. "Sensitivity Analyses Would Help," American Economic Review, American Economic Association, vol. 75(3), pages 308-313, June.
    4. Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
    5. Yohe, Gary W, 1980. "Current Publication Lags in Economics Journals," Journal of Economic Literature, American Economic Association, vol. 18(3), pages 1050-1055, September.
    6. Philip R. P. Coelho & James E. McClure, 2006. "Why Has Critical Commentary Been Curtailed at Top Economics Journals? A Reply to Robert Whaples," Econ Journal Watch, Econ Journal Watch, vol. 3(2), pages 283-291, May.
    7. Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc.
    8. Tsui1, Anne S. & Galaskiewicz, Joseph, 2011. "Commitment to Excellence: Upholding Research Integrity at Management and Organization Review," Management and Organization Review, Cambridge University Press, vol. 7(03), pages 389-395, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tie, Ying & Wang, Zheng, 2022. "Publish or perish? A tale of academic publications in Chinese universities," China Economic Review, Elsevier, vol. 73(C).
    2. Lawson, Nicholas, 2023. "What citation tests really tell us about bias in academic publishing," European Economic Review, Elsevier, vol. 158(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lawson, Nicholas, 2023. "What citation tests really tell us about bias in academic publishing," European Economic Review, Elsevier, vol. 158(C).
    2. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    3. Brogaard, Jonathan & Engelberg, Joseph & Parsons, Christopher A., 2014. "Networks and productivity: Causal evidence from editor rotations," Journal of Financial Economics, Elsevier, vol. 111(1), pages 251-270.
    4. Cherkashin, Ivan & Demidova, Svetlana & Imai, Susumu & Krishna, Kala, 2009. "The inside scoop: Acceptance and rejection at the journal of international economics," Journal of International Economics, Elsevier, vol. 77(1), pages 120-132, February.
    5. Bruno Frey, 2005. "Problems with Publishing: Existing State and Solutions," European Journal of Law and Economics, Springer, vol. 19(2), pages 173-190, April.
    6. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    7. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    8. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    9. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    10. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    11. David Michayluk & Ralf Zurbruegg, 2014. "Do lead articles signal higher quality in the digital age? Evidence from finance journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 961-973, February.
    12. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    13. João Ricardo Faria, 2005. "The Game Academics Play: Editors versus Authors," Bulletin of Economic Research, Wiley Blackwell, vol. 57(1), pages 1-12, January.
    14. Klaus E Meyer & Arjen Witteloostuijn & Sjoerd Beugelsdijk, 2017. "What’s in a p? Reassessing best practices for conducting and reporting hypothesis-testing research," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 48(5), pages 535-551, July.
    15. Stephen A. Gorman & Frank J. Fabozzi, 2021. "The ABC’s of the alternative risk premium: academic roots," Journal of Asset Management, Palgrave Macmillan, vol. 22(6), pages 405-436, October.
    16. Si, Kao & Li, Yiwei & Ma, Chao & Guo, Feng, 2023. "Affiliation bias in peer review and the gender gap," Research Policy, Elsevier, vol. 52(7).
    17. Anne Musson & Damien Rousselière, 2020. "Exploring the effect of crisis on cooperatives: a Bayesian performance analysis of French craftsmen cooperatives," Applied Economics, Taylor & Francis Journals, vol. 52(25), pages 2657-2678, May.
    18. Olaf Hübler & Joachim Frohn, 2006. "Developments and New Dimensions in Econometrics," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 1, pages 1-6, Springer.
    19. Vojtěch Roženský, 2012. "Mandatorní výdaje a flexibilita fiskální politiky v ČR [Mandatory Expenditure and the Flexibility of Fiscal Policy in the Czech Republic]," Politická ekonomie, Prague University of Economics and Business, vol. 2012(1), pages 40-57.
    20. Ma, Chao & Li, Yiwei & Guo, Feng & Si, Kao, 2019. "The citation trap: Papers published at year-end receive systematically fewer citations," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 667-687.

    More about this item

    JEL classification:

    • A10 - General Economics and Teaching - - General Economics - - - General
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • B40 - Schools of Economic Thought and Methodology - - Economic Methodology - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:easeco:v:40:y:2014:i:2:p:274-281. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.