IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp10752.html
   My bibliography  Save this paper

Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment

Author

Listed:
  • Powdthavee, Nattavudh

    (Nanyang Technological University, Singapore)

  • Riyanto, Yohanes E.

    (Nanyang Technological University, Singapore)

  • Knetsch, Jack L.

    (Simon Fraser University)

Abstract

Publications in leading journals are widely known to have a positive impact on economists' judgments of the value of authors' contributions to the literature and on their professional reputations. Very little attention has been given, however, to the impacts of the addition of publications in lower rated journals on such judgments. In our main tests, we asked subsamples of economists in 44 universities throughout the world to rate either a publication list with only higher rated journals or a list with all of these but with additional publications in nearly as many respected but lower rated journals. Our primary finding was that the inclusion of lower rated journals had a statistically significant negative impact on these economists' judgments of the value of the author's contribution. To the extent that such judgments may influence research and publication strategies our findings imply negative implications on social welfare.

Suggested Citation

  • Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2017. "Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment," IZA Discussion Papers 10752, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp10752
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp10752.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John P. Conley & Mario J. Crucini & Robert A. Driskill & Ali Sina Önder, 2013. "The Effects Of Publication Lags On Life-Cycle Research Productivity In Economics," Economic Inquiry, Western Economic Association International, vol. 51(2), pages 1251-1276, April.
    2. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    3. Combes, Pierre-Philippe & Linnemer, Laurent & Visser, Michael, 2008. "Publish or peer-rich? The role of skills and networks in hiring economics professors," Labour Economics, Elsevier, vol. 15(3), pages 423-441, June.
    4. Pierre-Philippe Combes & Laurent Linnemer & Michael Visser, 2008. "Publish or Peer-rich," Post-Print hal-00558189, HAL.
    5. Kahn, Shulamit, 1993. "Gender Differences in Academic Career Paths of Economists," American Economic Review, American Economic Association, vol. 83(2), pages 52-56, May.
    6. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    7. Arthur E. Attema & Werner B.F. Brouwer & Job Van Exel, 2014. "Your Right Arm For A Publication In Aer?," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 495-502, January.
    8. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    9. Paul W. Grimes & Charles A. Register, 1997. "Career Publications and Academic Job Rank: Evidence from the Class of 1968," The Journal of Economic Education, Taylor & Francis Journals, vol. 28(1), pages 82-92, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. How to Count Citations If You Must
      by noreply@blogger.com (David Stern) in Stochastic Trend on 2018-01-06 05:23:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    2. David I. Stern & Richard S.J. Tol, 2018. "How to Count Citations If You Must: Comment," Working Paper Series 0118, Department of Economics, University of Sussex Business School.
    3. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    4. Timothy Perri, 2018. "Economics of evaluation (with special reference to promotion and tenure committees)," Economics of Governance, Springer, vol. 19(1), pages 1-19, February.
    5. Zarrina Juraqulova & Jill J. McCluskey & Ron C. Mittelhammer, 2022. "Promotional achievement of economists: Does being agricultural or female matter?," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(4), pages 2064-2086, December.
    6. Payson Steven, 2019. "Cite This Economics Paper! It Is Time for the House of Cards to Fall Down," Open Economics, De Gruyter, vol. 2(1), pages 1-18, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    2. Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2018. "Lower-rated publications do lower academics’ judgments of publication lists: Evidence from a survey experiment of economists," Journal of Economic Psychology, Elsevier, vol. 66(C), pages 33-44.
    3. J. Atsu Amegashie, 2020. "Citations And Incentives In Academic Contests," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1233-1244, July.
    4. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    5. Anne Boring, 2015. "Gender Biases in student evaluations of teachers," Documents de Travail de l'OFCE 2015-13, Observatoire Francais des Conjonctures Economiques (OFCE).
    6. Jenny Bourne & Nathan Grawe & Nathan D. Grawe & Michael Hemesath & Maya Jensen, 2022. "Scholarly Activity among Economists at Liberal Arts Colleges: A Life Cycle Analysis," Working Papers 2022-01, Carleton College, Department of Economics.
    7. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2020. "Differences In Citation Patterns Across Journal Tiers: The Case Of Economics," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1217-1232, July.
    8. José Alberto Molina & Alberto Alcolea & Alfredo Ferrer & Alberto Alcolea & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2016. "Co-authorship and Academic Productivity in Economics: Interaction Maps from the Complex Networks Approach," Boston College Working Papers in Economics 914, Boston College Department of Economics.
    9. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2022. "The authors of economics journals revisited: Evidence from a large-scale replication of Hodgson & Rothman (1999)," ifso working paper series 20, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    10. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    11. repec:hal:spmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    12. José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
    13. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    14. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    15. Damien Besancenot & Kim Van Huynh & Francisco Serranito, 2015. " Thou shalt not work alone ," CEPN Working Papers hal-01175758, HAL.
    16. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2018. "Differences in citation patterns across journal tiers in economics," Documentos de Trabajo 16701, The Latin American and Caribbean Economic Association (LACEA).
    17. Franklin G. Mixon & Benno Torgler & Kamal P. Upadhyaya, 2022. "Committees or Markets? An Exploratory Analysis of Best Paper Awards in Economics," Economies, MDPI, vol. 10(5), pages 1-15, May.
    18. Payson Steven, 2019. "Cite This Economics Paper! It Is Time for the House of Cards to Fall Down," Open Economics, De Gruyter, vol. 2(1), pages 1-18, January.
    19. Stéphanie Combes & Pauline Givord, 2018. "Selective matching: gender gap and network formation in research," Working Papers 2018-07, Center for Research in Economics and Statistics.
    20. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2017. "A Meta-Ranking of Economics Publications," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 70(16), pages 40-42, August.

    More about this item

    Keywords

    lower ranked journals; publication; judgment bias; less-is-better effect; resume;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10752. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.