IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp10752.html
   My bibliography  Save this paper

Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment

Author

Listed:
  • Powdthavee, Nattavudh

    () (University of Warwick)

  • Riyanto, Yohanes E.

    () (Nanyang Technological University, Singapore)

  • Knetsch, Jack L.

    () (Simon Fraser University)

Abstract

Publications in leading journals are widely known to have a positive impact on economists' judgments of the value of authors' contributions to the literature and on their professional reputations. Very little attention has been given, however, to the impacts of the addition of publications in lower rated journals on such judgments. In our main tests, we asked subsamples of economists in 44 universities throughout the world to rate either a publication list with only higher rated journals or a list with all of these but with additional publications in nearly as many respected but lower rated journals. Our primary finding was that the inclusion of lower rated journals had a statistically significant negative impact on these economists' judgments of the value of the author's contribution. To the extent that such judgments may influence research and publication strategies our findings imply negative implications on social welfare.

Suggested Citation

  • Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2017. "Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment," IZA Discussion Papers 10752, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp10752
    as

    Download full text from publisher

    File URL: http://ftp.iza.org/dp10752.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John P. Conley & Mario J. Crucini & Robert A. Driskill & Ali Sina Önder, 2013. "The Effects Of Publication Lags On Life-Cycle Research Productivity In Economics," Economic Inquiry, Western Economic Association International, vol. 51(2), pages 1251-1276, April.
    2. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    3. Combes, Pierre-Philippe & Linnemer, Laurent & Visser, Michael, 2008. "Publish or peer-rich? The role of skills and networks in hiring economics professors," Labour Economics, Elsevier, vol. 15(3), pages 423-441, June.
    4. Kahn, Shulamit, 1993. "Gender Differences in Academic Career Paths of Economists," American Economic Review, American Economic Association, vol. 83(2), pages 52-56, May.
    5. Arthur E. Attema & Werner B.F. Brouwer & Job Van Exel, 2014. "Your Right Arm For A Publication In Aer?," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 495-502, January.
    6. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    7. Paul W. Grimes & Charles A. Register, 1997. "Career Publications and Academic Job Rank: Evidence from the Class of 1968," The Journal of Economic Education, Taylor & Francis Journals, vol. 28(1), pages 82-92, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. How to Count Citations If You Must
      by noreply@blogger.com (David Stern) in Stochastic Trend on 2018-01-06 05:23:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    2. David I. Stern & Richard S.J. Tol, 2018. "How to Count Citations If You Must: Comment," Working Paper Series 0118, Department of Economics, University of Sussex Business School.
    3. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    4. Timothy Perri, 2018. "Economics of evaluation (with special reference to promotion and tenure committees)," Economics of Governance, Springer, vol. 19(1), pages 1-19, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2018. "Lower-rated publications do lower academics’ judgments of publication lists: Evidence from a survey experiment of economists," Journal of Economic Psychology, Elsevier, vol. 66(C), pages 33-44.
    2. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    3. J. Atsu Amegashie, 2020. "Citations And Incentives In Academic Contests," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1233-1244, July.
    4. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    5. Imad A. Moosa, 2016. "A Critique of the Bucket Classification of Journals: The ABDC List as an Example," The Economic Record, The Economic Society of Australia, vol. 92(298), pages 448-463, September.
    6. Muhammad Asali, 2019. "A tale of two tracks," Education Economics, Taylor & Francis Journals, vol. 27(3), pages 323-337, May.
    7. Damien Besancenot & Kim Huynh & Francisco Serranito, 2015. " Thou shalt not work alone ," CEPN Working Papers hal-01175758, HAL.
    8. Damien Besancenot & Abdelghani Maddi, 2019. "Should citations be weighted to assess the influence of an academic article?," Economics Bulletin, AccessEcon, vol. 435(1), pages 435-445.
    9. Ernest Aigner & Florentin Gloetzl & Matthias Aistleitner & Jakob Kapeller, 2018. "The focus of academic economics: before and after the crisis," ICAE Working Papers 75, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    10. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2018. "Differences in citation patterns across journal tiers in economics," Documentos de Trabajo LACEA 016701, The Latin American and Caribbean Economic Association - LACEA.
    11. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2020. "Differences In Citation Patterns Across Journal Tiers: The Case Of Economics," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1217-1232, July.
    12. Krapf, Matthias & Ursprung, Heinrich W. & Zimmermann, Christian, 2017. "Parenthood and productivity of highly skilled labor: Evidence from the groves of academe," Journal of Economic Behavior & Organization, Elsevier, vol. 140(C), pages 147-175.
    13. Haley, M. Ryan & McGee, M. Kevin, 2020. "Jointly valuing journal visibility and author citation count: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 14(1).
    14. José Alberto Molina & Alberto Alcolea & Alfredo Ferrer & Alberto Alcolea & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2016. "Co-authorship and Academic Productivity in Economics: Interaction Maps from the Complex Networks Approach," Boston College Working Papers in Economics 914, Boston College Department of Economics.
    15. Raquel Carrasco & Javier Ruiz-Castillo, 2014. "The Evolution Of The Scientific Productivity Of Highly Productive Economists," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 1-16, January.
    16. Vera Sommer & Klaus Wohlrabe, 2017. "Citations, journal ranking and multiple authorships reconsidered: evidence from almost one million articles," Applied Economics Letters, Taylor & Francis Journals, vol. 24(11), pages 809-814, June.
    17. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    18. Stéphanie Combes & Pauline Givord, 2018. "Selective matching: gender gap and network formation in research," Working Papers 2018-07, Center for Research in Economics and Statistics.
    19. José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
    20. M. Ryan Haley, 2020. "Combining the weighted and unweighted Euclidean indices: a graphical approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 103-111, April.

    More about this item

    Keywords

    lower ranked journals; publication; judgment bias; less-is-better effect; resume;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10752. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Holger Hinte). General contact details of provider: http://www.iza.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.