IDEAS home Printed from https://ideas.repec.org/a/bla/ajecsc/v69y2010i5p1409-1452.html
   My bibliography  Save this article

Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline

Author

Listed:
  • Frederic S. Lee
  • Bruce C. Cronin
  • Scott McConnell
  • Erik Dean

Abstract

This article argues that the discipline of economics consists of two subdisciplines: heterodox and mainstream economics. Being distinct bodies of knowledge, it is possible that the processes of building scientific knowledge are different enough so to generate distinctly different referencing and citation practices. Therefore, a specific impact contribution score is necessary for ranking heterodox journals in terms of their contribution to building heterodox economics. If properly developed such a metric could also be used to produce a single overall quality‐equality ranking of mainstream and heterodox journals. Utilizing citation data and peer evaluations of 62 heterodox economics journals, a research quality measure is developed and then used to rank the journals. The measure is then used in conjunction with the SSCI five‐year impact factor to produce a comparative research quality‐equality rankings of the 62 heterodox and the 192 mainstream journals in the SSCI.

Suggested Citation

  • Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.
    • Handle: RePEc:bla:ajecsc:v:69:y:2010:i:5:p:1409-1452
    DOI: 10.1111/j.1536-7150.2010.00751.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1536-7150.2010.00751.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1536-7150.2010.00751.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rik Pieters & Hans Baumgartner, 2002. "Who Talks to Whom? Intra- and Interdisciplinary Communication of Economics Journals," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 483-509, June.
    2. Kodrzycki Yolanda K. & Yu Pingkang, 2006. "New Approaches to Ranking Economics Journals," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(1), pages 1-44, August.
    3. Sergio Da Silva, 2009. "Going parochial in the assessment of the Brazilian economics research output," Economics Bulletin, AccessEcon, vol. 29(4), pages 2832-2852.
    4. Péter Vinkler, 2002. "Subfield problems in applying the Garfield (Impact) Factors in practice," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 267-279, February.
    5. Graeme Hirst, 1978. "Discipline impact factors: A method for determining core journal lists," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(4), pages 171-172, July.
    6. Anton J. Nederhof, 2008. "Policy impact of bibliometric rankings of research performance of departments and individuals in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 163-174, January.
    7. Harry Bloch, 2010. "Research Evaluation Down Under: An Outsider's View from the Inside of the Australian Approach," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1530-1552, November.
    8. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    9. Baltagi, Badi H, 1999. "Applied Econometrics Rankings: 1989-1995," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 423-441, July-Aug..
    10. Frank L DuBois & David Reeb, 2000. "Ranking the International Business Journals," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 31(4), pages 689-704, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Raffaele Miniaci & Michele Pezzoni, 2020. "Social connections and editorship in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(3), pages 1292-1317, August.
    2. Wu, Dengsheng & Li, Jing & Lu, Xiaoli & Li, Jianping, 2018. "Journal editorship index for assessing the scholarly impact of academic institutions: An empirical analysis in the field of economics," Journal of Informetrics, Elsevier, vol. 12(2), pages 448-460.
    3. Lynne Chester, 2019. "Judging Heterodox Economics: A Response to Hodgson's Criticisms," Economic Thought, World Economics Association, vol. 8(1), pages 1-21, June.
    4. Florentin Gloetzl & Ernest Aigner, 2015. "Pluralism in the Market of Science? A citation network analysis of economic research at universities in Vienna," Ecological Economics Papers ieep5, Institute of Ecological Economics.
    5. Vogel, Rick & Hattke, Fabian & Petersen, Jessica, 2017. "Journal rankings in management and business studies: What rules do we play by?," Research Policy, Elsevier, vol. 46(10), pages 1707-1722.
    6. Chagas , André Luis Squarize, 2017. "Publish or Perish: um ranking de revistas da subárea de Economia Regional e Urbana para os pesquisadores brasileiros," Revista Brasileira de Estudos Regionais e Urbanos, Associação Brasileira de Estudos Regionais e Urbanos (ABER), vol. 11(4), pages 515-536.
    7. Michele Di Maio, 2013. "Are Mainstream and Heterodox Economists Different? An Empirical Analysis," American Journal of Economics and Sociology, Wiley Blackwell, vol. 72(5), pages 1315-1348, November.
    8. Raffaele Miniaci & Michele Pezzoni, 2015. "Is Publication in the Hands of Outstanding Scientists? A Study on the Determinants of Editorial Boards Membership in Economics," GREDEG Working Papers 2015-17, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    9. Ian Coelho de Souza Almeida & Rafael Galvão de Almeida & Lucas Resende de Carvalho, 2017. "Academic rankings and pluralism : the case of Brazil and the new version of Qualis," Textos para Discussão Cedeplar-UFMG 569, Cedeplar, Universidade Federal de Minas Gerais.
    10. Ferenc Moksony & Rita Hegedűs & Melinda Császár, 2014. "Rankings, research styles, and publication cultures: a study of American sociology departments," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1715-1729, December.
    11. Tim Thornton, 2013. "The Narrowing of the Australian University Economics Curriculum: An Analysis of the Problem and a Proposed Solution," The Economic Record, The Economic Society of Australia, vol. 89, pages 106-114, June.
    12. Martha A. Starr, 2010. "Increasing the Impact of Heterodox Work: Insights from RoSE," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1453-1474, November.
    13. Klaus Gründler & Niklas Potrafke, 2019. "Ideologically-charged terminology: austerity, fiscal consolidation, and sustainable governance," CESifo Working Paper Series 7613, CESifo.
    14. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    15. Arturo Hermann, 2018. "The Decline of the 'Original Institutional Economics' in the Post-World War II Period and the Perspectives of Today," Economic Thought, World Economics Association, vol. 7(1), pages 63-86, March.
    16. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    17. Pavel Sorokin, 2018. "Making Global Sociology in the Context of Neoliberal Domination: Challenges, Ideology and Possible Strategies," Sociological Research Online, , vol. 23(1), pages 21-42, March.
    18. Harry Bloch, 2010. "Research Evaluation Down Under: An Outsider's View from the Inside of the Australian Approach," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1530-1552, November.
    19. Eduardo Angeli, 2018. "Caminhos da Escola Austríaca: relação com ortodoxia, engajamento e produção de novo conhecimento [Paths of the Austrian School: its relationship with orthodoxy, engagement and production of new knowle," Nova Economia, Economics Department, Universidade Federal de Minas Gerais (Brazil), vol. 28(2), pages 681-704, May-Augus.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    2. Brenda Cheang & Chongshou Li & Andrew Lim & Zhenzhen Zhang, 2015. "Identifying patterns and structural influences in the scientific communication of business knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(1), pages 159-189, April.
    3. Gianfranco Di Vaio & Jacob Louis Weisdorf, 2010. "Ranking economic history journals: a citation-based impact-adjusted analysis," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 4(1), pages 1-17, January.
    4. Zhou Xu & Brenda Cheang & Andrew Lim & Qi Wen, 2011. "Evaluating OR/MS Journals via PageRank," Interfaces, INFORMS, vol. 41(4), pages 375-388, August.
    5. Klaus Wohlrabe, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," CESifo Working Paper Series 5726, CESifo.
    6. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    8. Fabian Scheidegger & Andre Briviba & Bruno S. Frey, 2023. "Behind the curtains of academic publishing: strategic responses of economists and business scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4765-4790, August.
    9. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    10. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 402-430, November.
    11. Guimaraes, Bernardo, 2011. "Qualis as a measuring stick for research output in Economics," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 31(1), March.
    12. Brenda Cheang & Samuel Kai Wah Chu & Chongshou Li & Andrew Lim, 2014. "OR/MS journals evaluation based on a refined PageRank method: an updated and more comprehensive review," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 339-361, August.
    13. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    14. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    15. Vanclay, Jerome K., 2012. "Publication patterns of award-winning forest scientists and implications for the Australian ERA journal ranking," Journal of Informetrics, Elsevier, vol. 6(1), pages 19-26.
    16. Chagas , André Luis Squarize, 2017. "Publish or Perish: um ranking de revistas da subárea de Economia Regional e Urbana para os pesquisadores brasileiros," Revista Brasileira de Estudos Regionais e Urbanos, Associação Brasileira de Estudos Regionais e Urbanos (ABER), vol. 11(4), pages 515-536.
    17. Ham, John C. & Wright, Julian & Ye, Ziqiu, 2023. "Documenting and Explaining the Dramatic Rise of the New Society Journals in Economics," IZA Discussion Papers 16337, Institute of Labor Economics (IZA).
    18. Tahamtan, Iman & Bornmann, Lutz, 2018. "Creativity in science and the link to cited references: Is the creative potential of papers reflected in their cited references?," Journal of Informetrics, Elsevier, vol. 12(3), pages 906-930.
    19. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    20. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ajecsc:v:69:y:2010:i:5:p:1409-1452. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0002-9246 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.