IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/69144.html

Ordinal ranking aggregation in bibliometric analysis

Author

Listed:
  • Wohlrabe, Klaus
  • Friedrich, Elisabeth

Abstract

This paper reviews standard ranking aggregation approaches in bibliometric analysis. These include the arithmetic and the harmonic mean. We also present two less-well known aggregation schemes, lexicographic and graphicolexic, which are based on the order of the rankings. Finally, we introduce two recently proposed ranking aggregation approaches which are based on stochastic aggregation. We describe all approaches and give a small illustrative and an empirical example to highlight the differences.

Suggested Citation

  • Wohlrabe, Klaus & Friedrich, Elisabeth, 2016. "Ordinal ranking aggregation in bibliometric analysis," MPRA Paper 69144, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:69144
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/69144/1/MPRA_paper_69144.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philip Hans Franses, 2014. "Trends in three decades of rankings of Dutch economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1257-1268, February.
    2. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    3. Klaus Wohlrabe, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," CESifo Working Paper Series 5726, CESifo.
    4. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    5. Anne‐Wil Harzing & Ron van der Wal, 2009. "A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 41-46, January.
    6. Wade D. Cook & Tal Raviv & Alan J. Richardson, 2010. "Aggregating Incomplete Lists of Journal Rankings: An Application to Academic Accounting Journals," Accounting Perspectives, John Wiley & Sons, vol. 9(3), pages 217-235, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    2. Klaus Wohlrabe, 2018. "Einige Anmerkungen zum FAZ-Ökonomenranking 2018," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(20), pages 29-33, October.
    3. Katharina Rath & Klaus Wohlrabe, 2016. "Recent trends in co-authorship in economics: evidence from RePEc," Applied Economics Letters, Taylor & Francis Journals, vol. 23(12), pages 897-902, August.
    4. Klaus Wohlrabe, 2014. "Eine Kritik des FAZ-Ökonomenrankings 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    5. Birkmaier, Daniel & Wohlrabe, Klaus, 2014. "The Matthew effect in economics reconsidered," Journal of Informetrics, Elsevier, vol. 8(4), pages 880-889.
    6. Ferda, HALICIOGLU, 2014. "Research Ranking Place of Turkish Economists in the World," MPRA Paper 54058, University Library of Munich, Germany.
    7. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    8. Klaus Wohlrabe & Constantin Bürgi, 2021. "What is the benefit from publishing a working paper in a journal in terms of citations? Evidence from economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4701-4714, June.
    9. Klaus Wohlrabe, 2020. "Einige Anmerkungen zum FAZ-Ökonomenranking 2020," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 73(11), pages 53-57, November.
    10. Klaus Wohlrabe & Elisabeth Friedrich, 2017. "The efficiency of economics departments reconsidered," Economics Bulletin, AccessEcon, vol. 37(3), pages 1602-1611.
    11. Joseph Gerald Hirschberg & Jeanette Ngaire Lye, 2020. "Grading Journals In Economics: The Abcs Of The Abdc," Journal of Economic Surveys, Wiley Blackwell, vol. 34(4), pages 876-921, September.
    12. Matthias Gnewuch & Klaus Wohlrabe, 2018. "Die (Super-)Effizienz von volkswirtschaftlichen Fakultäten," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(15), pages 30-34, August.
    13. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    14. Tol, Richard S.J., 2013. "The Matthew effect for cohorts of economists," Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
    15. Krapf, Matthias & Ursprung, Heinrich W. & Zimmermann, Christian, 2017. "Parenthood and productivity of highly skilled labor: Evidence from the groves of academe," Journal of Economic Behavior & Organization, Elsevier, vol. 140(C), pages 147-175.
    16. Richard S.J. Tol, 2013. "Quantile Kernel Regression for Identifying Excellent Economists," Working Paper Series 6013, Department of Economics, University of Sussex Business School.
    17. Tol, Richard S.J., 2013. "Identifying excellent researchers: A new approach," Journal of Informetrics, Elsevier, vol. 7(4), pages 803-810.
    18. Chiara Zanardello, 2023. "Market forces in Italian academia today (and yesterday)," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 651-698, January.
    19. Karol Paludkiewicz & Klaus Wohlrabe, 2010. "Qualitätsanalyse von Zeitschriften in den Wirtschaftswissenschaften – über Zitationsdatenbanken und Impaktfaktoren im Online-Zeitalter," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 63(21), pages 18-28, November.
    20. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Papers using RePEc data

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:69144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.