IDEAS home Printed from https://ideas.repec.org/a/wsi/acsxxx/v13y2010i01ns0219525910002487.html
   My bibliography  Save this article

Exploring And Understanding Citation-Based Scientific Metrics

Author

Listed:
  • MIKALAI KRAPIVIN

    (Department of Information Engineering and Computer Science, University of Trento, Trento, 38100, Italy)

  • MAURIZIO MARCHESE

    (Department of Information Engineering and Computer Science, University of Trento, Trento, 38100, Italy)

  • FABIO CASATI

    (Department of Information Engineering and Computer Science, University of Trento, Trento, 38100, Italy)

Abstract

This paper explores citation-based metrics, how they differ in ranking papers and authors, and why. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popularh-index, and a variation we propose of PageRank applied to papers (called PaperRank), that is appealing as it mirrors proven and successful algorithms for ranking web pages. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. Finally, we extend the analysis to other popular indexes, to show whether the choice of the index has a significant effect in how papers and authors are ranked. We put the techniques at work on a dataset of over 260 K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citation-based indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.

Suggested Citation

  • Mikalai Krapivin & Maurizio Marchese & Fabio Casati, 2010. "Exploring And Understanding Citation-Based Scientific Metrics," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 13(01), pages 59-81.
    • Handle: RePEc:wsi:acsxxx:v:13:y:2010:i:01:n:s0219525910002487
    DOI: 10.1142/S0219525910002487
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S0219525910002487
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://libkey.io/10.1142/S0219525910002487?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. ., 2007. "Managing Horizontal Information Flows in Japan," Chapters, in: Asian Firms, chapter 2, Edward Elgar Publishing.
    2. Editors, 2007. "Cicero on the Ethics of Information Asymmetry," Journal of Political Economy, University of Chicago Press, vol. 115(4), pages 1-1, August.
    3. ., 2007. "Costly Information and Decision Making," Chapters, in: Expectations, Rationality and Economic Performance, chapter 6, Edward Elgar Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Meiqian & Guo, Zhaoxia & Dong, Yucheng & Chiclana, Francisco & Herrera-Viedma, Enrique, 2021. "Citations optimal growth path: A tool to analyze sensitivity to citations of h-like indexes," Journal of Informetrics, Elsevier, vol. 15(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Junping Qiu & Ruimin Ma & Ni Cheng, 2008. "New exploratory work of evaluating a researcher’s output," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 335-344, November.
    2. Ngare, Philip, 2019. "Analysis of the coexistence of conventional and unconventional credit markets in the agribusiness sector in Kenya," KBA Centre for Research on Financial Markets and Policy Working Paper Series 37, Kenya Bankers Association (KBA).
    3. Ali Gazni & Fereshteh Didegah, 2016. "The relationship between authors’ bibliographic coupling and citation exchange: analyzing disciplinary differences," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 609-626, May.
    4. Desheng Dash Wu & David L. Olson & Luis A. Seco & John Birge, 2011. "Introduction To The Special Issue On "Operational Research And Asia Risk Management"," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 28(01), pages 1-1.
    5. repec:aia:aiaswp:wp69 is not listed on IDEAS
    6. Hiromi Saito & Koichi Sumikura, 2010. "An Empirical Analysis On Absorptive Capacity Based On Linkage With Academia," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 14(03), pages 491-509.
    7. Wilfried Pauwels & Peter M. Kort & Eve Vanhaecht, 2014. "R&D Investments As Prebargaining Strategies," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 16(03), pages 1-36.
    8. Rifat A. Atun & Desmond Sheridan, 2007. "Editorial: Innovation In Health Care: The Engine Of Technological Advances," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 11(02), pages 1-1.
    9. Youming Lei & Fuli Guan, 2012. "Disorder Induced Order In An Array Of Chaotic Duffing Oscillators," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 23(10), pages 1-10.
    10. Kai Leung Yung & Youming Lei & Yan Xu, 2009. "Taming Chaotic Arrays By Parametric Excitation With Proper Random Phase," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 20(10), pages 1633-1643.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:acsxxx:v:13:y:2010:i:01:n:s0219525910002487. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/acs/acs.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.