IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v4y2010i4p512-523.html
   My bibliography  Save this article

Publication point indicators: A comparative case study of two publication point systems and citation impact in an interdisciplinary context

Author

Listed:
  • Elleby, Anita
  • Ingwersen, Peter

Abstract

The paper presents comparative analyses of two publication point systems, The Norwegian and the in-house system from the interdisciplinary Danish Institute of International Studies (DIIS), used as case in the study for publications published 2006, and compares central citation-based indicators with novel publication point indicators (PPIs) that are formalized and exemplified. Two diachronic citation windows are applied: 2006-07 and 2006-08. Web of Science (WoS) as well as Google Scholar (GS) are applied to observe the cite delay and citedness for the different document types published by DIIS, journal articles, book chapters/conference papers and monographs. Journal Crown Indicator (JCI) calculations was based on WoS. Three PPIs are proposed: the Publication Point Ratio (PPR), which measures the sum of obtained publication points over the sum of the ideal points for the same set of documents; the Cumulated Publication Point Indicator (CPPI), which graphically illustrates the cumulated gain of obtained vs. ideal points, both seen as vectors; and the normalized Cumulated Publication Point Index (nCPPI) that represents the cumulated gain of publication success as index values, either graphically or as one overall score for the institution under evaluation.

Suggested Citation

  • Elleby, Anita & Ingwersen, Peter, 2010. "Publication point indicators: A comparative case study of two publication point systems and citation impact in an interdisciplinary context," Journal of Informetrics, Elsevier, vol. 4(4), pages 512-523.
    • Handle: RePEc:eee:infome:v:4:y:2010:i:4:p:512-523
    DOI: 10.1016/j.joi.2010.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157710000556
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2010.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kalervo Järvelin & Olle Persson, 2008. "The DCI index: Discounted cumulated impact‐based research evaluation," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(9), pages 1433-1440, July.
    2. Per O. Seglen, 1994. "Causal relationship between article citedness and journal impact," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 1-11, January.
    3. Ulf Sandström & Erik Sandström, 2009. "The field factor: towards a metric for academic institutions," Research Evaluation, Oxford University Press, vol. 18(3), pages 243-250, September.
    4. Kalervo Järvelin & Olle Persson, 2008. "Erratum re: “The DCI‐index: Discounted cumulated impact‐based research evaluation”, Journal of the American Society for Information Science and Technology, 59(9), 1433‐1440," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(14), pages 2350-2352, December.
    5. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    6. A. Raan, 1999. "Advanced bibliometric methods for the evaluation of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(3), pages 417-423, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Soleidy Rivero Amador & Maidelyn Díaz Pérez & María José López-Huertas & Reinaldo Javier Rodríguez Font, 2018. "Indicator system for managing science, technology and innovation in universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1575-1587, June.
    2. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    3. Ioana Lavinia Safta & Andrada-Ioana Sabău (Popa) & Neli Muntean, 2021. "Bibliometric Analysis of the Literature on Measuring Techniques for Manipulating Financial Statements," Risks, MDPI, vol. 9(7), pages 1-16, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chao Lu & Ying Ding & Chengzhi Zhang, 2017. "Understanding the impact change of a highly cited article: a content-based citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 927-945, August.
    2. Tóth, István & Lázár, Zsolt I. & Varga, Levente & Járai-Szabó, Ferenc & Papp, István & Florian, Răzvan V. & Ercsey-Ravasz, Mária, 2021. "Mitigating ageing bias in article level metrics using citation network analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Per Ahlgren & Cristian Colliander & Olle Persson, 2012. "Field normalized citation rates, field normalized journal impact and Norwegian weights for allocation of university research funds," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 767-780, September.
    4. Zhou, Ping & Leydesdorff, Loet, 2011. "Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing," Journal of Informetrics, Elsevier, vol. 5(3), pages 360-368.
    5. Kakushadze, Zura, 2016. "An index for SSRN downloads," Journal of Informetrics, Elsevier, vol. 10(1), pages 9-28.
    6. Peter Ingwersen & Birger Larsen, 2014. "Influence of a performance indicator on Danish research production and citation impact 2000–12," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1325-1344, November.
    7. Gaby Haddow & Paul Genoni, 2010. "Citation analysis and peer ranking of Australian social science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 471-487, November.
    8. William S. Pearson, 2020. "Research article titles in written feedback on English as a second language writing," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 997-1019, May.
    9. Katja Rost & Bruno S. Frey, 2011. "Quantitative and Qualitative Rankings of Scholars," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 63(1), pages 63-91, January.
    10. Nadia Simoes & Nuno Crespo, 2020. "A flexible approach for measuring author-level publishing performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 331-355, January.
    11. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    12. Alexander Kalgin & Olga Kalgina & Anna Lebedeva, 2019. "Publication Metrics as a Tool for Measuring Research Productivity and Their Relation to Motivation," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 44-86.
    13. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    14. Fernandez Martinez, Roberto & Lostado Lorza, Ruben & Santos Delgado, Ana Alexandra & Piedra, Nelson, 2021. "Use of classification trees and rule-based models to optimize the funding assignment to research projects: A case study of UTPL," Journal of Informetrics, Elsevier, vol. 15(1).
    15. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    16. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 9447, Victoria University of Wellington, Chair in Public Finance.
    17. Hui-Zhen Fu & Yuh-Shan Ho, 2013. "Comparison of independent research of China’s top universities using bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 259-276, July.
    18. Aksnes, Dag W. & Rip, Arie, 2009. "Researchers' perceptions of citations," Research Policy, Elsevier, vol. 38(6), pages 895-905, July.
    19. Lluís Rovira & Pau Senra & David Jou, 2000. "Bibliometric Analysis of Physics in Catalonia: Towards Quality Consolidation?," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(2), pages 233-256, October.
    20. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:4:y:2010:i:4:p:512-523. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.