IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v77y2008i1d10.1007_s11192-007-1834-5.html
   My bibliography  Save this article

New evaluation indexes for articles and authors’ academic achievements based on Open Access Resources

Author

Listed:
  • Soo-Ryun Cho

    (International Vaccine Institute Library
    Sung Kyun Kwan University)

Abstract

In Open Access (OA) environment where article-based or author-based evaluation is important, a new evaluation system is needed to accommodate characteristics of Open Access Resources (OAR) and to overcome limitations of pre-existing evaluation systems such as journal-based evaluation. Primary and secondary evaluation factors were selected. Primary factors include hits and citations that constitutes composite index. Several secondary factors each for article and author evaluation were selected for normalization of the indexes. To validate superiority of newly developed normalized composite index systems compared to the monovariable index system, time-driven bias and power of discrimination were adopted. The results led to the conclusion that composite index proved to be a more stable index offsetting the negative effects from one element to another and normalization makes the composite index even more stable by controlling the bias from external elements.

Suggested Citation

  • Soo-Ryun Cho, 2008. "New evaluation indexes for articles and authors’ academic achievements based on Open Access Resources," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 91-112, October.
    • Handle: RePEc:spr:scient:v:77:y:2008:i:1:d:10.1007_s11192-007-1834-5
    DOI: 10.1007/s11192-007-1834-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-007-1834-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-007-1834-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Michael E. D. Koenig, 1983. "Bibliometric indicators versus expert opinion in assessing research performance," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 34(2), pages 136-145, March.
    2. Lokman I. Meho & Diane H. Sonnenwald, 2000. "Citation ranking versus peer evaluation of senior faculty research performance: A case study of Kurdish scholarship," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(2), pages 123-138.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Selçuk Bilir & Ersin Göğüş & Özgecan Önal & Nazlı Derya Öztürkmen & Talar Yontan, 2013. "Research performance of Turkish astronomers in the period of 1980–2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 477-489, November.
    2. Mingyang Wang & Jiaqi Zhang & Guangsheng Chen & Kah-Hin Chai, 2019. "Examining the influence of open access on journals’ citation obsolescence by modeling the actual citation process," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1621-1641, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dangzhi Zhao & Elisabeth Logan, 2002. "Citation analysis using scientific publications on the Web as data source: A case study in the XML research area," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 449-472, July.
    2. Zheng Yan & Wenqian Robertson & Yaosheng Lou & Tom W. Robertson & Sung Yong Park, 2021. "Finding leading scholars in mobile phone behavior: a mixed-method analysis of an emerging interdisciplinary field," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9499-9517, December.
    3. Alberto Baccini & Giuseppe De Nicolao, 2016. "Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1651-1671, September.
    4. Siluo Yang & Feng Ma & Yanhui Song & Junping Qiu, 2010. "A longitudinal analysis of citation distribution breadth for Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 755-765, December.
    5. Hu, Zewen & Wu, Yishan, 2014. "Regularity in the time-dependent distribution of the percentage of never-cited papers: An empirical pilot study based on the six journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 136-146.
    6. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    7. Giovanni Abramo & Ciriaco D’Angelo, 2015. "An assessment of the first “scientific habilitation” for university appointments in Italy," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 32(3), pages 329-357, December.
    8. Martin, Ben R., 2012. "The evolution of science policy and innovation studies," Research Policy, Elsevier, vol. 41(7), pages 1219-1239.
    9. Peter Vinkler, 2010. "The πv-index: a new indicator to characterize the impact of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 461-475, March.
    10. Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
    11. Giovanni Abramo & Ciriaco Andrea D’Angelo & Emanuela Reale, 2019. "Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 537-554, October.
    12. Chi-Yen Yin & Hsiao-Hsin Chang, 2022. "What Is the Link between Strategic Innovation and Organizational Sustainability? Historical Review and Bibliometric Analytics," Sustainability, MDPI, vol. 14(11), pages 1-23, June.
    13. Abramo, Giovanni, 2018. "Revisiting the scientometric conceptualization of impact and its measurement," Journal of Informetrics, Elsevier, vol. 12(3), pages 590-597.
    14. Jeppe Nicolaisen & Tove Faber Frandsen, 2019. "Zero impact: a large-scale study of uncitedness," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1227-1254, May.
    15. P. Vinkler, 2010. "Indicators are the essence of scientometrics and bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 861-866, December.
    16. Giovanni Abramo & Tindaro Cicero & Ciriaco Andrea D’Angelo, 2013. "National peer-review research assessment exercises for the hard sciences can be a complete waste of money: the Italian case," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 311-324, April.
    17. Jean A. Pratt & Karina Hauser & Cassidy R. Sugimoto, 2012. "Defining the intellectual structure of information systems and related college of business disciplines: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 279-304, November.
    18. Giovanni Abramo & Ciriaco Andrea D'Angelo, 2015. "The VQR, Italy's second national research assessment: Methodological failures and ranking distortions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2202-2214, November.
    19. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    20. Mariana Pires Luz & Carla Marques-Portella & Mauro Mendlowicz & Sonia Gleiser & Evandro Silva Freire Coutinho & Ivan Figueira, 2008. "Institutional h-index: The performance of a new metric in the evaluation of Brazilian Psychiatric Post-graduation Programs," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 361-368, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:77:y:2008:i:1:d:10.1007_s11192-007-1834-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.