IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v95y2013i2d10.1007_s11192-012-0904-5.html
   My bibliography  Save this article

The role of editorial material in bibliometric research performance assessments

Author

Listed:
  • Thed Leeuwen

    (Leiden University)

  • Rodrigo Costas

    (Leiden University)

  • Clara Calero-Medina

    (Leiden University)

  • Martijn Visser

    (Leiden University)

Abstract

In this study, the possibilities to extend the basis for research performance exercises with editorial material are explored. While this document type has been traditionally not considered as an important type of scientific communication in research performance assessment procedures, there is a perception from researchers that editorial materials should be considered as relevant document types as important sources for the dissemination of scientific knowledge. In a number of these cases, some of the mentioned editorial materials are actually ‘highly cited’. This lead to a thorough scrutiny of editorials or editorial material over the period 1992–2001, for all citation indexes of Thomson Scientific. The relevance of editorial materials through three quantitative bibliometric characteristics of scientific publications, namely page length, number of references, and the number of received citations, are thoroughly analyzed.

Suggested Citation

  • Thed Leeuwen & Rodrigo Costas & Clara Calero-Medina & Martijn Visser, 2013. "The role of editorial material in bibliometric research performance assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 817-828, May.
    • Handle: RePEc:spr:scient:v:95:y:2013:i:2:d:10.1007_s11192-012-0904-5
    DOI: 10.1007/s11192-012-0904-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0904-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-012-0904-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thed N van Leeuwen, 2007. "Modelling of bibliometric approaches and importance of output verification in research performance assessment," Research Evaluation, Oxford University Press, vol. 16(2), pages 93-105, June.
    2. Juan Miguel Campanario & Jesús Carretero & Vera Marangon & Antonio Molina & Germán Ros, 2011. "Effect on the journal impact factor of the number and document type of citing records: a wide-scale study," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 75-84, April.
    3. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    4. Tove Faber Frandsen, 2008. "On the ratio of citable versus non-citable items in economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 439-451, March.
    5. Grant Lewison, 2009. "The percentage of reviews in research output: a simple measure of research esteem," Research Evaluation, Oxford University Press, vol. 18(1), pages 25-37, March.
    6. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    7. T N van Leeuwen & L J van der Wurff & A J M de Craen, 2007. "Classification of “research letters” in general medical journals and its consequences in bibliometric research evaluation processes," Research Evaluation, Oxford University Press, vol. 16(1), pages 59-63, March.
    8. Rodrigo Costas & Thed N. Leeuwen & María Bordons, 2012. "Referencing patterns of individual researchers: Do top scientists rely on more extensive information sources?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2433-2450, December.
    9. Anne-Wil Harzing, 2013. "Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 23-34, January.
    10. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2012. "Referencing patterns of individual researchers: Do top scientists rely on more extensive information sources?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2433-2450, December.
    11. Anne Sigogneau, 2000. "An Analysis of Document Types Published in Journals Related to Physics: Proceeding Papers Recorded in the Science Citation Index Database," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(3), pages 589-604, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paul Donner, 2017. "Document type assignment accuracy in the journal citation index data of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 219-236, October.
    2. Mao, Guozhu & Zou, Hongyang & Chen, Guanyi & Du, Huibin & Zuo, Jian, 2015. "Past, current and future of biomass energy research: A bibliometric analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1823-1833.
    3. John P. A. Ioannidis, 2023. "Prolific non-research authors in high impact scientific journals: meta-research study," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 3171-3184, May.
    4. Tove Faber Frandsen & Jeppe Nicolaisen, 2023. "Defining the unscholarly publication: a bibliometric study of uncited and barely cited publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1337-1350, February.
    5. Manuel Ennes Ferreira & Sandro Mendonça & João Pereira, 2018. "Gatekeeping African studies: What does “editormetrics” indicate about journal governance?," Working Papers Department of Economics 2018/07, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    6. Youssef Elomari & Masoud Norouzi & Marc Marín-Genescà & Alberto Fernández & Dieter Boer, 2022. "Integration of Solar Photovoltaic Systems into Power Networks: A Scientific Evolution Analysis," Sustainability, MDPI, vol. 14(15), pages 1-23, July.
    7. Seuk Yen Phoong & Shi Ling Khek & Seuk Wai Phoong, 2022. "The Bibliometric Analysis on Finite Mixture Model," SAGE Open, , vol. 12(2), pages 21582440221, May.
    8. Olesia Iefremova & Kamil Wais & Marcin Kozak, 2018. "Biographical articles in scientific literature: analysis of articles indexed in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1695-1719, December.
    9. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    10. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    11. Sandro Mendonça & João Pereira & Manuel Ennes Ferreira, 2018. "Gatekeeping African studies: what does “editormetrics” indicate about journal governance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1513-1534, December.
    12. John P A Ioannidis & Kevin Boyack & Paul F Wouters, 2016. "Citation Metrics: A Primer on How (Not) to Normalize," PLOS Biology, Public Library of Science, vol. 14(9), pages 1-7, September.
    13. Soheil Roumi & Fan Zhang & Rodney A. Stewart, 2022. "Global Research Trends on Building Indoor Environmental Quality Modelling and Indexing Systems—A Scientometric Review," Energies, MDPI, vol. 15(12), pages 1-26, June.
    14. Wenjie Zhang & Hongping Yuan, 2019. "A Bibliometric Analysis of Energy Performance Contracting Research from 2008 to 2018," Sustainability, MDPI, vol. 11(13), pages 1-23, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Olesia Iefremova & Kamil Wais & Marcin Kozak, 2018. "Biographical articles in scientific literature: analysis of articles indexed in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1695-1719, December.
    2. Paul Donner, 2017. "Document type assignment accuracy in the journal citation index data of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 219-236, October.
    3. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    4. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    5. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    6. María Bordons & Borja González-Albo & Javier Aparicio & Luz Moreno, 2015. "The influence of R&D intensity of countries on the impact of international collaborative research: evidence from Spain," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1385-1400, February.
    7. Soo Jeung Lee & Christian Schneijderberg & Yangson Kim & Isabel Steinhardt, 2021. "Have Academics’ Citation Patterns Changed in Response to the Rise of World University Rankings? A Test Using First-Citation Speeds," Sustainability, MDPI, vol. 13(17), pages 1-19, August.
    8. Juan Gorraiz & Christian Gumpenberger & Philip J. Purnell, 2014. "The power of book reviews: a simple and transparent enhancement approach for book citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 841-852, February.
    9. Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    10. Sánchez-Gil, Susana & Gorraiz, Juan & Melero-Fuentes, David, 2018. "Reference density trends in the major disciplines," Journal of Informetrics, Elsevier, vol. 12(1), pages 42-58.
    11. Anne-Wil Harzing, 2013. "Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 23-34, January.
    12. Julian Hamann & Wolfgang Kaltenbrunner, 2022. "Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010," Research Evaluation, Oxford University Press, vol. 31(4), pages 438-451.
    13. Weishu Liu & Yishan Ding & Mengdi Gu, 2017. "Book reviews in academic journals: patterns and dynamics," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 355-364, January.
    14. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2014. "Are the authors of highly cited articles also the most productive ones?," Journal of Informetrics, Elsevier, vol. 8(1), pages 89-97.
    15. Barrios, Maite & Guilera, Georgina & Gómez-Benito, Juana, 2013. "Impact and structural features of meta-analytical studies, standard articles and reviews in psychology: Similarities and differences," Journal of Informetrics, Elsevier, vol. 7(2), pages 478-486.
    16. Carolin Michels & Jun-Ying Fu, 2014. "Systematic analysis of coverage and usage of conference proceedings in web of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 307-327, August.
    17. María Bordons & Javier Aparicio & Rodrigo Costas, 2013. "Heterogeneity of collaboration and its relationship with research impact in a biomedical field," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 443-466, August.
    18. P�ivi Oinas & Samuli Lepp�l�, 2013. "Views on Book Reviews," Regional Studies, Taylor & Francis Journals, vol. 47(10), pages 1785-1789, November.
    19. Guoqiang Liang & Haiyan Hou & Xiaodan Lou & Zhigang Hu, 2019. "Qualifying threshold of “take-off” stage for successfully disseminated creative ideas," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1193-1208, September.
    20. Yoscelina Iraida Hernandez-García & Mónica Anzaldo Montoya, 2021. "Flow of ideas in the study of communication channels and references in publications on nanotechnology applied to food and agriculture in Mexico," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 995-1017, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:95:y:2013:i:2:d:10.1007_s11192-012-0904-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.