IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v113y2017i3d10.1007_s11192-017-2539-z.html
   My bibliography  Save this article

Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX

Author

Listed:
  • Daniel Torres-Salinas

    (Universidad de Granada (EC3metrics & Medialab UGR)
    Universidad de Navarra)

  • Nicolás Robinson-Garcia

    (Universitat Politècnica de València)

  • Juan Gorraiz

    (University of Vienna)

Abstract

More than 5 years after their emergence, altmetrics are still seen as a promise to complement traditional citation-based indicators. However, no study has focused on their potential usefulness to capture the impact of scholarly books. While recent literature shows that citation indicators cannot fully capture the impact of books, other studies have suggested alternative indicators such as usage, publishers’ prestige or library holdings. In this paper, we calculate 18 indicators which range from altmetrics to library holdings, views, downloads or citations to the production of monographs of a Spanish university using the bibliometric suite PlumX from EBSCO. The objective of the study is to adopt a multidimensional perspective on the analysis of books and understand the level of complementarity between these different indicators. Also, we compare the overview offered by this range of indicators when applied to monographs with the traditional bibliometric perspective focused on journal articles and citation impact. We observe a low presence of altmetric indicators for monographs, even lower than for journal articles and a predominance of library holdings, confirming this indicator as the most promising one towards the analysis of the impact of books.

Suggested Citation

  • Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    • Handle: RePEc:spr:scient:v:113:y:2017:i:3:d:10.1007_s11192-017-2539-z
    DOI: 10.1007/s11192-017-2539-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2539-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2539-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Howard D. White & Sebastian K. Boell & Hairong Yu & Mari Davis & Concepción S. Wilson & Fletcher T.H. Cole, 2009. "Libcitations: A measure for comparative assessment of book publications in the humanities and social sciences," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(6), pages 1083-1096, June.
    2. Juan Gorraiz & Philip J. Purnell & Wolfgang Glänzel, 2013. "Opportunities for and limitations of the Book Citation Index," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1388-1398, July.
    3. Anton J. Nederhof, 2006. "Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 81-100, January.
    4. Isabella Peters & Peter Kraker & Elisabeth Lex & Christian Gumpenberger & Juan Gorraiz, 2016. "Research data explored: an extended analysis of citations and altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 723-744, May.
    5. Mu‐hsuan Huang & Yu‐wei Chang, 2008. "Characteristics of research output in social sciences and humanities: From a research evaluation perspective," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(11), pages 1819-1828, September.
    6. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    7. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    8. Juan Gorraiz & Christian Gumpenberger & Thomas Glade, 2016. "On the bibliometric coordinates of four different research fields in Geography," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 873-897, May.
    9. Kayvan Kousha & Mike Thelwall, 2016. "Can Amazon.com reviews help to assess the wider impacts of books?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 566-581, March.
    10. Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
    11. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    12. Torres-Salinas, Daniel & Rodríguez-Sánchez, Rosa & Robinson-García, Nicolás & Fdez-Valdivia, J. & García, J.A., 2013. "Mapping citation patterns of book chapters in the Book Citation Index," Journal of Informetrics, Elsevier, vol. 7(2), pages 412-424.
    13. Wolfgang Glänzel & Juan Gorraiz, 2015. "Usage metrics versus altmetrics: confusing terminology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2161-2164, March.
    14. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    15. Bornmann, Lutz, 2014. "Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics," Journal of Informetrics, Elsevier, vol. 8(4), pages 895-903.
    16. Torres-Salinas, Daniel & Moed, Henk F., 2009. "Library Catalog Analysis as a tool in studies of social sciences and humanities: An exploratory study of published book titles in Economics," Journal of Informetrics, Elsevier, vol. 3(1), pages 9-26.
    17. Alesia Zuccala & Roberto Cornacchia, 2016. "Data matching, integration, and interoperability for a metric assessment of monographs," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 465-484, July.
    18. A. J. M. Linmans, 2010. "Why with bibliometrics the Humanities does not need to be the weakest link," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 337-354, May.
    19. Chi, Pei-Shan, 2016. "Differing disciplinary citation concentration patterns of book and journal literature?," Journal of Informetrics, Elsevier, vol. 10(3), pages 814-829.
    20. Juan Gorraiz & Christian Gumpenberger & Philip J. Purnell, 2014. "The power of book reviews: a simple and transparent enhancement approach for book citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 841-852, February.
    21. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    22. Kayvan Kousha & Mike Thelwall, 2009. "Google book search: Citation analysis for social science and the humanities," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(8), pages 1537-1549, August.
    23. Rodrigo Costas & Zohreh Zahedi & Paul Wouters, 2015. "Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2003-2019, October.
    24. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    25. Juan Gorraiz & Christian Gumpenberger & Christian Schlögl, 2014. "Usage versus citation behaviours in four subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1077-1095, November.
    26. Juan Gorraiz & Philip J. Purnell & Wolfgang Glänzel, 2013. "Opportunities for and limitations of the Book Citation Index," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(7), pages 1388-1398, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yajie Wang & Alesia Zuccala, 2021. "Scholarly book publishers as publicity agents for SSH titles on Twitter," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4817-4840, June.
    2. Daniel Torres-Salinas & Wenceslao Arroyo-Machado & Mike Thelwall, 2021. "Exploring WorldCat identities as an altmetric information source: a library catalog analysis experiment in the field of Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1725-1743, February.
    3. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    4. Ashraf Maleki, 2022. "OCLC library holdings: assessing availability of academic books in libraries in print and electronic compared to citations and altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 991-1020, February.
    5. Xia Nan & Ming Li & Jin Shi, 2020. "Using altmetrics for assessing impact of highly-cited books in Chinese Book Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1651-1669, March.
    6. Zhou, Qingqing & Zhang, Chengzhi, 2021. "Impacts towards a comprehensive assessment of the book impact by integrating multiple evaluation sources," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Siluo Yang & Xin Xing & Fan Qi & Maria Cláudia Cabrini Grácio, 2021. "Comparison of academic book impact from a disciplinary perspective: an analysis of citations and altmetric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1101-1123, February.
    8. Michael Taylor, 2020. "An altmetric attention advantage for open access books in the humanities and social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2523-2543, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siluo Yang & Xin Xing & Fan Qi & Maria Cláudia Cabrini Grácio, 2021. "Comparison of academic book impact from a disciplinary perspective: an analysis of citations and altmetric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1101-1123, February.
    2. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    3. Kousha, Kayvan & Thelwall, Mike, 2018. "Can Microsoft Academic help to assess the citation impact of academic books?," Journal of Informetrics, Elsevier, vol. 12(3), pages 972-984.
    4. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    5. Alesia Zuccala & Roberto Cornacchia, 2016. "Data matching, integration, and interoperability for a metric assessment of monographs," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 465-484, July.
    6. Mohammadamin Erfanmanesh & A. Noorhidawati & A. Abrizah, 2019. "What can Bookmetrix tell us about the impact of Springer Nature’s books," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 521-536, October.
    7. Zhang, Chengzhi & Zhou, Qingqing, 2020. "Assessing books’ depth and breadth via multi-level mining on tables of contents," Journal of Informetrics, Elsevier, vol. 14(2).
    8. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    9. Ashraf Maleki, 2022. "Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1129-1160, February.
    10. Yongjun Zhu & Erjia Yan & Silvio Peroni & Chao Che, 2020. "Nine million book items and eleven million citations: a study of book-based scholarly communication using OpenCitations," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1097-1112, February.
    11. Torres-Salinas, Daniel & Rodríguez-Sánchez, Rosa & Robinson-García, Nicolás & Fdez-Valdivia, J. & García, J.A., 2013. "Mapping citation patterns of book chapters in the Book Citation Index," Journal of Informetrics, Elsevier, vol. 7(2), pages 412-424.
    12. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz, 2019. "Cross-national distance and international business: an analysis of the most influential recent models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 173-208, October.
    13. Andrea Bonaccorsi & Cinzia Daraio & Stefano Fantoni & Viola Folli & Marco Leonetti & Giancarlo Ruocco, 2017. "Do social sciences and humanities behave like life and hard sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 607-653, July.
    14. Frederik T. Verleysen & Truyken L. B. Ossenblok, 2017. "Profiles of monograph authors in the social sciences and humanities: an analysis of productivity, career stage, co-authorship, disciplinary affiliation and gender, based on a regional bibliographic da," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1673-1686, June.
    15. Thelwall, Mike & Sud, Pardeep, 2014. "No citation advantage for monograph-based collaborations?," Journal of Informetrics, Elsevier, vol. 8(1), pages 276-283.
    16. Qingqing Zhou & Chengzhi Zhang & Star X. Zhao & Bikun Chen, 2016. "Measuring book impact based on the multi-granularity online review mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1435-1455, June.
    17. Chi, Pei-Shan, 2016. "Differing disciplinary citation concentration patterns of book and journal literature?," Journal of Informetrics, Elsevier, vol. 10(3), pages 814-829.
    18. Qingqing Zhou & Chengzhi Zhang, 2020. "Evaluating wider impacts of books via fine-grained mining on citation literatures," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1923-1948, December.
    19. Ülle Must, 2012. "Alone or together: examples from history research," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 527-537, May.
    20. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:113:y:2017:i:3:d:10.1007_s11192-017-2539-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.