IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v10y2016i4p1166-1177.html
   My bibliography  Save this article

The impact of author-selected keywords on citation counts

Author

Listed:
  • Uddin, Shahadat
  • Khan, Arif

Abstract

A number of bibliometric studies have shown that many factors impact citation counts besides the scientific quality. This paper used a large bibliometric dataset to investigate the impact of the different statistical properties of author-selected keywords and the network attributes of their co-occurrence networks on citation counts. Four statistical properties of author-selected keywords were considered: (i) Keyword growth (i.e., the relative increase or decrease in the presence statistics of an underlying keyword over a given period of time); (ii) Keyword diversity (i.e., the level of variety in a set of author-selected keywords); (iii) Number of keywords; and (iv) Percentage of new keywords. This study also considered network centrality which is a network attribute from the keyword co-occurrence network. Network centrality was calculated using the average of three basic network centrality measures: degree, closeness and betweenness centrality. A correlation and regression analysis showed that all of these factors had a significant positive relation with citation counts except the percentage of new keywords that had a significant negative relation. However, when the effect of four potential control variables (i.e., the number of article authors, the length of an article, the quality of the journal in which the article was published and the length of the title of an article) were controlled, only four variables related to author-selected keywords showed a significant relation with citation counts. Keyword growth, number of keywords and network centrality showed a positive relation with citation counts; whereas, the percentage of new keywords showed a negative relation with citation counts. The implications of these findings are discussed in this article.

Suggested Citation

  • Uddin, Shahadat & Khan, Arif, 2016. "The impact of author-selected keywords on citation counts," Journal of Informetrics, Elsevier, vol. 10(4), pages 1166-1177.
    • Handle: RePEc:eee:infome:v:10:y:2016:i:4:p:1166-1177
    DOI: 10.1016/j.joi.2016.10.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157716301146
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2016.10.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. P. F. Peters & A. F. J. van Raan, 1994. "On determinants of citation scores: A case study in chemical engineering," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 39-49, January.
    2. Ali Gazni & Fereshteh Didegah, 2011. "Investigating different types of research collaboration and citation impact: a case study of Harvard University’s publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 251-265, May.
    3. Christoph Grimpe & Katrin Hussinger, 2013. "Formal and Informal Knowledge and Technology Transfer from Academia to Industry: Complementarity Effects and Innovation Performance," Industry and Innovation, Taylor & Francis Journals, vol. 20(8), pages 683-700, November.
    4. Ali Gazni & Cassidy R. Sugimoto & Fereshteh Didegah, 2012. "Mapping world scientific collaboration: Authors, institutions, and countries," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(2), pages 323-335, February.
    5. Tazio Vanni & Marco Mesa-Frias & Ruben Sanchez-Garcia & Rafael Roesler & Gilberto Schwartsmann & Marcelo Z Goldani & Anna M Foss, 2014. "International Scientific Collaboration in HIV and HPV: A Network Analysis," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-8, March.
    6. Ali Gazni & Cassidy R. Sugimoto & Fereshteh Didegah, 2012. "Mapping world scientific collaboration: Authors, institutions, and countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(2), pages 323-335, February.
    7. David L. Anderson & Warren Smart & John Tressler, 2013. "Evaluating research -- peer review team assessment and journal based bibliographic measures: New Zealand PBRF research output scores in 2006," New Zealand Economic Papers, Taylor & Francis Journals, vol. 47(2), pages 140-157, August.
    8. Nick Haslam & Lauren Ban & Leah Kaufmann & Stephen Loughnan & Kim Peters & Jennifer Whelan & Sam Wilson, 2008. "What makes an article influential? Predicting impact in social and personality psychology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(1), pages 169-185, July.
    9. Ronald N. Kostoff, 2007. "The difference between highly and poorly cited medical articles in the journal Lancet," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 513-520, September.
    10. Craig, Iain D. & Plume, Andrew M. & McVeigh, Marie E. & Pringle, James & Amin, Mayur, 2007. "Do open access articles have greater citation impact?," Journal of Informetrics, Elsevier, vol. 1(3), pages 239-248.
    11. Abbasi, Alireza & Altmann, Jörn & Hossain, Liaquat, 2011. "Identifying the effects of co-authorship networks on the performance of scholars: A correlation and regression analysis of performance measures and social network analysis measures," Journal of Informetrics, Elsevier, vol. 5(4), pages 594-607.
    12. Alireza Abbasi & Liaquat Hossain & Shahadat Uddin & Kim J. R. Rasmussen, 2011. "Evolutionary dynamics of scientific collaboration networks: multi-levels and cross-time analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 687-710, November.
    13. Letchford, Adrian & Preis, Tobias & Moat, Helen Susannah, 2016. "The advantage of simple paper abstracts," Journal of Informetrics, Elsevier, vol. 10(1), pages 1-8.
    14. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    15. O. Mryglod & R. Kenna & Yu. Holovatch & B. Berche, 2013. "Absolute and specific measures of research group excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 115-127, April.
    16. Fereshteh Didegah & Mike Thelwall, 2013. "Determinants of research citation impact in nanoscience and nanotechnology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(5), pages 1055-1064, May.
    17. Mike Thelwall & Kayvan Kousha, 2015. "ResearchGate: Disseminating, communicating, and measuring Scholarship?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(5), pages 876-889, May.
    18. Abbasi, Alireza & Jaafari, Ali, 2013. "Research impact and scholars’ geographical diversity," Journal of Informetrics, Elsevier, vol. 7(3), pages 683-692.
    19. Ryan D. Duffy & Alex Jadidian & Gregory D. Webster & Kyle J. Sandell, 2011. "The research productivity of academic psychologists: assessment, trends, and best practice recommendations," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 207-227, October.
    20. Buter, R.K. & van Raan, A.F.J., 2011. "Non-alphanumeric characters in titles of scientific publications: An analysis of their occurrence and correlation with citation impact," Journal of Informetrics, Elsevier, vol. 5(4), pages 608-617.
    21. O. Mryglod & R. Kenna & Yu. Holovatch & B. Berche, 2013. "Comparison of a citation-based indicator and peer review for absolute and specific measures of research-group excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 767-777, December.
    22. Radhamany Sooryamoorthy, 2009. "Do types of collaboration change citation? Collaboration and citation patterns of South African science publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 177-193, October.
    23. Fereshteh Didegah & Mike Thelwall, 2013. "Determinants of research citation impact in nanoscience and nanotechnology," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(5), pages 1055-1064, May.
    24. Shahadat Uddin & Liaquat Hossain & Alireza Abbasi & Kim Rasmussen, 2012. "Trend and efficiency analysis of co-authorship network," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 687-699, February.
    25. Nazim Choudhury & Shahadat Uddin, 2016. "Time-aware link prediction to explore network effects on temporal knowledge evolution," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 745-776, August.
    26. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    27. Bornmann, Lutz & Schier, Hermann & Marx, Werner & Daniel, Hans-Dieter, 2012. "What factors determine citation counts of publications in chemistry besides their quality?," Journal of Informetrics, Elsevier, vol. 6(1), pages 11-18.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tian-Yuan Huang & Liying Yang, 2022. "Superior identification index: Quantifying the capability of academic journals to recognize good research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4023-4043, July.
    2. Luo, Zhuoran & Lu, Wei & He, Jiangen & Wang, Yuqi, 2022. "Combination of research questions and methods: A new measurement of scientific novelty," Journal of Informetrics, Elsevier, vol. 16(2).
    3. Jungwon Yoon & Han Woo Park, 2020. "Pattern and trend of scientific knowledge production in North Korea by a semantic network analysis of papers in journal titled technological innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1421-1438, August.
    4. Behrouzi, Saman & Shafaeipour Sarmoor, Zahra & Hajsadeghi, Khosrow & Kavousi, Kaveh, 2020. "Predicting scientific research trends based on link prediction in keyword networks," Journal of Informetrics, Elsevier, vol. 14(4).
    5. Julián D. Cortés, 2023. "Top, mid-tier, and predatory alike? The lexical structure of titles and abstracts of six business and management journals," Management Review Quarterly, Springer, vol. 73(1), pages 297-316, February.
    6. Gao, Qiang & Liang, Zhentao & Wang, Ping & Hou, Jingrui & Chen, Xiuxiu & Liu, Manman, 2021. "Potential index: Revealing the future impact of research topics based on current knowledge networks," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Qianjin Zong & Yafen Xie & Jiechun Liang, 2020. "Does open peer review improve citation count? Evidence from a propensity score matching analysis of PeerJ," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 607-623, October.
    8. Chang-Tang Chiang & Tun-Chih Kou & Tian-Lih Koo, 2021. "A Systematic Literature Review of the IT-Based Supply Chain Management System: Towards a Sustainable Supply Chain Management Model," Sustainability, MDPI, vol. 13(5), pages 1-18, February.
    9. Andrea Fronzetti Colladon & Ciriaco Andrea D’Angelo & Peter A. Gloor, 2020. "Predicting the future success of scientific publications through social network and semantic analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 357-377, July.
    10. Chowdhury, K.P., 2021. "Functional analysis of generalized linear models under non-linear constraints with applications to identifying highly-cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    11. Yoo Ri Kim & Anyu Liu & Allan M Williams, 2022. "Competitiveness in the visitor economy: A systematic literature review," Tourism Economics, , vol. 28(3), pages 817-842, May.
    12. Matheus Becker Costa & Leonardo Moraes Aguiar Lima Santos & Jones Luís Schaefer & Ismael Cristofer Baierle & Elpidio Oscar Benitez Nara, 2019. "Industry 4.0 technologies basic network identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 977-994, November.
    13. Hu, Ya-Han & Tai, Chun-Tien & Liu, Kang Ernest & Cai, Cheng-Fang, 2020. "Identification of highly-cited papers using topic-model-based and bibliometric features: the consideration of keyword popularity," Journal of Informetrics, Elsevier, vol. 14(1).
    14. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    15. Yufeng Duan & Zequan Xiong, 2017. "Download patterns of journal papers and their influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1761-1775, September.
    16. Xinyuan Zhang & Qing Xie & Chaemin Song & Min Song, 2022. "Mining the evolutionary process of knowledge through multiple relationships between keywords," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2023-2053, April.
    17. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    18. Bornmann, Lutz & Tekles, Alexander & Zhang, Helena H. & Ye, Fred Y., 2019. "Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime data," Journal of Informetrics, Elsevier, vol. 13(4).
    19. Lu, Chao & Bu, Yi & Dong, Xianlei & Wang, Jie & Ding, Ying & Larivière, Vincent & Sugimoto, Cassidy R. & Paul, Logan & Zhang, Chengzhi, 2019. "Analyzing linguistic complexity and scientific impact," Journal of Informetrics, Elsevier, vol. 13(3), pages 817-829.
    20. Shahadat Uddin & Nazim Choudhury & Md Ekramul Hossain, 2019. "A research framework to explore knowledge evolution and scholarly quantification of collaborative research," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 789-803, May.
    21. Amon, Julian & Hornik, Kurt, 2022. "Is it all bafflegab? – Linguistic and meta characteristics of research articles in prestigious economics journals," Journal of Informetrics, Elsevier, vol. 16(2).
    22. Zhongyi Wang & Keying Wang & Jiyue Liu & Jing Huang & Haihua Chen, 2022. "Measuring the innovation of method knowledge elements in scientific literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2803-2827, May.
    23. Lu, Wei & Liu, Zhifeng & Huang, Yong & Bu, Yi & Li, Xin & Cheng, Qikai, 2020. "How do authors select keywords? A preliminary study of author keyword selection behavior," Journal of Informetrics, Elsevier, vol. 14(4).
    24. Gabriele Sampagnaro, 2023. "Keyword occurrences and journal specialization," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5629-5645, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    2. Marian-Gabriel Hâncean & Matjaž Perc & Jürgen Lerner, 2021. "The coauthorship networks of the most productive European researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 201-224, January.
    3. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    4. Thelwall, Mike & Wilson, Paul, 2014. "Regression for citation data: An evaluation of different methods," Journal of Informetrics, Elsevier, vol. 8(4), pages 963-971.
    5. Fan, Lingxu & Guo, Lei & Wang, Xinhua & Xu, Liancheng & Liu, Fangai, 2022. "Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 16(4).
    6. Elizabeth S. Vieira, 2023. "The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3555-3579, June.
    7. Ajiferuke, Isola & Famoye, Felix, 2015. "Modelling count response variables in informetric studies: Comparison among count, linear, and lognormal regression models," Journal of Informetrics, Elsevier, vol. 9(3), pages 499-513.
    8. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    9. Yue Wang & Ning Li & Bin Zhang & Qian Huang & Jian Wu & Yang Wang, 2023. "The effect of structural holes on producing novel and disruptive research in physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1801-1823, March.
    10. Basma Albanna & Julia Handl & Richard Heeks, 2021. "Publication outperformance among global South researchers: An analysis of individual-level and publication-level predictors of positive deviance," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8375-8431, October.
    11. Martorell Cunil, Onofre & Otero González, Luis & Durán Santomil, Pablo & Mulet Forteza, Carlos, 2023. "How to accomplish a highly cited paper in the tourism, leisure and hospitality field," Journal of Business Research, Elsevier, vol. 157(C).
    12. Tahamtan, Iman & Bornmann, Lutz, 2018. "Core elements in the process of citing publications: Conceptual overview of the literature," Journal of Informetrics, Elsevier, vol. 12(1), pages 203-216.
    13. Dehdarirad, Tahereh & Nasini, Stefano, 2017. "Research impact in co-authorship networks: a two-mode analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 371-388.
    14. María Bordons & Javier Aparicio & Rodrigo Costas, 2013. "Heterogeneity of collaboration and its relationship with research impact in a biomedical field," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 443-466, August.
    15. Thelwall, Mike & Sud, Pardeep, 2014. "No citation advantage for monograph-based collaborations?," Journal of Informetrics, Elsevier, vol. 8(1), pages 276-283.
    16. Zhang, Xinyuan & Xie, Qing & Song, Min, 2021. "Measuring the impact of novelty, bibliometric, and academic-network factors on citation count using a neural network," Journal of Informetrics, Elsevier, vol. 15(2).
    17. Stefano Mammola & Diego Fontaneto & Alejandro Martínez & Filipe Chichorro, 2021. "Impact of the reference list features on the number of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 785-799, January.
    18. Gao, Qiang & Liang, Zhentao & Wang, Ping & Hou, Jingrui & Chen, Xiuxiu & Liu, Manman, 2021. "Potential index: Revealing the future impact of research topics based on current knowledge networks," Journal of Informetrics, Elsevier, vol. 15(3).
    19. María Bordons & Borja González-Albo & Javier Aparicio & Luz Moreno, 2015. "The influence of R&D intensity of countries on the impact of international collaborative research: evidence from Spain," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1385-1400, February.
    20. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:10:y:2016:i:4:p:1166-1177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.