IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v110y2017i1d10.1007_s11192-016-2158-0.html
   My bibliography  Save this article

To include or not: the role of review papers in citation-based analysis

Author

Listed:
  • Mei Hsiu-Ching Ho

    (National Taiwan University of Science and Technology)

  • John S. Liu

    (National Taiwan University of Science and Technology)

  • Kerr C.-T. Chang

    (Ingrasys Technology Inc.)

Abstract

Citation information helps researchers observe the evolution of the knowledge. In scientific publications, a review paper discusses a professional field and thus tends to have more citations than general papers do. This study investigated whether specific characteristics of review papers induce different results in citation-based analysis. From the Scopus database, we collected scientific publications in a specific research field, e-tourism, to examine the role of review papers in citation-based analysis. The dataset includes 1421 publications covering the period from the 1988–2015. Empirical statistics show that review papers’ specific citation patterns influence citation analysis. First, in the main path analysis, the result expresses review papers’ integrative role in linking papers from diverse perspectives toward a clear mainstream topic. Second, in a well-defined research context, review papers introduce bias in citation-based clustering analysis because the specific high citation pattern in review papers obfuscates the grouping process. When using citation information in analysis, scholars must consider the purpose of the study and treat review papers distinctly to avoid bias when using certain analysis methods and datasets.

Suggested Citation

  • Mei Hsiu-Ching Ho & John S. Liu & Kerr C.-T. Chang, 2017. "To include or not: the role of review papers in citation-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 65-76, January.
    • Handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2158-0
    DOI: 10.1007/s11192-016-2158-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2158-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2158-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Christian Lachance & Steve Poirier & Vincent Larivière, 2014. "The kiss of death? The effect of being cited in a review on subsequent citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(7), pages 1501-1505, July.
    2. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    3. Barrios, Maite & Guilera, Georgina & Gómez-Benito, Juana, 2013. "Impact and structural features of meta-analytical studies, standard articles and reviews in psychology: Similarities and differences," Journal of Informetrics, Elsevier, vol. 7(2), pages 478-486.
    4. John S. Liu & Louis Y.Y. Lu, 2012. "An integrated approach for main path analysis: Development of the Hirsch index as an example," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(3), pages 528-542, March.
    5. Sharif, Naubahar, 2006. "Emergence and development of the National Innovation Systems concept," Research Policy, Elsevier, vol. 35(5), pages 745-766, June.
    6. Karki, M. M. S., 1997. "Patent citation analysis: A policy analysis tool," World Patent Information, Elsevier, vol. 19(4), pages 269-272, December.
    7. Luc Anselin & Attila Varga & Zoltan Acs, 2008. "Geographical Spillovers and University Research: A Spatial Econometric Perspective," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 10, pages 122-134, Edward Elgar Publishing.
    8. Uma G. Gupta, 1997. "Using Citation Analysis to Explore the Intellectual Base, Knowledge Dissemination, and Research Impact of Interfaces (1970–1992)," Interfaces, INFORMS, vol. 27(2), pages 85-101, April.
    9. Robert Colebunders & Chris Kenyon & Ronald Rousseau, 2014. "Increase in numbers and proportions of review articles in Tropical Medicine, Infectious Diseases, and oncology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(1), pages 201-205, January.
    10. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "Data envelopment analysis 1978–2010: A citation-based literature survey," Omega, Elsevier, vol. 41(1), pages 3-15.
    11. John S. Liu & Louis Y.Y. Lu, 2012. "An integrated approach for main path analysis: Development of the Hirsch index as an example," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(3), pages 528-542, March.
    12. Bart Verspagen, 2000. "The Role of Large Multinationals in the Dutch Technology Infrastructure. A Patent Citation Analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 427-448, February.
    13. M. Meyer & D. Libaers & B. Thijs & K. Grant & W. Glänzel & K. Debackere, 2014. "Origin and emergence of entrepreneurship as a research field," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 473-485, January.
    14. Bart Verspagen, 2007. "Mapping Technological Trajectories As Patent Citation Networks: A Study On The History Of Fuel Cell Research," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 10(01), pages 93-115.
    15. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    16. Bhupatiraju, Samyukta & Nomaler, Önder & Triulzi, Giorgio & Verspagen, Bart, 2012. "Knowledge flows – Analyzing the core literature of innovation, entrepreneurship and science and technology studies," Research Policy, Elsevier, vol. 41(7), pages 1205-1218.
    17. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    18. Manuel Trajtenberg & Adam B. Jaffe & Michael S. Fogarty, 2000. "Knowledge Spillovers and Patent Citations: Evidence from a Survey of Inventors," American Economic Review, American Economic Association, vol. 90(2), pages 215-218, May.
    19. Maurseth, Per Botolf & Verspagen, Bart, 2002. " Knowledge Spillovers in Europe: A Patent Citations Analysis," Scandinavian Journal of Economics, Wiley Blackwell, vol. 104(4), pages 531-545, December.
    20. John S. Liu & Chung-Huei Kuan, 2016. "A new approach for main path analysis: Decay in knowledge diffusion," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 465-476, February.
    21. Joe Zhu (ed.), 2016. "Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-1-4899-7684-0, September.
    22. Per Botolf Maurseth & Bart Verspagen, 2002. "Knowledge Spillovers in Europe: A Patent Citations Analysis," Scandinavian Journal of Economics, Wiley Blackwell, vol. 104(4), pages 531-545, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petr Praus, 2023. "Empirical relationship between the number of review and research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2201-2209, April.
    2. Paulo Henrique Santos Gonçalves & Thiago Gonçalves-Souza & Ulysses Paulino Albuquerque, 2020. "Chronic anthropogenic disturbances in ecology: a bibliometric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1103-1117, May.
    3. Saeed Samiee & Brian R. Chabowski, 2021. "Knowledge structure in product- and brand origin–related research," Journal of the Academy of Marketing Science, Springer, vol. 49(5), pages 947-968, September.
    4. Martin Eling & Omid Ghavibazoo, 2019. "Research on long-term care insurance: status quo and directions for future research," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 44(2), pages 303-356, April.
    5. John S. Liu & Louis Y. Y. Lu & Mei Hsiu-Ching Ho, 2019. "A few notes on main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 379-391, April.
    6. Clemens Blümel & Alexander Schniedermann, 2020. "Studying review articles in scientometrics and beyond: a research agenda," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 711-728, July.
    7. Dejian Yu & Libo Sheng, 2020. "Knowledge diffusion paths of blockchain domain: the main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 471-497, October.
    8. Hansin Bilgili & Jonathan L. Johnson & Tsvetomira V. Bilgili & Alan E. Ellstrand, 2022. "Research on social relationships and processes governing the behaviors of members of the corporate elite: a review and bibliometric analysis," Review of Managerial Science, Springer, vol. 16(8), pages 2285-2339, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lu, Louis Y.Y. & Liu, John S., 2016. "A novel approach to identify the major research themes and development trajectory: The case of patenting research," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 71-82.
    2. Mei Hsiu-Ching Ho & Vincent H. Lin & John S. Liu, 2014. "Exploring knowledge diffusion among nations: a study of core technologies in fuel cells," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 149-171, July.
    3. Chen, Kaihua & Zhang, Yi & Fu, Xiaolan, 2019. "International research collaboration: An emerging domain of innovation studies?," Research Policy, Elsevier, vol. 48(1), pages 149-168.
    4. Nomaler, Onder & Verspagen, Bart, 2016. "River deep, mountain high: Of long-run knowledge trajectories within and between innovation clusters," MERIT Working Papers 2016-048, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    5. John S. Liu & Louis Y. Y. Lu & Mei Hsiu-Ching Ho, 2019. "A few notes on main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 379-391, April.
    6. Shuo Xu & Liyuan Hao & Xin An & Hongshen Pang & Ting Li, 2020. "Review on emerging research topics with key-route main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 607-624, January.
    7. Ying Huang & Donghua Zhu & Yue Qian & Yi Zhang & Alan L. Porter & Yuqin Liu & Ying Guo, 2017. "A hybrid method to trace technology evolution pathways: a case study of 3D printing," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 185-204, April.
    8. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    9. Yu, Dejian & Sheng, Libo, 2021. "Influence difference main path analysis: Evidence from DNA and blockchain domain citation networks," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Yu-tao Sun & Feng-chao Liu, 2013. "Measuring international trade-related technology spillover: a composite approach of network analysis and information theory," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 963-979, March.
    11. Chen, Liang & Xu, Shuo & Zhu, Lijun & Zhang, Jing & Xu, Haiyun & Yang, Guancan, 2022. "A semantic main path analysis method to identify multiple developmental trajectories," Journal of Informetrics, Elsevier, vol. 16(2).
    12. Ross Gittell & Jeffrey Sohl & Edinaldo Tebaldi, 2014. "Do Entrepreneurship and High-Tech Concentration Create Jobs? Exploring the Growth in Employment in U.S. Metropolitan Areas From 1991 to 2007," Economic Development Quarterly, , vol. 28(3), pages 244-253, August.
    13. Chun-Hua Hsiao & Kai-Yu Tang & John S. Liu, 2015. "Citation-based analysis of literature: a case study of technology acceptance research," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1091-1110, November.
    14. Kuan, Chung-Huei & Chen, Dar-Zen & Huang, Mu-Hsuan, 2020. "The overlooked citations: Investigating the impact of ignoring citations to published patent applications," Journal of Informetrics, Elsevier, vol. 14(1).
    15. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2018. "Missing links: Timing characteristics and their implications for capturing contemporaneous technological developments," Journal of Informetrics, Elsevier, vol. 12(1), pages 259-270.
    16. Franco Malerba & Maria Mancusi & Fabio Montobbio, 2013. "Innovation, international R&D spillovers and the sectoral heterogeneity of knowledge flows," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 149(4), pages 697-722, December.
    17. Nivedita Mukherji & Jonathan Silberman, 2021. "Knowledge flows between universities and industry: the impact of distance, technological compatibility, and the ability to diffuse knowledge," The Journal of Technology Transfer, Springer, vol. 46(1), pages 223-257, February.
    18. Menger Tu & Sandy Dall'erba & Mingque Ye, 2022. "Spatial and Temporal Evolution of the Chinese Artificial Intelligence Innovation Network," Sustainability, MDPI, vol. 14(9), pages 1-17, April.
    19. Conti, C. & Mancusi, M.L. & Sanna-Randaccio, F. & Sestini, R. & Verdolini, E., 2018. "Transition towards a green economy in Europe: Innovation and knowledge integration in the renewable energy sector," Research Policy, Elsevier, vol. 47(10), pages 1996-2009.
    20. Lööf, Hans & Perez, Luis & Baum, Christopher F, 2018. "Directed Technical Change in Clean Energy: Evidence from the Solar Industry," Working Paper Series in Economics and Institutions of Innovation 470, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2158-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.