IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v85y2010i2d10.1007_s11192-010-0270-0.html
   My bibliography  Save this article

Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management

Author

Listed:
  • John Mingers

    () (University of Kent)

  • Evangelia A. E. C. G. Lipitakis

    () (University of Kent)

Abstract

Assessing the quality of the knowledge produced by business and management academics is increasingly being metricated. Moreover, emphasis is being placed on the impact of the research rather than simply where it is published. The main metric for impact is the number of citations a paper receives. Traditionally this data has come from the ISI Web of Science but research has shown that this has poor coverage in the social sciences. A newer and different source for citations is Google Scholar. In this paper we compare the two on a dataset of over 4,600 publications from three UK Business Schools. The results show that Web of Science is indeed poor in the area of management and that Google Scholar, whilst somewhat unreliable, has a much better coverage. The conclusion is that Web of Science should not be used for measuring research impact in management.

Suggested Citation

  • John Mingers & Evangelia A. E. C. G. Lipitakis, 2010. "Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 613-625, November.
  • Handle: RePEc:spr:scient:v:85:y:2010:i:2:d:10.1007_s11192-010-0270-0
    DOI: 10.1007/s11192-010-0270-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-010-0270-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mingers, John & Xu, Fang, 2010. "The drivers of citations in management science journals," European Journal of Operational Research, Elsevier, vol. 205(2), pages 422-430, September.
    2. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nabil Amara & Réjean Landry, 2012. "Counting citations in the field of business and management: why use Google Scholar rather than the Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 553-581, December.
    2. McCannon, Bryan C., 2019. "Readability and research impact," Economics Letters, Elsevier, vol. 180(C), pages 76-79.
    3. Günter Krampen & Peter Weiland & Jürgen Wiesenhütter, 2015. "Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 827-840, September.
    4. Pablo D’Este & Puay Tang & Surya Mahdi & Andy Neely & Mabel Sánchez-Barrioluengo, 2013. "The pursuit of academic excellence and business engagement: is it irreconcilable?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 481-502, May.
    5. Amara, Nabil & Olmos-Peñuela, Julia & Fernández-de-Lucio, Ignacio, 2019. "Overcoming the “lost before translation” problem: An exploratory study," Research Policy, Elsevier, vol. 48(1), pages 22-36.
    6. Anne-Wil Harzing, 2013. "A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1057-1075, March.
    7. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    8. Richard S. J. Tol, 2012. "Shapley values for assessing research production and impact of schools and scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 763-780, March.
    9. Halevi, Gali & Moed, Henk & Bar-Ilan, Judit, 2017. "Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the Literature," Journal of Informetrics, Elsevier, vol. 11(3), pages 823-834.
    10. Nabil Amara & Réjean Landry & Norrin Halilem, 2015. "What can university administrators do to increase the publication and citation scores of their faculty members?," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 489-530, May.
    11. Joost C. F. Winter & Amir A. Zadpoor & Dimitra Dodou, 2014. "The expansion of Google Scholar versus Web of Science: a longitudinal study," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1547-1565, February.
    12. Alba Santa Soriano & Carolina Lorenzo Álvarez & Rosa María Torres Valdés, 2018. "Bibliometric analysis to identify an emerging research area: Public Relations Intelligence—a challenge to strengthen technological observatories in the network society," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1591-1614, June.
    13. Fargher, Neil & Wee, Marvin, 2019. "The impact of Ball and Brown (1968) on generations of research," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 55-72.
    14. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    15. David Michayluk & Ralf Zurbruegg, 2014. "Do lead articles signal higher quality in the digital age? Evidence from finance journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 961-973, February.
    16. John Mingers & Jesse R. O’Hanley & Musbaudeen Okunola, 2017. "Using Google Scholar institutional level data to evaluate the quality of university research," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1627-1643, December.
    17. Keshra Sangwal, 2013. "Some citation-related characteristics of scientific journals published in individual countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 719-741, December.
    18. Guillermo Armando Ronda-Pupo & Luis Ángel Guerras-Martín, 2016. "Collaboration network of knowledge creation and dissemination on Management research: ranking the leading institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 917-939, June.
    19. Saïd Echchakoui, 2020. "Why and how to merge Scopus and Web of Science during bibliometric analysis: the case of sales force literature from 1912 to 2019," Journal of Marketing Analytics, Palgrave Macmillan, vol. 8(3), pages 165-184, September.
    20. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    21. Saïd Echchakoui, 0. "Why and how to merge Scopus and Web of Science during bibliometric analysis: the case of sales force literature from 1912 to 2019," Journal of Marketing Analytics, Palgrave Macmillan, vol. 0, pages 1-20.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lakshmi Balachandran Nair & Michael Gibbert, 2016. "What makes a ‘good’ title and (how) does it matter for citations? A review and general model of article title attributes in management science," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1331-1359, June.
    2. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    3. Lutz Bornmann & Félix de Moya Anegón & Loet Leydesdorff, 2010. "Do Scientific Advancements Lean on the Shoulders of Giants? A Bibliometric Investigation of the Ortega Hypothesis," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-6, October.
    4. Dowling, Grahame R., 2014. "Playing the citations game: From publish or perish to be cited or sidelined," Australasian marketing journal, Elsevier, vol. 22(4), pages 280-287.
    5. Juan Xie & Kaile Gong & Jiang Li & Qing Ke & Hyonchol Kang & Ying Cheng, 2019. "A probe into 66 factors which are possibly associated with the number of citations an article received," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1429-1454, June.
    6. Hamid R. Jamali & Majid Nabavi, 2015. "Open access and sources of full-text articles in Google Scholar in different subject fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1635-1651, December.
    7. Abdelghani Maddi & Vincent Larivière & Yves Gingras, 2018. "Comportements de collaboration homme-femme et visibilité scientifique en économie et en gestion," CEPN Working Papers hal-01922263, HAL.
    8. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    9. Mike Thelwall, 2017. "Judit Bar-Ilan: information scientist, computer scientist, scientometrician," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1235-1244, December.
    10. J.R. Clark & Joshua C. Hall & Ashley S. Harrison, 2017. "The Relative Value of AER P&P Economic Education Papers," Working Papers 17-23, Department of Economics, West Virginia University.
    11. Metcalf, Mark & Stocks, Kevin & Summers, Scott L. & Wood, David A., 2015. "Citation-based accounting education publication rankings," Journal of Accounting Education, Elsevier, vol. 33(4), pages 294-308.
    12. Nikolaos A. Kazakis, 2014. "Bibliometric evaluation of the research performance of the Greek civil engineering departments in National and European context," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 505-525, October.
    13. Bareerah Hafeez Hoorani & Lakshmi Balachandran Nair & Michael Gibbert, 2019. "Designing for impact: the effect of rigor and case study design on citations of qualitative case studies in management," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 285-306, October.
    14. Meyer, Matthias & Waldkirch, Rüdiger W. & Duscher, Irina & Just, Alexander, 2018. "Drivers of citations: An analysis of publications in “top” accounting journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 24-46.
    15. Massimo Franceschet, 2010. "A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 243-258, April.
    16. Halevi, Gali & Moed, Henk & Bar-Ilan, Judit, 2017. "Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the Literature," Journal of Informetrics, Elsevier, vol. 11(3), pages 823-834.
    17. Vicente Safón & Domingo Docampo, 2020. "Analyzing the impact of reputational bias on global university rankings based on objective research performance data: the case of the Shanghai Ranking (ARWU)," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2199-2227, December.
    18. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    19. Elizabeth S. Vieira & José A. N. F. Gomes, 2009. "A comparison of Scopus and Web of Science for a typical university," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 587-600, November.
    20. João Mateus Freitas Veneroso & Marlon Dias & Alberto Ueda & Sabir Ribas & Berthier Ribeiro-Neto & Nivio Ziviani & Edmundo Souza e Silva, 2019. "P-score: a reputation bibliographic index that complements citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1269-1291, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:85:y:2010:i:2:d:10.1007_s11192-010-0270-0. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Springer Nature Abstracting and Indexing). General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.