IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v121y2019i2d10.1007_s11192-019-03221-w.html
   My bibliography  Save this article

The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lies

Author

Listed:
  • Sergio Copiello

    (IUAV University of Venice)

Abstract

Do open access (OA) documents benefit from a citation premium in comparison to traditional subscription-based articles? The question has been debated during the last two decades, as OA is gaining momentum and becoming an ever more established option. Without coming to a shared position, the literature on the topic has essentially split into two clusters: on the one hand, the studies that endorse the occurrence of an OA citation advantage; on the other hand, the works suggesting that it has a negligible extent, or is due to other confounding factors. The primary aim of this study is not to bring new evidence in favor or against the citation premium supposedly characterizing OA articles. Instead, this work is meant to test a specific hypothesis connected with the OA citation advantage, namely, that OA papers may benefit from higher citations in open indexing databases (e.g., Google Scholar) rather than in selective indexing engines (i.e., Scopus and Web of Science). The empirical findings, although conflicting, show that the hypothesis above is not misplaced since a few confirmatory results are achieved. However, the hypothesized relationship remains controversial, also because of an uncertain boundary between OA and paywall articles.

Suggested Citation

  • Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
  • Handle: RePEc:spr:scient:v:121:y:2019:i:2:d:10.1007_s11192-019-03221-w
    DOI: 10.1007/s11192-019-03221-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-019-03221-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-019-03221-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henk F. Moed, 2007. "The effect of “open access” on citation impact: An analysis of ArXiv's condensed matter section," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2047-2054, November.
    2. Philip M. Davis & Michael J. Fromerth, 2007. "Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(2), pages 203-215, May.
    3. Christian Gumpenberger & María-Antonia Ovalle-Perandones & Juan Gorraiz, 2013. "On the impact of Gold Open Access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 221-238, July.
    4. Jeffrey Beall, 2012. "Predatory publishers are corrupting open access," Nature, Nature, vol. 489(7415), pages 179-179, September.
    5. Philip M. Davis, 2009. "Author‐choice open‐access publishing in the biological and medical literature: A citation analysis," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 3-8, January.
    6. Laakso, Mikael & Björk, Bo-Christer, 2016. "Hybrid open access—A longitudinal study," Journal of Informetrics, Elsevier, vol. 10(4), pages 919-932.
    7. Gunther Eysenbach, 2006. "Citation Advantage of Open Access Articles," Working Papers id:626, eSocialSciences.
    8. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    9. Anne-Wil Harzing & Satu Alakangas, 2016. "Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 787-804, February.
    10. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    11. Sandra Miguel & Zaida Chinchilla-Rodriguez & Félix de Moya-Anegón, 2011. "Open access and Scopus: A new approach to scientific visibility from the standpoint of access," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1130-1145, June.
    12. Doh-Shin Jeon & Jean-Charles Rochet, 2010. "The Pricing of Academic Journals: A Two-Sided Market Perspective," American Economic Journal: Microeconomics, American Economic Association, vol. 2(2), pages 222-255, May.
    13. Aurelia Magdalena Pisoschi & Claudia Gabriela Pisoschi, 2016. "Is open access the solution to increase the impact of scientific journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1075-1095, November.
    14. Joost C. F. Winter & Amir A. Zadpoor & Dimitra Dodou, 2014. "The expansion of Google Scholar versus Web of Science: a longitudinal study," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1547-1565, February.
    15. Isidro F. Aguillo, 2012. "Is Google Scholar useful for bibliometrics? A webometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 343-351, May.
    16. Craig, Iain D. & Plume, Andrew M. & McVeigh, Marie E. & Pringle, James & Amin, Mayur, 2007. "Do open access articles have greater citation impact?," Journal of Informetrics, Elsevier, vol. 1(3), pages 239-248.
    17. Steffen Bernius & Matthias Hanauske & Berndt Dugall & Wolfgang König, 2013. "Exploring the effects of a transition to open access: Insights from a simulation study," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(4), pages 701-726, April.
    18. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "Erratum to: The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1149-1149, June.
    19. Steffen Bernius & Matthias Hanauske & Wolfgang König & Berndt Dugall, 2009. "Open Access Models and their Implications for the Players on the Scientific Publishing Market," Economic Analysis and Policy, Elsevier, vol. 39(1), pages 103-115, March.
    20. Per O. Seglen, 1992. "The skewness of science," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(9), pages 628-638, October.
    21. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 555-564, May.
    22. Kayvan Kousha & Mike Thelwall, 2008. "Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 273-294, February.
    23. Yassine Gargouri & Chawki Hajjem & Vincent Larivière & Yves Gingras & Les Carr & Tim Brody & Stevan Harnad, 2010. "Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-12, October.
    24. Gaulé, Patrick & Maystre, Nicolas, 2011. "Getting cited: Does open access help?," Research Policy, Elsevier, vol. 40(10), pages 1332-1338.
      • Patrick Gaulé & Nicolas Maystre, 2008. "Getting cited: does open access help?," CEMI Working Papers cemi-workingpaper-2008-00, Ecole Polytechnique Fédérale de Lausanne, Collège du Management de la Technologie, Management of Technology and Entrepreneurship Institute, Chaire en Economie et Management de l'Innovation.
    25. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    26. Emilio Delgado López-Cózar & Nicolás Robinson-García & Daniel Torres-Salinas, 2014. "The Google scholar experiment: How to index false papers and manipulate bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(3), pages 446-454, March.
    27. Ronald Snijder, 2016. "Revisiting an open access monograph experiment: measuring citations and tweets 5 years later," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1855-1875, December.
    28. Steffen Bernius & Matthias Hanauske & Berndt Dugall & Wolfgang König, 2013. "Exploring the effects of a transition to open access: Insights from a simulation study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(4), pages 701-726, April.
    29. Jim Ottaviani, 2016. "The Post-Embargo Open Access Citation Advantage: It Exists (Probably), It’s Modest (Usually), and the Rich Get Richer (of Course)," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-11, August.
    30. Solomon, David J. & Laakso, Mikael & Björk, Bo-Christer, 2013. "A longitudinal comparison of citation rates and growth among open access journals," Journal of Informetrics, Elsevier, vol. 7(3), pages 642-650.
    31. Lokman I. Meho & Kiduk Yang, 2007. "Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2105-2125, November.
    32. Hajar Sotudeh & Zahra Ghasempour & Maryam Yaghtin, 2015. "The citation advantage of author-pays model: the case of Springer and Elsevier OA journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 581-608, August.
    33. Misha Teplitskiy & Grace Lu & Eamon Duede, 2017. "Amplifying the impact of open access: Wikipedia and the diffusion of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2116-2127, September.
    34. MARK J. McCABE & CHRISTOPHER M. SNYDER, 2014. "Identifying The Effect Of Open Access On Citations Using A Panel Of Science Journals," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1284-1300, October.
    35. McCabe Mark J & Snyder Christopher M., 2007. "Academic Journal Prices in a Digital Age: A Two-Sided Market Model," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 7(1), pages 1-39, January.
    36. K. Brad Wray, 2016. "No new evidence for a citation benefit for Author-Pay Open Access Publications in the social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1031-1035, March.
    37. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "The museum of errors/horrors in Scopus," Journal of Informetrics, Elsevier, vol. 10(1), pages 174-182.
    38. Kayvan Kousha & Mike Thelwall, 2007. "Google Scholar citations and Google Web/URL citations: A multi‐discipline exploratory analysis," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(7), pages 1055-1065, May.
    39. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    40. Michael Norris & Charles Oppenheim & Fytton Rowland, 2008. "The citation advantage of open‐access articles," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(12), pages 1963-1972, October.
    41. Valderrama-Zurián, Juan-Carlos & Aguilar-Moya, Remedios & Melero-Fuentes, David & Aleixandre-Benavent, Rafael, 2015. "A systematic analysis of duplicate records in Scopus," Journal of Informetrics, Elsevier, vol. 9(3), pages 570-576.
    42. Sandra Miguel & Zaida Chinchilla‐Rodriguez & Félix de Moya‐Anegón, 2011. "Open access and Scopus: A new approach to scientific visibility from the standpoint of access," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(6), pages 1130-1145, June.
    43. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "Empirical analysis and classification of database errors in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 10(4), pages 933-953.
    44. Hajar Sotudeh & Abbas Horri, 2007. "The citation performance of open access journals: A disciplinary investigation of citation distribution models," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2145-2156, November.
    45. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    46. Hamid R. Jamali & Majid Nabavi, 2015. "Open access and sources of full-text articles in Google Scholar in different subject fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1635-1651, December.
    47. Mark J. McCabe & Christopher M. Snyder, 2005. "Open Access and Academic Journal Quality," American Economic Review, American Economic Association, vol. 95(2), pages 453-459, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nuria Bautista-Puig & Carmen Lopez-Illescas & Felix Moya-Anegon & Vicente Guerrero-Bote & Henk F. Moed, 2020. "Do journals flipping to gold open access show an OA citation or publication advantage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2551-2575, September.
    2. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hajar Sotudeh & Zohreh Estakhr, 2018. "Sustainability of open access citation advantage: the case of Elsevier’s author-pays hybrid open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 563-576, April.
    2. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    3. Hajar Sotudeh & Zahra Ghasempour & Maryam Yaghtin, 2015. "The citation advantage of author-pays model: the case of Springer and Elsevier OA journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 581-608, August.
    4. Sara M. González-Betancor & Pablo Dorta-González, 2019. "Publication modalities ‘article in press’ and ‘open access’ in relation to journal average citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1209-1223, September.
    5. Eberhard Feess & Marc Scheufen, 2016. "Academic copyright in the publishing game: a contest perspective," European Journal of Law and Economics, Springer, vol. 42(2), pages 263-294, October.
    6. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    7. Antonio Perianes-Rodríguez & Carlos Olmeda-Gómez, 2019. "Effects of journal choice on the visibility of scientific publications: a comparison between subscription-based and full Open Access models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1737-1752, December.
    8. Moed, Henk F. & Bar-Ilan, Judit & Halevi, Gali, 2016. "A new methodology for comparing Google Scholar and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 533-551.
    9. Pablo Dorta-González & Sara M. González-Betancor & María Isabel Dorta-González, 2017. "Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009–2014," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 877-901, August.
    10. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2018. "Scientific potential of European fully open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1373-1394, March.
    11. Liwei Zhang & Liang Ma, 2023. "Is open science a double-edged sword?: data sharing and the changing citation pattern of Chinese economics articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2803-2818, May.
    12. Chompunuch Saravudecha & Duangruthai Na Thungfai & Chananthida Phasom & Sodsri Gunta-in & Aorrakanya Metha & Peangkobfah Punyaphet & Tippawan Sookruay & Wannachai Sakuludomkan & Nut Koonrungsesomboon, 2023. "Hybrid Gold Open Access Citation Advantage in Clinical Medicine: Analysis of Hybrid Journals in the Web of Science," Publications, MDPI, vol. 11(2), pages 1-9, March.
    13. Yimei Zhu, 2017. "Who support open access publishing? Gender, discipline, seniority and other factors associated with academics’ OA practice," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 557-579, May.
    14. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    15. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    16. Martin-Martin, Alberto & Orduna-Malea, Enrique & Harzing, Anne-Wil & Delgado López-Cózar, Emilio, 2017. "Can we use Google Scholar to identify highly-cited documents?," Journal of Informetrics, Elsevier, vol. 11(1), pages 152-163.
    17. MARK J. McCABE & CHRISTOPHER M. SNYDER, 2014. "Identifying The Effect Of Open Access On Citations Using A Panel Of Science Journals," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1284-1300, October.
    18. Mark J. McCabe & Christopher M. Snyder, 2021. "Cite unseen: Theory and evidence on the effect of open access on cites to academic articles across the quality spectrum," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 1960-1979, December.
    19. Hamid R. Jamali & Majid Nabavi, 2015. "Open access and sources of full-text articles in Google Scholar in different subject fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1635-1651, December.
    20. Isabel Basson & Jaco P. Blanckenberg & Heidi Prozesky, 2021. "Do open access journal articles experience a citation advantage? Results and methodological reflections of an application of multiple measures to an analysis by WoS subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 459-484, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:121:y:2019:i:2:d:10.1007_s11192-019-03221-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.