IDEAS home Printed from https://ideas.repec.org/a/bla/jinfst/v71y2020i10p1257-1274.html
   My bibliography  Save this article

The citation advantage of promoted articles in a cross‐publisher distribution platform: A 12‐month randomized controlled trial

Author

Listed:
  • Paul Kudlow
  • Devin Bissky Dziadyk
  • Alan Rutledge
  • Aviv Shachak
  • Gunther Eysenbach

Abstract

There is currently a paucity of evidence‐based strategies that have been shown to increase citations of peer‐reviewed articles following their publication. We conducted a 12‐month randomized controlled trial to examine whether the promotion of article links in an online cross‐publisher distribution platform (TrendMD) affects citations. In all, 3,200 articles published in 64 peer‐reviewed journals across eight subject areas were block randomized at the subject level to either the TrendMD group (n = 1,600) or the control group (n = 1,600) of the study. Our primary outcome compares the mean citations of articles randomized to TrendMD versus control after 12 months. Articles randomized to TrendMD showed a 50% increase in mean citations relative to control at 12 months. The difference in mean citations at 12 months for articles randomized to TrendMD versus control was 5.06, 95% confidence interval [2.87, 7.25], was statistically significant (p

Suggested Citation

  • Paul Kudlow & Devin Bissky Dziadyk & Alan Rutledge & Aviv Shachak & Gunther Eysenbach, 2020. "The citation advantage of promoted articles in a cross‐publisher distribution platform: A 12‐month randomized controlled trial," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(10), pages 1257-1274, October.
    • Handle: RePEc:bla:jinfst:v:71:y:2020:i:10:p:1257-1274
    DOI: 10.1002/asi.24330
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/asi.24330
    Download Restriction: no
    File URL: https://libkey.io/10.1002/asi.24330?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jim Ottaviani, 2016. "The Post-Embargo Open Access Citation Advantage: It Exists (Probably), It’s Modest (Usually), and the Rich Get Richer (of Course)," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-11, August.
    2. Kuku Joseph Aduku & Mike Thelwall & Kayvan Kousha, 2017. "Do Mendeley reader counts reflect the scholarly impact of conference papers? An investigation of computer science and engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 573-581, July.
    3. Mike Thelwall & Paul Wilson, 2016. "Mendeley readership altmetrics for medical articles: An analysis of 45 fields," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(8), pages 1962-1972, August.
    4. Thelwall, Mike & Nevill, Tamara, 2018. "Could scientists use Altmetric.com scores to predict longer term citation counts?," Journal of Informetrics, Elsevier, vol. 12(1), pages 237-248.
    5. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    6. Saeideh Ebrahimy & Jafar Mehrad & Fatemeh Setareh & Massoud Hosseinchari, 2016. "Path analysis of the relationship between visibility and citation: the mediating roles of save, discussion, and recommendation metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1497-1510, December.
    7. Mike Thelwall, 2017. "Are Mendeley reader counts useful impact indicators in all fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1721-1731, December.
    8. Yuri Niyazov & Carl Vogel & Richard Price & Ben Lund & David Judd & Adnan Akil & Michael Mortonson & Josh Schwartzman & Max Shron, 2016. "Open Access Meets Discoverability: Citations to Articles Posted to Academia.edu," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-23, February.
    9. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "Erratum to: The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1149-1149, June.
    10. Carol Tenopir & Lisa Christian & Jordan Kaufman, 2019. "Seeking, Reading, and Use of Scholarly Articles: An International Study of Perceptions and Behavior of Researchers," Publications, MDPI, vol. 7(1), pages 1-23, March.
    11. Mike Thelwall, 2018. "Early Mendeley readers correlate with later citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1231-1240, June.
    12. Mike Thelwall & Pardeep Sud, 2016. "Mendeley readership counts: An investigation of temporal and disciplinary differences," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(12), pages 3036-3050, December.
    13. Susanne Mikki, 2017. "Scholarly publications beyond pay-walls: increased citation advantage for open publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1529-1538, December.
    14. Mikael Laakso & Bo-Christer Björk, 2013. "Delayed open access: An overlooked high-impact category of openly available scientific literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1323-1329, July.
    15. Mojisola Erdt & Htet Htet Aung & Ashley Sara Aw & Charlie Rapple & Yin-Leng Theng, 2017. "Analysing researchers’ outreach efforts and the association with publication metrics: A case study of Kudos," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-25, August.
    16. MARK J. McCABE & CHRISTOPHER M. SNYDER, 2014. "Identifying The Effect Of Open Access On Citations Using A Panel Of Science Journals," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1284-1300, October.
    17. Gunther Eysenbach, 2006. "Citation Advantage of Open Access Articles," Working Papers id:626, eSocialSciences.
    18. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 555-564, May.
    19. Paul Kudlow & Matthew Cockerill & Danielle Toccalino & Devin Bissky Dziadyk & Alan Rutledge & Aviv Shachak & Roger S. McIntyre & Arun Ravindran & Gunther Eysenbach, 2017. "Online distribution channel increases article usage on Mendeley: a randomized controlled trial," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1537-1556, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    2. Liwei Zhang & Liang Ma, 2024. "Different open access routes, varying societal impacts: evidence from the Royal Society biological journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3407-3431, June.
    3. Mike Thelwall, 2018. "Early Mendeley readers correlate with later citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1231-1240, June.
    4. S. Ravikumar & Bidyut Bikash Boruah & M. N. Ravikumar, 2022. "Correlation study between citation count and Mendeley readership of the articles of Sri Lankan authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4873-4885, August.
    5. Mingyang Wang & Jiaqi Zhang & Guangsheng Chen & Kah-Hin Chai, 2019. "Examining the influence of open access on journals’ citation obsolescence by modeling the actual citation process," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1621-1641, June.
    6. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    7. Hajar Sotudeh & Zohreh Estakhr, 2018. "Sustainability of open access citation advantage: the case of Elsevier’s author-pays hybrid open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 563-576, April.
    8. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    9. Guangyao Zhang & Yuqi Wang & Weixi Xie & Han Du & Chunlin Jiang & Xianwen Wang, 2021. "The open access usage advantage: a temporal and spatial analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6187-6199, July.
    10. Chompunuch Saravudecha & Duangruthai Na Thungfai & Chananthida Phasom & Sodsri Gunta-in & Aorrakanya Metha & Peangkobfah Punyaphet & Tippawan Sookruay & Wannachai Sakuludomkan & Nut Koonrungsesomboon, 2023. "Hybrid Gold Open Access Citation Advantage in Clinical Medicine: Analysis of Hybrid Journals in the Web of Science," Publications, MDPI, vol. 11(2), pages 1-9, March.
    11. Mousumi Karmakar & Sumit Kumar Banshal & Vivek Kumar Singh, 2020. "Does presence of social media plugins in a journal website result in higher social media attention of its research publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2103-2143, September.
    12. Banshal, Sumit Kumar & Gupta, Solanki & Lathabai, Hiran H & Singh, Vivek Kumar, 2022. "Power Laws in altmetrics: An empirical analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    13. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    14. Sara M. González-Betancor & Pablo Dorta-González, 2019. "Publication modalities ‘article in press’ and ‘open access’ in relation to journal average citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1209-1223, September.
    15. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    16. Mike Thelwall, 2020. "Data in Brief: Can a mega-journal for data be useful?," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 697-709, July.
    17. Raghu Raman & Nava Subramaniam & Vinith Kumar Nair & Avinash Shivdas & Krishnashree Achuthan & Prema Nedungadi, 2022. "Women Entrepreneurship and Sustainable Development: Bibliometric Analysis and Emerging Research Trends," Sustainability, MDPI, vol. 14(15), pages 1-31, July.
    18. Qianjin Zong & Yafen Xie & Rongchan Tuo & Jingshi Huang & Yang Yang, 2019. "The impact of video abstract on citation counts: evidence from a retrospective cohort study of New Journal of Physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1715-1727, June.
    19. Wen-Yau Cathy Lin, 2021. "Effects of open access and articles-in-press mechanisms on publishing lag and first-citation speed: a case on energy and fuels journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4841-4869, June.
    20. Mojisola Erdt & Htet Htet Aung & Ashley Sara Aw & Charlie Rapple & Yin-Leng Theng, 2017. "Analysing researchers’ outreach efforts and the association with publication metrics: A case study of Kudos," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-25, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jinfst:v:71:y:2020:i:10:p:1257-1274. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.