IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0279723.html
   My bibliography  Save this article

Analyzing referencing patterns in grey literature produced by influential global management consulting firms and international organizations

Author

Listed:
  • Sumayya Saleem
  • Elizabeth Dhuey
  • Linda White
  • Jamie Waese
  • Michal Perlman

Abstract

Given the growing influence of non-academic organizations in the policy sphere, it is important to investigate the evidence both produced by and relied on by these organizations. Using citation analysis, a methodology primarily used in academic literature, we investigated the evidence base supporting the grey literature published by leading global management consulting firms (GMCFs) and international organizations (IOs). With the topic of the skills needed for the future of work as a case study, we collected 234 reports published by influential GMCFs and IOs over twenty years. By extracting references from the bibliographies of these reports we: 1) analyzed referencing patterns by measuring citation counts, institutional self-referencing and utilization of scholarly sources; 2) compared reference patterns across GMCFs and IOs; and 3) described the most influential sources. Overall, both GMCFs and IOs showed increasing reliance on grey literature, demonstrated high levels of self-referencing, and had considerable variation in the number of sources referred to. Across type of publishing organization, we found that IOs had better referencing practices than GMCFs. Our findings call into question the evidence-base behind the reports published by these policy actors. We emphasize the need to rely on strong academic literature to inform policy decisions around the future of work.

Suggested Citation

  • Sumayya Saleem & Elizabeth Dhuey & Linda White & Jamie Waese & Michal Perlman, 2023. "Analyzing referencing patterns in grey literature produced by influential global management consulting firms and international organizations," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-20, February.
  • Handle: RePEc:plo:pone00:0279723
    DOI: 10.1371/journal.pone.0279723
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0279723
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0279723&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0279723?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dean Hendrix, 2009. "Institutional self-citation rates: A three year study of universities in the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 321-331, November.
    2. Steven M. Shugan, 2004. "Editorial: Consulting, Research, and Consulting Research," Marketing Science, INFORMS, vol. 23(2), pages 173-179.
    3. Guillermo Gallacher & Iqbal Hossain, 2020. "Remote Work and Employment Dynamics under COVID-19: Evidence from Canada," Canadian Public Policy, University of Toronto Press, vol. 46(S1), pages 44-54, July.
    4. Kam C. Chan & Kartono Liano, 2009. "Threshold citation analysis of influential articles, journals, institutions and researchers in accounting," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 49(1), pages 59-74, March.
    5. Robin Haunschild & Lutz Bornmann, 2022. "Reference publication year spectroscopy (RPYS) in practice: a software tutorial," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7253-7271, December.
    6. Stefano Mammola & Diego Fontaneto & Alejandro Martínez & Filipe Chichorro, 2021. "Impact of the reference list features on the number of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 785-799, January.
    7. Staša Milojević, 2012. "How Are Academic Age, Productivity and Collaboration Related to Citing Behavior of Researchers?," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-13, November.
    8. Erjia Yan & Ying Ding & Cassidy R. Sugimoto, 2011. "P-Rank: An indicator measuring prestige in heterogeneous scholarly networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(3), pages 467-477, March.
    9. Erjia Yan & Ying Ding & Cassidy R. Sugimoto, 2011. "P‐Rank: An indicator measuring prestige in heterogeneous scholarly networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(3), pages 467-477, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    2. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    3. Amodio, Pierluigi & Brugnano, Luigi & Scarselli, Filippo, 2021. "Implementation of the PaperRank and AuthorRank indices in the Scopus database," Journal of Informetrics, Elsevier, vol. 15(4).
    4. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    5. Geraldo J. Pessoa Junior & Thiago M. R. Dias & Thiago H. P. Silva & Alberto H. F. Laender, 2020. "On interdisciplinary collaborations in scientific coauthorship networks: the case of the Brazilian community," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2341-2360, September.
    6. Tehmina Amjad & Ying Ding & Ali Daud & Jian Xu & Vincent Malic, 2015. "Topic-based heterogeneous rank," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 313-334, July.
    7. Fang Zhang & Shengli Wu, 2021. "Measuring academic entities’ impact by content-based citation analysis in a heterogeneous academic network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 7197-7222, August.
    8. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2020. "Knowledge fusion through academic articles: a survey of definitions, techniques, applications and challenges," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2637-2666, December.
    9. Cao, Huiying & Gao, Chao & Wang, Zhen, 2023. "Ranking academic institutions by means of institution–publication networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 629(C).
    10. Wang, Ruby W. & Wei, Shelia X. & Ye, Fred Y., 2021. "Extracting a core structure from heterogeneous information network using h-subnet and meta-path strength," Journal of Informetrics, Elsevier, vol. 15(3).
    11. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    12. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    13. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    14. Yongjun Zhu & Erjia Yan, 2015. "Dynamic subfield analysis of disciplines: an examination of the trading impact and knowledge diffusion patterns of computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 335-359, July.
    15. Ignacio Rodríguez-Rodríguez & José-Víctor Rodríguez & Niloofar Shirvanizadeh & Andrés Ortiz & Domingo-Javier Pardo-Quiles, 2021. "Applications of Artificial Intelligence, Machine Learning, Big Data and the Internet of Things to the COVID-19 Pandemic: A Scientometric Review Using Text Mining," IJERPH, MDPI, vol. 18(16), pages 1-29, August.
    16. Peter Sjögårde & Fereshteh Didegah, 2022. "The association between topic growth and citation impact of research publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1903-1921, April.
    17. Hani Al-Dmour & Rima Al Hasan & Motasem Thneibat & Ra’ed Masa’deh & Wafa Alkhadra & Rand Al-Dmour & Ali Alalwan, 2023. "Integrated Model for the Factors Determining the Academic’s Remote Working Productivity and Engagement: Empirical Study," SAGE Open, , vol. 13(3), pages 21582440231, August.
    18. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.
    19. Wu, Lingfei & Kittur, Aniket & Youn, Hyejin & Milojević, Staša & Leahey, Erin & Fiore, Stephen M. & Ahn, Yong-Yeol, 2022. "Metrics and mechanisms: Measuring the unmeasurable in the science of science," Journal of Informetrics, Elsevier, vol. 16(2).
    20. Alejandra Bellatin & Gabriela Galassi, 2022. "What COVID-19 May Leave Behind: Technology-Related Job Postings in Canada," Staff Working Papers 22-17, Bank of Canada.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0279723. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.