IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0302877.html
   My bibliography  Save this article

Impact through research in education and studies in human society: A review of Australian Research Council ‘high-for-impact’ case studies

Author

Listed:
  • Grace Jefferson
  • Rosita Henry
  • Marion Heyeres
  • Rhian Morgan
  • Louisa Tomas
  • Komla Tsey
  • Ines Zuchowski

Abstract

Research impact is an important measure of the effective transmission and ongoing contribution of research beyond the scope of initial research publication outputs; however, determining what constitutes ‘high-for-impact’ research can be difficult for specific fields of study. This review of the Australian Research Council’s Engagement and Impact Assessment 2018 analyses high-for-impact case studies submitted in the fields of Education (n = 17) and Studies in Human Society (n = 11) with the aim of understanding and explicating how high impact research has been evidenced in these fields. The review was guided by three research questions that concern the identification of the key characteristics of high-for-impact case studies, their reported impacts, and the evidence researchers cite to support claims of impact. The review highlights an important limitation in how impact is defined and understood by researchers, particularly cultural and social impact. Half of the analysed case studies involved international engagement, with minimal partner collaboration in the global south and countries in the Indo-Pacific, despite the region’s strategic geo-political importance for Australia. Our findings draw into question the distribution of funding to universities and where investment might best be made for the highest potential return on research impact. Another key finding is that reported impacts across the domains of economy, society, culture, national security, public service, health, environment and quality of life offer little satisfactory evidence of impact, despite affording valuable insights into the nature of impact claimed. Accordingly, we conclude that to enhance the value of research and demonstrate impact in Education and Social Sciences, improved impact literacy is required among researchers. We assert that a better understanding of what constitutes impact and how it can be evidenced will support more impactful research designs. Wider adoption of the holistic anthropological definition of culture, which integrates values, practices and products, would enhance impact case studies by expanding their focus to include the broader cultural changes that underpin sustained social change. While the ARC engagement and impact agenda is a step in the right direction, improving the value of research for society will require a radical reconceptualisation of research and its funding, well beyond the current assessment framework. The Lowitja Institute’s research-for-impact framework [1] is proposed as an alternative approach to research priority-setting based on explicit evidence gap analysis.

Suggested Citation

  • Grace Jefferson & Rosita Henry & Marion Heyeres & Rhian Morgan & Louisa Tomas & Komla Tsey & Ines Zuchowski, 2024. "Impact through research in education and studies in human society: A review of Australian Research Council ‘high-for-impact’ case studies," PLOS ONE, Public Library of Science, vol. 19(5), pages 1-23, May.
  • Handle: RePEc:plo:pone00:0302877
    DOI: 10.1371/journal.pone.0302877
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0302877
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0302877&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0302877?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gonzalez-Brambila, Claudia N. & Veloso, Francisco M. & Krackhardt, David, 2013. "The impact of network embeddedness on research output," Research Policy, Elsevier, vol. 42(9), pages 1555-1567.
    2. Tsey, Komla & Onnis, Leigh-ann & Whiteside, Mary & McCalman, Janya & Williams, Megan & Heyeres, Marion & Lui, Siu Man (Carrie) & Klieve, Helen & Cadet-James, Yvonne & Baird, Leslie & Brown, Catherine , 2019. "Assessing research impact: Australian Research Council criteria and the case of Family Wellbeing research," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 176-186.
    3. He, Zi-Lin & Geng, Xue-Song & Campbell-Hunt, Colin, 2009. "Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university," Research Policy, Elsevier, vol. 38(2), pages 306-317, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guan, JianCheng & Zuo, KaiRui & Chen, KaiHua & Yam, Richard C.M., 2016. "Does country-level R&D efficiency benefit from the collaboration network structure?," Research Policy, Elsevier, vol. 45(4), pages 770-784.
    2. Tu, Jing, 2024. "Openness to international collaboration and tie strength in enhancing knowledge creation," Journal of Informetrics, Elsevier, vol. 18(1).
    3. Stefano Scarazzati & Lili Wang, 2019. "The effect of collaborations on scientific research output: the case of nanoscience in Chinese regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 839-868, November.
    4. Claudia N. Gonzalez Brambila & Renata Herrerias, 2024. "Assessing the impact of collaborative authorship in Business Economics in Latin America," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4623-4660, July.
    5. Chen, Kaihua & Zhang, Yi & Zhu, Guilong & Mu, Rongping, 2020. "Do research institutes benefit from their network positions in research collaboration networks with industries or/and universities?," Technovation, Elsevier, vol. 94.
    6. Yun Liu & Mengya Zhang & Gupeng Zhang & Xiongxiong You, 2022. "Scientific elites versus other scientists: who are better at taking advantage of the research collaboration network?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3145-3166, June.
    7. Lu, Wei & Ren, Yan & Huang, Yong & Bu, Yi & Zhang, Yuehan, 2021. "Scientific collaboration and career stages: An ego-centric perspective," Journal of Informetrics, Elsevier, vol. 15(4).
    8. Duk Hee Lee & Il Won Seo & Ho Chull Choe & Hee Dae Kim, 2012. "Collaboration network patterns and research performance: the case of Korean public research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 925-942, June.
    9. Mario Fernandes & Andreas Walter, 2023. "The times they are a-changin’: profiling newly tenured business economics professors in Germany over the past thirty years," Journal of Business Economics, Springer, vol. 93(5), pages 929-971, July.
    10. Carillo, Maria Rosaria & Papagni, Erasmo & Sapio, Alessandro, 2013. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 47(C), pages 25-36.
    11. Wang Guizhou & Zhang Si & Yu Tao & Ning Yu, 2021. "A Systematic Overview of Blockchain Research," Journal of Systems Science and Information, De Gruyter, vol. 9(3), pages 205-238, June.
    12. Andrej Kastrin & Jelena Klisara & Borut Lužar & Janez Povh, 2017. "Analysis of Slovenian research community through bibliographic networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 791-813, February.
    13. Zuo, Zhiya & Zhao, Kang, 2018. "The more multidisciplinary the better? – The prevalence and interdisciplinarity of research collaborations in multidisciplinary institutions," Journal of Informetrics, Elsevier, vol. 12(3), pages 736-756.
    14. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2011. "The relationship between scientists’ research performance and the degree of internationalization of their research," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 629-643, March.
    15. Ricardo S. Santos & Jose Soares & Pedro Carmona Marques & Helena V. G. Navas & José Moleiro Martins, 2021. "Integrating Business, Social, and Environmental Goals in Open Innovation through Partner Selection," Sustainability, MDPI, vol. 13(22), pages 1-25, November.
    16. Alison M. J. Buchan & Eva Jurczyk & Ruth Isserlin & Gary D. Bader, 2016. "Global neuroscience and mental health research: a bibliometrics case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 515-531, October.
    17. Yunpeng Sun & Ruoya Jia & Asif Razzaq & Qun Bao, 2023. "RETRACTED ARTICLE: Drivers of China’s geographical renewable energy development: evidence from spatial association network structure approaches," Economic Change and Restructuring, Springer, vol. 56(6), pages 4115-4163, December.
    18. Verónica Amarante & Marisa Bucheli & Mariana Rodriguez, 2024. "Research Networks and Publications in Economics: Evidence from a Small Developing Country," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 5571-5598, June.
    19. Barry Bozeman & Monica Gaughan & Jan Youtie & Catherine P. Slade & Heather Rimes, 2016. "Research collaboration experiences, good and bad: Dispatches from the front lines," Science and Public Policy, Oxford University Press, vol. 43(2), pages 226-244.
    20. Na Liu & Jiancheng Guan, 2015. "Dynamic evolution of collaborative networks: evidence from nano-energy research in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 1895-1919, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0302877. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.