IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v73y2019icp176-186.html
   My bibliography  Save this article

Assessing research impact: Australian Research Council criteria and the case of Family Wellbeing research

Author

Listed:
  • Tsey, Komla
  • Onnis, Leigh-ann
  • Whiteside, Mary
  • McCalman, Janya
  • Williams, Megan
  • Heyeres, Marion
  • Lui, Siu Man (Carrie)
  • Klieve, Helen
  • Cadet-James, Yvonne
  • Baird, Leslie
  • Brown, Catherine
  • Watkin Lui, Felecia
  • Grainger, Daniel
  • Gabriel, Zona
  • Millgate, Nigel
  • Cheniart, Ben
  • Hunter, Tahalani
  • Liu, Hong-Bo
  • Yinghong, Yang
  • Yan, Li
  • Lovett, Ray
  • Chong, Alwin
  • Kinchin, Irina

Abstract

Researchers worldwide are increasingly reporting the societal impact of their research as part of national research productivity assessments. However, the challenges they encounter in developing their impact case studies against specified government assessment criteria and how pitfalls can be mitigated are not reported. This paper examines the key steps taken to develop an Aboriginal Family Wellbeing (FWB) empowerment research impact case study in the context of an Australian Research Council (ARC) pilot research impact assessment exercise and the challenges involved in applying the ARC criteria. The requirement that researchers demonstrate how their institutions support them to conduct impactful research has the potential to create supportive environments for researchers to be more responsive to the needs of users outside academia. However, the 15-year reference period for the associated research underpinning the reported impact and the focus on researcher’s current institutional affiliation constitute potential constraints to demonstrating the true impact of research. For researchers working with Indigenous people, relationships that build over long periods of time, irrespective of university affiliation, are critical to conducting impactful research. A more open-ended time-frame, with no institutional restrictions for the ‘associated research’ provides the best opportunity to demonstrate the true benefits of research not only for Indigenous people but for Australian society more broadly.

Suggested Citation

  • Tsey, Komla & Onnis, Leigh-ann & Whiteside, Mary & McCalman, Janya & Williams, Megan & Heyeres, Marion & Lui, Siu Man (Carrie) & Klieve, Helen & Cadet-James, Yvonne & Baird, Leslie & Brown, Catherine , 2019. "Assessing research impact: Australian Research Council criteria and the case of Family Wellbeing research," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 176-186.
    • Handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:176-186
    DOI: 10.1016/j.evalprogplan.2019.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718918302088
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlyn E Orians & Joanne Abed & Christina H Drew & Shyanika Wijesinha Rose & Jennifer H Cohen & Jerry Phelps, 2009. "Scientific and public health impacts of the NIEHS Extramural Asthma Research Program: insights from primary data," Research Evaluation, Oxford University Press, vol. 18(5), pages 375-385, December.
    2. Alene, Arega D. & Coulibaly, Ousmane, 2009. "The impact of agricultural research on productivity and poverty in sub-Saharan Africa," Food Policy, Elsevier, vol. 34(2), pages 198-209, April.
    3. Walker, Tom & Ryan, Jim & Kelley, Tim, 2010. "Impact Assessment of Policy-Oriented International Agricultural Research: Evidence and Insights from Case Studies," World Development, Elsevier, vol. 38(10), pages 1453-1461, October.
    4. Onnis, Leigh-ann & Klieve, Helen & Tsey, Komla, 2018. "The evidence needed to demonstrate impact: A synthesis of the evidence from a phased social and emotional wellbeing intervention," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 35-43.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Samal, Parshuram & Mondal, Biswajit & Jambhulkar, Nitiprasad Namdeorao & Verma, Ramlakhan & Das, Anup Kumar & Singh, Onkar Nath, 2023. "Evaluation of crop research institutes under data and resource constraints: An alternative approach," Evaluation and Program Planning, Elsevier, vol. 97(C).
    2. Grainger, Daniel & Watkin-Lui, Felecia & Cheer, Karen, 2021. "The value of informed agency for Torres Strait climate change," Ecological Economics, Elsevier, vol. 180(C).
    3. Rene Brauer & Mirek Dymitrow, 2020. "The Language of Sustainable Tourism as a Proxy Indicator of Quality," Sustainability, MDPI, vol. 13(1), pages 1-17, December.
    4. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heyeres, Marion & Tsey, Komla & Yang, Yinghong & Yan, Li & Jiang, Hua, 2019. "The characteristics and reporting quality of research impact case studies: A systematic review," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 10-23.
    2. Thanos Fragkandreas, 2022. "Three Decades of Research on Innovation and Inequality: Causal Scenarios, Explanatory Factors, and Suggestions," Working Papers 60, Birkbeck Centre for Innovation Management Research, revised Feb 2022.
    3. Smale, Melinda & Kergna, Alpha O. & Assima, Amidou & Weltzien, Eva & Rattunde, Fred, 2014. "An Overview and Economic Assessment of Sorghum Improvement in Mali," Food Security International Development Working Papers 198186, Michigan State University, Department of Agricultural, Food, and Resource Economics.
    4. Aftab Ahmad, 2020. "Poverty Terrorism Nexus: A Case Study Of Pakistan," Bulletin of Business and Economics (BBE), Research Foundation for Humanity (RFH), vol. 9(4), pages 162-172, December.
    5. Neema Ciza Angélique & Vwima Stany & Philippe Lebailly & Hossein Azadi, 2022. "Agricultural Development in the Fight against Poverty: The Case of South Kivu, DR Congo," Land, MDPI, vol. 11(4), pages 1-24, March.
    6. Maru, Yiheyis & Sparrow, Ashley & Stirzaker, Richard & Davies, Jocelyn, 2018. "Integrated agricultural research for development (IAR4D) from a theory of change perspective," Agricultural Systems, Elsevier, vol. 165(C), pages 310-320.
    7. Maxwell, T.W. & Songly, You & Ung, Boratana & Peou, Leakhna & Reid, Jenny, 2012. "The social and other impacts of a cattle/crop innovation in Cambodia," Agricultural Systems, Elsevier, vol. 107(C), pages 83-91.
    8. Embaye, Weldensie & Hendricks, Nathan & Lilja, Nina, 2017. "Sorghum research and poverty reduction in the presence of trade distortions in Ethiopia," African Journal of Agricultural and Resource Economics, African Association of Agricultural Economists, vol. 12(2), June.
    9. Lingran Yuan & Shurui Zhang & Shuo Wang & Zesen Qian & Binlei Gong, 2021. "World agricultural convergence," Journal of Productivity Analysis, Springer, vol. 55(2), pages 135-153, April.
    10. Yalew, Amsalu W. & Hirte, Georg & Lotze-Campen, Hermann & Tscharaktschiew, Stefan, 2017. "General equilibrium effects of public adaptation in agriculture in LDCs: Evidence from Ethiopia," CEPIE Working Papers 11/17, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    11. Johnson, M., 2014. "Exploring strategic priorities for regional agricultural research and development investments in Southern Africa," IWMI Working Papers H046297, International Water Management Institute.
    12. Zuzana Smeets Kristkova & Edward Smeets & Hans van Meijl, 2016. "Agricultural R&D investments, biofuel policy and food security – a CGE analysis," EcoMod2016 9966, EcoMod.
    13. Fuglie, Keith O. & Rada, Nicholas E., 2013. "Resources, Policies, and Agricultural Productivity in Sub-Saharan Africa," Economic Research Report 145368, United States Department of Agriculture, Economic Research Service.
    14. Christina H. Drew & Kristianna G. Pettibone & Fallis Owen Finch & Douglas Giles & Paul Jordan, 2016. "Automated Research Impact Assessment: a new bibliometrics approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 987-1005, March.
    15. Maurice Osewe & Aijun Liu & Tim Njagi, 2020. "Farmer-Led Irrigation and Its Impacts on Smallholder Farmers’ Crop Income: Evidence from Southern Tanzania," IJERPH, MDPI, vol. 17(5), pages 1-13, February.
    16. Msangi, Siwa, 2009. "Biofuels, Growth and Agricultural Development," 2009 Conference, August 16-22, 2009, Beijing, China 51723, International Association of Agricultural Economists.
    17. Rossi, Paula & Kagatsume, Masaru, 2010. "Economic Impact of Japan's Food and Agricultural FDI on Worldwide Recipient Countries," Conference papers 332018, Purdue University, Center for Global Trade Analysis, Global Trade Analysis Project.
    18. Alessandro Magrini & Fabio Bartolini & Alessandra Coli & Barbara Pacini, 2019. "A structural equation model to assess the impact of agricultural research expenditure on multiple dimensions," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2063-2080, July.
    19. Komla Tsey & Siu Man (Carrie) Lui & Marion Heyeres & Josephine Pryce & Li Yan & Sharee Bauld, 2018. "Developing Soft Skills: Exploring the Feasibility of an Australian Well-Being Program for Health Managers and Leaders in Timor-Leste," SAGE Open, , vol. 8(4), pages 21582440188, November.
    20. Onnis, Leigh-ann & Hakendorf, Marcia & Diamond, Mark & Tsey, Komla, 2019. "CQI approaches for evaluating management development programs: A case study with health service managers from geographically remote settings," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 91-101.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:176-186. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.