IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i10p4299-d362438.html
   My bibliography  Save this article

Alternative Metrics for Assessing the Social Impact of Tourism Research

Author

Listed:
  • Alba Viana Lora

    (Department of Geography, Rovira i Virgili University, 43480 Vila-seca, Spain)

  • Marta Gemma Nel-lo Andreu

    (Department of Geography, Rovira i Virgili University, 43480 Vila-seca, Spain)

Abstract

Alternative metrics are increasingly used to measure the social impact of research. This article seeks to analyze the social impact of research in the field of tourism. For this purpose, we will determine the extent to which the articles in this field reach society by examining the scores they achieve on social media and studying the correlation between scientific impact and social impact. Altmetric information will be used for data extraction and analysis. The results show a low correlation between citations and the Altmetric Attention Score (AAS), as well as a presence that is not captured by most publications in the field of study. Interestingly, publications with higher AASs are concentrated in the same journals. The article concludes by determining that alternative metrics can be used to complement academic impact but cannot be a substitute for it. Further progress is needed in the development of a framework that unifies both impacts.

Suggested Citation

  • Alba Viana Lora & Marta Gemma Nel-lo Andreu, 2020. "Alternative Metrics for Assessing the Social Impact of Tourism Research," Sustainability, MDPI, vol. 12(10), pages 1-12, May.
    • Handle: RePEc:gam:jsusta:v:12:y:2020:i:10:p:4299-:d:362438
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/10/4299/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/12/10/4299/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luca Tricarico & Andrea Galimberti & Ausilia Campanaro & Chiara Magoni & Massimo Labra, 2020. "Experimenting with RRI tools to Drive Sustainable Agri-Food Research: The SASS Case Study from Sub-Saharan Africa," Sustainability, MDPI, vol. 12(3), pages 1-19, January.
    2. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    3. Stefan de Jong & Katharine Barker & Deborah Cox & Thordis Sveinsdottir & Peter Van den Besselaar, 2014. "Understanding societal impact through productive interactions: ICT research as a case," Research Evaluation, Oxford University Press, vol. 23(2), pages 89-102.
    4. Terhi Esko & Reijo Miettinen, 2019. "Scholarly understanding, mediating artefacts and the social impact of research in the educational sciences," Research Evaluation, Oxford University Press, vol. 28(4), pages 295-303.
    5. Rau, Henrike & Goggins, Gary & Fahy, Frances, 2018. "From invisibility to impact: Recognising the scientific and societal relevance of interdisciplinary sustainability research," Research Policy, Elsevier, vol. 47(1), pages 266-276.
    6. Michael Cuthill, 2010. "Strengthening the ‘social’ in sustainable development: Developing a conceptual framework for social sustainability in a rapid urban growth region in Australia," Sustainable Development, John Wiley & Sons, Ltd., vol. 18(6), pages 362-373, November/.
    7. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    8. Reetta Muhonen & Paul Benneworth & Julia Olmos-Peñuela, 2020. "From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact," Research Evaluation, Oxford University Press, vol. 29(1), pages 34-47.
    9. J Britt Holbrook & Robert Frodeman, 2011. "Peer review and the ex ante assessment of societal impacts," Research Evaluation, Oxford University Press, vol. 20(3), pages 239-246, September.
    10. Beatriz Barros & Ana Fernández-Zubieta & Raul Fidalgo-Merino & Francisco Triguero, 2018. "Scientific knowledge percolation process and social impact: A case study on the biotechnology and microbiology perceptions on Twitter," Science and Public Policy, Oxford University Press, vol. 45(6), pages 804-814.
    11. Emanuela Reale & Dragana Avramov & Kubra Canhial & Claire Donovan & Ramon Flecha & Poul Holm & Charles Larkin & Benedetto Lepori & Judith Mosoni-Fried & Esther Oliver & Emilia Primeri & Lidia Puigvert, 2018. "A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research," Research Evaluation, Oxford University Press, vol. 27(4), pages 298-308.
    12. Xiaozan Lyu & Rodrigo Costas, 2020. "How do academic topics shift across altmetric sources? A case study of the research area of Big Data," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 909-943, May.
    13. Giacomo Manetti & Marco Bellucci, 2016. "The use of social media for engaging stakeholders in sustainability reporting," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 29(6), pages 985-1011, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. So Young Lee & José M. Díaz-Puente & Pablo Vidueira, 2020. "Enhancing Rural Innovation and Sustainability Through Impact Assessment: A Review of Methods and Tools," Sustainability, MDPI, vol. 12(16), pages 1-26, August.
    2. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    2. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    3. Juha-Pekka Lauronen, 2022. "The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals," Research Evaluation, Oxford University Press, vol. 31(2), pages 214-225.
    4. Marra, Mita, 2022. "Productive interactions in digital training partnerships: Lessons learned for regional development and university societal impact assessment," Evaluation and Program Planning, Elsevier, vol. 95(C).
    5. Jorrit P Smit & Laurens K Hessels, 2021. "The production of scientific and societal value in research evaluation: a review of societal impact assessment methods [Systems Thinking, Knowledge and Action: Towards Better Models and Methods]," Research Evaluation, Oxford University Press, vol. 30(3), pages 323-335.
    6. Juha-Pekka Lauronen, 2022. "Tension in Interpretations of the Social Impact of the Social Sciences: Walking a Tightrope Between Divergent Conceptualizations of Research Utilization," SAGE Open, , vol. 12(2), pages 21582440221, April.
    7. Helka Kalliomäki & Sampo Ruoppila & Jenni Airaksinen, 2021. "It takes two to tango: Examining productive interactions in urban research collaboration [Generating Research Questions through Problematization]," Research Evaluation, Oxford University Press, vol. 30(4), pages 529-539.
    8. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    9. Alessandro Margherita & Gianluca Elia & Claudio Petti, 2022. "What Is Quality in Research? Building a Framework of Design, Process and Impact Attributes and Evaluation Perspectives," Sustainability, MDPI, vol. 14(5), pages 1-18, March.
    10. Hans Jonker & Florian Vanlee & Walter Ysebaert, 2022. "Societal impact of university research in the written press: media attention in the context of SIUR and the open science agenda among social scientists in Flanders, Belgium," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7289-7306, December.
    11. Zhang, Lin & Sivertsen, Gunnar & Du, Huiying & HUANG, Ying & Glänzel, Wolfgang, 2021. "Gender differences in the aims and impacts of research," SocArXiv 9n347, Center for Open Science.
    12. Kroll, Henning & Hansmeier, Hendrik & Hufnagl, Miriam, 2022. "Productive interactions in basic research an enquiry into impact pathways at the DESY synchrotron," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    13. Jonathan P. Doh & Lorraine Eden & Anne S. Tsui & Srilata Zaheer, 2023. "Developing international business scholarship for global societal impact," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 54(5), pages 757-767, July.
    14. Stefan P L de Jong & Corina Balaban & Maria Nedeva, 2022. "From ‘productive interactions’ to ‘enabling conditions’: The role of organizations in generating societal impact of academic research [One Size Does Not Fit All! New Perspectives on the University ," Science and Public Policy, Oxford University Press, vol. 49(4), pages 643-645.
    15. Jianhua Hou & Xiucai Yang & Yang Zhang, 2023. "The effect of social media knowledge cascade: an analysis of scientific papers diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5169-5195, September.
    16. Pablo D’Este & Irene Ramos-Vielba & Richard Woolley & Nabil Amara, 2018. "How do researchers generate scientific and societal impacts? Toward an analytical and operational framework," Science and Public Policy, Oxford University Press, vol. 45(6), pages 752-763.
    17. Matt, M. & Colinet, L. & Gaunand, A. & Joly, P.B., 2015. "A typology of impact pathways generated by a public agricultural research organization," Working Papers 2015-03, Grenoble Applied Economics Laboratory (GAEL).
    18. Marco Gatti, 2018. "The Impact of Management Accounting Research: An Analysis of the Past and a Look at the Future," International Journal of Business and Management, Canadian Center of Science and Education, vol. 13(5), pages 1-47, March.
    19. Ole Henning Sørensen & Jakob Bjørner & Andreas Holtermann & Johnny Dyreborg & Jorid Birkelund Sørli & Jesper Kristiansen & Steffen Bohni Nielsen, 2022. "Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety," Research Evaluation, Oxford University Press, vol. 31(1), pages 118-131.
    20. Blanca L. Díaz Mariño & Frida Carmina Caballero-Rico & Ramón Ventura Roque Hernández & José Alberto Ramírez de León & Daniel Alejandro González-Bandala, 2021. "Towards the Construction of Productive Interactions for Social Impact," Sustainability, MDPI, vol. 13(2), pages 1-20, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:10:p:4299-:d:362438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.