IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i16p6559-d398554.html
   My bibliography  Save this article

Enhancing Rural Innovation and Sustainability Through Impact Assessment: A Review of Methods and Tools

Author

Listed:
  • So Young Lee

    (Universidad Politécnica de Madrid, E.T.S.I. Agronómica, Alimentaria y de Biosistemas, Avda, Puerta de Hierro, 2 - 28040 Madrid, Spain)

  • José M. Díaz-Puente

    (Universidad Politécnica de Madrid, E.T.S.I. Agronómica, Alimentaria y de Biosistemas, Avda, Puerta de Hierro, 2 - 28040 Madrid, Spain)

  • Pablo Vidueira

    (Universidad Politécnica de Madrid, E.T.S.I. Agronómica, Alimentaria y de Biosistemas, Avda, Puerta de Hierro, 2 - 28040 Madrid, Spain)

Abstract

Assessing impacts in innovation contexts/settings with the aim of fostering sustainability requires tackling complex issues. Literature shows that key sources of this complexity relate to the need to integrate the local context; identify the underlying problems; engage key stakeholders; and reflect on their feedback throughout the innovation process. A systematic literature review on innovation impact assessment reveals that social impacts have been the most studied, thus, where promising methods and tools were used. Nevertheless, there are many unresolved issues beyond assessing social impacts in innovation processes. Literature highlights that building on co-creating innovation processes that respond to stakeholders’ real needs and context, and adapting to changing circumstances by integrating timely feedback from stakeholders are two critical challenges calling for a systems thinking approach. This study proposes Developmental Evaluation (DE) as a systemic approach to evaluation which supports adaptive development in complex environments and that adds value by integrating continuous feedback from diverse stakeholders. As a non-prescriptive evaluation approach in terms of methods and tools, DE can provide meaningful guidance to use diverse methods and tools in furthering ongoing development and adaptation in innovation processes by linking the evaluation activities—impact assessment among them—with the DE principles that are situational, adaptive and continuously responsive.

Suggested Citation

  • So Young Lee & José M. Díaz-Puente & Pablo Vidueira, 2020. "Enhancing Rural Innovation and Sustainability Through Impact Assessment: A Review of Methods and Tools," Sustainability, MDPI, vol. 12(16), pages 1-26, August.
  • Handle: RePEc:gam:jsusta:v:12:y:2020:i:16:p:6559-:d:398554
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/16/6559/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/12/16/6559/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tsogtbaatar Byambaa & Craig Janes & Tim Takaro & Kitty Corbett, 2015. "Putting Health Impact Assessment into practice through the lenses of diffusion of innovations theory: a review," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 17(1), pages 23-40, February.
    2. Frank Vanclay, 2015. "The Potential Application of Qualitative Evaluation Methods in European Regional Development: Reflections on the Use of Performance Story Reporting in Australian Natural Resource Management," Regional Studies, Taylor & Francis Journals, vol. 49(8), pages 1326-1339, August.
    3. Sylvain Quiedeville & Dominique Barjolle & Jean-Claude Mouret & Matthias Stolze, 2017. "Ex-Post Evaluation of the Impacts of the Science-Based Research and Innovation Program: A New Method Applied in the Case of Farmers’ Transition to Organic Production in the Camargue," Journal of Innovation Economics, De Boeck Université, vol. 0(1), pages 145-170.
    4. Ottar Michelsen & Francesco Cherubini & Anders Hammer Strømman, 2012. "Impact Assessment of Biodiversity and Carbon Pools from Land Use and Land Use Changes in Life Cycle Assessment, Exemplified with Forestry Operations in Norway," Journal of Industrial Ecology, Yale University, vol. 16(2), pages 231-242, April.
    5. Maredia, Mywish K. & Shankar, Bhavani & Kelley, Timothy G. & Stevenson, James R., 2014. "Impact assessment of agricultural research, institutional innovation, and technology adoption: Introduction to the special section," Food Policy, Elsevier, vol. 44(C), pages 214-217.
    6. Dax, Thomas & Oedl-Wieser, Theresia, 2016. "Rural innovation activities as a means for changing development perspectives – An assessment of more than two decades of promoting LEADER initiatives across the European Union," Studies in Agricultural Economics, Research Institute for Agricultural Economics, vol. 118(1), pages 1-8, April.
    7. Horton, Douglas & Mackay, Ronald, 2003. "Using evaluation to enhance institutional learning and change: recent experiences with agricultural research and development," Agricultural Systems, Elsevier, vol. 78(2), pages 127-142, November.
    8. Alba Viana Lora & Marta Gemma Nel-lo Andreu, 2020. "Alternative Metrics for Assessing the Social Impact of Tourism Research," Sustainability, MDPI, vol. 12(10), pages 1-12, May.
    9. Cong, Rong-Gang & Stefaniak, Irena & Madsen, Bjarne & Dalgaard, Tommy & Jensen, Jørgen Dejgård & Nainggolan, Doan & Termansen, Mette, 2017. "Where to implement local biotech innovations? A framework for multi-scale socio-economic and environmental impact assessment of Green Bio-Refineries," Land Use Policy, Elsevier, vol. 68(C), pages 141-151.
    10. Jing Wang & Stephanie D. Maier & Rafael Horn & Robert Holländer & Ralf Aschemann, 2018. "Development of an Ex-Ante Sustainability Assessment Methodology for Municipal Solid Waste Management Innovations," Sustainability, MDPI, vol. 10(9), pages 1-29, September.
    11. Georg M. Eichler & Erich J. Schwarz, 2019. "What Sustainable Development Goals Do Social Innovations Address? A Systematic Review and Content Analysis of Social Innovation Literature," Sustainability, MDPI, vol. 11(2), pages 1-18, January.
    12. Hall, Andrew & Rasheed Sulaiman, V. & Clark, Norman & Yoganand, B., 2003. "From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research," Agricultural Systems, Elsevier, vol. 78(2), pages 213-241, November.
    13. Karla Utting, 2009. "Assessing the Impact of Fair Trade Coffee: Towards an Integrative Framework," Journal of Business Ethics, Springer, vol. 86(1), pages 127-149, April.
    14. Artur da Rosa Pires & Martina Pertoldi & John Edwards & Fatime Barbara Hegyi, 2014. "Smart Specialisation and Innovation in Rural Areas," JRC Research Reports JRC90000, Joint Research Centre.
    15. Andrea Karin Barrueto & Juerg Merz & Thomas Kohler & Thomas Hammer, 2018. "What Prompts Agricultural Innovation in Rural Nepal: A Study Using the Example of Macadamia and Walnut Trees as Novel Cash Crops," Agriculture, MDPI, vol. 8(2), pages 1-16, February.
    16. Mackay, Ronald & Horton, Douglas, 2003. "Expanding the use of impact assessment and evaluation in agricultural research and development," Agricultural Systems, Elsevier, vol. 78(2), pages 143-165, November.
    17. Douthwaite, Boru & Kuby, Thomas & van de Fliert, Elske & Schulz, Steffen, 2003. "Impact pathway evaluation: an approach for achieving and attributing impact in complex systems," Agricultural Systems, Elsevier, vol. 78(2), pages 243-265, November.
    18. Olivier Crevoisier, 2004. "The Innovative Milieus Approach: Toward a Territorialized Understanding of the Economy?," Economic Geography, Taylor & Francis Journals, vol. 80(4), pages 367-379, October.
    19. Turner, James A. & Klerkx, Laurens & White, Toni & Nelson, Tracy & Everett-Hincks, Julie & Mackay, Alec & Botha, Neels, 2017. "Unpacking systemic innovation capacity as strategic ambidexterity: How projects dynamically configure capabilities for agricultural innovation," Land Use Policy, Elsevier, vol. 68(C), pages 503-523.
    20. Kristina Henzler & Stephanie D. Maier & Michael Jäger & Rafael Horn, 2020. "SDG-Based Sustainability Assessment Methodology for Innovations in the Field of Urban Surfaces," Sustainability, MDPI, vol. 12(11), pages 1-32, June.
    21. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elena Feo & Hannes Mareen & Sylvia Burssens & Pieter Spanoghe, 2021. "The Relevance of Videos as a Practical Tool for Communication and Dissemination in Horizon2020 Thematic Networks," Sustainability, MDPI, vol. 13(23), pages 1-19, November.
    2. Elena Feo & Sylvia Burssens & Hannes Mareen & Pieter Spanoghe, 2022. "Shedding Light into the Need of Knowledge Sharing in H2020 Thematic Networks for the Agriculture and Forestry Innovation," Sustainability, MDPI, vol. 14(7), pages 1-15, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thornton, PK & Schuetz, T & Förch, W & Cramer, L & Abreu, D & Vermeulen, S & Campbell, BM, 2017. "Responding to global change: A theory of change approach to making agricultural research for development outcome-based," Agricultural Systems, Elsevier, vol. 152(C), pages 145-153.
    2. Turner, James A & Guesmi, Bouali & Gil, José M. & Heanue, Kevin & Sierra, Miguel & Percy, Helen & Bortagaray, Isabel & Chams, Nour & Milne, Cath, 2022. "Evaluation capacity building in response to the agricultural research impact agenda: Emerging insights from Ireland, Catalonia (Spain), New Zealand, and Uruguay," Evaluation and Program Planning, Elsevier, vol. 94(C).
    3. Birner, Regina & Davis, Kristin & Pender, John & Nkonya, Ephraim & Anandajayasekeram, Ponniah & Ekboir, Javier & Mbabu, Adiel & Spielman, David & Horna, Daniela & Benin, Samuel & Cohen, Marc J., 2006. "From "best practice" to "best fit": a framework for designing and analyzing pluralistic agricultural advisory services worldwide," FCND discussion papers 210, International Food Policy Research Institute (IFPRI).
    4. Klerkx, Laurens & Aarts, Noelle & Leeuwis, Cees, 2010. "Adaptive management in agricultural innovation systems: The interactions between innovation networks and their environment," Agricultural Systems, Elsevier, vol. 103(6), pages 390-400, July.
    5. Faure, Guy & Barret, Danielle & Blundo-Canto, Genowefa & Dabat, Marie-Hélène & Devaux-Spatarakis, Agathe & Le Guerroué, Jean Louis & Marquié, Catherine & Mathé, Syndhia & Temple, Ludovic & Toillier, A, 2018. "How different agricultural research models contribute to impacts: Evidence from 13 case studies in developing countries," Agricultural Systems, Elsevier, vol. 165(C), pages 128-136.
    6. Pant, Laxmi P., 2010. "Assessing Innovations in International Research and Development Practice," MERIT Working Papers 2010-043, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    7. Klerkx, Laurens & Leeuwis, Cees, 2008. "Institutionalizing end-user demand steering in agricultural R&D: Farmer levy funding of R&D in The Netherlands," Research Policy, Elsevier, vol. 37(3), pages 460-472, April.
    8. Maru, Yiheyis Taddele & Sparrow, Ashley & Butler, James R.A. & Banerjee, Onil & Ison, Ray & Hall, Andy & Carberry, Peter, 2018. "Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities," Agricultural Systems, Elsevier, vol. 165(C), pages 344-353.
    9. van Mierlo, Barbara & Janssen, Arni & Leenstra, Ferry & van Weeghel, Ellen, 2013. "Encouraging system learning in two poultry subsectors," Agricultural Systems, Elsevier, vol. 115(C), pages 29-40.
    10. Schut, Marc & Klerkx, Laurens & Rodenburg, Jonne & Kayeke, Juma & Hinnou, Léonard C. & Raboanarielina, Cara M. & Adegbola, Patrice Y. & van Ast, Aad & Bastiaans, Lammert, 2015. "RAAIS: Rapid Appraisal of Agricultural Innovation Systems (Part I). A diagnostic tool for integrated analysis of complex problems and innovation capacity," Agricultural Systems, Elsevier, vol. 132(C), pages 1-11.
    11. Peter Midmore, 2017. "The Science of Impact and the Impact of Agricultural Science," Journal of Agricultural Economics, Wiley Blackwell, vol. 68(3), pages 611-631, September.
    12. Midmore, Peter, 2017. "The Science of Impact and the Impact of Agricultural Science," 91st Annual Conference, April 24-26, 2017, Royal Dublin Society, Dublin, Ireland 258614, Agricultural Economics Society.
    13. Markow, Jekaterina & Fieldsend, Andrew F. & Münchhausen, Susanne von & Häring, Anna Maria, 2023. "Building agricultural innovation capacity from the bottom up: Using spillover effects from projects to strengthen agricultural innovation systems," Agricultural Systems, Elsevier, vol. 209(C).
    14. Faure, Guy & Davis, Kristin E. & Ragasa, Catherine & Franzel, Steven & Babu, Suresh Chandra, 2016. "Framework to assess performance and impact of pluralistic agricultural extension systems: The best-fit framework revisited:," IFPRI discussion papers 1567, International Food Policy Research Institute (IFPRI).
    15. Abboud, Rida & Claussen, Caroline, 2016. "The use of Outcome Harvesting in learning-oriented and collaborative inquiry approaches to evaluation: An example from Calgary, Alberta," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 47-54.
    16. Garb, Yaakov & Friedlander, Lonia, 2014. "From transfer to translation: Using systemic understandings of technology to understand drip irrigation uptake," Agricultural Systems, Elsevier, vol. 128(C), pages 13-24.
    17. Gaitán-Cremaschi, Daniel & Klerkx, Laurens & Aguilar-Gallegos, Norman & Duncan, Jessica & Pizzolón, Alejandro & Dogliotti, Santiago & Rossing, Walter A.H., 2022. "Public food procurement from family farming: A food system and social network perspective," Food Policy, Elsevier, vol. 111(C).
    18. Schut, Marc & van Asten, Piet & Okafor, Chris & Hicintuka, Cyrille & Mapatano, Sylvain & Nabahungu, Nsharwasi Léon & Kagabo, Desire & Muchunguzi, Perez & Njukwe, Emmanuel & Dontsop-Nguezet, Paul M. & , 2016. "Sustainable intensification of agricultural systems in the Central African Highlands: The need for institutional innovation," Agricultural Systems, Elsevier, vol. 145(C), pages 165-176.
    19. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    20. Michael Fritsch & Viktor Slavtchev, 2007. "What determines the efficiency of regional innovation systems?," Jena Economics Research Papers 2007-006, Friedrich-Schiller-University Jena.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:16:p:6559-:d:398554. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.