IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v46y2017i1p207-218.html
   My bibliography  Save this article

Opening the black box of impact – Ideal-type impact pathways in a public agricultural research organization

Author

Listed:
  • Matt, M.
  • Gaunand, A.
  • Joly, P-B.
  • Colinet, L.

Abstract

This paper develops a renewed research impact assessment approach that goes beyond the traditional computation of internal rates of returns but allows collective learning, understanding and guiding systems transformation. Our approach (ASIRPA) builds on the broader research impact assessment literature which discusses impact-generating mechanisms in nonlinear dynamic processes. The main originality of ASIRPA is that it is based on a theory of innovation inspired by Actor Network Theory and a standardized ex-post case study methodology. Standardized case studies allow systematic codification of the variables for each case study, and the building of four ideal-type impact pathways. Each of these ideal-types is characterized by specific translation mechanisms, critical points, research and adoption networks, research outputs, and impacts. Our analytical framework and empirical analysis provide new insights into the contribution of an agricultural Public Research Organization to impact generation, and the role of users and networks in impact pathways.

Suggested Citation

  • Matt, M. & Gaunand, A. & Joly, P-B. & Colinet, L., 2017. "Opening the black box of impact – Ideal-type impact pathways in a public agricultural research organization," Research Policy, Elsevier, vol. 46(1), pages 207-218.
  • Handle: RePEc:eee:respol:v:46:y:2017:i:1:p:207-218
    DOI: 10.1016/j.respol.2016.09.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733316301500
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2016.09.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eric von Hippel, 1986. "Lead Users: A Source of Novel Product Concepts," Management Science, INFORMS, vol. 32(7), pages 791-805, July.
    2. Joly, P. B. & Mangematin, V., 1996. "Profile of public laboratories, industrial partnerships and organisation of R & D: the dynamics of industrial relationships in a large research organisation," Research Policy, Elsevier, vol. 25(6), pages 901-922, September.
    3. Howells, Jeremy, 2006. "Intermediation and the role of intermediaries in innovation," Research Policy, Elsevier, vol. 35(5), pages 715-728, June.
    4. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    5. Joly, P.B. & Gaunand, A. & Colinet, L. & Larédo, P. & Lemarié, S. & Matt, M., 2015. "ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization," Working Papers 2015-04, Grenoble Applied Economics Laboratory (GAEL).
    6. von Hippel, Eric, 1976. "The dominant role of users in the scientific instrument innovation process," Research Policy, Elsevier, vol. 5(3), pages 212-239, July.
    7. Julian M. Alston & Philip G. Pardey & Jennifer S. James & Matthew A. Anderson, 2009. "The Economics of Agricultural R&D," Annual Review of Resource Economics, Annual Reviews, vol. 1(1), pages 537-566, September.
    8. Evenson, Robert E., 2001. "Economic impacts of agricultural research and extension," Handbook of Agricultural Economics, in: B. L. Gardner & G. C. Rausser (ed.), Handbook of Agricultural Economics, edition 1, volume 1, chapter 11, pages 573-628, Elsevier.
    9. Youtie, Jan & Shapira, Philip, 2008. "Building an innovation hub: A case study of the transformation of university roles in regional technological and economic development," Research Policy, Elsevier, vol. 37(8), pages 1188-1204, September.
    10. Douthwaite, Boru & Kuby, Thomas & van de Fliert, Elske & Schulz, Steffen, 2003. "Impact pathway evaluation: an approach for achieving and attributing impact in complex systems," Agricultural Systems, Elsevier, vol. 78(2), pages 243-265, November.
    11. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    12. Franck Aggeri & Armand Hatchuel, 2003. "Ordres socio-économiques et polarisation de la recherche dans l'agriculture : pour une critique des rapports science/société," Post-Print halshs-00644599, HAL.
    13. Stefan de Jong & Katharine Barker & Deborah Cox & Thordis Sveinsdottir & Peter Van den Besselaar, 2014. "Understanding societal impact through productive interactions: ICT research as a case," Research Evaluation, Oxford University Press, vol. 23(2), pages 89-102.
    14. Nedeva, Maria, 2013. "Between the global and the national: Organising European science," Research Policy, Elsevier, vol. 42(1), pages 220-230.
    15. Green, Ken & Hull, Richard & McMeekin, Andrew & Walsh, Vivien, 1999. "The construction of the techno-economic: networks vs. paradigms," Research Policy, Elsevier, vol. 28(7), pages 777-792, September.
    16. Andy Stirling, 2014. "Transforming Power: social science and the politics of energy choices," SPRU Working Paper Series 2014-03, SPRU - Science Policy Research Unit, University of Sussex Business School.
    17. Gaunand, A. & Hocdé, A. & Lemarié, S. & Matt, M. & Turckheim, E.de, 2015. "How does public agricultural research impact society? A characterization of various patterns," Research Policy, Elsevier, vol. 44(4), pages 849-861.
    18. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    19. Klerkx, Laurens & Leeuwis, Cees, 2008. "Matching demand and supply in the agricultural knowledge infrastructure: Experiences with innovation intermediaries," Food Policy, Elsevier, vol. 33(3), pages 260-276, June.
    20. Claire Donovan, 2011. "State of the art in assessing research impact: introduction to a special issue," Research Evaluation, Oxford University Press, vol. 20(3), pages 175-179, September.
    21. P.-B. Joly & Vincent Mangematin, 1996. "Profile of public laboratories, industrial partnerships and organisation of R & D: the dynamics of industrial relationships in a large research organisation," Post-Print hal-00422575, HAL.
    22. Jack Spaapen & Leonie van Drooge, 2011. "Introducing ‘productive interactions’ in social impact assessment," Research Evaluation, Oxford University Press, vol. 20(3), pages 211-218, September.
    23. Bozeman, Barry, 2000. "Technology transfer and public policy: a review of research and theory," Research Policy, Elsevier, vol. 29(4-5), pages 627-655, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    2. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    3. Ciarli, Tommaso & Ràfols, Ismael, 2019. "The relation between research priorities and societal demands: The case of rice," Research Policy, Elsevier, vol. 48(4), pages 949-967.
    4. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    5. Toffolini, Quentin & Jeuffroy, Marie-Hélène & Meynard, Jean-Marc & Borg, Julie & Enjalbert, Jérôme & Gauffreteau, Arnaud & Goldringer, Isabelle & Lefèvre, Amélie & Loyce, Chantal & Martin, Philippe & , 2020. "Design as a source of renewal in the production of scientific knowledge in crop science," Agricultural Systems, Elsevier, vol. 185(C).
    6. vom Brocke, Kirsten & Kondombo, Clarisse Pulcherie & Guillet, Marion & Kaboré, Roger & Sidibé, Adama & Temple, Ludovic & Trouche, Gilles, 2020. "Impact of participatory sorghum breeding in Burkina Faso," Agricultural Systems, Elsevier, vol. 180(C).
    7. Dominique Barjolle & Peter Midmore & Otto Schmid, 2018. "Tracing the Pathways from Research to Innovation: Evidence from Case Studies," EuroChoices, The Agricultural Economics Society, vol. 17(1), pages 11-18, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matt, M. & Colinet, L. & Gaunand, A. & Joly, P.B., 2015. "A typology of impact pathways generated by a public agricultural research organization," Working Papers 2015-03, Grenoble Applied Economics Laboratory (GAEL).
    2. Pierre Benoit Joly & Laurence Colinet & Ariane Gaunand & Stephane Lemarié & Mireille Matt, 2016. "Agricultural research impact assessment: issues, methods and challenges," Working Papers hal-01431457, HAL.
    3. Joly, P.B. & Gaunand, A. & Colinet, L. & Larédo, P. & Lemarié, S. & Matt, M., 2015. "ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization," Working Papers 2015-04, Grenoble Applied Economics Laboratory (GAEL).
    4. Gaunand, A. & Hocdé, A. & Lemarié, S. & Matt, M. & Turckheim, E.de, 2015. "How does public agricultural research impact society? A characterization of various patterns," Research Policy, Elsevier, vol. 44(4), pages 849-861.
    5. Callaert, Julie & Landoni, Paolo & Van Looy, Bart & Verganti, Roberto, 2015. "Scientific yield from collaboration with industry: The relevance of researchers’ strategic approaches," Research Policy, Elsevier, vol. 44(4), pages 990-998.
    6. James A. Cunningham & Vincent Mangematin & Conor O’Kane & Paul O’Reilly, 2016. "At the frontiers of scientific advancement: the factors that influence scientists to become or choose to become publicly funded principal investigators," The Journal of Technology Transfer, Springer, vol. 41(4), pages 778-797, August.
    7. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    8. Isabel Maria Bodas Freitas & Aldo Geuna & Federica Rossi, 2011. "University–Industry Interactions: The Unresolved Puzzle," Chapters, in: Cristiano Antonelli (ed.), Handbook on the Economic Complexity of Technological Change, chapter 11, Edward Elgar Publishing.
    9. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    10. Julia Olmos‐Peñuela & Paul Benneworth & Elena Castro‐Martínez, 2015. "Exploring the factors related with scientists’ willingness to incorporating external knowledge," CHEPS Working Papers 201504, University of Twente, Center for Higher Education Policy Studies (CHEPS).
    11. Véronique Schaeffer & Sıla Öcalan-Özel & Julien Pénin, 2020. "The complementarities between formal and informal channels of university–industry knowledge transfer: a longitudinal approach," The Journal of Technology Transfer, Springer, vol. 45(1), pages 31-55, February.
    12. Peter Weißhuhn & Katharina Helming & Johanna Ferretti, 2018. "Research impact assessment in agriculture—A review of approaches and impact areas," Research Evaluation, Oxford University Press, vol. 27(1), pages 36-42.
    13. Lisa Blix Germundsson & Sören Augustinsson & Alina Lidén, 2020. "Collaboration in the Making—Towards a Practice-Based Approach to University Innovation Intermediary Organisations," Sustainability, MDPI, Open Access Journal, vol. 12(12), pages 1-14, June.
    14. Archibugi, Daniele & Filippetti, Andrea, 2018. "The retreat of public research and its adverse consequences on innovation," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 97-111.
    15. Alessandro Magrini & Fabio Bartolini & Alessandra Coli & Barbara Pacini, 2019. "A structural equation model to assess the impact of agricultural research expenditure on multiple dimensions," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2063-2080, July.
    16. Faure, Guy & Barret, Danielle & Blundo-Canto, Genowefa & Dabat, Marie-Hélène & Devaux-Spatarakis, Agathe & Le Guerroué, Jean Louis & Marquié, Catherine & Mathé, Syndhia & Temple, Ludovic & Toillier, A, 2018. "How different agricultural research models contribute to impacts: Evidence from 13 case studies in developing countries," Agricultural Systems, Elsevier, vol. 165(C), pages 128-136.
    17. Ciarli, Tommaso & Ràfols, Ismael, 2019. "The relation between research priorities and societal demands: The case of rice," Research Policy, Elsevier, vol. 48(4), pages 949-967.
    18. Hird, Mackenzie D. & Pfotenhauer, Sebastian M., 2017. "How complex international partnerships shape domestic research clusters: Difference-in-difference network formation and research re-orientation in the MIT Portugal Program," Research Policy, Elsevier, vol. 46(3), pages 557-572.
    19. James A. Cunningham & Matthias Menter & Chris Young, 2017. "A review of qualitative case methods trends and themes used in technology transfer research," The Journal of Technology Transfer, Springer, vol. 42(4), pages 923-956, August.
    20. Rossi, Federica & Rosli, Ainurul & Yip, Nick, 2017. "Academic engagement as knowledge co-production and implications for impact: Evidence from Knowledge Transfer Partnerships," Journal of Business Research, Elsevier, vol. 80(C), pages 1-9.

    More about this item

    Keywords

    Public agricultural research; Societal impact; Impact pathways; Ideal-types; Evaluation;
    All these keywords.

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • A13 - General Economics and Teaching - - General Economics - - - Relation of Economics to Social Values
    • C39 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:46:y:2017:i:1:p:207-218. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/respol .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.