IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v46y2017i1p207-218.html
   My bibliography  Save this article

Opening the black box of impact – Ideal-type impact pathways in a public agricultural research organization

Author

Listed:
  • Matt, M.
  • Gaunand, A.
  • Joly, P-B.
  • Colinet, L.

Abstract

This paper develops a renewed research impact assessment approach that goes beyond the traditional computation of internal rates of returns but allows collective learning, understanding and guiding systems transformation. Our approach (ASIRPA) builds on the broader research impact assessment literature which discusses impact-generating mechanisms in nonlinear dynamic processes. The main originality of ASIRPA is that it is based on a theory of innovation inspired by Actor Network Theory and a standardized ex-post case study methodology. Standardized case studies allow systematic codification of the variables for each case study, and the building of four ideal-type impact pathways. Each of these ideal-types is characterized by specific translation mechanisms, critical points, research and adoption networks, research outputs, and impacts. Our analytical framework and empirical analysis provide new insights into the contribution of an agricultural Public Research Organization to impact generation, and the role of users and networks in impact pathways.

Suggested Citation

  • Matt, M. & Gaunand, A. & Joly, P-B. & Colinet, L., 2017. "Opening the black box of impact – Ideal-type impact pathways in a public agricultural research organization," Research Policy, Elsevier, vol. 46(1), pages 207-218.
    • Handle: RePEc:eee:respol:v:46:y:2017:i:1:p:207-218
    DOI: 10.1016/j.respol.2016.09.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733316301500
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2016.09.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eric von Hippel, 1986. "Lead Users: A Source of Novel Product Concepts," Management Science, INFORMS, vol. 32(7), pages 791-805, July.
    2. Joly, P. B. & Mangematin, V., 1996. "Profile of public laboratories, industrial partnerships and organisation of R & D: the dynamics of industrial relationships in a large research organisation," Research Policy, Elsevier, vol. 25(6), pages 901-922, September.
    3. Howells, Jeremy, 2006. "Intermediation and the role of intermediaries in innovation," Research Policy, Elsevier, vol. 35(5), pages 715-728, June.
    4. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    5. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    6. Joly, P.B. & Gaunand, A. & Colinet, L. & Larédo, P. & Lemarié, S. & Matt, M., 2015. "ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization," Working Papers 2015-04, Grenoble Applied Economics Laboratory (GAEL).
    7. von Hippel, Eric, 1976. "The dominant role of users in the scientific instrument innovation process," Research Policy, Elsevier, vol. 5(3), pages 212-239, July.
    8. Julian M. Alston & Philip G. Pardey & Jennifer S. James & Matthew A. Anderson, 2009. "The Economics of Agricultural R&D," Annual Review of Resource Economics, Annual Reviews, vol. 1(1), pages 537-566, September.
    9. Evenson, Robert E., 2001. "Economic impacts of agricultural research and extension," Handbook of Agricultural Economics, in: B. L. Gardner & G. C. Rausser (ed.), Handbook of Agricultural Economics, edition 1, volume 1, chapter 11, pages 573-628, Elsevier.
    10. Youtie, Jan & Shapira, Philip, 2008. "Building an innovation hub: A case study of the transformation of university roles in regional technological and economic development," Research Policy, Elsevier, vol. 37(8), pages 1188-1204, September.
    11. Klerkx, Laurens & Leeuwis, Cees, 2008. "Matching demand and supply in the agricultural knowledge infrastructure: Experiences with innovation intermediaries," Food Policy, Elsevier, vol. 33(3), pages 260-276, June.
    12. Douthwaite, Boru & Kuby, Thomas & van de Fliert, Elske & Schulz, Steffen, 2003. "Impact pathway evaluation: an approach for achieving and attributing impact in complex systems," Agricultural Systems, Elsevier, vol. 78(2), pages 243-265, November.
    13. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    14. Claire Donovan, 2011. "State of the art in assessing research impact: introduction to a special issue," Research Evaluation, Oxford University Press, vol. 20(3), pages 175-179, September.
    15. Franck Aggeri & Armand Hatchuel, 2003. "“Socioeconomic orders” and the polarization of research in agriculture: For a critique of the relations between science and society [Ordres socio-économiques et polarisation de la recherche dans l'," Post-Print halshs-00644599, HAL.
    16. Stefan de Jong & Katharine Barker & Deborah Cox & Thordis Sveinsdottir & Peter Van den Besselaar, 2014. "Understanding societal impact through productive interactions: ICT research as a case," Research Evaluation, Oxford University Press, vol. 23(2), pages 89-102.
    17. Nedeva, Maria, 2013. "Between the global and the national: Organising European science," Research Policy, Elsevier, vol. 42(1), pages 220-230.
    18. P.-B. Joly & Vincent Mangematin, 1996. "Profile of public laboratories, industrial partnerships and organisation of R & D: the dynamics of industrial relationships in a large research organisation," Post-Print hal-00422575, HAL.
    19. Green, Ken & Hull, Richard & McMeekin, Andrew & Walsh, Vivien, 1999. "The construction of the techno-economic: networks vs. paradigms," Research Policy, Elsevier, vol. 28(7), pages 777-792, September.
    20. Andy Stirling, 2014. "Transforming Power: social science and the politics of energy choices," SPRU Working Paper Series 2014-03, SPRU - Science Policy Research Unit, University of Sussex Business School.
    21. Jack Spaapen & Leonie van Drooge, 2011. "Introducing ‘productive interactions’ in social impact assessment," Research Evaluation, Oxford University Press, vol. 20(3), pages 211-218, September.
    22. Bozeman, Barry, 2000. "Technology transfer and public policy: a review of research and theory," Research Policy, Elsevier, vol. 29(4-5), pages 627-655, April.
    23. Gaunand, A. & Hocdé, A. & Lemarié, S. & Matt, M. & Turckheim, E.de, 2015. "How does public agricultural research impact society? A characterization of various patterns," Research Policy, Elsevier, vol. 44(4), pages 849-861.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Toffolini, Quentin & Jeuffroy, Marie-Hélène & Meynard, Jean-Marc & Borg, Julie & Enjalbert, Jérôme & Gauffreteau, Arnaud & Goldringer, Isabelle & Lefèvre, Amélie & Loyce, Chantal & Martin, Philippe & , 2020. "Design as a source of renewal in the production of scientific knowledge in crop science," Agricultural Systems, Elsevier, vol. 185(C).
    2. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    3. Nuno Oliveira & Davide Secchi, 2023. "Theory Building, Case Dependence, and Researchers’ Bounded Rationality: An Illustration From Studies of Innovation Diffusion," Sociological Methods & Research, , vol. 52(2), pages 993-1042, May.
    4. S. Wigboldus & M. A. McEwan & B. van Schagen & I. Okike & T. A. van Mourik & A. Rietveld & T. Amole & F. Asfaw & M. C. Hundayehu & F. Iradukunda & P. Kulakow & S. Namanda & I. Suleman & B. R. Wimba, 2023. "Understanding capacities to scale innovations for sustainable development: a learning journey of scaling partnerships in three parts of Africa," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(8), pages 8197-8231, August.
    5. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    6. A. Gaunand & L. Colinet & P.-B. Joly & M. Matt, 2022. "Counting what really counts? Assessing the political impact of science," The Journal of Technology Transfer, Springer, vol. 47(3), pages 699-721, June.
    7. Ciarli, Tommaso & Ràfols, Ismael, 2019. "The relation between research priorities and societal demands: The case of rice," Research Policy, Elsevier, vol. 48(4), pages 949-967.
    8. Molas-Gallart, Jordi & Woolley, Richard, 2022. "Research impact seen from the user side," INGENIO (CSIC-UPV) Working Paper Series 202201, INGENIO (CSIC-UPV).
    9. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    10. Toffolini, Quentin & Hannachi, Mourad & Capitaine, Mathieu & Cerf, Marianne, 2023. "Ideal-types of experimentation practices in agricultural Living Labs: Various appropriations of an open innovation model," Agricultural Systems, Elsevier, vol. 208(C).
    11. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    12. Jorrit P Smit & Laurens K Hessels, 2021. "The production of scientific and societal value in research evaluation: a review of societal impact assessment methods [Systems Thinking, Knowledge and Action: Towards Better Models and Methods]," Research Evaluation, Oxford University Press, vol. 30(3), pages 323-335.
    13. vom Brocke, Kirsten & Kondombo, Clarisse Pulcherie & Guillet, Marion & Kaboré, Roger & Sidibé, Adama & Temple, Ludovic & Trouche, Gilles, 2020. "Impact of participatory sorghum breeding in Burkina Faso," Agricultural Systems, Elsevier, vol. 180(C).
    14. Silje Maria Tellmann & Magnus Gulbrandsen, 2022. "The other side of the boundary: Productive interactions seen from the policy side [Rethinking Policy ‘Impact’: Four Models of Research-Policy Relations]," Science and Public Policy, Oxford University Press, vol. 49(4), pages 621-631.
    15. Dominique Barjolle & Peter Midmore & Otto Schmid, 2018. "Tracing the Pathways from Research to Innovation: Evidence from Case Studies," EuroChoices, The Agricultural Economics Society, vol. 17(1), pages 11-18, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matt, M. & Colinet, L. & Gaunand, A. & Joly, P.B., 2015. "A typology of impact pathways generated by a public agricultural research organization," Working Papers 2015-03, Grenoble Applied Economics Laboratory (GAEL).
    2. Joly, P.B. & Gaunand, A. & Colinet, L. & Larédo, P. & Lemarié, S. & Matt, M., 2015. "ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization," Working Papers 2015-04, Grenoble Applied Economics Laboratory (GAEL).
    3. Kroll, Henning & Hansmeier, Hendrik & Hufnagl, Miriam, 2022. "Productive interactions in basic research an enquiry into impact pathways at the DESY synchrotron," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    4. Pierre Benoit Joly & Laurence Colinet & Ariane Gaunand & Stephane Lemarié & Mireille Matt, 2016. "Agricultural research impact assessment: issues, methods and challenges," Working Papers hal-01431457, HAL.
    5. Gaunand, A. & Hocdé, A. & Lemarié, S. & Matt, M. & Turckheim, E.de, 2015. "How does public agricultural research impact society? A characterization of various patterns," Research Policy, Elsevier, vol. 44(4), pages 849-861.
    6. Paget, Nicolas & Le Gal, Pierre-Yves & Goulet, Frédéric, 2024. "Motivations and challenges of intrapreneurship in research organizations. The case of decision support systems in agricultural research for development," Technovation, Elsevier, vol. 130(C).
    7. Pierre-Benoit Joly & Mireille Matt, 2022. "Towards a new generation of research impact assessment approaches," The Journal of Technology Transfer, Springer, vol. 47(3), pages 621-631, June.
    8. Isabel Maria Bodas Freitas & Aldo Geuna & Federica Rossi, 2011. "University–Industry Interactions: The Unresolved Puzzle," Chapters, in: Cristiano Antonelli (ed.), Handbook on the Economic Complexity of Technological Change, chapter 11, Edward Elgar Publishing.
    9. Callaert, Julie & Landoni, Paolo & Van Looy, Bart & Verganti, Roberto, 2015. "Scientific yield from collaboration with industry: The relevance of researchers’ strategic approaches," Research Policy, Elsevier, vol. 44(4), pages 990-998.
    10. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    11. James A. Cunningham & Vincent Mangematin & Conor O’Kane & Paul O’Reilly, 2016. "At the frontiers of scientific advancement: the factors that influence scientists to become or choose to become publicly funded principal investigators," The Journal of Technology Transfer, Springer, vol. 41(4), pages 778-797, August.
    12. Bührer, Susanne & Feidenheimer, Alexander & Walz, Rainer & Lindner, Ralf & Beckert, Bernd & Wallwaey, Elisa, 2022. "Concepts and methods to measure societal impacts: An overview," Discussion Papers "Innovation Systems and Policy Analysis" 74, Fraunhofer Institute for Systems and Innovation Research (ISI).
    13. Irwin Feller, 2022. "Assessing the societal impact of publicly funded research," The Journal of Technology Transfer, Springer, vol. 47(3), pages 632-650, June.
    14. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    15. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    16. Julia Olmos‐Peñuela & Paul Benneworth & Elena Castro‐Martínez, 2015. "Exploring the factors related with scientists’ willingness to incorporating external knowledge," CHEPS Working Papers 201504, University of Twente, Center for Higher Education Policy Studies (CHEPS).
    17. Ciarli, Tommaso & Ràfols, Ismael, 2019. "The relation between research priorities and societal demands: The case of rice," Research Policy, Elsevier, vol. 48(4), pages 949-967.
    18. Véronique Schaeffer & Sıla Öcalan-Özel & Julien Pénin, 2020. "The complementarities between formal and informal channels of university–industry knowledge transfer: a longitudinal approach," The Journal of Technology Transfer, Springer, vol. 45(1), pages 31-55, February.
    19. Pablo D’Este & Irene Ramos-Vielba & Richard Woolley & Nabil Amara, 2018. "How do researchers generate scientific and societal impacts? Toward an analytical and operational framework," Science and Public Policy, Oxford University Press, vol. 45(6), pages 752-763.
    20. Turner, James A & Guesmi, Bouali & Gil, José M. & Heanue, Kevin & Sierra, Miguel & Percy, Helen & Bortagaray, Isabel & Chams, Nour & Milne, Cath, 2022. "Evaluation capacity building in response to the agricultural research impact agenda: Emerging insights from Ireland, Catalonia (Spain), New Zealand, and Uruguay," Evaluation and Program Planning, Elsevier, vol. 94(C).

    More about this item

    Keywords

    Public agricultural research; Societal impact; Impact pathways; Ideal-types; Evaluation;
    All these keywords.

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • A13 - General Economics and Teaching - - General Economics - - - Relation of Economics to Social Values
    • C39 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:46:y:2017:i:1:p:207-218. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.