IDEAS home Printed from https://ideas.repec.org/p/hal/pseptp/halshs-04155302.html
   My bibliography  Save this paper

The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research

Author

Listed:
  • James Stevenson

    (IFPRI - International Food Policy Research Institute [India] - IFPRI - International Food Policy Research Institute [Washington] - CGIAR - Consultative Group on International Agricultural Research [CGIAR], CGIAR Standing Panel on Impact Assessment)

  • Karen Macours

    (PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École nationale des ponts et chaussées - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement, PJSE - Paris Jourdan Sciences Economiques - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École nationale des ponts et chaussées - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Douglas Gollin

    (University of Oxford)

Abstract

We take stock of the major changes in methodology for studying the impacts of international agricultural research, focusing on the period 2006–2020. Impact assessment of agricultural research has a long and recognized tradition. Until the mid-2000s, such assessments were dominated by a model of demand for and supply of agricultural products in partial equilibrium. The basic ideas for this approach were sketched out by Griliches more than half a century ago. We describe the implications of heightened standards of evidence for good practice in three domains of research design: causal inference, valid measurement, and statistical representativeness. We document advances in each of these domains and review recent evidence that demonstrates the lessons that can be learned from adopting these practices, emphasizing the importance of evidence at-scale, the need to consider portfolios of innovations at a national level, and the challenges of accounting for innovations that are promoted as bundles.

Suggested Citation

  • James Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," PSE-Ecole d'économie de Paris (Postprint) halshs-04155302, HAL.
  • Handle: RePEc:hal:pseptp:halshs-04155302
    DOI: 10.1146/annurev-resource-101722-082519
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a
    for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wiebe, Keith & Sulser, Timothy B & Dunston, Shahnila & Rosegrant, Mark W. & Fuglie, Keith & Willenbockel, Dirk & Nelson, Gerald C., 2020. "Modeling impacts of faster productivity growth to inform the CGIAR initiative on Crops to End Hunger," SocArXiv h2g6r, Center for Open Science.
    2. Barrett, Christopher B. (ed.), 2013. "Food Security and Sociopolitical Stability," OUP Catalogue, Oxford University Press, number 9780199679362.
    3. Renkow, Mitch & Byerlee, Derek, 2010. "The impacts of CGIAR research: A review of recent evidence," Food Policy, Elsevier, vol. 35(5), pages 391-402, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alemu, Solomon & Kosmowski, Frederic & Stevenson, James R. & Mallia, Paola & Taye, Lemi & Macours, Karen, 2024. "Studying inclusive innovation with the right data: An empirical illustration from Ethiopia," Agricultural Systems, Elsevier, vol. 219(C).
    2. Kramer, Berber & Spielman, David J., 2025. "Quality seeds, improved varieties: The economics of crop genetic improvement and farmer uptake," IFPRI book chapters, in: Global food policy report 2025: Food policy: Lessons and priorities for a changing world, chapter 9, pages 221-244, International Food Policy Research Institute (IFPRI).
    3. Fuglie, Keith O. & Echeverria, Ruben G., 2024. "The economic impact of CGIAR-related crop technologies on agricultural productivity in developing countries, 1961–2020," World Development, Elsevier, vol. 176(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pemsl, Diemuth E. & Staver, Charles & Hareau, Guy & Alene, Arega D. & Abdoulaye, Tahirou & Kleinwechter, Ulrich & Labarta, Ricardo & Thiele, Graham, 2022. "Prioritizing international agricultural research investments: lessons from a global multi-crop assessment," Research Policy, Elsevier, vol. 51(4).
    2. repec:osf:socarx:ybgsm_v1 is not listed on IDEAS
    3. Kruseman, Gideon, 2022. "Understanding the regional landscape and contributions of crops to end hunger in the Global South: Towards a parsimonious foundation," SocArXiv ybgsm, Center for Open Science.
    4. Huang, Kaixing, 2024. "The Green Revolution, grain imports, and income divergence in the developing world," European Economic Review, Elsevier, vol. 166(C).
    5. Fuglie, Keith O. & Wiebe, Keith D. & Prager, Steven D. & Sulser, Timothy B. & Cenacchi, Nicola & Bonilla Cedrez, Camila & Willenbockel, Dirk, 2022. "Quantitative analysis to inform priorities for international agricultural research," IFPRI discussion papers 2133, International Food Policy Research Institute (IFPRI).
    6. Liao, Chuan & Jung, Suhyun & Brown, Daniel G. & Agrawal, Arun, 2024. "Does land tenure change accelerate deforestation? A matching-based four-country comparison," Ecological Economics, Elsevier, vol. 215(C).
    7. Ashok, K.R. & Giuliani, A. & Thilagavathi, M. & Raj, S.V. & Ramamoorthy R. & Devi M. & Sanjeevikumar A., 2017. "Trait Valuation in Genetically Modified Crops: An ex-ante Analysis of GM Cassava 223 against Cassava Mosaic Disease," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 30(2).
    8. Mekonnen, D. & Spielman, D., 2018. "Changing patterns in the international movement of crop genetic material: An analysis of global policy drivers and potential consequences," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277432, International Association of Agricultural Economists.
    9. Tomich, Thomas P. & Lidder, Preetmoninder & Coley, Mariah & Gollin, Douglas & Meinzen-Dick, Ruth & Webb, Patrick & Carberry, Peter, 2019. "Food and agricultural innovation pathways for prosperity," Agricultural Systems, Elsevier, vol. 172(C), pages 1-15.
    10. Svanidze, Miranda & Götz, Linde & Djuric, Ivan & Glauben, Thomas, 2019. "Food security and the functioning of wheat markets in Eurasia: a comparative price transmission analysis for the countries of Central Asia and the South Caucasus," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 11(3), pages 733-752.
    11. John Baffes & Xiaoli Etienne, 2024. "Yield growth patterns of food commodities: Insights and challenges," PLOS ONE, Public Library of Science, vol. 19(11), pages 1-21, November.
    12. Gerling, Lena, 2017. "Riots and the Window of Opportunity for Coup Plotters: Evidence on the Link between Urban Protests and Coups d’État," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168054, Verein für Socialpolitik / German Economic Association.
    13. Thornton, PK & Schuetz, T & Förch, W & Cramer, L & Abreu, D & Vermeulen, S & Campbell, BM, 2017. "Responding to global change: A theory of change approach to making agricultural research for development outcome-based," Agricultural Systems, Elsevier, vol. 152(C), pages 145-153.
    14. Matt, M. & Colinet, L. & Gaunand, A. & Joly, P.B., 2015. "A typology of impact pathways generated by a public agricultural research organization," Working Papers 2015-03, Grenoble Applied Economics Laboratory (GAEL).
    15. Michael Bernardi & Christa Hainz & Paulina Maier & Maria Waldinger, 2023. "A “Green Revolution” for Sub-Saharan Africa? Challenges and Opportunities," EconPol Policy Brief 54, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    16. Alison Heslin, 2021. "Riots and resources: How food access affects collective violence," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(2), pages 199-214, March.
    17. repec:osf:thesis:8ckgz_v1 is not listed on IDEAS
    18. Michael Bernardi & Christa Hainz & Paulina Maier & Maria Waldinger, 2023. "Eine „Grüne Revolution“ in Subsahara-Afrika? Herausforderungen und Chancen," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 76(05), pages 29-33, May.
    19. Peter Weißhuhn & Katharina Helming & Johanna Ferretti, 2018. "Research impact assessment in agriculture—A review of approaches and impact areas," Research Evaluation, Oxford University Press, vol. 27(1), pages 36-42.
    20. Beliyou Haile & Carlo Azzarri & Cleo Roberts & David J. Spielman, 2017. "Targeting, bias, and expected impact of complex innovations on developing-country agriculture: evidence from Malawi," Agricultural Economics, International Association of Agricultural Economists, vol. 48(3), pages 317-326, May.
    21. repec:zbw:iamodp:285032 is not listed on IDEAS
    22. Kamanda, Josey & Birner, Regina & Bantilan, Cynthia, 2017. "The “efficient boundaries” of international agricultural research: A conceptual framework with empirical illustrations," Agricultural Systems, Elsevier, vol. 150(C), pages 78-85.
    23. Prager, Steven D. & Wiebe, Keith D., 2022. "Strategic foresight in One CGIAR: Gaps and needs in approaches and capacity," Other briefs January 2022, International Food Policy Research Institute (IFPRI).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • Q16 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - R&D; Agricultural Technology; Biofuels; Agricultural Extension Services

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:pseptp:halshs-04155302. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Caroline Bauer (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.