IDEAS home Printed from https://ideas.repec.org/p/hal/pseptp/halshs-04155302.html
   My bibliography  Save this paper

The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research

Author

Listed:
  • James Stevenson

    (IFPRI - International Food Policy Research Institute [India] - IFPRI - International Food Policy Research Institute [Washington] - CGIAR - Consultative Group on International Agricultural Research [CGIAR], CGIAR Standing Panel on Impact Assessment)

  • Karen Macours

    (PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École nationale des ponts et chaussées - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement, PJSE - Paris Jourdan Sciences Economiques - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École nationale des ponts et chaussées - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Douglas Gollin

    (University of Oxford)

Abstract

We take stock of the major changes in methodology for studying the impacts of international agricultural research, focusing on the period 2006–2020. Impact assessment of agricultural research has a long and recognized tradition. Until the mid-2000s, such assessments were dominated by a model of demand for and supply of agricultural products in partial equilibrium. The basic ideas for this approach were sketched out by Griliches more than half a century ago. We describe the implications of heightened standards of evidence for good practice in three domains of research design: causal inference, valid measurement, and statistical representativeness. We document advances in each of these domains and review recent evidence that demonstrates the lessons that can be learned from adopting these practices, emphasizing the importance of evidence at-scale, the need to consider portfolios of innovations at a national level, and the challenges of accounting for innovations that are promoted as bundles.

Suggested Citation

  • James Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," PSE-Ecole d'économie de Paris (Postprint) halshs-04155302, HAL.
  • Handle: RePEc:hal:pseptp:halshs-04155302
    DOI: 10.1146/annurev-resource-101722-082519
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wiebe, Keith & Sulser, Timothy B & Dunston, Shahnila & Rosegrant, Mark W. & Fuglie, Keith & Willenbockel, Dirk & Nelson, Gerald C., 2020. "Modeling impacts of faster productivity growth to inform the CGIAR initiative on Crops to End Hunger," SocArXiv h2g6r, Center for Open Science.
    2. Barrett, Christopher B. (ed.), 2013. "Food Security and Sociopolitical Stability," OUP Catalogue, Oxford University Press, number 9780199679362, Decembrie.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alemu, Solomon & Kosmowski, Frederic & Stevenson, James R. & Mallia, Paola & Taye, Lemi & Macours, Karen, 2024. "Studying inclusive innovation with the right data: An empirical illustration from Ethiopia," Agricultural Systems, Elsevier, vol. 219(C).
    2. Fuglie, Keith O. & Echeverria, Ruben G., 2024. "The economic impact of CGIAR-related crop technologies on agricultural productivity in developing countries, 1961–2020," World Development, Elsevier, vol. 176(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liao, Chuan & Jung, Suhyun & Brown, Daniel G. & Agrawal, Arun, 2024. "Does land tenure change accelerate deforestation? A matching-based four-country comparison," Ecological Economics, Elsevier, vol. 215(C).
    2. Svanidze, Miranda & Götz, Linde & Djuric, Ivan & Glauben, Thomas, 2019. "Food security and the functioning of wheat markets in Eurasia: a comparative price transmission analysis for the countries of Central Asia and the South Caucasus," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 11(3), pages 733-752.
    3. Gerling, Lena, 2017. "Riots and the Window of Opportunity for Coup Plotters: Evidence on the Link between Urban Protests and Coups d’État," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168054, Verein für Socialpolitik / German Economic Association.
    4. Alison Heslin, 2021. "Riots and resources: How food access affects collective violence," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(2), pages 199-214, March.
    5. repec:osf:thesis:8ckgz_v1 is not listed on IDEAS
    6. Pemsl, Diemuth E. & Staver, Charles & Hareau, Guy & Alene, Arega D. & Abdoulaye, Tahirou & Kleinwechter, Ulrich & Labarta, Ricardo & Thiele, Graham, 2022. "Prioritizing international agricultural research investments: lessons from a global multi-crop assessment," Research Policy, Elsevier, vol. 51(4).
    7. repec:zbw:iamodp:285032 is not listed on IDEAS
    8. Prager, Steven D. & Wiebe, Keith D., 2022. "Strategic foresight in One CGIAR: Gaps and needs in approaches and capacity," Other briefs January 2022, International Food Policy Research Institute (IFPRI).
    9. Gentilini,Ugo, 2015. "Entering the city : emerging evidence and practices with safety nets in urban areas," Social Protection and Labor Policy and Technical Notes 98253, The World Bank.
    10. Belesky, Paul, 2015. "Towards a New Political Economy of Food: State Capitalism and the Emergence of Neomercantilism in the Global Food System," Thesis Commons 8ckgz, Center for Open Science.
    11. Chan, Chin Yee & Prager, Steven & Balie, Jean & Kozicka, Marta & Hareau, Guy & Valera, Harold Glenn & Tran, Nhuong & Wiebe, Keith & Diagne, Mandiaye & Alene, Arega, 2021. "The Future of Food Security, Nutrition and Health for Agri-food Systems Transformation," SocArXiv qgn9u, Center for Open Science.
    12. CGIAR Research Program on Policies, Institutions, and Markets, 2021. "Technological innovation and sustainable intensification: Highlights, lessons learned, and priorities for One CGIAR," PIM flagship insights 1, International Food Policy Research Institute (IFPRI).
    13. Belesky, Paul, 2016. "Rice, politics and power: the political economy of food insecurity in East Asia," Thesis Commons hn264, Center for Open Science.
    14. Artiom Volkov & Agnė Žičkienė & Mangirdas Morkunas & Tomas Baležentis & Erika Ribašauskienė & Dalia Streimikiene, 2021. "A Multi-Criteria Approach for Assessing the Economic Resilience of Agriculture: The Case of Lithuania," Sustainability, MDPI, vol. 13(4), pages 1-16, February.
    15. Prager, Steven & Wiebe, Keith, 2021. "Strategic Foresight in the One CGIAR: Gaps and Needs in Approaches and Capacity," SocArXiv 7kfxv, Center for Open Science.
    16. Hatab, Assem Abu & Hess, Sebastian, 2021. ""Feed the Mouth, the Eye Ashamed": Have Food Prices Triggered Social Unrest in Egypt?," 2021 Conference, August 17-31, 2021, Virtual 315082, International Association of Agricultural Economists.
    17. Cenacchi, Nicola & Dunston, Shahnila & Gueneau, Arthur & Mason-D’Croz, Daniel & Mishra, Abhijeet & Pitois, Gauthier & Robertson, Richard D. & Robinson, Sherman & Rosegrant, Mark W. & Sulser, Timothy, 2024. "The International Model for Policy Analysis of Agricultural Commodities and Trade (IMPACT): Model documentation for version 3.6," Research reports 148953, International Food Policy Research Institute (IFPRI).
    18. Yousef, Sahar, 2020. "Can Trade Liberalization in Agricultural Products Mitigate the Effect of Climate Change on Civil Strife?," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304609, Agricultural and Applied Economics Association.
    19. repec:osf:socarx:ybgsm_v1 is not listed on IDEAS
    20. Petrescu-Mag, Ruxandra Mălina & Petrescu, Dacinia Crina & Reti, Kinga-Olga, 2019. "My land is my food: Exploring social function of large land deals using food security–land deals relation in five Eastern European countries," Land Use Policy, Elsevier, vol. 82(C), pages 729-741.
    21. Oh, Saera & Lim, Sunghun, 2024. "Geopolitical Risks and Agricultural Trade Diversification in Southern Africa: Port-level Evidence from the Russia-UkraineWar," 2024 Annual Meeting, July 28-30, New Orleans, LA 343735, Agricultural and Applied Economics Association.
    22. Nawab Khan & Ram L. Ray & Hazem S. Kassem & Sajjad Hussain & Shemei Zhang & Muhammad Khayyam & Muhammad Ihtisham & Simplice A. Asongu, 2021. "Potential Role of Technology Innovation in Transformation of Sustainable Food Systems: A Review," Agriculture, MDPI, vol. 11(10), pages 1-20, October.
    23. Gerling, Lena, 2017. "Riots and the window of opportunity for coup plotters: Evidence on the link between urban protests and coups d'état," CIW Discussion Papers 2/2017, University of Münster, Center for Interdisciplinary Economics (CIW).

    More about this item

    Keywords

    agricultural research for development; impact assessment; measurement; causality; scale;
    All these keywords.

    JEL classification:

    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • Q16 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - R&D; Agricultural Technology; Biofuels; Agricultural Extension Services

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:pseptp:halshs-04155302. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Caroline Bauer (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.