IDEAS home Printed from https://ideas.repec.org/p/ags/iwmirp/329155.html
   My bibliography  Save this paper

Measuring the impact of integrated systems research: promising approaches and why CGIAR needs to care

Author

Listed:
  • Johnson, N.

Abstract

Measuring the impact of integrated systems research has been a challenge to CGIAR since it expanded into natural resource management research in the early 1990s. Despite repeated efforts, it has yet to be adequately addressed. Meanwhile, the demand for evidence of impact on development outcomes has only increased, as have calls for greater methodological rigor. At the same time, there is greater recognition of the complex, systemic nature of many problems facing society today and the need for new approaches to designing, implementing and evaluating research. In an attempt to provide pragmatic guidance to One CGIAR and others on how to address these issues in the design of research for development programs that involve integrated systems research (ISR), CGIAR held a virtual workshop on Measuring the Impact of Integrated Systems Research on September 27–30, 2021. Participants took stock of recent experiences and reviewed existing and new tools and approaches with the potential to overcome conceptual, empirical and institutional challenges that obstruct ISR. In terms of methods for assessing the impact of ISR, the workshop highlighted recent advances in the use of geospatial data and called for more significant investment in both the quantity and quality of qualitative methods. Integrating monitoring, evaluation, learning and impact assessment (MELIA) into the research programs will require greater capacity on the part of managers, researchers and MELIA specialists to use theory of change effectively and efficiently for multiple purposes. It is also becoming increasingly clear that some of the challenges in conducting ISR in CGIAR are not technical but have to do with structures, processes and internal tensions within CGIAR itself about the kind of outcomes it seeks and the way it organizes and implements research. While calling for research that contributes to sustainability and systems transformation, CGIAR has in different ways failed to adequately support, and to learn from, the kinds of integrated systems approaches that will likely underpin success. Workshop participants proposed tackling this head-on through changing CGIAR systems, processes and incentive structures, and engaging directly with funders on how impact is understood and measured.

Suggested Citation

  • Johnson, N., 2022. "Measuring the impact of integrated systems research: promising approaches and why CGIAR needs to care," IWMI Reports 329155, International Water Management Institute.
    • Handle: RePEc:ags:iwmirp:329155
    DOI: 10.22004/ag.econ.329155
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/329155/files/H050911.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.329155?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Meinzen-Dick, Ruth & Janssen, Marco A. & Kandikuppa, Sandeep & Chaturvedi, Rahul & Rao, Kaushalendra & Theis, Sophie, 2018. "Playing games to save water: Collective action games for groundwater management in Andhra Pradesh, India," World Development, Elsevier, vol. 107(C), pages 40-53.
    2. James Stevenson & Bernard Vanlauwe & Karen Macours & Nancy Johnson & Lakshmi Krishnan & Frank Place & David Spielman & Karl Hughes & Paul Vlek, 2019. "Farmer adoption of plot- and farm-level natural resource management practices: Between rhetoric and reality," PSE-Ecole d'économie de Paris (Postprint) halshs-02095028, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johnson, N., 2021. "Measuring the impact of integrated systems research: promising approaches and why CGIAR needs to care," IWMI Books, Reports H050911, International Water Management Institute.
    2. Rommel, Jens & Anggraini, Eva, 2018. "Spatially explicit framed field experiments on ecosystem services governance," Ecosystem Services, Elsevier, vol. 34(PB), pages 201-205.
    3. Abate, Gashaw T. & Bernard, Tanguy & Makhija, Simrin & Spielman, David J., 2023. "Accelerating technical change through ICT: Evidence from a video-mediated extension experiment in Ethiopia," World Development, Elsevier, vol. 161(C).
    4. Hughes, Karl & Morgan, Seth & Baylis, Katherine & Oduol, Judith & Smith-Dumont, Emilie & Vågen, Tor-Gunnar & Kegode, Hilda, 2020. "Assessing the downstream socioeconomic impacts of agroforestry in Kenya," World Development, Elsevier, vol. 128(C).
    5. Lobell, David B., 2020. "Viewpoint: Principles and priorities for one CGIAR," Food Policy, Elsevier, vol. 91(C).
    6. Ward, Frank A., 2023. "Innovations for the Water Resource Economics Curriculum: Training the Next Generation," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 5(2), April.
    7. Masuda, Yuta J. & Waterfield, Gina & Castilla, Carolina & Kang, Shiteng & Zhang, Wei, 2022. "Does balancing gender composition lead to more prosocial outcomes? Experimental evidence of equality in public goods and extraction games from rural Kenya," World Development, Elsevier, vol. 156(C).
    8. Barrett, Christopher B. & Islam, Asad & Pakrashi, Debayan & Ruthbah, Ummul, 2021. "Experimental Evidence on Adoption and Impact of the System of rice Intensification," Working Papers 309950, Cornell University, Department of Applied Economics and Management.
    9. Simon West & Caroline Schill, 2022. "Negotiating the ethical-political dimensions of research methods: a key competency in mixed methods, inter- and transdisciplinary, and co-production research," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-13, December.
    10. Francis Oremo & Richard Mulwa & Nicholas Oguge, 2019. "Knowledge, Attitude and Practice in Water Resources Management among Smallholder Irrigators in the Tsavo Sub-Catchment, Kenya," Resources, MDPI, vol. 8(3), pages 1-17, July.
    11. Macours, Karen & Behaghel, Luc & Gignoux, Jérémie, 2020. "Social learning in agriculture: does smallholder heterogeneity impede technology diffusion in Sub-Saharan Africa?," CEPR Discussion Papers 15220, C.E.P.R. Discussion Papers.
    12. Ortiz-Riomalo, Juan Felipe & Koessler, Ann-Kathrin & Engel, Stefanie, 2022. "Fostering co-operation through participation in natural resource management. An integrative review," EconStor Preprints 253261, ZBW - Leibniz Information Centre for Economics.
    13. Ndlovu, Nicholas. P. & Borrass, Lars, 2021. "Promises and potentials do not grow trees and crops. A review of institutional and policy research in agroforestry for the Southern African region," Land Use Policy, Elsevier, vol. 103(C).
    14. Sandeep Kandikuppa & Clark Gray, 2022. "Climate change and household debt in rural India," Climatic Change, Springer, vol. 173(3), pages 1-27, August.
    15. Robert-Jan Den Haan & Mascha C. Van der Voort, 2018. "On Evaluating Social Learning Outcomes of Serious Games to Collaboratively Address Sustainability Problems: A Literature Review," Sustainability, MDPI, vol. 10(12), pages 1-26, December.
    16. Paul Christian & Florence Kondylis & Valerie Mueller & Astrid Zwager & Tobias Siegfried, 2022. "Monitoring Water for Conservation: A Proof of Concept from Mozambique," American Journal of Agricultural Economics, John Wiley & Sons, vol. 104(1), pages 92-110, January.
    17. Nicolas Gratiot & Jérémie Klein & Marceau Challet & Olivier Dangles & Serge Janicot & Miriam Candelas & Géraldine Sarret & Géremy Panthou & Benoît Hingray & Nicolas Champollion & Julien Montillaud & P, 2023. "A transition support system to build decarbonization scenarios in the academic community," Post-Print hal-04126329, HAL.
    18. Bartels, Lara & Falk, Thomas & Duche, Vishwambhar & Vollan, Björn, 2022. "Experimental games in transdisciplinary research: The potential importance of individual payments," Journal of Environmental Economics and Management, Elsevier, vol. 113(C).
    19. Wegmann, Johannes & Mußhoff, Oliver, 2019. "Groundwater management institutions in the face of rapid urbanization – Results of a framed field experiment in Bengaluru, India," Ecological Economics, Elsevier, vol. 166(C), pages 1-1.
    20. Meine van Noordwijk & Erika Speelman & Gert Jan Hofstede & Ai Farida & Ali Yansyah Abdurrahim & Andrew Miccolis & Arief Lukman Hakim & Charles Nduhiu Wamucii & Elisabeth Lagneaux & Federico Andreotti , 2020. "Sustainable Agroforestry Landscape Management: Changing the Game," Land, MDPI, vol. 9(8), pages 1-38, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:iwmirp:329155. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/iwmiclk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.