IDEAS home Printed from https://ideas.repec.org/p/idb/spdwps/1007.html
   My bibliography  Save this paper

Designing Impact Evaluations for Agricultural Projects

Author

Listed:
  • Paul Winters
  • Lina Salazar
  • Alessandro Maffioli

Abstract

The purpose of this guideline is to provide suggestions on designing impact evaluations for agricultural projects, particularly projects that directly target farmers, and seek to improve agricultural production, productivity and profitability. Specific issues in evaluating agricultural projects are addressed, including the need to use production-based indicators and to carefully consider indirect or spillover effects that are common in agricultural projects. The guideline considers the challenges of conducting impact evaluations of agricultural projects as well as the methods for assessing impact. Issues of collecting agricultural data for an impact evaluation and how to put together the overall design strategy in an evaluation plan are also covered. The guideline concludes with three case studies of impact evaluations designed for a technology adoption project in the Dominican Republic, a forestry/technology project in Nicaragua, and a crop insurance project in Peru.

Suggested Citation

  • Paul Winters & Lina Salazar & Alessandro Maffioli, 2010. "Designing Impact Evaluations for Agricultural Projects," SPD Working Papers 1007, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    • Handle: RePEc:idb:spdwps:1007
    as

    Download full text from publisher

    File URL: http://www.iadb.org/document.cfm?id=35529432
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dercon, Stefan & Christiaensen, Luc, 2011. "Consumption risk, technology adoption and poverty traps: Evidence from Ethiopia," Journal of Development Economics, Elsevier, vol. 96(2), pages 159-173, November.
    2. Bravo-Ureta, Boris E. & Pinheiro, António E., 1993. "Efficiency Analysis of Developing Country Agriculture: A Review of the Frontier Function Literature," Agricultural and Resource Economics Review, Cambridge University Press, vol. 22(1), pages 88-101, April.
    3. Hongbin Cai & Yuyu Chen & Hanming Fang & Li-An Zhou, 2009. "Microinsurance, Trust and Economic Development: Evidence from a Randomized Natural Field Experiment," NBER Working Papers 15396, National Bureau of Economic Research, Inc.
    4. Feder, Gershon & Just, Richard E & Zilberman, David, 1985. "Adoption of Agricultural Innovations in Developing Countries: A Survey," Economic Development and Cultural Change, University of Chicago Press, vol. 33(2), pages 255-298, January.
    5. Amir K. Abadi Ghadim & David J. Pannell & Michael P. Burton, 2005. "Risk, uncertainty, and learning in adoption of a crop innovation," Agricultural Economics, International Association of Agricultural Economists, vol. 33(1), pages 1-9, July.
    6. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    7. Datar, Gayatri & Del Carpio, Ximena V., 2009. "Are irrigation rehabilitation projects good for poor farmers in Peru ?," Policy Research Working Paper Series 5154, The World Bank.
    8. Barham, Bradford L. & Boucher, Stephen & Carter, Michael R., 1996. "Credit constraints, credit unions, and small-scale producers in Guatemala," World Development, Elsevier, vol. 24(5), pages 793-806, May.
    9. Ximena V. Del Carpio & Norman Loayza & Gayatri Datar, 2011. "Is Irrigation Rehabilitation Good for Poor Farmers? An Impact Evaluation of a Non‐Experimental Irrigation Project in Peru," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 449-473, June.
    10. Barnett, Barry J. & Barrett, Christopher B. & Skees, Jerry R., 2008. "Poverty Traps and Index-Based Risk Transfer Products," World Development, Elsevier, vol. 36(10), pages 1766-1785, October.
    11. Editors The, 2008. "From the Editors," Basic Income Studies, De Gruyter, vol. 3(1), pages 1-1, July.
    12. Barham, Bradford & Carter, Michael R. & Sigelko, Wayne, 1995. "Agro-export production and peasant land access: Examining the dynamic between adoption and accumulation," Journal of Development Economics, Elsevier, vol. 46(1), pages 85-107, February.
    13. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petraud, Jean & Boucher, Stephen & Carter, Michael, 2015. "Competing theories of risk preferences and the demand for crop insurance: Experimental evidence from Peru," 2015 Conference, August 9-14, 2015, Milan, Italy 211383, International Association of Agricultural Economists.
    2. Boris E. Bravo‐Ureta & Mario González‐Flores & William Greene & Daniel Solís, 2021. "Technology and Technical Efficiency Change: Evidence from a Difference in Differences Selectivity Corrected Stochastic Production Frontier Model," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 362-385, January.
    3. Jeremy Jelliffe & Boris E. Bravo-Ureta & C. Michael Deom & David Kalule Okello, 2016. "The Sustainability Of Farmer-Led Multiplication And Dissemination Of High-Yield And Disease Resistant Groundnut Varieties," Zwick Center Research Reports 04, University of Connecticut, Department of Agricultural and Resource Economics, Charles J. Zwick Center for Food and Resource Policy.
    4. Jelliffe, Jeremy L. & Bravo-Ureta, Boris E. & Deom, C. Michael, 2015. "Adaptation and Adoption of Improved Seeds through Extension: Evidence from Farmer-Led Groundnut Multiplication in Uganda," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205980, Agricultural and Applied Economics Association.
    5. Paloyo, Alfredo R. & Rogan, Sally & Siminski, Peter, 2016. "The effect of supplemental instruction on academic performance: An encouragement design experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 57-69.
    6. Bravo-Ureta, Boris E. & Higgins, Daniel & Arslan, Aslihan, 2020. "Irrigation infrastructure and farm productivity in the Philippines: A stochastic Meta-Frontier analysis," World Development, Elsevier, vol. 135(C).
    7. Fresenbet Zeleke & Girma T. Kassie & Jema Haji & Belaineh Legesse, 2021. "Would Market Sheds Improve Market Participation and Earnings of Small Ruminant Keepers? Evidence from Ethiopia," Journal of Agricultural Economics, Wiley Blackwell, vol. 72(2), pages 470-485, June.
    8. Murathi Kiratu, Nixon, 2014. "An Assessment of the Impact of Kilimo Plus Subsidy Program on Smallholder Farmers' Food Security and Income in Nakuru North District, Kenya," Research Theses 243470, Collaborative Masters Program in Agricultural and Applied Economics.
    9. González-Flores, Mario & Bravo-Ureta, Boris E. & Solís, Daniel & Winters, Paul, 2014. "The impact of high value markets on smallholder productivity in the Ecuadorean Sierra: A Stochastic Production Frontier approach correcting for selectivity bias," Food Policy, Elsevier, vol. 44(C), pages 237-247.
    10. Alawode, O.O. & Oluwatayo, I.B., 2019. "Development Outcomes of Fadama III among Fish Farmers in Nigeria: Evidence from Lagos State," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 10-19.
    11. Martey, Edward & Kuwornu, John K.M. & Adjebeng-Danquah, Joseph, 2019. "Estimating the effect of mineral fertilizer use on Land productivity and income: Evidence from Ghana," Land Use Policy, Elsevier, vol. 85(C), pages 463-475.
    12. Onil Banerjee & Kevin Boyle & Cassandra Rogers & Janice Cumberbatch & Barbara Kanninen & Michele H. Lemay & Maja Schling, 2016. "A Retrospective Stated Preference Approach to Assessment of Coastal Infrastructure Investments: An Application to Barbados," IDB Publications (Working Papers) 95856, Inter-American Development Bank.
    13. Giuliani, Elisa & Pietrobelli, Carlo, 2014. "Social Network Analysis Methodologies for the Evaluation of Cluster Development Programs," Papers in Innovation Studies 2014/11, Lund University, CIRCLE - Centre for Innovation Research.
    14. Jeremy L. Jelliffe & Boris E. Bravo-Ureta & C. Michael Deom & David K. Okello, 2018. "Adoption of High-Yielding Groundnut Varieties: The Sustainability of a Farmer-Led Multiplication-Dissemination Program in Eastern Uganda," Sustainability, MDPI, vol. 10(5), pages 1-21, May.
    15. Peter Griffiths, 2015. "Marketing by Controlling Social Discourse: The Fairtrade Case," Economic Affairs, Wiley Blackwell, vol. 35(2), pages 256-271, June.
    16. Kijima, Yoko & Ito, Yukinori & Otsuka, Keijiro, 2012. "Assessing the Impact of Training on Lowland Rice Productivity in an African Setting: Evidence from Uganda," World Development, Elsevier, vol. 40(8), pages 1610-1618.
    17. Banerjee, Onil & Boyle, Kevin & Rogers, Cassandra & Cumberbatch, Janice & Kanninen, Barbara & Lemay, Michele H. & Schling, Maja, 2016. "A Retrospective Stated Preference Approach to Assessment of Coastal Infrastructure Investments: An Application to Barbados," IDB Publications (Working Papers) 7849, Inter-American Development Bank.
    18. Kafle, Kashi & Songsermsawas, Tisorn & Winters, Paul, 2021. "IFAD Research Series Issue 65 - Impacts of agricultural value chain development in a mountainous region: Evidence from Nepal," IFAD Research Series 311008, International Fund for Agricultural Development (IFAD).
    19. Edward Martey & Prince M. Etwire & Isaac Koomson, 2022. "Parental Time Poverty, Child Work and School Attendance in Ghana," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 15(4), pages 1489-1515, August.
    20. Boris E. Bravo-Ureta, 2014. "Stochastic frontiers, productivity effects and development projects," Economics and Business Letters, Oviedo University Press, vol. 3(1), pages 51-58.
    21. Kafle, Kashi & Songsermsawas, T. & Winters, P., 2021. "Impacts of agricultural value chain development in a mountainous region: evidence from Nepal," IWMI Books, Reports H050432, International Water Management Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shawn Cole & Xavier Giné & James Vickery, 2017. "How Does Risk Management Influence Production Decisions? Evidence from a Field Experiment," The Review of Financial Studies, Society for Financial Studies, vol. 30(6), pages 1935-1970.
    2. Kondylis, Florence & Mueller, Valerie, 2012. "Seeing is Believing? Evidence from a Demonstration Plot Experiment in Mozambique," Mozambique Working Paper 1, International Food Policy Research Institute (IFPRI).
    3. Antoine Leblois & Philippe Quirion, 2013. "Agricultural insurances based on meteorological indices: realizations, methods and research challenges," Post-Print hal-00656778, HAL.
    4. Petraud, Jean & Boucher, Stephen & Carter, Michael, 2015. "Competing theories of risk preferences and the demand for crop insurance: Experimental evidence from Peru," 2015 Conference, August 9-14, 2015, Milan, Italy 211383, International Association of Agricultural Economists.
    5. Kondylis, Florence & Mueller, Valerie & Zhu, Jessica, 2017. "Seeing is believing? Evidence from an extension network experiment," Journal of Development Economics, Elsevier, vol. 125(C), pages 1-20.
    6. Awondo, Sebastain N. & Octavio, Ramirez & Colson, Gregory & Kostandini, Genti & Fonsah, Esendugue, 2015. "Self-Protection from Weather Risk using Improved Maize Varieties or Off-Farm Income and the Propensity for Insurance," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 206226, Agricultural and Applied Economics Association.
    7. Michael R. CARTER & Alain de JANVRY & Elisabeth SADOULET & Alexandros SARRIS, 2014. "Index-based weather insurance for developing countries: A review of evidence and a set of propositions for up-scaling," Working Papers P111, FERDI.
    8. Sebastain N. Awondo & Octavio A. Ramirez & Gregory J. Colson & Esendugue G. Fonsah & Genti Kostandini, 2017. "Self†protection from weather risk using improved maize varieties or off†farm income and the propensity for insurance," Agricultural Economics, International Association of Agricultural Economists, vol. 48(1), pages 61-76, January.
    9. Carter, Michael R. & Barham, Bradford L., 1996. "Level playing fields and laissez faire: Postliberal development strategy in inegalitarian agrarian economies," World Development, Elsevier, vol. 24(7), pages 1133-1149, July.
    10. Mai, Nhat Chi, 2013. "Essays on Farm Household Decision-Making: Evidence from Vietnam," OSF Preprints 96azx, Center for Open Science.
    11. Farrin, Katie & Miranda, Mario J., 2015. "A heterogeneous agent model of credit-linked index insurance and farm technology adoption," Journal of Development Economics, Elsevier, vol. 116(C), pages 199-211.
    12. Tesfaye, Wondimagegn & Tirivayi, Nyasha, 2020. "Crop diversity, household welfare and consumption smoothing under risk: Evidence from rural Uganda," World Development, Elsevier, vol. 125(C).
    13. Guizar-Mateos, Isai & Miranda, Mario J. & Gonzalez-Vega, Claudio, 2013. "The Role of Credit and Deposits in the Dynamics of Technology Decisions and Poverty Traps," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 149860, Agricultural and Applied Economics Association.
    14. Terrance Hurley & Jawoo Koo & Kindie Tesfaye, 2018. "Weather risk: how does it change the yield benefits of nitrogen fertilizer and improved maize varieties in sub‐Saharan Africa?," Agricultural Economics, International Association of Agricultural Economists, vol. 49(6), pages 711-723, November.
    15. Bishu, Kinfe & O'Reilly, Seamus & Lahiff, Edward & Steiner, Bodo, 2016. "Cattle farmers’ perceptions of risk and risk management strategies," MPRA Paper 74954, University Library of Munich, Germany.
    16. Freudenreich, Hanna & Musshoff, Oliver & Wiercinski, Ben, 2017. "The Relationship between Farmers' Shock Experiences and their Uncertainty Preferences - Experimental Evidence from Mexico," GlobalFood Discussion Papers 256212, Georg-August-Universitaet Goettingen, GlobalFood, Department of Agricultural Economics and Rural Development.
    17. Khushbu Mishra & Abdoul G. Sam & Gracious M. Diiro & Mario J. Miranda, 2020. "Gender and the dynamics of technology adoption: Empirical evidence from a household‐level panel data," Agricultural Economics, International Association of Agricultural Economists, vol. 51(6), pages 857-870, November.
    18. Mobarak, A. Mushfiq & Rosenzweig, Mark R., 2012. "Selling formal Insurance to the Informally Insured," Center Discussion Papers 121671, Yale University, Economic Growth Center.
    19. Adjognon, Serge G. & Liverpool-Tasie, Lenis Saweda O. & Reardon, Thomas A., 2017. "Agricultural input credit in Sub-Saharan Africa: Telling myth from facts," Food Policy, Elsevier, vol. 67(C), pages 93-105.
    20. Tristan Le Cotty & Elodie Maître d’Hôtel & Raphael Soubeyran & Julie Subervie, 2018. "Linking Risk Aversion, Time Preference and Fertiliser Use in Burkina Faso," Journal of Development Studies, Taylor & Francis Journals, vol. 54(11), pages 1991-2006, November.

    More about this item

    Keywords

    Impact Evaluation; Agriculture; Technology Adoption; Development Effectiveness; Dominican Republic; PACTA; Nicaragua; APAGRO Program; Cotton Farmers; Peru;
    All these keywords.

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets
    • Q18 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Policy; Food Policy; Animal Welfare Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:idb:spdwps:1007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Felipe Herrera Library (email available below). General contact details of provider: https://edirc.repec.org/data/iadbbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.