IDEAS home Printed from https://ideas.repec.org/p/ess/wpaper/id2187.html
   My bibliography  Save this paper

Rough Guide to Impact Evaluation of Environmental and Development Programs

Author

Listed:
  • Subhrendu K Pattanayak

    ()

Abstract

This paper is a “rough guide†for evaluation of programs, projects and policies in the environment and development arena. First, a general overview of the what, how, and why of program evaluation, with particular emphasis on the role of control groups, pre and post measurement, and covariate data to define counterfactual scenarios (including formal definition of all terms) are provided. Second, a detailed review with examples of the four main methods for evaluation – randomized experiments, natural experiments, matching methods, and panel-based DID estimators with a description of the pros and cons of each method is given. Finally, the econometric evaluations within the broader context is placed– how can we move beyond estimation of average treatment effects; what do we do under time, resource and data constraints; and when and where should we rely on theory-based evaluations are explained.

Suggested Citation

  • Subhrendu K Pattanayak, 2009. "Rough Guide to Impact Evaluation of Environmental and Development Programs," Working Papers id:2187, eSocialSciences.
  • Handle: RePEc:ess:wpaper:id:2187
    Note: Institutional Papers
    as

    Download full text from publisher

    File URL: http://www.esocialsciences.org/Download/repecDownload.aspx?fname=Document11982009570.2346613.pdf&fcategory=Articles&AId=2187&fref=repec
    Download Restriction: no

    References listed on IDEAS

    as
    1. Edmonds, Eric V., 2002. "Government-initiated community resource management and local resource extraction from Nepal's forests," Journal of Development Economics, Elsevier, vol. 68(1), pages 89-115, June.
    2. Christina Paxson & Norbert R. Schady, 2002. "The Allocation and Impact of Social Funds: Spending on School Infrastructure in Peru," World Bank Economic Review, World Bank Group, vol. 16(2), pages 297-319, August.
    3. Jalan, Jyotsna & Ravallion, Martin, 2003. "Does piped water reduce diarrhea for children in rural India?," Journal of Econometrics, Elsevier, vol. 112(1), pages 153-173, January.
    4. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, Elsevier.
    5. Operations Evaluation Department, 2004. "Monitoring and Evaluation," World Bank Publications, The World Bank, number 23975.
    6. Kenneth Y. Chay & Michael Greenstone, 2005. "Does Air Quality Matter? Evidence from the Housing Market," Journal of Political Economy, University of Chicago Press, vol. 113(2), pages 376-424, April.
    7. Robert S. Chase, 2002. "Supporting Communities in Transition: The Impact of the Armenian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 219-240, August.
    8. Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications, The World Bank, number 13949.
    9. Leach, Gerald, 1992. "The energy transition," Energy Policy, Elsevier, vol. 20(2), pages 116-123, February.
    10. Frondel, Manuel & Schmidt, Christoph M., 2005. "Evaluating environmental programs: The perspective of modern evaluation research," Ecological Economics, Elsevier, vol. 55(4), pages 515-526, December.
    11. Ferraro, Paul J. & McIntosh, Craig & Ospina, Monica, 2007. "The effectiveness of the US endangered species act: An econometric analysis using matching methods," Journal of Environmental Economics and Management, Elsevier, vol. 54(3), pages 245-261, November.
    12. Elizabeth Frankenberg & Douglas McKee & Duncan Thomas, 2005. "Health consequences of forest fires in Indonesia," Demography, Springer;Population Association of America (PAA), vol. 42(1), pages 109-129, February.
    13. Halbert White, 2004. "New Perspectives in Econometric Theory," Books, Edward Elgar Publishing, number 3245, April.
    14. Isabelle Huault & V. Perret & S. Charreire-Petit, 2007. "Management," Post-Print halshs-00337676, HAL.
    15. Kenneth Y. Chay & Michael Greenstone, 2003. "The Impact of Air Pollution on Infant Mortality: Evidence from Geographic Variation in Pollution Shocks Induced by a Recession," The Quarterly Journal of Economics, Oxford University Press, vol. 118(3), pages 1121-1167.
    16. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    17. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 241-274, August.
    18. Menno Pradhan & Laura B. Rawlings, 2002. "The Impact and Targeting of Social Infrastructure Investments: Lessons from the Nicaraguan Social Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 275-295, August.
    19. Laura B. Rawlings & Lynne Sherburne-Benz & Julie van Domelen, 2004. "Evaluating Social Funds : A Cross-Country Analysis of Community Investments," World Bank Publications, The World Bank, number 15057.
    20. Narain, Urvashi & Gupta, Shreekant & van 't Veld, Klaas, 2008. "Poverty and resource dependence in rural India," Ecological Economics, Elsevier, vol. 66(1), pages 161-176, May.
    21. Jalan, Jyotsna & Somanathan, E., 2008. "The importance of being informed: Experimental evidence on demand for environmental quality," Journal of Development Economics, Elsevier, vol. 87(1), pages 14-28, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brooks, N. & Bhojvaid, V. & Jeuland, M.A. & Lewis, J.J. & Patange, O. & Pattanayak, S.K., 2016. "How much do alternative cookstoves reduce biomass fuel use? Evidence from North India," Resource and Energy Economics, Elsevier, vol. 43(C), pages 153-171.
    2. Bauch, Simone C. & Sills, Erin O. & Pattanayak, Subhrendu K., 2014. "Have We Managed to Integrate Conservation and Development? ICDP Impacts in the Brazilian Amazon," World Development, Elsevier, vol. 64(S1), pages 135-148.
    3. Miteva, Daniela A. & Murray, Brian C. & Pattanayak, Subhrendu K., 2015. "Do protected areas reduce blue carbon emissions? A quasi-experimental evaluation of mangroves in Indonesia," Ecological Economics, Elsevier, vol. 119(C), pages 127-135.
    4. Mohebalian, Phillip M. & Aguilar, Francisco X., 2016. "Additionality and design of forest conservation programs: Insights from Ecuador's Socio Bosque Program," Forest Policy and Economics, Elsevier, vol. 71(C), pages 103-114.
    5. repec:eee:forpol:v:84:y:2017:i:c:p:62-71 is not listed on IDEAS
    6. repec:eee:wdevel:v:97:y:2017:i:c:p:298-312 is not listed on IDEAS

    More about this item

    Keywords

    evaluation; environment; development area; econometric; natural and quasi experiments; resource; data constraints; data; theory; DID estimators; south asia;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ess:wpaper:id:2187. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Padma Prakash). General contact details of provider: http://www.esocialsciences.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.