IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Rough Guide to Impact Evaluation of Environmental and Development Programs

  • Subhrendu K Pattanayak


This paper is a “rough guide†for evaluation of programs, projects and policies in the environment and development arena. First, a general overview of the what, how, and why of program evaluation, with particular emphasis on the role of control groups, pre and post measurement, and covariate data to define counterfactual scenarios (including formal definition of all terms) are provided. Second, a detailed review with examples of the four main methods for evaluation – randomized experiments, natural experiments, matching methods, and panel-based DID estimators with a description of the pros and cons of each method is given. Finally, the econometric evaluations within the broader context is placed– how can we move beyond estimation of average treatment effects; what do we do under time, resource and data constraints; and when and where should we rely on theory-based evaluations are explained.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by eSocialSciences in its series Working Papers with number id:2187.

in new window

Date of creation: Aug 2009
Date of revision:
Handle: RePEc:ess:wpaper:id:2187
Note: Institutional Papers
Contact details of provider: Web page:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Kenneth Y. Chay & Michael Greenstone, 2005. "Does Air Quality Matter? Evidence from the Housing Market," Journal of Political Economy, University of Chicago Press, vol. 113(2), pages 376-424, April.
  2. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, Elsevier.
  3. Leach, Gerald, 1992. "The energy transition," Energy Policy, Elsevier, vol. 20(2), pages 116-123, February.
  4. Kenneth Y. Chay & Michael Greenstone, 2003. "The Impact Of Air Pollution On Infant Mortality: Evidence From Geographic Variation In Pollution Shocks Induced By A Recession," The Quarterly Journal of Economics, MIT Press, vol. 118(3), pages 1121-1167, August.
  5. Jalan, Jyotsna & Ravallion, Martin, 2001. "Does piped water reduce diarrhea for children in rural India ?," Policy Research Working Paper Series 2664, The World Bank.
  6. Menno Pradhan & Laura B. Rawlings, 2002. "The Impact and Targeting of Social Infrastructure Investments: Lessons from the Nicaraguan Social Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 275-295, August.
  7. Jalan, Jyotsna & Somanathan, E., 2008. "The importance of being informed: Experimental evidence on demand for environmental quality," Journal of Development Economics, Elsevier, vol. 87(1), pages 14-28, August.
  8. Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications, The World Bank, number 13949.
  9. Frondel, Manuel & Schmidt, Christoph M., 2005. "Evaluating environmental programs: The perspective of modern evaluation research," Ecological Economics, Elsevier, vol. 55(4), pages 515-526, December.
  10. Christina Paxson & Norbert R. Schady, 2002. "The Allocation and Impact of Social Funds: Spending on School Infrastructure in Peru," World Bank Economic Review, World Bank Group, vol. 16(2), pages 297-319, August.
  11. Edmonds, Eric V., 2002. "Government-initiated community resource management and local resource extraction from Nepal's forests," Journal of Development Economics, Elsevier, vol. 68(1), pages 89-115, June.
  12. Isabelle Huault & V. Perret & S. Charreire-Petit, 2007. "Management," Post-Print halshs-00337676, HAL.
  13. Laura B. Rawlings & Lynne Sherburne-Benz & Julie van Domelen, 2004. "Evaluating Social Funds : A Cross-Country Analysis of Community Investments," World Bank Publications, The World Bank, number 15057.
  14. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 241-274, August.
  15. Halbert White, 2004. "New Perspectives in Econometric Theory," Books, Edward Elgar, number 3245, April.
  16. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
  17. Elizabeth Frankenberg & Douglas McKee & Duncan Thomas, 2005. "Health consequences of forest fires in Indonesia," Demography, Springer, vol. 42(1), pages 109-129, February.
  18. Robert S. Chase, 2002. "Supporting Communities in Transition: The Impact of the Armenian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 219-240, August.
  19. Ferraro, Paul J. & McIntosh, Craig & Ospina, Monica, 2007. "The effectiveness of the US endangered species act: An econometric analysis using matching methods," Journal of Environmental Economics and Management, Elsevier, vol. 54(3), pages 245-261, November.
  20. Narain, Urvashi & Gupta, Shreekant & van 't Veld, Klaas, 2008. "Poverty and resource dependence in rural India," Ecological Economics, Elsevier, vol. 66(1), pages 161-176, May.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ess:wpaper:id:2187. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Padma Prakash)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.