Program Evaluation and Spillover Effects
AbstractThis note defines what spillover effects are, why it is important to measure them, and how to design a field experiment that will enable researchers to measure the average effects of the treatment in the presence of spillover effects on subjects both eligible and ineligible for the program. In addition, it discusses how to use nonexperimental methods for estimating spillover effects when the experimental design is not a viable option. Several practical examples are provided to show how spillover effects can be estimated. Evaluations that account for spillover effects should be designed in such a way that they explain both the cause of these effects and who is affected by them. Failure to have such an evaluation design can result in wrong policy recommendations and in the neglect of important mechanisms through which the program operates. To estimate the direct and indirect effect of a program, one has to use control groups that are not affected by the program either directly or indirectly. This often means selecting the control groups from different geographic units (e.g. the village or school). In order to understand the mechanisms that cause spillover effects one has to think about competing explanations and collect data on relevant outcomes. In many cases, unveiling the mechanisms behind the spillover effects results in a better understanding of how the program works in general.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD) in its series SPD Working Papers with number 1003.
Date of creation: May 2010
Date of revision:
Impact Evaluation; Spillover Effects; Field Experiments; Data Collection; Indirect Treatment Effect; Program Mechanisms;
Other versions of this item:
- C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
- D62 - Microeconomics - - Welfare Economics - - - Externalities
This paper has been announced in the following NEP Reports:
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Paul Winters & Susana Sitja Rubio, 2010.
"Evaluating the Impact of Regional Development Programs,"
SPD Working Papers
1004, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
- Paul Winters & Susana Sitja Rubio, 2010. "Evaluating the Impact of Regional Development Programs," IDB Publications 8421, Inter-American Development Bank.
- Martin Persson, U. & Alpízar, Francisco, 2013. "Conditional Cash Transfers and Payments for Environmental Services—A Conceptual Framework for Explaining and Judging Differences in Outcomes," World Development, Elsevier, vol. 43(C), pages 124-137.
- Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
- Paul Winters & Lina Salazar & Alessandro Maffioli, 2010.
"Designing Impact Evaluations for Agricultural Projects,"
8378, Inter-American Development Bank.
- Paul Winters & Lina Salazar & Alessandro Maffioli, 2010. "Designing Impact Evaluations for Agricultural Projects," SPD Working Papers 1007, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
- Roy, Manan & Millimet, Daniel L. & Tchernis, Rusty, 2010.
"Federal Nutrition Programs and Childhood Obesity: Inside the Black Box,"
IZA Discussion Papers
5316, Institute for the Study of Labor (IZA).
- Manan Roy & Daniel Millimet & Rusty Tchernis, 2012. "Federal nutrition programs and childhood obesity: inside the black box," Review of Economics of the Household, Springer, vol. 10(1), pages 1-38, March.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Luis Daniel Martinez).
If references are entirely missing, you can add them using this form.