IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp9033.html
   My bibliography  Save this paper

Program Evaluation and Spillover Effects

Author

Listed:
  • Angelucci, Manuela

    () (University of Texas at Austin)

  • Di Maro, Vincenzo

    () (Jobs Knowledge Platform and World Bank)

Abstract

This paper is a practical guide for researchers and practitioners who want to understand spillover effects in program evaluation. The paper defines spillover effects and discusses why it is important to measure them. It explains how to design a field experiment to measure the average effects of the treatment on eligible and ineligible subjects for the program in the presence of spillover effects. In addition, the paper discusses the use of nonexperimental methods for estimating spillover effects when the experimental design is not a viable option. Evaluations that account for spillover effects should be designed such that they explain the cause of these effects and whom they affect. Such an evaluation design is necessary to avoid inappropriate policy recommendations and neglecting important mechanisms through which the program operates.

Suggested Citation

  • Angelucci, Manuela & Di Maro, Vincenzo, 2015. "Program Evaluation and Spillover Effects," IZA Discussion Papers 9033, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp9033
    as

    Download full text from publisher

    File URL: http://ftp.iza.org/dp9033.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 128(2), pages 531-580.
    2. Pierre Dubois & Bruno Jullien & Thierry Magnac, 2008. "Formal and Informal Risk Sharing in LDCs: Theory and Empirical Evidence," CESifo Working Paper Series 2184, CESifo.
    3. Hirano, Keisuke & Hahn, Jinyong, 2010. "Design of randomized experiments to measure social interaction effects," Economics Letters, Elsevier, vol. 106(1), pages 51-53, January.
    4. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    5. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    6. Sarah Baird & Aislinn Bohren & Berk Ozler & Craig McIntosh, 2014. "Designing Experiments to Measure Spillover Effects," Working Papers 2014-11, The George Washington University, Institute for International Economic Policy.
    7. Townsend, Robert M, 1994. "Risk and Insurance in Village India," Econometrica, Econometric Society, vol. 62(3), pages 539-591, May.
    8. Gustavo J. Bobonis & Frederico Finan, 2009. "Neighborhood Peer Effects in Secondary School Enrollment Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 695-716, November.
    9. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    10. Pierre Dubois & Bruno Jullien & Thierry Magnac, 2008. "Formal and Informal Risk Sharing in LDCs: Theory and Empirical Evidence," Econometrica, Econometric Society, vol. 76(4), pages 679-725, July.
    11. Dean Yang, 2008. "Can Enforcement Backfire? Crime Displacement in the Context of Customs Reform in the Philippines," The Review of Economics and Statistics, MIT Press, vol. 90(1), pages 1-14, February.
    12. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, Oxford University Press, vol. 119(1), pages 249-275.
    13. Jeffrey I. Steinfeld, 1999. "Book," Journal of Industrial Ecology, Yale University, vol. 3(4), pages 145-147, October.
    14. Rafael Di Tella & Ernesto Schargrodsky, 2004. "Do Police Reduce Crime? Estimates Using the Allocation of Police Forces After a Terrorist Attack," American Economic Review, American Economic Association, vol. 94(1), pages 115-133, March.
    15. Ciro Avitabile, 2011. "Spillover Effects in Healthcare Programs: Evidence on Social Norms and Information Sharing," CSEF Working Papers 271, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy, revised 14 Mar 2011.
    16. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Manuela Angelucci & Silvia Prina & Heather Royer & Anya Samek, 2015. "When Incentives Backfire: Spillover Effects in Food Choice," NBER Working Papers 21481, National Bureau of Economic Research, Inc.
    2. Castro, Marcelo Araújo & Mattos, Enlinson & Regatieri, Rebeca, 2015. "Fiscal interactions and spillover effects of a federal grant to Brazilian municipalities," Textos para discussão 388, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    3. Schmidt, Emily & Tadesse, Fanaye, 2017. "The sustainable land management program in the Ethiopian highlands: An evaluation of its impact on crop production:," ESSP working papers 103, International Food Policy Research Institute (IFPRI).
    4. Victoria Castillo & Lucas Figal Garone & Alessandro Maffioli & Lina Salazar, 2015. "Tourism Policy, a Big Push to Employment: Evidence from a Multiple Synthetic Control Approach," IDB Publications (Working Papers) 87973, Inter-American Development Bank.
    5. Ibanez, Marcela & Blackman, Allen, 2016. "Is Eco-Certification a Win–Win for Developing Country Agriculture? Organic Coffee Certification in Colombia," World Development, Elsevier, vol. 82(C), pages 14-27.
    6. Githiomi, Caroline & Muriithi, Beatrice & Irungu, Patrick & Mwungu, Chris M. & Diiro, Gracious & Affognon, Hippolyte & Mburu, John & Ekesi, Sunday, 2019. "Economic analysis of spillover effects of an integrated pest management (IPM) strategy for suppression of mango fruit fly in Kenya," Food Policy, Elsevier, vol. 84(C), pages 121-132.
    7. Martin Persson, U. & Alpízar, Francisco, 2013. "Conditional Cash Transfers and Payments for Environmental Services—A Conceptual Framework for Explaining and Judging Differences in Outcomes," World Development, Elsevier, vol. 43(C), pages 124-137.
    8. Arthur Alik-Lagrange & Martin Ravallion, 2016. "Social Frictions to Knowledge Diffusion: Evidence from an Information Intervention," NBER Working Papers 21877, National Bureau of Economic Research, Inc.
    9. Pascaline Dupas & Edward Miguel, 2016. "Impacts and Determinants of Health Levels in Low-Income Countries," NBER Working Papers 22235, National Bureau of Economic Research, Inc.
    10. Miguel Ángel Borrella Mas & Mariano Bosch Mossi & Marcello Sartarelli, 2016. "Non-Contributory Pensions Number-Gender Effects on Poverty and Household Decisions," Working Papers. Serie AD 2016-02, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    11. Beliyou Haile & Carlo Azzarri & Cleo Roberts & David J. Spielman, 2017. "Targeting, bias, and expected impact of complex innovations on developing-country agriculture: evidence from Malawi," Agricultural Economics, International Association of Agricultural Economists, vol. 48(3), pages 317-326, May.
    12. Manan Roy & Daniel Millimet & Rusty Tchernis, 2012. "Federal nutrition programs and childhood obesity: inside the black box," Review of Economics of the Household, Springer, vol. 10(1), pages 1-38, March.
    13. Giuliani, Elisa & Maffioli, Alessandro & Pacheco, Manuel & Pietrobelli, Carlo & Stucchi, Rodolfo, 2014. "Evaluating the Impact of Cluster Development Programs," Papers in Innovation Studies 2014/10, Lund University, CIRCLE - Center for Innovation, Research and Competences in the Learning Economy.
    14. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).

    More about this item

    Keywords

    impact evaluation; spillover effects; field experiments; data collection; Indirect Treatment Effect; program mechanisms;

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D62 - Microeconomics - - Welfare Economics - - - Externalities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp9033. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Holger Hinte). General contact details of provider: http://www.iza.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.