IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/7243.html
   My bibliography  Save this paper

Program evaluation and spillover effects

Author

Listed:
  • Angelucci,M.
  • Di Maro,Vincenzo

Abstract

This paper is a practical guide for researchers and practitioners who want to understand spillover effects in program evaluation. The paper defines spillover effects and discusses why it is important to measure them. It explains how to design a field experiment to measure the average effects of the treatment on eligible and ineligible subjects for the program in the presence of spillover effects. In addition, the paper discusses the use of nonexperimental methods for estimating spillover effects when the experimental design is not a viable option. Evaluations that account for spillover effects should be designed such that they explain the cause of these effects and whom they affect. Such an evaluation design is necessary to avoid inappropriate policy recommendations and neglecting important mechanisms through which the program operates.

Suggested Citation

  • Angelucci,M. & Di Maro,Vincenzo, 2015. "Program evaluation and spillover effects," Policy Research Working Paper Series 7243, The World Bank.
    • Handle: RePEc:wbk:wbrwps:7243
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2015/04/21/090224b082dee59a/1_0/Rendered/PDF/Program0evaluation0and0spillover0effects.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    2. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    3. Sarah Baird & Aislinn Bohren & Berk Ozler & Craig McIntosh, 2014. "Designing Experiments to Measure Spillover Effects," Working Papers 2014-11, The George Washington University, Institute for International Economic Policy.
    4. Townsend, Robert M, 1994. "Risk and Insurance in Village India," Econometrica, Econometric Society, vol. 62(3), pages 539-591, May.
    5. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    6. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    7. Pierre Dubois & Bruno Jullien & Thierry Magnac, 2008. "Formal and Informal Risk Sharing in LDCs: Theory and Empirical Evidence," Econometrica, Econometric Society, vol. 76(4), pages 679-725, July.
    8. Dean Yang, 2008. "Can Enforcement Backfire? Crime Displacement in the Context of Customs Reform in the Philippines," The Review of Economics and Statistics, MIT Press, vol. 90(1), pages 1-14, February.
    9. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    10. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    11. Ciro Avitabile, 2011. "Spillover Effects in Healthcare Programs: Evidence on Social Norms and Information Sharing," CSEF Working Papers 271, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy, revised 14 Mar 2011.
    12. Hirano, Keisuke & Hahn, Jinyong, 2010. "Design of randomized experiments to measure social interaction effects," Economics Letters, Elsevier, vol. 106(1), pages 51-53, January.
    13. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    14. Gustavo J. Bobonis & Frederico Finan, 2009. "Neighborhood Peer Effects in Secondary School Enrollment Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 695-716, November.
    15. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    16. Ciro Avitabile, 2011. "Spillover Effects in Healthcare Programs: Evidence on Social Norms and Information Sharing," CSEF Working Papers 271, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy, revised 14 Mar 2011.
    17. Jeffrey I. Steinfeld, 1999. "Book," Journal of Industrial Ecology, Yale University, vol. 3(4), pages 145-147, October.
    18. Rafael Di Tella & Ernesto Schargrodsky, 2004. "Do Police Reduce Crime? Estimates Using the Allocation of Police Forces After a Terrorist Attack," American Economic Review, American Economic Association, vol. 94(1), pages 115-133, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arthur Alik-Lagrange & Martin Ravallion, 2016. "Social Frictions to Knowledge Diffusion: Evidence from an Information Intervention," NBER Working Papers 21877, National Bureau of Economic Research, Inc.
    2. John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
    3. Rafael Perez Ribas & Fabio Veras Soares & Clarissa Gondim Teixeira & Elydia Silva & Guilherme Issamu Hirata, 2010. "Beyond Cash: Assessing Externality and Behaviour Effects of Non-Experimental Cash Transfers," Working Papers 65, International Policy Centre for Inclusive Growth.
    4. List, John A. & Momeni, Fatemeh & Zenou, Yves, 2019. "Are Estimates of Early Education Programs Too Pessimistic? Evidence from a Large-Scale Field Experiment that Causally Measures Neighbor Effects," Working Paper Series 1293, Research Institute of Industrial Economics.
    5. Zenou, Yves & List, John & Momeni, Fatemeh, 2019. "Are Estimates of Early Education Programs Too Pessimistic? Evidence from a Large-Scale Field Experiment that Causally Measures," CEPR Discussion Papers 13725, C.E.P.R. Discussion Papers.
    6. Huber, Martin & Steinmayr, Andreas, 2017. "A framework for separating individual treatment effects from spillover, interaction, and general equilibrium effects," FSES Working Papers 481, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    7. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2014. "Designing Experiments to Measure Spillover Effects," PIER Working Paper Archive 14-032, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    8. Olivia D�Aoust & Olivier Sterck & Philip Verwimp, 2013. "Buying Peace: The Mirage of Demobilizing Rebels," HiCN Working Papers 145, Households in Conflict Network.
    9. Bobonis, Gustavo J. & Castro, Roberto & Morales, Juan S., 2015. "Conditional Cash Transfers for Women and Spousal Violence: Evidence of the Long-Term Relationship from the Oportunidades Program in Rural Mexico," IDB Publications (Working Papers) 7267, Inter-American Development Bank.
    10. Matteo Bobba & Jérémie Gignoux, 2019. "Neighborhood Effects in Integrated Social Policies," The World Bank Economic Review, World Bank, vol. 33(1), pages 116-139.
    11. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    12. repec:idb:brikps:259 is not listed on IDEAS
    13. Abramitzky, Ran & Lavy, Victor & Pérez, Santiago, 2021. "The long-term spillover effects of changes in the return to schooling," Journal of Public Economics, Elsevier, vol. 196(C).
    14. Gustavo J Bobonis & Roberto Castro & Juan S Morales, 2020. "Legal Reforms, Conditional Cash Transfers, and Intimate Partner Violence: Evidence from Mexico," Working Papers tecipa-678, University of Toronto, Department of Economics.
    15. Rafael P. Ribas, 2014. "Liquidity Constraints, Informal Financing, and Entrepreneurship: Direct and Indirect Effects of a Cash Transfer Programme," Working Papers 131, International Policy Centre for Inclusive Growth.
    16. DiTraglia, Francis J. & García-Jimeno, Camilo & O’Keeffe-O’Donovan, Rossa & Sánchez-Becerra, Alejandro, 2023. "Identifying causal effects in experiments with spillovers and non-compliance," Journal of Econometrics, Elsevier, vol. 235(2), pages 1589-1624.
    17. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    18. Dario Tortarolo & Guillermo Cruces & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    19. Matteo Bobba & Jérémie Gignoux, 2014. "Neighborhood effects and take-up of transfers in integrated social policies: Evidence from Progresa," PSE Working Papers halshs-00646590, HAL.
    20. Jeffrey A. Flory, 2011. "Micro-Savings & Informal Insurance in Villages: How Financial Deepening Affects Safety Nets of the Poor, A Natural Field Experiment," Working Papers 2011-008, Becker Friedman Institute for Research In Economics.
    21. Gordon B. Dahl & Katrine V. L?ken & Magne Mogstad, 2014. "Peer Effects in Program Participation," American Economic Review, American Economic Association, vol. 104(7), pages 2049-2074, July.

    More about this item

    Keywords

    Disease Control&Prevention; Science Education; Labor Policies; Scientific Research&Science Parks; Population Policies;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D62 - Microeconomics - - Welfare Economics - - - Externalities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:7243. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.