IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp2368.html
   My bibliography  Save this paper

Estimating ATT Effects with Non-Experimental Data and Low Compliance

Author

Listed:
  • Angelucci, Manuela

    (University of Texas at Austin)

  • Attanasio, Orazio

    (Yale University)

Abstract

In this paper we discuss several methodological issues related to the identification and estimation of Average Treatment on the Treated (ATT) effects in the presence of low compliance. We consider non-experimental data consisting of a treatment group, where a program is implemented, and of a control group that is non-randomly drawn, where the program is not offered. Estimating the ATT involves tackling both the non-random assignment of the program and the non-random participation among treated individuals. We argue against standard matching approaches to deal with the latter issue because they are based on the assumption that we observe all variables that determine both participation and outcome. Instead, we propose an IV-type estimator which exploits the fact that the ATT can be expressed as the Average Intent to Treat divided by the participation share, in the absence of spillover effects. We propose a semi-parametric estimator that couples the flexibility of matching estimators with a standard Instrumental Variable approach. We discuss the different assumptions necessary for the identification of the ATT with each of the two approaches, and we provide an empirical application by estimating the effect of the Mexican conditional cash transfer program, Oportunidades, on food consumption.

Suggested Citation

  • Angelucci, Manuela & Attanasio, Orazio, 2006. "Estimating ATT Effects with Non-Experimental Data and Low Compliance," IZA Discussion Papers 2368, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp2368
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp2368.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hoddinott, John & Skoufias, Emmanuel, 2004. "The Impact of PROGRESA on Food Consumption," Economic Development and Cultural Change, University of Chicago Press, vol. 53(1), pages 37-61, October.
    2. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    3. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Paul J. Gertler & Sebastian W. Martinez & Marta Rubio-Codina, 2012. "Investing Cash Transfers to Raise Long-Term Living Standards," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 164-192, January.
    6. Robert J. LaLonde, 1995. "The Promise of Public Sector-Sponsored Training Programs," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 149-168, Spring.
    7. Joshua D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    8. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Gabriela Farfan Betran & Genoni,Maria Eugenia & Rubalcava,Luis & Teruel,Graciela M. & Thomas,Duncan, 2022. "Scaling Up Oportunidades and ItsImpact on Child Nutrition," Policy Research Working Paper Series 10088, The World Bank.
    2. Manuela Angelucci & Orazio Attanasio, 2009. "Oportunidades: Program Effect on Consumption, Low Participation, and Methodological Issues," Economic Development and Cultural Change, University of Chicago Press, vol. 57(3), pages 479-506, April.
    3. de Crombrugghe, D.P.I. & Espinoza, H. & Heijke, J.A.M., 2010. "Job-training programmes with low completion rates: the case of Projoven-Peru," ROA Research Memorandum 004, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    4. Cavatassi, Ramina & González-Flores, Mario & Winters, Paul & Andrade-Piedra, Jorge & Espinosa, Patricio & Thiele, Graham, 2016. "Linking smallholders to the new agricultural economy: The case of the plataformas de concertación in Ecuador," IFPRI book chapters, in: Devaux, André & Torero, Maximo & Donovan, Jason & Horton, Douglas E. (ed.), Innovation for inclusive value-chain development: Successes and challenges, chapter 12, pages 375-410, International Food Policy Research Institute (IFPRI).
    5. Chakravarty, Shubha & Lundberg, Mattias & Nikolov, Plamen & Zenker, Juliane, 2019. "Vocational training programs and youth labor market outcomes: Evidence from Nepal," Journal of Development Economics, Elsevier, vol. 136(C), pages 71-110.
    6. Asadul Islam Author-X-Name-Asadul, 2008. "Who Benefits From Microfinance? The Impact Evaluation Of Large Scale Programs In Bangladesh," Monash Economics Working Papers 29/08, Monash University, Department of Economics.
    7. Chakravarty,Shubha & Lundberg,Mattias K. A. & Nikolov, Plamen V. & Zenker,Juliane & Chakravarty,Shubha & Lundberg,Mattias K. A. & Zenker,Juliane & Nikolov, Plamen V., 2016. "The role of training programs for youth employment in Nepal : impact evaluation report on the employment fund," Policy Research Working Paper Series 7656, The World Bank.
    8. Pettersson, Jan & Wikström, Johan, 2013. "Peeing out of poverty? Human fertilizer and the productivity of farming households," Working Paper Series 2013:1, Uppsala University, Department of Economics.
    9. Ibanez, Marcela & Dietrich, Stephan, 2015. "Impact of Weather Insurance on Small Scale Farmers: A Natural Experiment," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112887, Verein für Socialpolitik / German Economic Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Guillermo Cruces & Sebastian Galiani, 2003. "Generalizing the Causal Effect of Fertility on Female Labor Supply," Labor and Demography 0310002, University Library of Munich, Germany.
    3. Joshua D. Angrist, 2004. "Treatment effect heterogeneity in theory and practice," Economic Journal, Royal Economic Society, vol. 114(494), pages 52-83, March.
    4. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    5. McLaughlin, Joanne Song, 2017. "Does Communist party membership pay? Estimating the economic returns to party membership in the labor market in China," Journal of Comparative Economics, Elsevier, vol. 45(4), pages 963-983.
    6. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    7. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    8. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    9. Cockx, Bart & Bardoulat, Isabelle, 1999. "Vocational Training: Does it speed up the Transition Rate out of Unemployment ?," LIDAM Discussion Papers IRES 1999032, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    10. Manuela Angelucci & Orazio Attanasio, 2009. "Oportunidades: Program Effect on Consumption, Low Participation, and Methodological Issues," Economic Development and Cultural Change, University of Chicago Press, vol. 57(3), pages 479-506, April.
    11. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    12. Bryan S. Graham & James Powell, 2008. "Identification and Estimation of 'Irregular' Correlated Random Coefficient Models," NBER Working Papers 14469, National Bureau of Economic Research, Inc.
    13. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    14. Silvia Moler‐Zapata & Richard Grieve & Anirban Basu & Stephen O’Neill, 2023. "How does a local instrumental variable method perform across settings with instruments of differing strengths? A simulation study and an evaluation of emergency surgery," Health Economics, John Wiley & Sons, Ltd., vol. 32(9), pages 2113-2126, September.
    15. Flores-Lagunes, Alfonso & Gonzalez, Arturo & Neumann, Todd C., 2007. "Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps," IZA Discussion Papers 2846, Institute of Labor Economics (IZA).
    16. Asadul Islam Author-X-Name-Asadul, 2008. "Who Benefits From Microfinance? The Impact Evaluation Of Large Scale Programs In Bangladesh," Monash Economics Working Papers 29/08, Monash University, Department of Economics.
    17. Dambala Gelo & Steven F. Koch, 2011. "The Welfare Effect of Common Property Forestry Rights:Evidence from Ethiopian Villages," Working Papers 201123, University of Pretoria, Department of Economics.
    18. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    19. Awotide, Bola Amoke & Awoyemi, Taiwo Timothy & Diagne, Aliou & Ojehomon, Vivian E.T., 2012. "Impact of Seed Voucher System on Rice Farmers’ Welfare in Nigeria: A Randomized Control Trial Approach," 2012 Conference, August 18-24, 2012, Foz do Iguacu, Brazil 124995, International Association of Agricultural Economists.
    20. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.

    More about this item

    Keywords

    program evaluation; treatment effects;

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp2368. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.