IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp3362.html
   My bibliography  Save this paper

Heterogeneous Impacts in PROGRESA

Author

Listed:
  • Djebbari, Habiba

    (Aix-Marseille University)

  • Smith, Jeffrey A.

    (University of Wisconsin-Madison)

Abstract

The “common effect” model in program evaluation assumes that all treated individuals have the same impact from a program. Our paper contributes to the recent literature that tests and goes beyond the common effect model by investigating impact heterogeneity using data from the experimental evaluation of the Mexican conditional cash transfer program PROGRESA. Our analysis builds upon and extends that in Heckman, Smith and Clements (1997) and more recent studies of quantile treatment effects and random coefficient models. We find strong evidence of systematic (i.e. subgroup) variation in impacts in PROGRESA and modest evidence of heterogeneous impacts conditional on the systematic impacts. We find evidence against the perfect positive dependence assumption that underlies the interpretation of quantile treatment effects as impacts at quantiles of the untreated outcome distribution. Our paper concludes with a discussion of the policy relevance of our findings and of heterogeneous impacts more generally.

Suggested Citation

  • Djebbari, Habiba & Smith, Jeffrey A., 2008. "Heterogeneous Impacts in PROGRESA," IZA Discussion Papers 3362, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp3362
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp3362.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Emmanuel Skoufias & Susan Wendy Parker, 2001. "Conditional Cash Transfers and Their Impact on Child Work and Schooling: Evidence from the PROGRESA Program in Mexico," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2001), pages 45-96, August.
    2. Justin Tobias, 2006. "Estimation, Learning and Parameters of Interest in a Multiple Outcome Selection Model," Econometric Reviews, Taylor & Francis Journals, vol. 25(1), pages 1-40.
    3. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    4. repec:mpr:mprres:3005 is not listed on IDEAS
    5. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    6. Yannis Bilias & Roger Koenker, 2001. "Quantile regression for duration data: A reappraisal of the Pennsylvania Reemployment Bonus Experiments," Empirical Economics, Springer, vol. 26(1), pages 199-220.
    7. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 487-535.
    8. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    9. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    10. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    11. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    12. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    13. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    14. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 63-84, Spring.
    15. Mark C. Berger & Dan Black & Jeffrey Smith, 2000. "Evaluating Profiling as a Means of Allocating Government Services," University of Western Ontario, Departmental Research Report Series 200018, University of Western Ontario, Department of Economics.
    16. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    17. James Heckman & Edward Vytlacil, 1998. "Instrumental Variables Methods for the Correlated Random Coefficient Model: Estimating the Average Rate of Return to Schooling When the Return is Correlated with Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 33(4), pages 974-987.
    18. Christopher J. O'Leary & Paul T. Decker & Stephen A. Wandner, 2002. "Targeting Reemployment Bonuses," Book chapters authored by Upjohn Institute researchers, in: Stephen A. Wandner & Randall W. Eberts & Christopher J. O'Leary (ed.), Targeting Employment Services, chapter 6, pages 161-182, W.E. Upjohn Institute for Employment Research.
    19. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    20. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    21. Ana C. Dammert, 2009. "Heterogeneous Impacts of Conditional Cash Transfers: Evidence from Nicaragua," Economic Development and Cultural Change, University of Chicago Press, vol. 58(1), pages 53-83, October.
    22. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2003. "Is the Threat of Reemployment Services More Effective Than the Services Themselves? Evidence from Random Assignment in the UI System," American Economic Review, American Economic Association, vol. 93(4), pages 1313-1327, September.
    23. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    24. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
    25. Brendstrup, Bjarne & Paarsch, Harry J., 2007. "Semiparametric identification and estimation in multi-object, English auctions," Journal of Econometrics, Elsevier, vol. 141(1), pages 84-108, November.
    26. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    27. Campo, Juan Carlos Chavez-Martin del, 2006. "Does Conditionality Generate Heterogeneity and Regressivity in Program Impacts? The Progresa Experience," Working Papers 127042, Cornell University, Department of Applied Economics and Management.
    28. Skoufias, Emmanuel & Parker, Susan W., 2001. "Conditional cash transfers and their impact on child work and schooling," FCND briefs 123, International Food Policy Research Institute (IFPRI).
    29. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    30. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    31. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    32. Heckman, James J, 1996. "Randomization as an Instrumental Variable: Notes," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 336-341, May.
    33. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-275, October.
    34. repec:cdl:indrel:245292 is not listed on IDEAS
    35. Skoufias, Emmanuel & Davis, Benjamin & de la Vega, Sergio, 2001. "Targeting the Poor in Mexico: An Evaluation of the Selection of Households into PROGRESA," World Development, Elsevier, vol. 29(10), pages 1769-1784, October.
    36. Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico:," Research reports 139, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Ana C. Dammert, 2009. "Heterogeneous Impacts of Conditional Cash Transfers: Evidence from Nicaragua," Economic Development and Cultural Change, University of Chicago Press, vol. 58(1), pages 53-83, October.
    3. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    4. Christian Durán, 2004. "Evaluación microeconométrica de las políticas públicas de empleo: aspectos metodológicos," Hacienda Pública Española / Review of Public Economics, IEF, vol. 170(3), pages 107-133, september.
    5. Justine Burns & Malcolm Kewsell & Rebecca Thornton, 2009. "Evaluating the Impact of Health Programmes," SALDRU Working Papers 40, Southern Africa Labour and Development Research Unit, University of Cape Town.
    6. Sørensen, Kenneth Lykke, 2016. "Heterogeneous impacts on earnings from an early effort in labor market programs," Labour Economics, Elsevier, vol. 41(C), pages 266-279.
    7. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    8. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.
    9. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    10. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    11. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    12. Angelucci, Manuela & De Giorgi, Giacomo & Rangel, Marcos A. & Rasul, Imran, 2010. "Family networks and school enrolment: Evidence from a randomized social experiment," Journal of Public Economics, Elsevier, vol. 94(3-4), pages 197-221, April.
    13. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    14. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    15. Gamper-Rabindran, Shanti & Khan, Shakeeb & Timmins, Christopher, 2010. "The impact of piped water provision on infant mortality in Brazil: A quantile panel data approach," Journal of Development Economics, Elsevier, vol. 92(2), pages 188-200, July.
    16. Paul J. Gertler & Sebastian W. Martinez & Marta Rubio-Codina, 2012. "Investing Cash Transfers to Raise Long-Term Living Standards," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 164-192, January.
    17. Flores-Lagunes, Alfonso & Gonzalez, Arturo & Neumann, Todd C., 2007. "Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps," IZA Discussion Papers 2846, Institute of Labor Economics (IZA).
    18. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    19. Antecol, Heather & Eren, Ozkan & Ozbeklik, Serkan, 2013. "The effect of Teach for America on the distribution of student achievement in primary school: Evidence from a randomized experiment," Economics of Education Review, Elsevier, vol. 37(C), pages 113-125.
    20. Achyuta Adhvaryu & Teresa Molina & Anant Nyshadham & Jorge Tamayo, 2023. "Helping Children Catch Up: Early Life Shocks and the PROGRESA Experiment," The Economic Journal, Royal Economic Society, vol. 134(657), pages 1-22.

    More about this item

    Keywords

    randomized experiment; quantile treatment effects; heterogeneous impacts;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp3362. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.