IDEAS home Printed from https://ideas.repec.org/a/udc/esteco/v38y2011i1p129-168.html
   My bibliography  Save this article

Evaluating the Chile Solidario program: results using the Chile Solidario panel and the administrative databases

Author

Listed:
  • Fernando Hoces de la Guardia
  • Andrés Hojman
  • Osvaldo Larrañaga

Abstract

This paper presents the results of a three-year evaluation performed on the first cohorts of Chile Solidario, the most important anti-poverty program in Chile. The paper presents a description of the program, emphasizing the mechanism by which people were admitted into the program. We then propose evaluation strategies and discuss their validity. The final evaluation is conducted using a Matching estimator, and we discuss the principles surrounding the potential for this to be a valid evaluation method. The initial results using the Chile Solidario Panel suggest that the program had positive effects on psychosocial welfare and on take-up of subsidies and social programs. However, it is not possible to obtain reliable results due to data shortcomings, particularly the lack of baseline data. In order to solve the problem, we generated a database using six years of administrative data, including around 1,000,000 family records per year. A method for overcoming the treatment substitution problem is discussed and implemented. Results are much more robust than those of the Chile Solidario Panel and show small, but clearly positive effects for several variables, especially the number of workers in the family, the percentage of workers in the famly and the employment of the head of the family.

Suggested Citation

  • Fernando Hoces de la Guardia & Andrés Hojman & Osvaldo Larrañaga, 2011. "Evaluating the Chile Solidario program: results using the Chile Solidario panel and the administrative databases," Estudios de Economia, University of Chile, Department of Economics, vol. 38(1 Year 20), pages 129-168, June.
  • Handle: RePEc:udc:esteco:v:38:y:2011:i:1:p:129-168
    as

    Download full text from publisher

    File URL: http://www.econ.uchile.cl/uploads/publicacion/f7896162f51ede24f0659feeb81a0baae2f1121f.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    2. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    3. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    4. Alberto Abadie & David Drukker & Jane Leber Herr & Guido W. Imbens, 2004. "Implementing matching estimators for average treatment effects in Stata," Stata Journal, StataCorp LP, vol. 4(3), pages 290-311, September.
    5. James Heckman & Neil Hohmann & Jeffrey Smith & Michael Khoo, 2000. "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 115(2), pages 651-694.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Margherita Scarlato & Giorgio d'Agostino & Francesca Capparucci, 2016. "Evaluating CCTs from a Gender Perspective: The Impact of Chile Solidario on Women's Employment Prospect," Journal of International Development, John Wiley & Sons, Ltd., vol. 28(2), pages 177-197, March.
    2. Rodríguez Torres, Omar, 2022. "The productive role of social policy," MERIT Working Papers 2022-010, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    3. Guido Neidhöfer & Miguel Niño‐Zarazúa, 2019. "The Long(er)‐Term Impacts of Chile Solidario on Human Capital and Labor Income," Population and Development Review, The Population Council, Inc., vol. 45(S1), pages 209-244, December.
    4. Santiago Garganta & Joaquín Zentner, 2020. "Efecto de la Doble Escolaridad sobre la Participación Laboral Femenina en República Dominicana," Asociación Argentina de Economía Política: Working Papers 4348, Asociación Argentina de Economía Política.
    5. Guido Neidhöfer & Miguel Niño‐Zarazúa, 2019. "The Long(er)‐Term Impacts of Chile Solidario on Human Capital and Labor Income," Population and Development Review, The Population Council, Inc., vol. 45(S1), pages 209-244, December.
    6. Leibbrandt, Murray & Lilenstein, Kezia & Shenker, Callie & Woolard, Ingrid, 2013. "The influence of social transfers on labour supply: A South African and international review," SALDRU Working Papers 112, Southern Africa Labour and Development Research Unit, University of Cape Town.
    7. Gatenio Gabel, Shirley, 2012. "Social protection and children in developing countries," Children and Youth Services Review, Elsevier, vol. 34(3), pages 537-545.
    8. Barrientos Armando & Villa Juan Miguel, 2015. "Evaluating Antipoverty Transfer Programmes in Latin America and Sub-Saharan Africa. Better Policies? Better Politics?," Journal of Globalization and Development, De Gruyter, vol. 6(1), pages 147-179, June.
    9. Bruno Martorano & Marco Sanfilippo, 2012. "Innovative Features in Conditional Cash Transfers: An impact evaluation of Chile Solidario on households and children," Papers inwopa656, Innocenti Working Papers.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    3. Szulc, Adam, 2009. "A matching estimator of household equivalence scales," Economics Letters, Elsevier, vol. 103(2), pages 81-83, May.
    4. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    5. David McKenzie & John Gibson & Steven Stillman, 2010. "How Important Is Selection? Experimental vs. Non-Experimental Measures of the Income Gains from Migration," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 913-945, June.
    6. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    7. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    8. McKenzie, David & Gibson, John & Stillman, Steven, 2006. "How important is selection ? Experimental versus non-experimental measures of the income gains from migration," Policy Research Working Paper Series 3906, The World Bank.
    9. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    10. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    11. Lina Cardona-Sosa & Leonardo Morales, 2015. "Efectos laborales de los servicios de cuidado infantil: evidencia del programa Buen Comienzo," Borradores de Economia 882, Banco de la Republica de Colombia.
    12. David McKenzie & John Gibson & Steven Stillman, 2006. "How Important is Selection? Experimental vs Non-experimental Measures of the Income Gains of Migration," Working Papers 06_02, Motu Economic and Public Policy Research.
    13. List John A. & Millimet Daniel L, 2008. "The Market: Catalyst for Rationality and Filter of Irrationality," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-55, November.
    14. Alvaro Garcia-Marin & Nico Voigtländer, 2019. "Exporting and Plant-Level Efficiency Gains: It's in the Measure," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1777-1825.
    15. Grit Muehler & Michael Beckmann & Bernd Schauenberg, 2007. "The returns to continuous training in Germany: new evidence from propensity score matching estimators," Review of Managerial Science, Springer, vol. 1(3), pages 209-235, November.
    16. Advani, Arun & Sloczynski, Tymon, 2013. "Mostly Harmless Simulations? On the Internal Validity of Empirical Monte Carlo Studies," IZA Discussion Papers 7874, Institute of Labor Economics (IZA).
    17. Bart, COCKX & Jean, RIES, 2004. "The Exhaustion of Unemployment Benefits in Belgium. Does it Enhance the Probability of Employment ?," LIDAM Discussion Papers IRES 2004016, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    18. Maria Cervini-Pla & Judit Vall Castelló, 2018. "The earnings and employment losses before entering the disability system," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(8), pages 1111-1128, November.
    19. repec:kap:iaecre:v:17:y:2011:i:1:p:89-100 is not listed on IDEAS
    20. Erlend E. Bø & Elin Halvorsen & Thor O. Thoresen, 2019. "Heterogeneity of the Carnegie Effect," Journal of Human Resources, University of Wisconsin Press, vol. 54(3), pages 726-759.
    21. Maria Cervini-Plá & Jose I. Silva & Judit Vall Castelló, 2016. "Estimating the income loss of disabled individuals: the case of Spain," Empirical Economics, Springer, vol. 51(2), pages 809-829, September.

    More about this item

    Keywords

    Matching; Extreme poverty; Impact evaluation; Treatment substitution; Administrative data.;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • I30 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - General
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:udc:esteco:v:38:y:2011:i:1:p:129-168. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Verónica Kunze (email available below). General contact details of provider: https://edirc.repec.org/data/deuclcl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.