IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/93.html
   My bibliography  Save this paper

Going beyond LATE: Bounding Average Treatment Effects of Job Corps Training

Author

Listed:
  • Chen, Xuan
  • Flores, Carlos A.
  • Flores-Lagunes, Alfonso

Abstract

We derive nonparametric sharp bounds on average treatment effects with an instrumental variable (IV) and use them to evaluate the effectiveness of the Job Corps training program for disadvantaged youth. We focus on the population average treatment effect (ATE) and the average treatment effect on the treated (ATT), which are parameters not point identified with an IV under heterogeneous treatment effects. The main assumptions employed to bound the ATE and ATT are monotonicity in the treatment of the average outcomes of specified subpopulations, and mean dominance assumptions across the potential outcomes of these subpopulations. Importantly, the direction of the mean dominance assumptions can be informed from data, and some of our bounds do not require an outcome with bounded support. We employ these bounds to assess the effectiveness of Job Corps using data from a randomized social experiment with non-compliance (a common feature of social experiments). Our empirical results indicate that the effect of Job Corps on eligible applicants (the target population) four years after randomization is to increase weekly earnings and employment by at least $24:61 and 4:3 percentage points, respectively, and to decrease yearly dependence on public welfare benefits by at least $84:29. Furthermore, the effect of Job Corps on participants (the treated population) is to increase weekly earnings by between $28:67 and $43:47, increase employment by between 4:9 and 9:3 percentage points, and decrease public benefits received by between $108:72 and $140:29. Finally, some of our results point to positive average effects of Job Corps on the labor market outcomes of those individuals who decide not to enroll in Job Corps regardless of their treatment assignment (the so-called never takers), suggesting that these individuals would benefit from participating in Job Corps.

Suggested Citation

  • Chen, Xuan & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2017. "Going beyond LATE: Bounding Average Treatment Effects of Job Corps Training," GLO Discussion Paper Series 93, Global Labor Organization (GLO).
  • Handle: RePEc:zbw:glodps:93
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/163002/1/GLO-DP-0093.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. Charles F. Manski, 1997. "Monotone Treatment Response," Econometrica, Econometric Society, vol. 65(6), pages 1311-1334, November.
    3. Alfonso Flores‐Lagunes & Arturo Gonzalez & Todd Neumann, 2010. "Learning But Not Earning? The Impact Of Job Corps Training On Hispanic Youth," Economic Inquiry, Western Economic Association International, vol. 48(3), pages 651-667, July.
    4. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    5. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    6. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107016064.
    7. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    8. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107638105.
    9. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    10. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    11. Carlos A. Flores & Alfonso Flores-Lagunes, 2010. "Nonparametric Partial Identification of Causal Net and Mechanism Average Treatment Effects," Working Papers 2010-25, University of Miami, Department of Economics.
    12. Joshua D. Angrist, 2004. "Treatment effect heterogeneity in theory and practice," Economic Journal, Royal Economic Society, vol. 114(494), pages 52-83, March.
    13. Robert A. Moffitt, 2003. "The Temporary Assistance for Needy Families Program," NBER Chapters, in: Means-Tested Transfer Programs in the United States, pages 291-364, National Bureau of Economic Research, Inc.
    14. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    15. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    16. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    17. Keisuke Hirano & Jack R. Porter, 2012. "Impossibility Results for Nondifferentiable Functionals," Econometrica, Econometric Society, vol. 80(4), pages 1769-1790, July.
    18. Chiburis, Richard C., 2010. "Semiparametric bounds on treatment effects," Journal of Econometrics, Elsevier, vol. 159(2), pages 267-275, December.
    19. Card, David, 1999. "The causal effect of education on earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 30, pages 1801-1863, Elsevier.
    20. van Ours, Jan C., 2004. "The locking-in effect of subsidized jobs," Journal of Comparative Economics, Elsevier, vol. 32(1), pages 37-55, March.
    21. Martin Huber & Lukas Laffers & Giovanni Mellace, 2017. "Sharp IV Bounds on Average Treatment Effects on the Treated and Other Populations Under Endogeneity and Noncompliance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 56-79, January.
    22. Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Partial Identification of Local Average Treatment Effects With an Invalid Instrument," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 534-545, October.
    23. Robert A. Moffitt, 2003. "Means-Tested Transfer Programs in the United States," NBER Books, National Bureau of Economic Research, Inc, number moff03-1, March.
    24. Maria Bampasidou & Carlos A. Flores & Alfonso Flores-Lagunes & Daniel J. Parisian, 2014. "The Role of Degree Attainment in the Differential Impact of Job Corps on Adolescents and Young Adults," Research in Labor Economics, in: Factors Affecting Worker Well-being: The Impact of Change in the Labor Market, volume 40, pages 113-156, Emerald Group Publishing Limited.
    25. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    26. Andrew Chesher, 2010. "Instrumental Variable Models for Discrete Outcomes," Econometrica, Econometric Society, vol. 78(2), pages 575-601, March.
    27. Jay Bhattacharya & Azeem M. Shaikh & Edward Vytlacil, 2008. "Treatment Effect Bounds under Monotonicity Assumptions: An Application to Swan-Ganz Catheterization," American Economic Review, American Economic Association, vol. 98(2), pages 351-356, May.
    28. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    29. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    30. repec:mpr:mprres:2952 is not listed on IDEAS
    31. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2008. "Does Job Corps Work? Impact Findings from the National Job Corps Study," American Economic Review, American Economic Association, vol. 98(5), pages 1864-1886, December.
    32. Bhattacharya, Jay & Shaikh, Azeem M. & Vytlacil, Edward, 2012. "Treatment effect bounds: An application to Swan–Ganz catheterization," Journal of Econometrics, Elsevier, vol. 168(2), pages 223-243.
    33. Hahn, Jinyong, 2010. "Bounds on ATE with discrete outcomes," Economics Letters, Elsevier, vol. 109(1), pages 24-27, October.
    34. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    35. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    36. Paolo Frumento & Fabrizia Mealli & Barbara Pacini & Donald B. Rubin, 2012. "Evaluating the Effect of Training on Wages in the Presence of Noncompliance, Nonemployment, and Missing Outcome Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 450-466, June.
    37. German Blanco & Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 659-701.
    38. Machado, Cecilia & Shaikh, Azeem M. & Vytlacil, Edward J., 2019. "Instrumental variables and the sign of the average treatment effect," Journal of Econometrics, Elsevier, vol. 212(2), pages 522-555.
    39. Azeem M. Shaikh & Edward J. Vytlacil, 2011. "Partial Identification in Triangular Systems of Equations With Binary Dependent Variables," Econometrica, Econometric Society, vol. 79(3), pages 949-955, May.
    40. O. Ashenfelter & D. Card (ed.), 1999. "Handbook of Labor Economics," Handbook of Labor Economics, Elsevier, edition 1, volume 3, number 3.
    41. repec:pri:rpdevs:deaton_instruments_randomization_learning_all_04april_2010 is not listed on IDEAS
    42. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107016057.
    43. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2012. "Estimating the Effects of Length of Exposure to Instruction in a Training Program: The Case of Job Corps," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 153-171, February.
    44. repec:mpr:mprres:6097 is not listed on IDEAS
    45. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107674165.
    46. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    47. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    48. Martin Huber & Giovanni Mellace, 2010. "Sharp IV bounds on average treatment effects under endogeneity and noncompliance," University of St. Gallen Department of Economics working paper series 2010 2010-31, Department of Economics, University of St. Gallen.
    49. James J. Heckman & Edward J. Vytlacil, 2000. "Instrumental Variables, Selection Models, and Tight Bounds on the Average Treatment Effect," NBER Technical Working Papers 0259, National Bureau of Economic Research, Inc.
    50. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    51. Peter Z. Schochet & John Burghardt & Steven Glazerman, 2001. "National Job Corps Study: The Impacts of Job Corps on Participants' Employment and Related Outcomes," Mathematica Policy Research Reports db6c4204b8e1408bb0c6289ec, Mathematica Policy Research.
    52. Xuan Chen & Carlos A. Flores, 2015. "Bounds on Treatment Effects in the Presence of Sample Selection and Noncompliance: The Wage Effects of Job Corps," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 523-540, October.
    53. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107627314.
    54. Robert A. Moffitt, 2003. "Introduction to "Means-Tested Transfer Programs in the United States"," NBER Chapters, in: Means-Tested Transfer Programs in the United States, pages 1-14, National Bureau of Economic Research, Inc.
    55. Acemoglu,Daron & Arellano,Manuel & Dekel,Eddie (ed.), 2013. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9781107016040.
    56. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    57. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    58. repec:mpr:mprres:2951 is not listed on IDEAS
    59. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    60. Zvi Eckstein & Kenneth I. Wolpin, 1999. "Why Youths Drop Out of High School: The Impact of Preferences, Opportunities, and Abilities," Econometrica, Econometric Society, vol. 67(6), pages 1295-1340, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vitor Possebom, 2019. "Sharp Bounds for the Marginal Treatment Effect with Sample Selection," Papers 1904.08522, arXiv.org.
    2. Anthony Strittmatter, 2019. "Heterogeneous Earnings Effects of the Job Corps by Gender Earnings: A Translated Quantile Approach," Papers 1908.08721, arXiv.org.
    3. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    4. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.
    5. Domenico Depalo & Santiago Pereda-Fernández, 2020. "Consistent estimates of the public/private wage gap," Empirical Economics, Springer, vol. 58(6), pages 2937-2947, June.
    6. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    7. Strittmatter, Anthony, 2019. "Heterogeneous earnings effects of the job corps by gender: A translated quantile approach," Labour Economics, Elsevier, vol. 61(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. German Blanco & Xuan Chen & Carlos A. Flores & Alfonso Flores-Lagunes, 2020. "Bounds on Average and Quantile Treatment Effects on Duration Outcomes Under Censoring, Selection, and Noncompliance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 901-920, October.
    2. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    3. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.
    4. Amin, Vikesh & Flores, Carlos A. & Flores-Lagunes, Alfonso & Parisian, Daniel J., 2016. "The effect of degree attainment on arrests: Evidence from a randomized social experiment," Economics of Education Review, Elsevier, vol. 54(C), pages 259-273.
    5. Lina Zhang & David T. Frazier & D. S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Papers 2009.02642, arXiv.org, revised Sep 2022.
    6. Strittmatter, Anthony, 2019. "Heterogeneous earnings effects of the job corps by gender: A translated quantile approach," Labour Economics, Elsevier, vol. 61(C).
    7. Kitagawa, Toru, 2021. "The identification region of the potential outcome distributions under instrument independence," Journal of Econometrics, Elsevier, vol. 225(2), pages 231-253.
    8. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae Lee, 2018. "The identification power of smoothness assumptions in models with counterfactual outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 617-642, July.
    9. Bhattacharya, Jay & Shaikh, Azeem M. & Vytlacil, Edward, 2012. "Treatment effect bounds: An application to Swan–Ganz catheterization," Journal of Econometrics, Elsevier, vol. 168(2), pages 223-243.
    10. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    11. Pedro Carneiro & Michael Lokshin & Nithin Umapathi, 2017. "Average and Marginal Returns to Upper Secondary Schooling in Indonesia," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 16-36, January.
    12. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    13. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    14. Kaspar Wüthrich, 2020. "A Comparison of Two Quantile Models With Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 443-456, April.
    15. Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vitor, 2023. "Identifying marginal treatment effects in the presence of sample selection," Journal of Econometrics, Elsevier, vol. 234(2), pages 565-584.
    16. Anthony Strittmatter, 2019. "Heterogeneous Earnings Effects of the Job Corps by Gender Earnings: A Translated Quantile Approach," Papers 1908.08721, arXiv.org.
    17. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    18. Xintong Wang & Alfonso Flores-Lagunes, 2022. "Conscription and Military Service: Do They Result in Future Violent and Nonviolent Incarcerations and Recidivism?," Journal of Human Resources, University of Wisconsin Press, vol. 57(5), pages 1715-1757.
    19. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae (Simon) Lee, 2014. "The identification power of smoothness assumptions in models with counterfactual outcomes," CeMMAP working papers 17/14, Institute for Fiscal Studies.
    20. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Keywords

    Training programs; Program evaluation; Average treatment effects; Bounds; Instrumental variables;
    All these keywords.

    JEL classification:

    • J30 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:93. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.