IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19446.html
   My bibliography  Save this paper

Does Federally-Funded Job Training Work? Nonexperimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms

Author

Listed:
  • Fredrik Andersson
  • Harry J. Holzer
  • Julia I. Lane
  • David Rosenblum
  • Jeffrey Smith

Abstract

We study the job training provided under the US Workforce Investment Act (WIA) to adults and dislocated workers in two states. Our substantive contributions center on impacts estimated non-experimentally using administrative data. These impacts compare WIA participants who do and do not receive training. In addition to the usual impacts on earnings and employment, we link our state data to the Longitudinal Employer Household Dynamics (LEHD) data at the U.S. Census Bureau, which allows us to estimate impacts on the characteristics of the firms at which participants find employment. We find moderate positive impacts on employment, earnings and desirable firm characteristics for adults, but not for dislocated workers. Our primary methodological contribution consists of assessing the value of the additional conditioning information provided by the LEHD relative to the data available in state Unemployment Insurance (UI) earnings records. We find that value to be zero.

Suggested Citation

  • Fredrik Andersson & Harry J. Holzer & Julia I. Lane & David Rosenblum & Jeffrey Smith, 2013. "Does Federally-Funded Job Training Work? Nonexperimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms," NBER Working Papers 19446, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:19446
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19446.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jeremy Lise & Shannon Seitz & Jeffrey Smith, 2003. "Equilibrium Policy Experiments and the Evaluation of Social Programs," Working Papers 1012, Queen's University, Department of Economics.
    2. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    3. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    4. Markus Frlich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    5. Matias Busso & John DiNardo & Justin McCrary, 2014. "New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 885-897, December.
    6. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    7. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.
    8. repec:adr:anecst:y:2008:i:91-92:p:17 is not listed on IDEAS
    9. Kornfeld, Robert & Bloom, Howard S, 1999. "Measuring Program Impacts on Earnings and Employment: Do Unemployment Insurance Wage Reports from Employers Agree with Surveys of Individuals?," Journal of Labor Economics, University of Chicago Press, vol. 17(1), pages 168-197, January.
    10. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    11. Fredriksson, Peter & Johansson, Per, 2002. "Program evaluation and random program starts," Working Paper Series 2003:1, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    12. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    13. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    14. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2006. "National Job Corps Study and Longer-Term Follow-Up Study: Impact and Benefit-Cost Findings Using Survey and Summary Earnings Records Data," Mathematica Policy Research Reports 8074f4e4499d4e2ab1de13747, Mathematica Policy Research.
    15. Dolton, Peter & Smith, Jeffrey A., 2011. "The Impact of the UK New Deal for Lone Parents on Benefit Receipt," IZA Discussion Papers 5491, Institute for the Study of Labor (IZA).
    16. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    17. Bev Dahlby, 2008. "The Marginal Cost of Public Funds: Theory and Applications," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262042509, January.
    18. Devin G. Pope & Justin R. Sydnor, 2011. "Implementing Anti-discrimination Policies in Statistical Profiling Models," American Economic Journal: Economic Policy, American Economic Association, vol. 3(3), pages 206-231, August.
    19. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    20. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    21. Irma Perez-Johnson & Quinn Moore & Robert Santillano, 2011. "Improving the Effectiveness of Individual Training Accounts: Long-Term Findings from an Experimental Evaluation of Three Service Delivery Models (Appendices)," Mathematica Policy Research Reports 8184db8183ac4abca4b55c4f0, Mathematica Policy Research.
    22. repec:mpr:mprres:5840 is not listed on IDEAS
    23. David H. Greenberg & Charles Michalopoulos & Philip K. Robins, 2004. "What Happens To The Effects Of Government-Funded Training Programs Over Time?," Journal of Human Resources, University of Wisconsin Press, vol. 39(1).
    24. Emily Oster, 2013. "Unobservable Selection and Coefficient Stability: Theory and Validation," NBER Working Papers 19054, National Bureau of Economic Research, Inc.
    25. Daniel Friedlander & David H. Greenberg & Philip K. Robins, 1997. "Evaluating Government Training Programs for the Economically Disadvantaged," Journal of Economic Literature, American Economic Association, vol. 35(4), pages 1809-1855, December.
    26. Cahuc, Pierre & Le Barbanchon, Thomas, 2010. "Labor market policy evaluation in equilibrium: Some lessons of the job search and matching model," Labour Economics, Elsevier, vol. 17(1), pages 196-205, January.
    27. John M. Abowd & Bryce E. Stephens & Lars Vilhuber & Fredrik Andersson & Kevin L. McKinney & Marc Roemer & Simon Woodcock, 2009. "The LEHD Infrastructure Files and the Creation of the Quarterly Workforce Indicators," NBER Chapters,in: Producer Dynamics: New Evidence from Micro Data, pages 149-230 National Bureau of Economic Research, Inc.
    28. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    29. Robert J. LaLonde, 1995. "The Promise of Public Sector-Sponsored Training Programs," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 149-168, Spring.
    30. Irma Perez-Johnson & Quinn Moore & Robert Santillano, 2011. "Improving the Effectiveness of Individual Training Accounts: Long-Term Findings from an Experimental Evaluation of Three Service Delivery Models," Mathematica Policy Research Reports ddb772ea2aa242a1a74579eb0, Mathematica Policy Research.
    31. David H. Greenberg & Charles Michalopoulos & Philip K. Robin, 2006. "Do experimental and nonexperimental evaluations give different answers about the effectiveness of government-funded training programs?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(3), pages 523-552.
    32. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute for the Study of Labor (IZA).
    33. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    34. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    35. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    36. Black, Dan A. & Smith, J.A.Jeffrey A., 2004. "How robust is the evidence on the effects of college quality? Evidence from matching," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 99-124.
    37. Carolyn Heinrich & Peter Mueser & Kenneth Troske & Kyung-Seong Jeon & Daver Kahvecioglu, 2013. "Do Public Employment and Training Programs Work?," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-23, December.
    38. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute for the Study of Labor (IZA).
    39. Burt S. Barnow & David Greenberg, 2015. "Do Estimated Impacts on Earnings Depend on the Source of the Data Used to Measure Them? Evidence From Previous Social Experiments," Evaluation Review, , vol. 39(2), pages 179-228, April.
    40. David W. Stevens, 2007. "Employment that is not covered by state unemployment insurance Laws," Longitudinal Employer-Household Dynamics Technical Papers 2007-04, Center for Economic Studies, U.S. Census Bureau.
    41. repec:mpr:mprres:7217 is not listed on IDEAS
    42. Harry J. Holzer & Julia I. Lane & Lars Vilhuber & Henry Jackson & George Putnam, 2001. "Escaping poverty for low-wage workers The role of employer characteristics and changes," Longitudinal Employer-Household Dynamics Technical Papers 2001-02, Center for Economic Studies, U.S. Census Bureau.
    43. Geoffrey L. Wallace & Robert Haveman, 2007. "The implications of differences between employer and worker employment|earnings reports for policy evaluation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 737-754.
    44. John M. Abowd & Paul A. Lengermann & Kevin L. McKinney, 2002. "The Measurement of Human Capital in the U.S. Economy," Longitudinal Employer-Household Dynamics Technical Papers 2002-09, Center for Economic Studies, U.S. Census Bureau, revised Mar 2003.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters,in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234 National Bureau of Economic Research, Inc.
    2. Michele Campolieti & Morley Gunderson & Jeffrey Smith, 2014. "The effect of vocational rehabilitation on the employment outcomes of disability insurance beneficiaries: new evidence from Canada," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 3(1), pages 1-29, December.
    3. Marchand, J. & Smeeding, T., 2016. "Poverty and Aging," Handbook of the Economics of Population Aging, Elsevier.
      • Marchand, Joseph & Smeeding, Timothy, 2016. "Poverty and Aging," Working Papers 2016-11, University of Alberta, Department of Economics, revised 20 Nov 2016.
    4. Fitzenberger, Bernd & Furdas, Marina & Sajons, Christoph, 2016. "End-of-year spending and the long-run employment effects of training programs for the unemployed," ZEW Discussion Papers 16-084, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
    5. repec:bla:indres:v:56:y:2017:i:1:p:40-72 is not listed on IDEAS

    More about this item

    JEL classification:

    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19446. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.