Sensitivity Testing of Net Impact Estimates of Workforce Development Programs Using Administrative Data
AbstractThis paper addresses the question of whether administrative data sources, such as performance monitoring data, can be used for program evaluation purposes. It argues that under certain circumstances, such data can be used. In particular, program performance data that are routinely gathered and monitored by administrators of many workforce development programs meet these circumstances. The paper goes on to demonstrate the point by using administrative data from the state of Washington to examine the net impact on earnings and employment of services provided to adults under the Workforce Investment Act (WIA).Because of a lack of consensus about appropriate net impact estimators, the strategy of this paper is to examine the sensitivity of the results to various estimation techniques. The paper describes the various estimation techniques, and it summarizes the net impact estimates that are generated for the State of Washington. For the most part, the results are fairly stable across the techniques, which the paper argues adds a degree of confidence in them. The final section of the paper offers guidance to policymakers and program administrators who may not be familiar with the technical details of various analytical approaches about how empirical results that may appear to be complex or unstable can be used for program improvement.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoPaper provided by W.E. Upjohn Institute for Employment Research in its series Upjohn Working Papers and Journal Articles with number 08-139.
Date of creation: Feb 2008
Date of revision:
incumbant; worker; on-the-job training; ojt; hollenbeck;
Find related papers by JEL classification:
- J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
- J48 - Labor and Demographic Economics - - Particular Labor Markets - - - Particular Labor Markets; Public Policy
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2006.
"Using State Administrative Data to Measure Program Performance,"
0702, Department of Economics, University of Missouri.
- Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
- Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. "Using State Administrative Data to Measure Program Performance," Working Papers 0309, Department of Economics, University of Missouri.
- Mueser, Peter R. & Troske, Kenneth & Gorislavsky, Alexey, 2003. "Using State Administrative Data to Measure Program Performance," IZA Discussion Papers 786, Institute for the Study of Labor (IZA).
- Guido W. Imbens, 2003.
"Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review,"
NBER Technical Working Papers
0294, National Bureau of Economic Research, Inc.
- Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998.
"Characterizing Selection Bias Using Experimental Data,"
NBER Working Papers
6699, National Bureau of Economic Research, Inc.
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
- Christopher J. O'Leary & Randall W. Eberts, 2009. "Employment and Training Policy in the United States during the Economic Crisis," Upjohn Working Papers and Journal Articles 10-161, W.E. Upjohn Institute for Employment Research.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.