IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this article or follow this journal

Comparing Treatments across Labor Markets: An Assessment of Nonexperimental Multiple-Treatment Strategies

  • Carlos A. Flores

    (California Polytechnic State University at San Luis Obispo)

  • Oscar A. Mitnik

    (Federal Deposit Insurance Corporation and IZA)

We study the effectiveness of nonexperimental strategies in adjusting for comparison group differences when using data from several programs, each implemented at a different location, to compare their effect if implemented at alternative locations. First, we adjust for individual characteristics differences simultaneously across all groups using unconfoundedness-based and conditional difference-in-difference methods for multiple treatments. Second, we adjust for differences in local economic conditions and stress their role after program participation. Our results show that it is critical to have sufficient overlap across locations in both dimensions and illustrate the difficulty of adjusting for local economic conditions that differ greatly across locations. © 2013 The President and Fellows of Harvard College and the Massachusetts Institute of Technology.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/REST_a_00373
File Function: link to full text PDF
Download Restriction: Access to full text is restricted to subscribers.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Article provided by MIT Press in its journal Review of Economics and Statistics.

Volume (Year): 95 (2013)
Issue (Month): 5 (December)
Pages: 1691-1707

as
in new window

Handle: RePEc:tpr:restat:v:95:y:2013:i:5:p:1691-1707
Contact details of provider: Web page: http://mitpress.mit.edu/journals/

Order Information: Web: http://mitpress.mit.edu/journal-home.tcl?issn=00346535

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Newey, Whitney K., 1994. "Kernel Estimation of Partial Means and a General Variance Estimator," Econometric Theory, Cambridge University Press, vol. 10(02), pages 1-21, June.
  2. Bryan S. Graham & Cristine Campos de Xavier Pinto & Daniel Egel, 2008. "Inverse Probability Tilting for Moment Condition Models with Missing Data," NBER Working Papers 13981, National Bureau of Economic Research, Inc.
  3. Rajeev H. Dehejia & Sadek Wahba, 1998. "Propensity Score Matching Methods for Non-experimental Causal Studies," NBER Working Papers 6829, National Bureau of Economic Research, Inc.
  4. Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. "Using State Administrative Data to Measure Program Performance," Working Papers 0309, Department of Economics, University of Missouri.
  5. Markus Fr–lich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, 04.
  6. Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute for the Study of Labor (IZA).
  7. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
  8. Rajeev H. Dehejia, 2002. "Was there a Riverside miracle? An hierarchical framework for evaluating programs with grouped data," Discussion Papers 0102-15, Columbia University, Department of Economics.
  9. Miana Plesca & Jeffrey Smith, 2007. "Evaluating multi-treatment programs: theory and evidence from the U.S. Job Training Partnership Act experiment," Empirical Economics, Springer, vol. 32(2), pages 491-528, May.
  10. David H Greenberg & Philip K. Robins, 2011. "Have Welfare-to-Work Programs Improved Over Time in Putting Welfare Recipients to Work?," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 64(5), pages 910-920, October.
  11. Charles Michalopoulos & Howard S. Bloom & Carolyn J. Hill, 2004. "Can Propensity-Score Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs?," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 156-179, February.
  12. Matias D. Cattaneo, 2010. "multi-valued treatment effects," The New Palgrave Dictionary of Economics, Palgrave Macmillan.
  13. Dolton, Peter & Smith, Jeffrey A., 2011. "The Impact of the UK New Deal for Lone Parents on Benefit Receipt," IZA Discussion Papers 5491, Institute for the Study of Labor (IZA).
  14. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
  15. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
  16. David G. Blanchflower & Richard B. Freeman, 2000. "Youth Employment and Joblessness in Advanced Countries," NBER Books, National Bureau of Economic Research, Inc, number blan00-1, January.
  17. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
  18. Cattaneo, Matias D., 2010. "Efficient semiparametric estimation of multi-valued treatment effects under ignorability," Journal of Econometrics, Elsevier, vol. 155(2), pages 138-154, April.
  19. Andrew Dyke & Carolyn J. Heinrich & Peter R. Mueser & Kenneth R. Troske & Kyung-Seong Jeon, 2006. "The Effects of Welfare-to-Work Program Activities on Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 567-608, July.
  20. James Heckman & Neil Hohmann & Jeffrey Smith, 1998. "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," UWO Department of Economics Working Papers 9819, University of Western Ontario, Department of Economics.
  21. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
  22. Guido W. Imbens, 1999. "The Role of the Propensity Score in Estimating Dose-Response Functions," NBER Technical Working Papers 0237, National Bureau of Economic Research, Inc.
  23. Kosuke Imai & David A. van Dyk, 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 854-866, January.
  24. Michael Lechner, 2002. "Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(1), pages 59-82.
  25. Shakeeb Khan & Elie Tamer, 2010. "Irregular Identification, Support Conditions, and Inverse Weight Estimation," Econometrica, Econometric Society, vol. 78(6), pages 2021-2042, November.
  26. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
  27. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute for the Study of Labor (IZA).
  28. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
  29. V. Joseph Hotz & Guido W. Imbens & Julie H. Mortimer, 1999. "Predicting the Efficacy of Future Training Programs Using Past Experiences," NBER Technical Working Papers 0238, National Bureau of Economic Research, Inc.
  30. Wang-Sheng Lee, 2013. "Propensity score matching and variations on the balancing test," Empirical Economics, Springer, vol. 44(1), pages 47-80, February.
  31. Friedlander, Daniel & Robins, Philip K, 1995. "Evaluating Program Evaluations: New Evidence on Commonly Used Nonexperimental Methods," American Economic Review, American Economic Association, vol. 85(4), pages 923-37, September.
  32. Frölich, Markus & Heshmati, Almas & Lechner, Michael, 2000. "A Microeconometric Evaluation of Rehabilitation of Long-term Sickness in Sweden," SSE/EFI Working Paper Series in Economics and Finance 373, Stockholm School of Economics, revised 03 Apr 2000.
  33. Alfonso Flores-Lagunes & Arturo Gonzalez & Todd Neumann, 2010. "Learning But Not Earning? The Impact Of Job Corps Training On Hispanic Youth," Economic Inquiry, Western Economic Association International, vol. 48(3), pages 651-667, 07.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:95:y:2013:i:5:p:1691-1707. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Karie Kirkpatrick)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.