IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v175y2012i2p587-617.html
   My bibliography  Save this article

Evaluating continuous training programmes by using the generalized propensity score

Author

Listed:
  • Jochen Kluve
  • Hilmar Schneider
  • Arne Uhlendorff
  • Zhong Zhao

Abstract

This paper assesses the dynamics of treatment effects arising from variation in the duration of training. We use German administrative data that have the extraordinary feature that the amount of treatment varies continuously from 10 days to 395 days (i.e. 13 months). This feature allows us to estimate a continuous dose-response function that relates each value of the dose, i.e. days of training, to the individual post-treatment employment probability (the response). The dose-response function is estimated after adjusting for covariate imbalance using the generalized propensity score, a recently developed method for covariate adjustment under continuous treatment regimes. Our data have the advantage that we can consider both the actual and planned training durations as treatment variables: If only actual durations are observed, treatment effect estimates may be biased because of endogenous exits. Our results indicate an increasing dose-response function for treatments of up to 100 days, which then flattens out. That is, longer training programs do not seem to add an additional treatment effect.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2012. "Evaluating continuous training programmes by using the generalized propensity score," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 587-617, April.
  • Handle: RePEc:bla:jorssa:v:175:y:2012:i:2:p:587-617
    DOI: j.1467-985X.2011.01000.x
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/j.1467-985X.2011.01000.x
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/j.1467-985X.2011.01000.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kosuke Imai & David A. van Dyk, 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 854-866, January.
    2. Jere R. Behrman & Yingmei Cheng & Petra E. Todd, 2004. "Evaluating Preschool Programs When Length of Exposure to the Program Varies: A Nonparametric Approach," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 108-132, February.
    3. Werner Eichhorst & Klaus F. Zimmermann, 2007. "And Then There Were Four...How Many (and Which) Measures of Active Labor Market Policy Do We Still Need?," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 53(3), pages 243-272.
    4. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    5. Blien, Uwe & Hirschenauer, Franziska & Arendt, Manfred & Braun, Hans Jürgen & Gunst, Dieter-Michael & Kilcioglu, Sibel & Kleinschmidt, Helmut & Musati, Martina & Roß, Hermann & Vollkommer, Dieter & We, 2004. "Typisierung von Bezirken der Agenturen für Arbeit (Classification of employment office areas)," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 37(2), pages 146-175.
    6. Jochen Kluve & Boris Augurzky, 2007. "Assessing the performance of matching algorithms when selection into treatment is strong," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 533-557.
    7. Lechner, Michael, 1999. "Identification and Estimation of Causal Effects of Multiple Treatments Under the Conditional Independence Assumption," IZA Discussion Papers 91, Institute of Labor Economics (IZA).
    8. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    9. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    10. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    11. Ulf Rinne & Marc Schneider & Arne Uhlendorff, 2011. "Do the skilled and prime-aged unemployed benefit more from training? Effect heterogeneity of public training programmes in Germany," Applied Economics, Taylor & Francis Journals, vol. 43(25), pages 3465-3494.
    12. Blien, Uwe & Hirschenauer, Franziska & Arendt, Manfred & Braun, Hans Jürgen & Gunst, Dieter-Michael & Kilcioglu, Sibel & Kleinschmidt, Helmut & Musati, Martina & Roß, Hermann & Vollkommer, Dieter & We, 2004. "Typisierung von Bezirken der Agenturen für Arbeit (Classification of employment office areas)," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 37(2), pages 146-175.
    13. Schneider, Hilmar & Uhlendorff, Arne, 2006. "Die Wirkung der Hartz-Reform im Bereich der beruflichen Weiterbildung," IZA Discussion Papers 2255, Institute of Labor Economics (IZA).
    14. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    15. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2012. "Estimating the Effects of Length of Exposure to Instruction in a Training Program: The Case of Job Corps," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 153-171, February.
    16. Flores-Lagunes, Alfonso & Gonzalez, Arturo & Neumann, Todd C., 2007. "Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps," IZA Discussion Papers 2846, Institute of Labor Economics (IZA).
    17. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    18. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    19. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    20. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    21. Jacobi, Lena & Kluve, Jochen, 2007. "Before and after the Hartz reforms: The performance of active labour market policy in Germany," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 40(1), pages 45-64.
    22. Jacobi, Lena & Kluve, Jochen, 2007. "Before and after the Hartz reforms: The performance of active labour market policy in Germany," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 40(1), pages 45-64.
    23. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    24. Conny Wunsch, 2005. "Labour Market Policy in Germany: Institutions, Instruments and Reforms since Unification," University of St. Gallen Department of Economics working paper series 2005 2005-06, Department of Economics, University of St. Gallen.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kluve, Jochen & Schneider, Hilmar & Uhlendorff, Arne & Zhao, Zhong, 2007. "Evaluating Continuous Training Programs Using the Generalized Propensity Score," Ruhr Economic Papers 35, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    2. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    3. repec:zbw:rwirep:0035 is not listed on IDEAS
    4. Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2007. "Evaluating Continuous Training Programs Using the Generalized Propensity Score," Ruhr Economic Papers 0035, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    5. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    6. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2009. "Estimating the Effects of Lenght of Exposure to Traning Program: The Case of Job Corps," Working Papers 2010-3, University of Miami, Department of Economics.
    7. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    8. Huber, Martin & Lechner, Michael & Walter, Thomas & Wunsch, Conny, 2009. "Do German Welfare-to-Work Programmes Reduce Welfare and Increase Work?," CEPR Discussion Papers 7238, C.E.P.R. Discussion Papers.
    9. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    10. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    11. Flores-Lagunes, Alfonso & Gonzalez, Arturo & Neumann, Todd C., 2007. "Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps," IZA Discussion Papers 2846, Institute of Labor Economics (IZA).
    12. Frölich, Markus & Lechner, Michael, 2010. "Exploiting Regional Treatment Intensity for the Evaluation of Labor Market Policies," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1014-1029.
    13. Stefanie Behncke & Markus Frölich & Michael Lechner, 2010. "Unemployed and their caseworkers: should they be friends or foes?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 67-92, January.
    14. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    15. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    16. Michael Lechner & Stephan Wiehler, 2013. "Does the Order and Timing of Active Labour Market Programmes Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(2), pages 180-212, April.
    17. Dehejia Rajeev, 2015. "Experimental and Non-Experimental Methods in Development Economics: A Porous Dialectic," Journal of Globalization and Development, De Gruyter, vol. 6(1), pages 47-69, June.
    18. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2003. "Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS," IFS Working Papers W03/20, Institute for Fiscal Studies.
    19. Marco Caliendo & Jens Hogenacker, 2012. "The German labor market after the Great Recession: successful reforms and future challenges," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-24, December.
    20. Behncke, Stefanie & Frölich, Markus & Lechner, Michael, 2008. "A Caseworker Like Me: Does the Similarity between Unemployed and Caseworker Increase Job Placements?," IZA Discussion Papers 3437, Institute of Labor Economics (IZA).
    21. Lechner, Michael, 2008. "Long-Run Labour Market Effects of Individual Sports Activities," IZA Discussion Papers 3559, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:175:y:2012:i:2:p:587-617. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.