IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc14/100500.html
   My bibliography  Save this paper

Decomposing a Matching Estimation - Correlated Unobserved non-random Selection, Substitution, and Causal Effects in a Large Scale ALMP Program in Germany

Author

Listed:
  • Fervers, Lukas
  • Brändle, Tobias
  • Webel, Carina

Abstract

We analyse the treatment effects of a large scale German active labour market program. Modellprojekte Bürgerarbeit is a modified public employment scheme, with an activation period as a first step. Using data from individual employment records we perform matching estimations to analyse the treatment effect on the treated. In the cross-section estimation, we find reemployment rates to about 10%-points higher in the treatment group. Additionally, we consider that this effect might be upward biased due to correlated time-invariant unobserved heterogeneity and negative spill-over effects on non-participants. Therefore, we combine matching with difference-in-difference estimation (to control for unobserved heterogeneity), Doing so, we estimate a slightly lower treatment effect (about 8%-points). Finally, we use untreated individuals from regions with treated individuals (pseudo-treatment), and compare them to untreated individuals from regions without treatment. The negative pseudo-treatment effect lies around 2%-points, indicating negative spill-over effects. We conclude that the 10%-point difference from the matching estimation can be decomposed into a causal effect (6%-points), correlated unobserved heterogeneity and negative spill-over effects (2%-points each).

Suggested Citation

  • Fervers, Lukas & Brändle, Tobias & Webel, Carina, 2014. "Decomposing a Matching Estimation - Correlated Unobserved non-random Selection, Substitution, and Causal Effects in a Large Scale ALMP Program in Germany," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100500, Verein für Socialpolitik / German Economic Association.
  • Handle: RePEc:zbw:vfsc14:100500
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/100500/1/VfS_2014_pid_846.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    2. Gesine Stephan & André Pahnke, 2011. "The Relative Effectiveness Of Selected Active Labor Market Programs: An Empirical Investigation For Germany," Manchester School, University of Manchester, vol. 79(6), pages 1262-1293, December.
    3. Cavaco, Sandra & Fougère, Denis & Pouget, Julien, 2005. "Estimating the Effect of a Retraining Program for Displaced Workers on Their Transition to Permanent Jobs," IZA Discussion Papers 1513, Institute of Labor Economics (IZA).
    4. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    5. repec:adr:anecst:y:2012:i:107-108:p:7 is not listed on IDEAS
    6. Reinhard Hujer & Paulo J.M. Rodrigues & Katja Wolf, 2009. "Estimating the macroeconomic effects of active labour market policies using spatial econometric methods," International Journal of Manpower, Emerald Group Publishing Limited, vol. 30(7), pages 648-671, November.
    7. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    8. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    9. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    10. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    11. Bruno Crépon & Marc Ferracci & Denis Fougere, 2012. "Training the Unemployed in France: How Does it Affect Unemployment Duration and Recurrence?," Annals of Economics and Statistics, GENES, issue 107-108, pages 175-199.
    12. repec:iab:iabfda:201001(de is not listed on IDEAS
    13. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    14. Andrew Dyke & Carolyn J. Heinrich & Peter R. Mueser & Kenneth R. Troske & Kyung-Seong Jeon, 2006. "The Effects of Welfare-to-Work Program Activities on Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 567-608, July.
    15. Stephen Kastoryano & Bas van der Klaauw, 2022. "Dynamic evaluation of job search assistance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 227-241, March.
    16. Núria Rodríguez-Planas & Benus Jacob, 2010. "Evaluating active labor market programs in Romania," Empirical Economics, Springer, vol. 38(1), pages 65-84, February.
    17. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    18. Marco Caliendo & Reinhard Hujer & Stephan L. Thomsen, 2008. "The employment effects of job-creation schemes in Germany: A microeconometric evaluation," Advances in Econometrics, in: Modelling and Evaluating Treatment Effects in Econometrics, pages 381-428, Emerald Group Publishing Limited.
    19. Michael Lechner & Ruth Miquel & Conny Wunsch, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, Verein für Socialpolitik, vol. 8(4), pages 468-509, November.
    20. Lammers, Marloes & Bloemen, Hans & Hochguertel, Stefan, 2013. "Job search requirements for older unemployed: Transitions to employment, early retirement and disability benefits," European Economic Review, Elsevier, vol. 58(C), pages 31-57.
    21. Dorner, Matthias & Heining, Jörg & Jacobebbinghaus, Peter & Seth, Stefan, 2010. "Stichprobe der Integrierten Arbeitsmarktbiografien (SIAB) 1975-2008," FDZ Datenreport. Documentation on Labour Market Data 201001_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    22. Laura Larsson, 2003. "Evaluation of Swedish Youth Labor Market Programs," Journal of Human Resources, University of Wisconsin Press, vol. 38(4).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    2. Wulfgramm, Melike & Fervers, Lukas, 2013. "Unemployment and Subsequent Employment Stability: Does Labour Market Policy Matter?," IZA Discussion Papers 7193, Institute of Labor Economics (IZA).
    3. Muller, Paul & van der Klaauw, Bas & Heyma, Arjan, 2017. "Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance," IZA Discussion Papers 10531, Institute of Labor Economics (IZA).
    4. Bernhard Boockmann & Tobias Brändle, 2019. "Coaching, Counseling, Case‐Working: Do They Help the Older Unemployed Out of Benefit Receipt and Back Into the Labor Market?," German Economic Review, Verein für Socialpolitik, vol. 20(4), pages 436-468, November.
    5. Sarah Bernhard & Thomas Kruppe, 2012. "Effectiveness of Further Vocational Training in Germany – Empirical Findings for Persons Receiving Means-tested Unemployment Benefits," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 132(4), pages 501-526.
    6. Paul Muller & Bas van der Klaauw & Arjan Heyma, 2020. "Comparing econometric methods to empirically evaluate activation programs for job seekers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 526-547, August.
    7. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    8. Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
    9. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    10. Leduc, Elisabeth & Tojerow, Ilan, 2020. "Subsidizing Domestic Services as a Tool to Fight Unemployment: Effectiveness and Hidden Costs," IZA Discussion Papers 13544, Institute of Labor Economics (IZA).
    11. Kelly, Elish & McGuinness, Seamus & O'Connell, Philip J., 2011. "What Can Active Labour Market Policies Do?," Papers EC1, Economic and Social Research Institute (ESRI).
    12. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    13. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    14. Heyer, Gerd & Koch, Susanne & Stephan, Gesine & Wolff, Joachim, 2011. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011 (Evaluation of active labor market programs : a summary of recent results for the German program refor," IAB-Discussion Paper 201117, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    15. Lechner, Michael & Wunsch, Conny & Scioch, Patrycja, 2013. "Do Firms Benefit from Active Labour Market Policies?," IZA Discussion Papers 7614, Institute of Labor Economics (IZA).
    16. Eva m. Berger & Guenther Koenig & Henning Müller & Felix Schmidt & Daniel Schunk, 2017. "Self-Regulation Training and Job Search Effort: A Natural Field Experiment within an Active Labor Market Program," Working Papers 1712, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    17. Alessio Brown & Johannes Koettl, 2015. "Active labor market programs - employment gain or fiscal drain?," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-36, December.
    18. Gerd Heyer & Susanne Koch & Gesine Stephan & Joachim Wolff, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 45(1), pages 41-62, March.
    19. Sandra Cavaco & Denis Fougère & Julien Pouget, 2013. "Estimating the effect of a retraining program on the re-employment rate of displaced workers," Empirical Economics, Springer, vol. 44(1), pages 261-287, February.
    20. Marwa Sahnoun & Chokri Abdennadher, 2018. "The assessment of active labor market policies: evidence from OECD countries," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 35(2), pages 257-283, August.

    More about this item

    JEL classification:

    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc14:100500. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.