IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/3298.html
   My bibliography  Save this paper

Disentangling Treatment Effects of Polish Active Labour Market Policies: Evidence from Matched Samples

Author

Listed:
  • Schmidt, Christoph
  • Kluve, Jochen
  • Lehmann, Hartmut

Abstract

This Paper estimates causal effects of two Polish active labour market policies – Training and Intervention Works – on employment probabilities. Utilizing data from the 18th wave of the Polish Labor Force Survey we discuss three stages of an appropriately designed exact matching procedure. The approach is illustrated using the estimated propensity score as a summary measure of balance. Distributions of pre-treatment labour market status histories show the decisive relevance of employment indicators as determinants of programme participation – a point often ignored in evaluation research. We implement a conditional difference-in-differences estimator of treatment effects based on these individual trinomial sequences of pre-treatment labour market status. Our findings suggest that Training raises employment probability, while Intervention Works seems to lead to a negative treatment effect for men. Furthermore, we find that appropriate subdivision of the matched sample for conditional treatment effect estimation can add considerable insight to the interpretation of results.

Suggested Citation

  • Schmidt, Christoph & Kluve, Jochen & Lehmann, Hartmut, 2002. "Disentangling Treatment Effects of Polish Active Labour Market Policies: Evidence from Matched Samples," CEPR Discussion Papers 3298, C.E.P.R. Discussion Papers.
    • Handle: RePEc:cpr:ceprdp:3298
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP3298
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    2. Kluve, Jochen & Lehmann, Hartmut & Schmidt, Christoph M., 1999. "Active Labor Market Policies in Poland: Human Capital Enhancement, Stigmatization, or Benefit Churning?," Journal of Comparative Economics, Elsevier, vol. 27(1), pages 61-89, March.
    3. Michael Lechner, 2000. "An Evaluation of Public-Sector-Sponsored Continuous Vocational Training Programs in East Germany," Journal of Human Resources, University of Wisconsin Press, vol. 35(2), pages 347-375.
    4. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
    5. Augurzky, Boris & Schmidt, Christoph M., 2001. "The Propensity Score: A Means to An End," IZA Discussion Papers 271, Institute of Labor Economics (IZA).
    6. Card, David & Sullivan, Daniel G, 1988. "Measuring the Effect of Subsidized Training Programs on Movements in and out of Employment," Econometrica, Econometric Society, vol. 56(3), pages 497-530, May.
    7. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    8. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    9. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    10. Marek GÕra & Christoph M. Schmidt, 1998. "Long-term unemployment, unemployment benefits and social assistance: The Polish experience," Empirical Economics, Springer, vol. 23(1/2), pages 55-85.
    11. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    12. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    13. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    14. Schmidt, Christoph M., 1999. "Knowing What Works: The Case for Rigorous Program Evaluation," IZA Discussion Papers 77, Institute of Labor Economics (IZA).
    15. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    16. Puhani, Patrick A, 1998. "Advantage Through Training? A Microeconometric Evaluation of the Employment Effects of Active Labour Market Programmes in Poland," CEPR Discussion Papers 2000, C.E.P.R. Discussion Papers.
    17. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    18. Donald B. Rubin, 1977. "Assignment to Treatment Group on the Basis of a Covariate," Journal of Educational and Behavioral Statistics, , vol. 2(1), pages 1-26, March.
    19. Joshua D. Angrist & Jinyong Hahn, 1999. "When to Control for Covariates? Panel-Asymptotic Results for Estimates of Treatment Effects," NBER Technical Working Papers 0241, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeff Borland & Yi-Ping Tseng, 2004. "Does 'Work for the Dole' Work?," Melbourne Institute Working Paper Series wp2004n14, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    2. Jeff Borland & Yi-Ping Tseng, 2007. "Does a Minimum Job Search Requirement Reduce Time on Unemployment Payments? Evidence from the Jobseeker Diary in Australia," ILR Review, Cornell University, ILR School, vol. 60(3), pages 357-378, April.
    3. Núria Rodríguez-Planas & Jacob Benus, 2007. "Evaluating Active Labor Markets in Romania," UFAE and IAE Working Papers 699.07, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    4. Rodríguez-Planas, Núria, 2007. "What Works Best for Getting the Unemployed Back to Work: Employment Services or Small-Business Assistance Programmes? Evidence from Romania," IZA Discussion Papers 3051, Institute of Labor Economics (IZA).
    5. Betcherman, Gordon & Olivas, Karina & Dar, Amit, 2004. "Impacts of active labor market programs : new evidence from evaluations with particular attention to developing and transition countries," Social Protection Discussion Papers and Notes 29142, The World Bank.
    6. Jekaterina Dmitrijeva, 2008. "Does Unemployed Training Increase Individual Employability? Evidence from Latvian Microdata," Documents de recherche 08-04, Centre d'Études des Politiques Économiques (EPEE), Université d'Evry Val d'Essonne.
    7. Maciej Bukowski & Piotr Lewandowski, 2005. "Transitions from unemployment in Poland: a multinomial logit analysis," Labor and Demography 0511008, University Library of Munich, Germany, revised 19 Dec 2005.
    8. Jeff Borland & Yi-Ping Tseng, 2003. "How Do Administrative Arrangements Affect Exit from Unemployment Payments? The Case of the Job Seeker Diary in Australia," Melbourne Institute Working Paper Series wp2003n27, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    9. Venetoklis, Takis, 2002. "Public Policy Evaluation: Introduction to Quantitative Methodologies," Research Reports 90, VATT Institute for Economic Research.
    10. F. Alfonso Arellano, 2010. "Do Training Programmes Get The Unemployed Back To Work? A Look At The Spanish Experience," Revista de Economia Aplicada, Universidad de Zaragoza, Departamento de Estructura Economica y Economia Publica, vol. 18(2), pages 39-65, Autumn.
    11. Jeff Borland & Yi-Ping Tseng & Roger Wilkins, 2013. "Does Coordination of Welfare Services Delivery Make a Difference for Extremely Disadvantaged Jobseekers? Evidence from the ‘YP-super-4’ Trial," The Economic Record, The Economic Society of Australia, vol. 89(287), pages 469-489, December.
    12. Geoff Perry & Tim Maloney, 2008. "Economic Evaluation of the Training Opportunities Programme in New Zealand," Australian Journal of Labour Economics (AJLE), Bankwest Curtin Economics Centre (BCEC), Curtin Business School, vol. 11(2), pages 163-185.
    13. Catalina Amuedo-Dorantes & Miguel Malo & Fernando Muñoz-Bullón, 2008. "The Role of Temporary Help Agency Employment on Temp-to-Perm Transitions," Journal of Labor Research, Springer, vol. 29(2), pages 138-161, June.
    14. Nuria Rodriguez-Planas† & Jacob Benus, 2007. "Evaluative Active Labor Market Programmes in Romania," Working Papers 2007-31, FEDEA.
    15. Venetoklis, Takis, 2004. "An Evaluation of Wage Subsidy Programs to SMEs Utilising Propensity Score Matching," Research Reports 106, VATT Institute for Economic Research.
    16. World Bank Group, 2016. "Activation and Public Employment Services in Poland," World Bank Publications - Reports 29831, The World Bank Group.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kluve, Jochen & Lehmann, Hartmut & Schmidt, Christoph M., 2008. "Disentangling Treatment Effects of Active Labor Market Policies: The Role of Labor Force Status Sequences," Labour Economics, Elsevier, vol. 15(6), pages 1270-1295, December.
    2. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    5. Jochen Kluve & Boris Augurzky, 2007. "Assessing the performance of matching algorithms when selection into treatment is strong," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 533-557.
    6. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    7. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    8. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    9. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    10. Gueorgui Kambourov & Iourii Manovskii & Miana Plesca, 2020. "Occupational mobility and the returns to training," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(1), pages 174-211, February.
    11. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    12. Hujer, Reinhard & Caliendo, Marco, 2000. "Evaluation of Active Labour Market Policy: Methodological Concepts and Empirical Estimates," IZA Discussion Papers 236, Institute of Labor Economics (IZA).
    13. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    14. Hara, Hiromi, 2022. "The effect of public-sponsored job training in Japan," Journal of the Japanese and International Economies, Elsevier, vol. 64(C).
    15. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    16. Geoff Perry & Tim Maloney, 2008. "Economic Evaluation of the Training Opportunities Programme in New Zealand," Australian Journal of Labour Economics (AJLE), Bankwest Curtin Economics Centre (BCEC), Curtin Business School, vol. 11(2), pages 163-185.
    17. Richard Disney & Eleonora Fischera & Trudy Owens, 2010. "Has the Introduction of Microfinance Crowded-out Informal Loans in Malawi?," Discussion Papers 10/08, University of Nottingham, CREDIT.
    18. Chabé-Ferret, Sylvain, 2017. "Should We Combine Difference In Differences with Conditioning on Pre-Treatment Outcomes?," TSE Working Papers 17-824, Toulouse School of Economics (TSE).
    19. Regner, Hakan, 2002. "A nonexperimental evaluation of training programs for the unemployed in Sweden," Labour Economics, Elsevier, vol. 9(2), pages 187-206, April.
    20. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.

    More about this item

    Keywords

    Transition; Propensity score; Active labor market policy; determinants of programme participation; exact matching;
    All these keywords.

    JEL classification:

    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:3298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.