IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpla/0505006.html
   My bibliography  Save this paper

Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods

Author

Listed:
  • Michael Lechner

    (University of St. Gallen, Swiss Institute for International Economics & Applied Economic Research, Bodanstr. 8, CH- 9000 St. Gallen/Switzerland)

Abstract

Recently, several studies have analysed active labour market policies by using a recently proposed matching estimator for multiple programmes. Since there is only very limited practical experience with this estimator, this paper checks its sensitivity with resprect to issues that are of practical importance in this kind of evaluation study. The estimator turns out to be fairly robust to several features that concern its implementation. Furthermore, the paper demonstrates that the matching approach per se is no panacea for solving all the problems of evaluation studies, but that its success depends critically on the information that is available in the data. Finally, a comparison with a bootstrap distribution provides some justification for using a simplified approximation of the distribution of the estimator that ignores its sequential nature.

Suggested Citation

  • Michael Lechner, 2005. "Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods," Labor and Demography 0505006, University Library of Munich, Germany.
    • Handle: RePEc:wpa:wuwpla:0505006
    Note: Type of Document - pdf; pages: 23
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/lab/papers/0505/0505006.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Markus Frölich & Almas Heshmati & Michael Lechner, 2004. "A microeconometric evaluation of rehabilitation of long-term sickness in Sweden," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(3), pages 375-396.
    2. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    3. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    4. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    5. Geweke, John & Keane, Michael P & Runkle, David, 1994. "Alternative Computational Approaches to Inference in the Multinomial Probit Model," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 609-632, November.
    6. Fougère, Denis & Crépon, Bruno & Brodaty, Thomas, 2000. "Using Matching Estimators to Evaluate Alternative Youth Employment Programs: Evidence from France, 1986-1988," CEPR Discussion Papers 2604, C.E.P.R. Discussion Papers.
    7. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    8. Lalive, R. & van Ours, J.C. & Zweimüller, J., 2000. "The Impact of Active Labor Market Programs and Benefit Entitlement Rules on the Duration of Unemployment," Discussion Paper 2000-41, Tilburg University, Center for Economic Research.
    9. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    10. Borsch-Supan, Axel & Hajivassiliou, Vassilis A., 1993. "Smooth unbiased multivariate probability simulators for maximum likelihood estimation of limited dependent variable models," Journal of Econometrics, Elsevier, vol. 58(3), pages 347-368, August.
    11. van Ours, Jan C. & Zweimüller, Josef & Lalive, Rafael, 2000. "The Impact Of Active Labour Market Policies And Benefit Entitlement Rules On The Duration Of Unemployment," CEPR Discussion Papers 2451, C.E.P.R. Discussion Papers.
    12. Larsson, Laura, 2000. "Evaluation of Swedish Youth Labour Market Programmes," Working Paper Series 2000:6, Uppsala University, Department of Economics.
    13. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    14. Spanos,Aris, 1999. "Probability Theory and Statistical Inference," Cambridge Books, Cambridge University Press, number 9780521424080.
    15. Guido W. Imbens, 1999. "The Role of the Propensity Score in Estimating Dose-Response Functions," NBER Technical Working Papers 0237, National Bureau of Economic Research, Inc.
    16. Lechner, Michael, 1999. "Earnings and Employment Effects of Continuous Off-the-Job Training in East Germany after Unification," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(1), pages 74-90, January.
    17. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    18. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    19. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    20. Robert G. Fay, 1996. "Enhancing the Effectiveness of Active Labour Market Policies: Evidence from Programme Evaluations in OECD Countries," OECD Labour Market and Social Policy Occasional Papers 18, OECD Publishing.
    21. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    22. Larsson, L., 2000. "Evaluation of Swedish Youth Labour Market Programmes," Papers 2000:6, Uppsala - Working Paper Series.
    23. Larsson, Laura, 2000. "Evaluation of Swedish youth labour market programmes," Working Paper Series 2000:1, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    2. Barbara Sianesi, 2001. "Differential effects of Swedish active labour market programmes for unemployed adults during the 1990s," IFS Working Papers W01/25, Institute for Fiscal Studies.
    3. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Barbara Sianesi, 2002. "Swedish active labour market programmes in the 1990s: overall effectiveness and differential performance," IFS Working Papers W02/03, Institute for Fiscal Studies.
    6. Michael Lechner, 2000. "Programme Heterogeneity and Propensity Score Matching: An Application to the Evaluation of Active Labour Market Policies," Econometric Society World Congress 2000 Contributed Papers 0647, Econometric Society.
    7. Raaum, Oddbjørn & Torp, Hege & Zhang, Tao, 2003. "Business cycles and the impact of labour market programmes," Memorandum 14/2002, Oslo University, Department of Economics.
    8. Richard Disney & Eleonora Fischera & Trudy Owens, 2010. "Has the Introduction of Microfinance Crowded-out Informal Loans in Malawi?," Discussion Papers 10/08, University of Nottingham, CREDIT.
    9. Jochen Kluve & Boris Augurzky, 2007. "Assessing the performance of matching algorithms when selection into treatment is strong," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 533-557.
    10. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.
    11. Hottenrott, Hanna & Lopes-Bento, Cindy, 2014. "(International) R&D collaboration and SMEs: The effectiveness of targeted public R&D support schemes," Research Policy, Elsevier, vol. 43(6), pages 1055-1066.
    12. Richard Dorsett, 2004. "The new deal for young people: effect of the options on the labour market status of young men," PSI Research Discussion Series 7, Policy Studies Institute, UK.
    13. Barbara Sianesi, 2002. "An evaluation of the Swedish system of active labour market programmes in the 1990s," IFS Working Papers W02/01, Institute for Fiscal Studies.
    14. Michael Lechner, 2004. "Sequential Matching Estimation of Dynamic Causal Models," University of St. Gallen Department of Economics working paper series 2004 2004-06, Department of Economics, University of St. Gallen.
    15. Sianesi, Barbara, 2001. "An evaluation of the active labour market programmes in Sweden," Working Paper Series 2001:5, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    16. Markus Frölich & Almas Heshmati & Michael Lechner, 2004. "A microeconometric evaluation of rehabilitation of long-term sickness in Sweden," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(3), pages 375-396.
    17. Michael Lechner, 2002. "Mikroökonometrische Evaluation arbeitsmarktpolitischer Massnahmen," University of St. Gallen Department of Economics working paper series 2002 2002-20, Department of Economics, University of St. Gallen.
    18. Martin Eichler & Michael Lechner, 2000. "Some Econometric Evidence on the Effectiveness of Active Labour Market Programmes in East Germany," William Davidson Institute Working Papers Series 318, William Davidson Institute at the University of Michigan.
    19. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    20. Hämäläinen, Kari & Ollikainen, Virve, 2004. "Differential Effects of Active Labour Market Programmes in the Early Stages of Young People's Unemployment," Research Reports 115, VATT Institute for Economic Research.

    More about this item

    Keywords

    Balancing score; Matching; Multiple programmes; Programme evaluation; Sensitivity analysis; Treatment effects;
    All these keywords.

    JEL classification:

    • J - Labor and Demographic Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpla:0505006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.