IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12261.html
   My bibliography  Save this paper

New Evidence on Long-Term Effects of Start-Up Subsidies: Matching Estimates and Their Robustness

Author

Listed:
  • Caliendo, Marco

    (University of Potsdam)

  • Tübbicke, Stefan

    (Institute for Employment Research (IAB), Nuremberg)

Abstract

The German start-up subsidy (SUS) program for the unemployed has recently undergone a major make-over, altering its institutional setup, adding an additional layer of selection and leading to ambiguous predictions of the program's effectiveness. Using propensity score matching (PSM) as our main empirical approach, we provide estimates of long-term effects of the post-reform subsidy on individual employment prospects and labor market earnings up to 40 months after entering the program. Our results suggest large and persistent long-term effects of the subsidy on employment probabilities and net earned income. These effects are larger than what was estimated for the pre-reform program. Extensive sensitivity analyses within the standard PSM framework reveal that the results are robust to different choices regarding the implementation of the weighting procedure and also with respect to deviations from the conditional independence assumption. As a further assessment of the results' sensitivity, we go beyond the standard selection-on-observables approach and employ an instrumental variable setup using regional variation in the likelihood of receiving treatment. Here, we exploit the fact that the reform increased the discretionary power of local employment agencies in allocating active labor market policy funds, allowing us to obtain a measure of local preferences for SUS as the program of choice. The results based on this approach give rise to similar estimates. Thus, our results indicating that SUS are still an effective active labor market program after the reform do not appear to be driven by "hidden bias".

Suggested Citation

  • Caliendo, Marco & Tübbicke, Stefan, 2019. "New Evidence on Long-Term Effects of Start-Up Subsidies: Matching Estimates and Their Robustness," IZA Discussion Papers 12261, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp12261
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12261.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    2. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    3. Matias Busso & John DiNardo & Justin McCrary, 2014. "New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 885-897, December.
    4. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    5. Sascha O. Becker & Marco Caliendo, 2007. "Sensitivity analysis for average treatment effects," Stata Journal, StataCorp LP, vol. 7(1), pages 71-83, February.
    6. Marco Caliendo & Frank Fossen & Alexander Kritikos, 2014. "Personality characteristics and the decisions to become and stay self-employed," Small Business Economics, Springer, vol. 42(4), pages 787-814, April.
    7. Lutz Bellmann & Marco Caliendo & Stefan Tübbicke, 2018. "The Post‐Reform Effectiveness of the New German Start‐Up Subsidy for the Unemployed," LABOUR, CEIS, vol. 32(3), pages 293-319, September.
    8. Caliendo, Marco & Künn, Steffen, 2011. "Start-up subsidies for the unemployed: Long-term evidence and effect heterogeneity," Journal of Public Economics, Elsevier, vol. 95(3), pages 311-331.
    9. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    10. Michael Lechner & Anthony Strittmatter, 2019. "Practical procedures to deal with common support problems in matching estimation," Econometric Reviews, Taylor & Francis Journals, vol. 38(2), pages 193-207, February.
    11. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    12. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    13. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    14. Chabé-Ferret, Sylvain, 2015. "Analysis of the bias of Matching and Difference-in-Difference under alternative earnings and selection processes," Journal of Econometrics, Elsevier, vol. 185(1), pages 110-123.
    15. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    16. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    17. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    18. W. Sauerbrei & P. Royston, 1999. "Building multivariable prognostic and diagnostic models: transformation of the predictors by using fractional polynomials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 162(1), pages 71-94.
    19. Dunn, Thomas & Holtz-Eakin, Douglas, 2000. "Financial Capital, Human Capital, and the Transition to Self-Employment: Evidence from Intergenerational Links," Journal of Labor Economics, University of Chicago Press, vol. 18(2), pages 282-305, April.
    20. Marco Caliendo & Steffen Künn, 2015. "Getting back into the labor market: the effects of start-up subsidies for unemployed females," Journal of Population Economics, Springer;European Society for Population Economics, vol. 28(4), pages 1005-1043, October.
    21. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    22. Marco Caliendo & Steffen K�nn, 2014. "Regional Effect Heterogeneity of Start-up Subsidies for the Unemployed," Regional Studies, Taylor & Francis Journals, vol. 48(6), pages 1108-1134, June.
    23. Richard Duhautois & Dominique Redor & Lionel Desiage, 2015. "Long Term Effect of Public Subsidies on Start-up Survival and Economic Performance: An Empirical Study with French Data," Revue d'économie industrielle, De Boeck Université, vol. 0(1), pages 11-41.
    24. Marco Caliendo, 2016. "Start-up subsidies for the unemployed: Opportunities and limitations," IZA World of Labor, Institute of Labor Economics (IZA), pages 200-200, March.
    25. Caliendo, Marco & Künn, Steffen & Weißenberger, Martin, 2016. "Personality traits and the evaluation of start-up subsidies," European Economic Review, Elsevier, vol. 86(C), pages 87-108.
    26. Vladasel, Theodor & Lindquist, Matthew J. & Sol, Joeri & van Praag, Mirjam, 2021. "On the origins of entrepreneurship: Evidence from sibling correlations," Journal of Business Venturing, Elsevier, vol. 36(5).
    27. Núria Rodríguez-Planas & Benus Jacob, 2010. "Evaluating active labor market programs in Romania," Empirical Economics, Springer, vol. 38(1), pages 65-84, February.
    28. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    29. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    30. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    31. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.
    32. L. Behrenz & L. Delander & J. Månsson, 2016. "Is Starting a Business a Sustainable way out of Unemployment? Treatment Effects of the Swedish Start-up Subsidy," Journal of Labor Research, Springer, vol. 37(4), pages 389-411, December.
    33. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    34. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    35. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    36. Patrick Royston & Gareth Ambler, 1999. "Multivariable fractional polynomials," Stata Technical Bulletin, StataCorp LP, vol. 8(43).
    37. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    38. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    39. Bernhard, Stefan & Grüttner, Michael, 2015. "Der Gründungszuschuss nach der Reform: Eine qualitative Implementationsstudie zur Umsetzung der Reform in den Agenturen," IAB-Forschungsbericht 201504, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Srhoj Stjepan & Zilic Ivan, 2021. "“Fine...I’ll do it myself”: Lessons from self-employment grants in a long recession period," IZA Journal of Labor Policy, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 11(1), pages 1-32, May.
    2. Congregado, Emilio & Fossen, Frank M. & Rubino, Nicola & Troncoso, David, 2024. "Long-Term Effects of Shocks on New Opportunity and Necessity Entrepreneurship," IZA Discussion Papers 16930, Institute of Labor Economics (IZA).
    3. Siddhartha Bandyopadhyay & Sanjukta Sarkar & Rudra Sensarma, 2021. "Does Access to Key Household Resources Help in Reducing Violence against Women?," Discussion Papers 21-09, Department of Economics, University of Birmingham.
    4. Melcangi, Davide & Turen, Javier, 2023. "Subsidizing startups under imperfect information," Journal of Monetary Economics, Elsevier, vol. 139(C), pages 93-109.
    5. Remya Tressa Jacob & Rudra Sensarma, 2022. "Does knowledge empower? A story of debt literacy and credit usage in rural consumer finance," Working papers 529, Indian Institute of Management Kozhikode.
    6. Francesco Manaresi & Carlo Menon & Pietro Santoleri, 2021. "Supporting innovative entrepreneurship: an evaluation of the Italian “Start-up Act” [The effects of entry on incumbent innovation and productivity]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(6), pages 1591-1614.
    7. Lucia Svabova & Barbora Gabrikova, 2024. "A Measure That Really Works? Impact Evaluation of the Contribution for Self-Employment as a Tool of Active Labour Market Policy in Slovakia," Economies, MDPI, vol. 12(5), pages 1-20, May.
    8. Caliendo, Marco & Tübbicke, Stefan, 2021. "Design and effectiveness of start-up subsidies: Evidence from a policy reform in Germany," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 333-340.
    9. Léonard Moulin, 2023. "Do private schools increase academic achievement? Evidence from France," Education Economics, Taylor & Francis Journals, vol. 31(2), pages 247-274, March.
    10. Gabrikova Barbora & Svabova Lucia, 2022. "Allowance for Self-Employed Gainful Activity in Slovakia: A Closer look into the Factors Involved," Folia Oeconomica Stetinensia, Sciendo, vol. 22(2), pages 55-77, December.
    11. Céline Odding & Lucy Kok & Lennart Kroon & Marloes Lammers, 2024. "From Unemployed to Self-Employed: Analysis of Treatment Effects of a Dutch Self-Employment Programme," De Economist, Springer, vol. 172(1), pages 49-99, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Caliendo & Stefan Tübbicke, 2019. "Do Start-Up Subsidies for the Unemployed Affect Participants’ Well-Being? A Rigorous Look at (Un-)Intended Consequences of Labor Market Policies," CEPA Discussion Papers 14, Center for Economic Policy Analysis.
    2. Lutz Bellmann & Marco Caliendo & Stefan Tübbicke, 2018. "The Post‐Reform Effectiveness of the New German Start‐Up Subsidy for the Unemployed," LABOUR, CEIS, vol. 32(3), pages 293-319, September.
    3. L. Behrenz & L. Delander & J. Månsson, 2016. "Is Starting a Business a Sustainable way out of Unemployment? Treatment Effects of the Swedish Start-up Subsidy," Journal of Labor Research, Springer, vol. 37(4), pages 389-411, December.
    4. Caliendo, Marco & Künn, Steffen & Weißenberger, Martin, 2016. "Personality traits and the evaluation of start-up subsidies," European Economic Review, Elsevier, vol. 86(C), pages 87-108.
    5. Caliendo, Marco & Tübbicke, Stefan, 2021. "Design and effectiveness of start-up subsidies: Evidence from a policy reform in Germany," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 333-340.
    6. Hugo Bodory & Lorenzo Camponovo & Martin Huber & Michael Lechner, 2020. "The Finite Sample Performance of Inference Methods for Propensity Score Matching and Weighting Estimators," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 183-200, January.
    7. Marco Caliendo & Steffen Künn, 2015. "Getting back into the labor market: the effects of start-up subsidies for unemployed females," Journal of Population Economics, Springer;European Society for Population Economics, vol. 28(4), pages 1005-1043, October.
    8. Céline Odding & Lucy Kok & Lennart Kroon & Marloes Lammers, 2024. "From Unemployed to Self-Employed: Analysis of Treatment Effects of a Dutch Self-Employment Programme," De Economist, Springer, vol. 172(1), pages 49-99, March.
    9. Manuela Deidda & Adriana Di Liberto & Marta Foddi & Giovanni Sulis, 2015. "Employment subsidies, informal economy and women’s transition into work in a depressed area: evidence from a matching approach," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-25, December.
    10. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    11. Tübbicke Stefan, 2022. "Entropy Balancing for Continuous Treatments," Journal of Econometric Methods, De Gruyter, vol. 11(1), pages 71-89, January.
    12. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.
    13. Felfe, Christina & Lechner, Michael & Steinmayr, Andreas, 2011. "Sport and Child Development," Economics Working Paper Series 1135, University of St. Gallen, School of Economics and Political Science.
    14. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    15. Caliendo, Marco & Künn, Steffen & Weissenberger, Martin, 2020. "Catching up or lagging behind? The long-term business and innovation potential of subsidized start-ups out of unemployment," Research Policy, Elsevier, vol. 49(10).
    16. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    17. Tübbicke, Stefan, 2023. "How sensitive are matching estimates of active labor market policy effects to typically unobserved confounders?," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 57, pages 1-26.
    18. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    19. Caliendo, Marco & Künn, Steffen, 2011. "Start-up subsidies for the unemployed: Long-term evidence and effect heterogeneity," Journal of Public Economics, Elsevier, vol. 95(3), pages 311-331.
    20. Advani, Arun & Sloczynski, Tymon, 2013. "Mostly Harmless Simulations? On the Internal Validity of Empirical Monte Carlo Studies," IZA Discussion Papers 7874, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    start-up subsidies; policy reform; matching; instrumental variables;
    All these keywords.

    JEL classification:

    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy
    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • L26 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Entrepreneurship

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12261. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.