IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14015.html
   My bibliography  Save this paper

Empirical Monte Carlo Evidence on Estimation of Timing-of-Events Models

Author

Listed:
  • Lombardi, Stefano

    (VATT, Helsinki)

  • van den Berg, Gerard J.

    (University of Groningen)

  • Vikström, Johan

    (IFAU)

Abstract

This paper builds on the Empirical Monte Carlo simulation approach developed by Huber et al. (2013) to study the estimation of Timing-of-Events (ToE) models. We exploit rich Swedish data of unemployed job-seekers with information on participation in a training program to simulate placebo treatment durations. We first use these simulations to examine which covariates are key confounders to be included in selection models. The joint inclusion of specific short-term employment history indicators (notably, the share of time spent in employment), together with baseline socio-economic characteristics, regional and inflow timing information, is important to deal with selection bias. Next, we omit subsets of explanatory variables and estimate ToE models with discrete distributions for the ensuing systematic unobserved heterogeneity. In many cases the ToE approach provides accurate effect estimates, especially if time-varying variation in the unemployment rate of the local labor market is taken into account. However, assuming too many or too few support points for unobserved heterogeneity may lead to large biases. Information criteria, in particular those penalizing parameter abundance, are useful to select the number of support points.

Suggested Citation

  • Lombardi, Stefano & van den Berg, Gerard J. & Vikström, Johan, 2021. "Empirical Monte Carlo Evidence on Estimation of Timing-of-Events Models," IZA Discussion Papers 14015, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14015
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14015.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frölich, Markus & Huber, Martin & Wiesenfarth, Manuel, 2017. "The finite sample performance of semi- and non-parametric estimators for treatment effects and policy evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 91-102.
    2. Jaap H. Abbring & Gerard J. Berg & Jan C. Ours, 2005. "The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment," Economic Journal, Royal Economic Society, vol. 115(505), pages 602-630, July.
    3. van Ours, Jan C. & Williams, Jenny & Fergusson, David & Horwood, L. John, 2013. "Cannabis use and suicidal ideation," Journal of Health Economics, Elsevier, vol. 32(3), pages 524-537.
    4. Govert E. Bijwaard & Christian Schluter & Jackline Wahba, 2014. "The Impact of Labor Market Dynamics on the Return Migration of Immigrants," The Review of Economics and Statistics, MIT Press, vol. 96(3), pages 483-494, July.
    5. Wiji Narendranathan & Mark B. Stewart, 1993. "Modelling the Probability of Leaving Unemployment: Competing Risks Models with Flexible Base‐Line Hazards," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 42(1), pages 63-83, March.
    6. Bruno Crépon & Marc Ferracci & Gregory Jolivet & Gerard J. van den Berg, 2018. "Information shocks and the empirical evaluation of training programs during unemployment spells," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(4), pages 594-616, June.
    7. Abbring, Jaap H & van den Berg, Gerard J & van Ours, Jan C, 2001. "Business Cycles and Compositional Variation in U.S. Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 436-448, October.
    8. van Ours, Jan C. & Williams, Jenny, 2012. "The effects of cannabis use on physical and mental health," Journal of Health Economics, Elsevier, vol. 31(4), pages 564-577.
    9. van Ours, Jan C. & Williams, Jenny, 2009. "Why parents worry: Initiation into cannabis use by youth and their educational attainment," Journal of Health Economics, Elsevier, vol. 28(1), pages 132-142, January.
    10. Palali, Ali & van Ours, Jan, 2015. "Love Conquers All but Nicotine : Spousal Peer Effects on the Decision to Quit Smoking," Discussion Paper 2015-048, Tilburg University, Center for Economic Research.
    11. Michael Lechner & Anthony Strittmatter, 2019. "Practical procedures to deal with common support problems in matching estimation," Econometric Reviews, Taylor & Francis Journals, vol. 38(2), pages 193-207, February.
    12. Huh, Keun & Sickles, Robin C, 1994. "Estimation of the Duration Model by Nonparametric Maximum Likelihood, Maximum Penalized Likelihood, and Probability Simulators," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 683-694, November.
    13. Lindeboom, Maarten & Llena-Nozal, Ana & van der Klaauw, Bas, 2016. "Health shocks, disability and work," Labour Economics, Elsevier, vol. 43(C), pages 186-200.
    14. Hugo Bodory & Lorenzo Camponovo & Martin Huber & Michael Lechner, 2020. "The Finite Sample Performance of Inference Methods for Propensity Score Matching and Weighting Estimators," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 183-200, January.
    15. Ali Palali & Jan C. Van ours, 2017. "Love Conquers all but Nicotine: Spousal Peer Effects on the Decision to Quit Smoking," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1710-1727, December.
    16. Fox, Jeremy T. & Kim, Kyoo il & Ryan, Stephen P. & Bajari, Patrick, 2012. "The random coefficients logit model is identified," Journal of Econometrics, Elsevier, vol. 166(2), pages 204-212.
    17. Ichimura, Hidehiko & Thompson, T. Scott, 1998. "Maximum likelihood estimation of a binary choice model with random coefficients of unknown distribution," Journal of Econometrics, Elsevier, vol. 86(2), pages 269-295, June.
    18. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    19. van den Berg, Gerard J & van Ours, Jan C, 1996. "Unemployment Dynamics and Duration Dependence," Journal of Labor Economics, University of Chicago Press, vol. 14(1), pages 100-125, January.
    20. Arun Advani & Toru Kitagawa & Tymon Słoczyński, 2019. "Mostly harmless simulations? Using Monte Carlo studies for estimator selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 893-910, September.
    21. Bergemann, Annette & Pohlan, Laura & Uhlendorff, Arne, 2017. "The impact of participation in job creation schemes in turbulent times," Labour Economics, Elsevier, vol. 47(C), pages 182-201.
    22. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    23. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    24. Martin Huber & Michael Lechner & Giovanni Mellace, 2016. "The Finite Sample Performance of Estimators for Mediation Analysis Under Sequential Conditional Independence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 139-160, January.
    25. Gaure, Simen & Roed, Knut & Zhang, Tao, 2007. "Time and causality: A Monte Carlo assessment of the timing-of-events approach," Journal of Econometrics, Elsevier, vol. 141(2), pages 1159-1195, December.
    26. Van den Berg, Gerard J., 2001. "Duration models: specification, identification and multiple durations," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 55, pages 3381-3460, Elsevier.
    27. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    28. van den Berg, Gerard J. & Gupta, Sumedha, 2015. "The role of marriage in the causal pathway from economic conditions early in life to mortality," Journal of Health Economics, Elsevier, vol. 40(C), pages 141-158.
    29. Jahn, Elke & Rosholm, Michael, 2013. "Is temporary agency employment a stepping stone for immigrants?," Economics Letters, Elsevier, vol. 118(1), pages 225-228.
    30. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    31. Berg, G.J. & Ours, J.C., 1993. "Unemployment dynamics and duration dependence in France, the Netherlands and the UK," Serie Research Memoranda 0038, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    32. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    33. Eric Gautier & Yuichi Kitamura, 2013. "Nonparametric Estimation in Random Coefficients Binary Choice Models," Econometrica, Econometric Society, vol. 81(2), pages 581-607, March.
    34. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    35. Baert, Stijn & Cockx, Bart & Verhaest, Dieter, 2013. "Overeducation at the start of the career: Stepping stone or trap?," Labour Economics, Elsevier, vol. 25(C), pages 123-140.
    36. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    37. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    38. Katarina Richardson & Gerard J. Berg, 2013. "Duration Dependence Versus Unobserved Heterogeneity In Treatment Effects: Swedish Labor Market Training And The Transition Rate To Employment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 325-351, March.
    39. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    40. Caliendo, Marco & Künn, Steffen & Uhlendorff, Arne, 2016. "Earnings exemptions for unemployed workers: The relationship between marginal employment, unemployment duration and job quality," Labour Economics, Elsevier, vol. 42(C), pages 177-193.
    41. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    42. van den Berg, Gerard J & van Ours, Jan C, 1994. "Unemployment Dynamics and Duration Dependence in France, the Netherlands and the United Kingdom," Economic Journal, Royal Economic Society, vol. 104(423), pages 432-443, March.
    43. Holm, Anders & Høgelund, Jan & Gørtz, Mette & Rasmussen, Kristin Storck & Houlberg, Helle Sofie Bøje, 2017. "Employment effects of active labor market programs for sick-listed workers," Journal of Health Economics, Elsevier, vol. 52(C), pages 33-44.
    44. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    45. Baker, Michael & Melino, Angelo, 2000. "Duration dependence and nonparametric heterogeneity: A Monte Carlo study," Journal of Econometrics, Elsevier, vol. 96(2), pages 357-393, June.
    46. Bergemann, Annette & Pohlan, Laura & Uhlendorff, Arne, 2016. "Job Creation Schemes in Turbulent Times," IZA Discussion Papers 10369, Institute of Labor Economics (IZA).
    47. Briesch, Richard A. & Chintagunta, Pradeep K. & Matzkin, Rosa L., 2010. "Nonparametric Discrete Choice Models With Unobserved Heterogeneity," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 291-307.
    48. Busk, Henna, 2016. "Sanctions and the exit from unemployment in two different benefit schemes," Labour Economics, Elsevier, vol. 42(C), pages 159-176.
    49. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2014. "Unobservable, but Unimportant? The Influence of Personality Traits (and Other Usually Unobserved Variables) for the Evaluation of Labor Market Policies," IZA Discussion Papers 8337, Institute of Labor Economics (IZA).
    50. Vikström, Johan, 2017. "Dynamic treatment assignment and evaluation of active labor market policies," Labour Economics, Elsevier, vol. 49(C), pages 42-54.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caroline Hall & Inés Hardoy & Kristine Simson, 2024. "Policies for young adults with reduced work capacity. Labour market impact in Sweden and Norway," Journal of Population Economics, Springer;European Society for Population Economics, vol. 37(1), pages 1-33, March.
    2. von Simson Kristine & Hardoy Inés, 2020. "Tackling disabilities in young age—Policies that work," IZA Journal of Labor Policy, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 10(1), pages 1-27, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gaure, Simen & Roed, Knut & Zhang, Tao, 2007. "Time and causality: A Monte Carlo assessment of the timing-of-events approach," Journal of Econometrics, Elsevier, vol. 141(2), pages 1159-1195, December.
    2. Schmidl, Ricarda, 2015. "The Effectiveness of Early Vacancy Information in the Presence of Monitoring and ALMP," IZA Discussion Papers 9575, Institute of Labor Economics (IZA).
    3. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    4. Arun Advani & Toru Kitagawa & Tymon Słoczyński, 2019. "Mostly harmless simulations? Using Monte Carlo studies for estimator selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 893-910, September.
    5. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    6. Goller, Daniel & Lechner, Michael & Moczall, Andreas & Wolff, Joachim, 2020. "Does the estimation of the propensity score by machine learning improve matching estimation? The case of Germany's programmes for long term unemployed," Labour Economics, Elsevier, vol. 65(C).
    7. Marco Caliendo & Stefan Tübbicke, 2019. "Do Start-Up Subsidies for the Unemployed Affect Participants’ Well-Being? A Rigorous Look at (Un-)Intended Consequences of Labor Market Policies," CEPA Discussion Papers 14, Center for Economic Policy Analysis.
    8. Tübbicke, Stefan, 2023. "How sensitive are matching estimates of active labor market policy effects to typically unobserved confounders?," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 57, pages 1-26.
    9. Seonho Shin, 2022. "Evaluating the Effect of the Matching Grant Program for Refugees: An Observational Study Using Matching, Weighting, and the Mantel-Haenszel Test," Journal of Labor Research, Springer, vol. 43(1), pages 103-133, March.
    10. Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
    11. Hagen, Tobias, 2016. "Econometric Evaluation of a Placement Coaching Program for Recipients of Disability Insurance Benefits in Switzerland," VfS Annual Conference 2016 (Augsburg): Demographic Change 145736, Verein für Socialpolitik / German Economic Association.
    12. Advani, Arun & Sloczynski, Tymon, 2013. "Mostly Harmless Simulations? On the Internal Validity of Empirical Monte Carlo Studies," IZA Discussion Papers 7874, Institute of Labor Economics (IZA).
    13. Garcia-Louzao, Jose, 2022. "Workers’ job mobility in response to severance pay generosity," Labour Economics, Elsevier, vol. 75(C).
    14. Hagen, Tobias, 2016. "Econometric evaluation of a placement coaching program for recipients of disability insurance benefits in Switzerland," Working Paper Series 10, Frankfurt University of Applied Sciences, Faculty of Business and Law.
    15. von Simson Kristine & Hardoy Inés, 2020. "Tackling disabilities in young age—Policies that work," IZA Journal of Labor Policy, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 10(1), pages 1-27, March.
    16. Abbring, Jaap H. & van den Berg, Gerard J. & van Ours, Jan C., 2002. "The anatomy of unemployment dynamics," European Economic Review, Elsevier, vol. 46(10), pages 1785-1824, December.
    17. Frölich, Markus & Huber, Martin & Wiesenfarth, Manuel, 2017. "The finite sample performance of semi- and non-parametric estimators for treatment effects and policy evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 91-102.
    18. Røed, Knut & Westlie, Lars, 2007. "Unemployment Insurance in Welfare States: Soft Constraints and Mild Sanctions," Memorandum 13/2007, Oslo University, Department of Economics.
    19. Nisar Ahmad & Michael Svarer & Amjad Naveed, 2019. "The Effect of Active Labour Market Programmes and Benefit Sanctions on Reducing Unemployment Duration," Journal of Labor Research, Springer, vol. 40(2), pages 202-229, June.
    20. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.

    More about this item

    Keywords

    propensity score; unemployment; duration analysis; matching; training; employment;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14015. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.