IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2609.36824.html

Testing for Unobserved Heterogeneity in Censored Duration Models: EM Approach

Author

Listed:
  • Hiroyuki Kasahara
  • Hirokazu Matsuyama
  • Katsumi Shimotsu
  • Shota Takeishi

Abstract

Ignoring unobserved heterogeneity in duration models biases parameter estimates and invalidates inference, but testing for it is non-regular: the null hypothesis lies on the boundary of the parameter space and some parameters are unidentified under the null. These features render standard asymptotic theory inapplicable. This paper develops an EM test for unobserved heterogeneity in censored Weibull duration models, building on the EM approach of Li, Chen, and Marriott (2009). The test statistic has an asymptotic null distribution equal to the square of max{0, N(0,1)}, hence critical values require neither simulation nor bootstrap, and the test accommodates covariate-dependent censoring of arbitrary form. Monte Carlo simulations compare the EM test with the likelihood ratio test (LRT) of Cho and White (2010), information matrix tests, and Lagrange multiplier tests. The EM test has empirical size close to the nominal level for sample sizes of 500 or more, where the LRT remains markedly conservative and the other tests over-reject. Its size-adjusted power is comparable to that of the LRT and higher than that of the other tests. Because size adjustment requires knowledge of the data-generating process and is unavailable in practice, the EM test attains higher power than the LRT in most designs as the tests would actually be applied. In an application to the Stanford Heart Transplant data, the EM test rejects homogeneity in every covariate specification, whereas the LRT's conclusion depends on a user-chosen set of admissible parameter values and on the specification.

Suggested Citation

  • Hiroyuki Kasahara & Hirokazu Matsuyama & Katsumi Shimotsu & Shota Takeishi, 2026. "Testing for Unobserved Heterogeneity in Censored Duration Models: EM Approach," Papers 2609.36824, arXiv.org.
  • Handle: RePEc:arx:papers:2609.36824
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2609.36824
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pastore, Francesco & Quintano, Claudio & Rocca, Antonella, 2021. "Some young people have all the luck! The duration dependence of the school-to-work transition in Europe," Labour Economics, Elsevier, vol. 70(C).
    2. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    3. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
    4. James E. Prieger, "undated". "Conditional Moment Tests for Parametric Duration Models," Department of Economics 00-10, California Davis - Department of Economics.
    5. Shosei Sakaguchi, 2024. "Partial identification and inference in duration models with endogenous censoring," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(2), pages 308-326, March.
    6. Chen, Ming-Yuan, 2002. "Survival duration of plants: Evidence from the US petroleum refining industry," International Journal of Industrial Organization, Elsevier, vol. 20(4), pages 517-555, April.
    7. Ferrall, Christopher, 1997. "Unemployment Insurance Eligibility and the School-to-Work Transition in Canada and the United States," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(2), pages 115-129, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cho, Jin Seo & White, Halbert, 2010. "Testing for unobserved heterogeneity in exponential and Weibull duration models," Journal of Econometrics, Elsevier, vol. 157(2), pages 458-480, August.
    2. Gómez-Déniz, E. & Pérez-Rodríguez, J.V., 2019. "Modelling bimodality of length of tourist stay," Annals of Tourism Research, Elsevier, vol. 75(C), pages 131-151.
    3. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    4. Yang, Zhenlin & Tsui, Albert K., 2004. "Analytically calibrated Box-Cox percentile limits for duration and event-time models," Insurance: Mathematics and Economics, Elsevier, vol. 35(3), pages 649-677, December.
    5. Van den Berg, Gerard J., 2001. "Duration models: specification, identification and multiple durations," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 55, pages 3381-3460, Elsevier.
    6. repec:lan:wpaper:1023 is not listed on IDEAS
    7. J Taylor & A N Nguyen, 2003. "Transition from school to first job: the influence of educational attainment," Working Papers 540112, Lancaster University Management School, Economics Department.
    8. Andrey Launov & Klaus Wälde, 2013. "Estimating Incentive And Welfare Effects Of Nonstationary Unemployment Benefits," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 54(4), pages 1159-1198, November.
    9. Victor Aguirregabiria, 2006. "Another Look at the Identification of Dynamic Discrete Decision Processes: With an Application to Retirement Behavior," 2006 Meeting Papers 169, Society for Economic Dynamics.
    10. Patrick Arni & Rafael Lalive & Jan C. Van Ours, 2013. "How Effective Are Unemployment Benefit Sanctions? Looking Beyond Unemployment Exit," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1153-1178, November.
    11. Kemptner, Daniel & Tolan, Songül, 2018. "The role of time preferences in educational decision making," Economics of Education Review, Elsevier, vol. 67(C), pages 25-39.
    12. Christelis, Dimitris & Dobrescu, Loretti I. & Motta, Alberto, 2020. "Early life conditions and financial risk-taking in older age," The Journal of the Economics of Ageing, Elsevier, vol. 17(C).
    13. Michelle Sheran Sylvester, 2007. "The Career and Family Choices of Women: A Dynamic Analysis of Labor Force Participation, Schooling, Marriage and Fertility Decisions," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 10(3), pages 367-399, July.
    14. Insoo Cho & Peter F. Orazem, 2021. "How endogenous risk preferences and sample selection affect analysis of firm survival," Small Business Economics, Springer, vol. 56(4), pages 1309-1332, April.
    15. Sun, Yuxin & Ibikunle, Gbenga, 2017. "Informed trading and the price impact of block trades: A high frequency trading analysis," International Review of Financial Analysis, Elsevier, vol. 54(C), pages 114-129.
    16. Ali Palali & Jan C. Van ours, 2017. "Love Conquers all but Nicotine: Spousal Peer Effects on the Decision to Quit Smoking," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1710-1727, December.
    17. Steven M. Lewis & Adrian E. Raftery, 1999. "Bayesian Analysis of Event History Models with Unobserved Heterogeneity via Markov Chain Monte Carlo," Sociological Methods & Research, , vol. 28(1), pages 35-60, August.
    18. Janneke van Brummelen & Paolo Gorgi & Siem Jan Koopman, 2025. "Score-driven time-varying parameter models with splinebased densities," Tinbergen Institute Discussion Papers 25-011/III, Tinbergen Institute.
    19. Francesco Devicienti & Valentina Gualtieri & Mariacristina Rossi, 2014. "The Persistence Of Income Poverty And Lifestyle Deprivation: Evidence From Italy," Bulletin of Economic Research, Wiley Blackwell, vol. 66(3), pages 246-278, July.
    20. Takahashi, Makoto & Watanabe, Toshiaki & Omori, Yasuhiro, 2016. "Volatility and quantile forecasts by realized stochastic volatility models with generalized hyperbolic distribution," International Journal of Forecasting, Elsevier, vol. 32(2), pages 437-457.
    21. Mohammed Yousef Mai, 2017. "Science Teachers' Attitudes towards Using ICT and Mobile Learning Technologies in Malaysian Schools," European Journal of Interdisciplinary Studies Articles, Revistia Research and Publishing, vol. 2(1), pages 62-76, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2609.36824. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.