IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20150126.html
   My bibliography  Save this paper

A Nonparametric Method for Predicting Survival Probabilities

Author

Listed:
  • Bas van der Klaauw

    (VU University Amsterdam)

  • Sandra Vriend

    (VU University Amsterdam, the Netherlands)

Abstract

Public programs often use statistical profiling to assess the risk that applicants will become long-term dependent on the program. The literature uses linear probability models and (Cox) proportional hazard models to predict duration outcomes. These either focus on one threshold duration or impose proportionality. In this paper we propose a nonparametric weighted survivor prediction method where the weights depend on the distance in characteristics between individuals. A simulation study shows that an Epanechnikov weighting function with a small bandwidth gives the best predictions while the choice of distance function is less important for the performance of the weighted survivor prediction method. This yields predictions that are slightly better than Cox survivor function predictions. In an empirical application concerning the outflow to work from unemployment insu rance, we do not find that the weighting method outperforms Cox survivor function predictions.

Suggested Citation

  • Bas van der Klaauw & Sandra Vriend, 2015. "A Nonparametric Method for Predicting Survival Probabilities," Tinbergen Institute Discussion Papers 15-126/V, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20150126
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/15126.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bell, Stephen H. & Orr, Larry L., 2002. "Screening (and creaming?) applicants to job training programs: the AFDC homemaker-home health aide demonstrations," Labour Economics, Elsevier, vol. 9(2), pages 279-301, April.
    2. Rosholm, Michael & Staghøj, Jonas & Svarer, Michael & Hammer, Bo, 2006. "A Danish Profiling System," Nationaløkonomisk tidsskrift, Nationaløkonomisk Forening, vol. 2006(1), pages 209-229.
    3. Hugo Benitez-Silva & Moshe Buchinsky & John Rust, 2004. "How Large are the Classification Errors in the Social Security Disability Award Process?," NBER Working Papers 10219, National Bureau of Economic Research, Inc.
    4. Markus Frölich & Michael Lechner & Heidi Steiger, 2003. "Statistically Assisted Programme Selection - International Experiences and Potential Benefits for Switzerland," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 139(III), pages 311-331, September.
    5. Machin, Stephen & Manning, Alan, 1999. "The causes and consequences of longterm unemployment in Europe," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 47, pages 3085-3139, Elsevier.
    6. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    7. Ravallion, Martin & Chao, Kalvin, 1989. "Targeted policies for poverty alleviation under imperfect information: Algorithms and applications," Journal of Policy Modeling, Elsevier, vol. 11(2), pages 213-224.
    8. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    9. Alberto Abadie & David Drukker & Jane Leber Herr & Guido W. Imbens, 2004. "Implementing matching estimators for average treatment effects in Stata," Stata Journal, StataCorp LP, vol. 4(3), pages 290-311, September.
    10. Staghøj, Jonas & Svarer, Michael & Rosholm, Michael, 2007. "A Statistical Programme Assignment Model," IZA Discussion Papers 3165, Institute of Labor Economics (IZA).
    11. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    12. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    13. Nicola Persico & Petra E. Todd, 2005. "Passenger Profiling, Imperfect Screening, and Airport Security," American Economic Review, American Economic Association, vol. 95(2), pages 127-131, May.
    14. Dan A. Black & Jose Galdo & Jeffrey A. Smith, 2007. "Evaluating the Worker Profiling and Reemployment Services System Using a Regression Discontinuity Approach," American Economic Review, American Economic Association, vol. 97(2), pages 104-107, May.
    15. Christopher J. O’Leary & Paul T. Decke & Stephen A. Wandner, 2005. "Cost-Effectiveness of Targeted Reemployment Bonuses," Journal of Human Resources, University of Wisconsin Press, vol. 40(1).
    16. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    17. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    18. Randall W. Eberts, 2002. "Using Statistical Assessment Tools to Target Services to Work First Participants," Book chapters authored by Upjohn Institute researchers, in: Randall W. Eberts & Christopher J. O'Leary & Stephen A. Wandner (ed.), Targeting Employment Services, chapter 8, pages 337-379, W.E. Upjohn Institute for Employment Research.
    19. Elbers, Chris & Fujii, Tomoki & Lanjouw, Peter & Ozler, Berk & Yin, Wesley, 2007. "Poverty alleviation through geographic targeting: How much does disaggregation help?," Journal of Development Economics, Elsevier, vol. 83(1), pages 198-213, May.
    20. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    21. Heller, Ruth & Rosenbaum, Paul R. & Small, Dylan S., 2009. "Split Samples and Design Sensitivity in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1090-1101.
    22. Stefanie Behncke & Markus Frölich & Michael Lechner, 2006. "Statistical Assistance for Programme Selection - For a Better Targeting of Active Labour Market Policies in Switzerland," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 4(02), pages 61-68, July.
    23. Stefanie Behncke & Markus Frölich & Michael Lechner, 2006. "Statistical Assistance for Programme Selection - For a Better Targeting of Active Labour Market Policies in Switzerland," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 4(2), pages 61-68, 07.
    24. Katherine P. Dickinson & Terry R. Johnson & Richard W. West, 1986. "An Analysis of the Impact of CETA Programs on Participants' Earnings," Journal of Human Resources, University of Wisconsin Press, vol. 21(1), pages 64-91.
    25. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    26. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2003. "Is the Threat of Reemployment Services More Effective Than the Services Themselves? Evidence from Random Assignment in the UI System," American Economic Review, American Economic Association, vol. 93(4), pages 1313-1327, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Rosholm & Jonas Staghøj & Michael Svarer, 2007. "A Statistical Programme Assignment Model," Economics Working Papers 2007-16, Department of Economics and Business Economics, Aarhus University.
    2. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Markus Frölich, 2006. "Statistical Treatment Choice: An Application to Active Labour Market Programmes," University of St. Gallen Department of Economics working paper series 2006 2006-14, Department of Economics, University of St. Gallen.
    5. Jonas Staghøj & Michael Svarer & Michael Rosholm, 2010. "Choosing the Best Training Programme: Is there a Case for Statistical Treatment Rules?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(2), pages 172-201, April.
    6. Philip J. O’Connell & Seamus Mcguinness & Elish Kelly, 2012. "The Transition from Short- to Long-Term Unemployment: A Statistical Profiling Model for Ireland," The Economic and Social Review, Economic and Social Studies, vol. 43(1), pages 135-164.
    7. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    8. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    9. Conny Wunsch, 2007. "Optimal Use of Labour Market Policies," University of St. Gallen Department of Economics working paper series 2007 2007-26, Department of Economics, University of St. Gallen.
    10. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    11. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    12. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    13. Marco Caliendo & Reinhard Hujer & Stephan Thomsen, 2008. "Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany," Applied Economics, Taylor & Francis Journals, vol. 40(9), pages 1101-1122.
    14. Stefanie Behncke & Markus Frölich & Michael Lechner, 2010. "Unemployed and their caseworkers: should they be friends or foes?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 67-92, January.
    15. Abbott, Joshua K. & Klaiber, H. Allen, 2011. "The Value Of Water As An Urban Club Good: A Matching Approach To Hoa-Provided Lakes," 2011 Annual Meeting, July 24-26, 2011, Pittsburgh, Pennsylvania 103781, Agricultural and Applied Economics Association.
    16. Michael Lechner & Anthony Strittmatter, 2019. "Practical procedures to deal with common support problems in matching estimation," Econometric Reviews, Taylor & Francis Journals, vol. 38(2), pages 193-207, February.
    17. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    18. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    19. Doerr, Annabelle & Strittmatter, Anthony, 2014. "Assignment Mechanisms, Selection Criteria, and the Effectiveness of Training Programs," Economics Working Paper Series 1421, University of St. Gallen, School of Economics and Political Science, revised May 2017.
    20. Esaka, Taro, 2014. "Are consistent pegs really more prone to currency crises?," Journal of International Money and Finance, Elsevier, vol. 44(C), pages 136-163.

    More about this item

    Keywords

    profiling; Kaplan-Meier estimator; Cox proportional hazard model; distance metrics; weights; matching; unemployment duration;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20150126. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.