IDEAS home Printed from https://ideas.repec.org/p/uwo/uwowop/200018.html
   My bibliography  Save this paper

Evaluating Profiling as a Means of Allocating Government Services

Author

Listed:

Abstract

This paper considers the use of statistical profiling to allocate persons to alternative options within government programs, or to participation or non-participation in programs. Profiling has been used in the United States to allocate unemployment insurance (UI) claimants to reemployment services based on the predicted duration of their UI claim. We place profiling in the context of the choice among alternative assignment mechanisms. Different mechanisms have different costs and benefits – any one mechanism, whether profiling or something else, may not be optimal for every program. Within profiling systems, we highlight the need for clarity regarding the objective of the assignment mechanism, e.g. equity or efficiency, and we discuss situations in which equity and efficiency goals may conflict. In relation to UI profiling in the United States, we provide empirical evidence from the state of Kentucky on two important questions. First, we demonstrate that it is possible to effectively predict the duration of UI spells, but that effectively doing so requires using more covariates than many US states presently do. This finding is important because effective prediction of the profiling variable is a necessary but not sufficient condition for the success of a profiling system. Second, we show that the impact of reemployment services does not appear to vary with expected duration of the UI spell, indicating that UI profiling in Kentucky does not advance the goal of efficiency, though it may advance equity goals.

Suggested Citation

  • Mark C. Berger & Dan Black & Jeffrey Smith, 2000. "Evaluating Profiling as a Means of Allocating Government Services," University of Western Ontario, Departmental Research Report Series 200018, University of Western Ontario, Department of Economics.
  • Handle: RePEc:uwo:uwowop:200018
    as

    Download full text from publisher

    File URL: https://ir.lib.uwo.ca/cgi/viewcontent.cgi?article=1362&context=economicsresrpt
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Machin, Stephen & Manning, Alan, 1999. "The causes and consequences of longterm unemployment in Europe," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 47, pages 3085-3139, Elsevier.
    2. Randall W. Eberts & Christopher J. O'Leary, 1996. "Design of the Worker Profiling and Reemployment Services System and Evaluation in Michigan," Upjohn Working Papers 96-41, W.E. Upjohn Institute for Employment Research.
    3. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    4. Christopher J. O'Leary & Stephen A. Wandner, 2001. "Unemployment Compensation and Older Workers," Book chapters authored by Upjohn Institute researchers, in: Peter P. Budetti & Richard V. Burkhauser & Janice M. Gregory & H. Allan Hunt (ed.), Ensuring Health and Income Security for an Aging Workforce, pages 85-133, W.E. Upjohn Institute for Employment Research.
    5. Heckman, James J & Heinrich, Carolyn & Smith, Jeffrey, 1997. "Assessing the Performance of Performance Standards in Public Bureaucracies," American Economic Review, American Economic Association, vol. 87(2), pages 389-395, May.
    6. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    7. Dan A. Black & Mark C. Berger & Jeffrey A. Smith & Brett J. Noel, 1999. "Is the Threat of Training More Effective Than Training Itself? Experimental Evidence from the UI System," University of Western Ontario, Departmental Research Report Series 9907, University of Western Ontario, Department of Economics.
    8. Charles F. Manski, 1999. "Statistical Treatment Rules for Heterogeneous Populations: With Application to Randomized Experiments," NBER Technical Working Papers 0242, National Bureau of Economic Research, Inc.
    9. James J. Heckman & Jeffrey A. Smith & Christopher Taber, 1996. "What Do Bureaucrats Do? The Effects of Performance Standards and Bureaucratic Preferences on Acceptance into the JTPA Program," NBER Working Papers 5535, National Bureau of Economic Research, Inc.
    10. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2002. "Is the Threat of Reemployment Services More Effective than the Services Themselves? Experimental Evidence from the UI System," NBER Working Papers 8825, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    2. Jorge N. Zumaeta Ph.D., 2021. "An Econometric Analysis of the Effects of the Job Training Partnership Act on Self-Sufficiency," The Journal of Social Sciences Research, Academic Research Publishing Group, vol. 7(2), pages 66-74, 06-2021.
    3. John V. Pepper, 2002. "To Train or Not To Train: Optimal Treatment Assignment Rules Using Welfare-to-Work Experiments," Virginia Economics Online Papers 356, University of Virginia, Department of Economics.
    4. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    5. Dan A. Black & Mark C. Berger & Jeffrey A. Smith & Brett J. Noel, 1999. "Is the Threat of Training More Effective Than Training Itself? Experimental Evidence from the UI System," University of Western Ontario, Departmental Research Report Series 9907, University of Western Ontario, Department of Economics.
    6. Smith, Jeffrey, 2002. "Introduction," Labour Economics, Elsevier, vol. 9(2), pages 137-141, April.
    7. Staghøj, Jonas & Svarer, Michael & Rosholm, Michael, 2007. "A Statistical Programme Assignment Model," IZA Discussion Papers 3165, Institute of Labor Economics (IZA).
    8. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    9. Doerr, Annabelle & Strittmatter, Anthony, 2014. "Assignment Mechanisms, Selection Criteria, and the Effectiveness of Training Programs," Economics Working Paper Series 1421, University of St. Gallen, School of Economics and Political Science, revised May 2017.
    10. Rosholm, Michael & Staghøj, Jonas & Svarer, Michael & Hammer, Bo, 2006. "A Danish Profiling System," Nationaløkonomisk tidsskrift, Nationaløkonomisk Forening, vol. 2006(1), pages 209-229.
    11. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2002. "Is the Threat of Reemployment Services More Effective than the Services Themselves? Experimental Evidence from the UI System," NBER Working Papers 8825, National Bureau of Economic Research, Inc.
    12. Markus Frölich, 2006. "Statistical treatment choice: an application to active labour market programmes," CeMMAP working papers CWP24/06, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Jeff Borland & Yi-Ping Tseng & Roger Wilkins, 2013. "Does Coordination of Welfare Services Delivery Make a Difference for Extremely Disadvantaged Jobseekers? Evidence from the ‘YP-super-4’ Trial," The Economic Record, The Economic Society of Australia, vol. 89(287), pages 469-489, December.
    14. O'Connell, Philip J. & McGuinness, Seamus & Kelly, Elish, 2010. "A Statistical Profiling Model of Long-Term Unemployment Risk in Ireland," Papers WP345, Economic and Social Research Institute (ESRI).
    15. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    16. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    17. Markus Frölich & Michael Lechner & Heidi Steiger, 2003. "Statistically Assisted Programme Selection - International Experiences and Potential Benefits for Switzerland," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 139(III), pages 311-331, September.
    18. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    19. Pedro Portugal & José Ferreira Machado, 2006. "U.S. Unemployment Duration: Has Long Become Longer or Short Become Shorter?," Working Papers w200613, Banco de Portugal, Economics and Research Department.
    20. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    21. Sergio Cappellini, 2022. "Optimal Unemployment Insurance with Worker Profiling," "Marco Fanno" Working Papers 0294, Dipartimento di Scienze Economiche "Marco Fanno".
    22. John V. Pepper, 2003. "Using Experiments to Evaluate Performance Standards: What Do Welfare-to-Work Demonstrations Reveal to Welfare Reformers?," Journal of Human Resources, University of Wisconsin Press, vol. 38(4).
    23. Körtner, John & Bonoli, Giuliano, 2021. "Predictive Algorithms in the Delivery of Public Employment Services," SocArXiv j7r8y, Center for Open Science.
    24. Bell, Stephen H. & Orr, Larry L., 2002. "Screening (and creaming?) applicants to job training programs: the AFDC homemaker-home health aide demonstrations," Labour Economics, Elsevier, vol. 9(2), pages 279-301, April.
    25. Marios Michaelides & Peter Mueser, 2015. "The labor market effects of U.S. reemployment programs during the great recession," University of Cyprus Working Papers in Economics 08-2015, University of Cyprus Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tuomas Takalo & Tanja Tanayama & Otto Toivanen, 2005. "Selection Or Self-Rejection? Applications Into A Treatment," Industrial Organization 0510002, University Library of Munich, Germany.
    2. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    3. Bas van der Klaauw & Sandra Vriend, 2015. "A Nonparametric Method for Predicting Survival Probabilities," Tinbergen Institute Discussion Papers 15-126/V, Tinbergen Institute.
    4. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    5. Conny Wunsch, 2007. "Optimal Use of Labour Market Policies," University of St. Gallen Department of Economics working paper series 2007 2007-26, Department of Economics, University of St. Gallen.
    6. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    7. Masahiro Kato & Masaaki Imaizumi & Takuya Ishihara & Toru Kitagawa, 2023. "Asymptotically Optimal Fixed-Budget Best Arm Identification with Variance-Dependent Bounds," Papers 2302.02988, arXiv.org, revised Jul 2023.
    8. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    9. Pascal Courty & Gerald Marschke, 2003. "Making Government Accountable: Lessons from a Federal Job Training Program," The Centre for Market and Public Organisation 03/083, The Centre for Market and Public Organisation, University of Bristol, UK.
    10. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    11. Romain Aeberhardt & Élise Coudin & Roland Rathelot, 2017. "The heterogeneity of ethnic employment gaps," Journal of Population Economics, Springer;European Society for Population Economics, vol. 30(1), pages 307-337, January.
    12. Brian Bell & Richard Blundell & John Reenen, 1999. "Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 6(3), pages 339-360, August.
    13. Cullen, Julie Berry, 2003. "The impact of fiscal incentives on student disability rates," Journal of Public Economics, Elsevier, vol. 87(7-8), pages 1557-1589, August.
    14. Keisuke Hirano & Jack R. Porter, 2016. "Panel Asymptotics and Statistical Decision Theory," The Japanese Economic Review, Japanese Economic Association, vol. 67(1), pages 33-49, March.
    15. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    16. Charles F. Manski, 2005. "Fractional Treatment Rules for Social Diversification of Indivisible Private Risks," NBER Working Papers 11675, National Bureau of Economic Research, Inc.
    17. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    18. Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2020. "Robust Forecasting," Papers 2011.03153, arXiv.org, revised Dec 2020.
    19. Basu, Anirban, 2015. "Welfare implications of learning through solicitation versus diversification in health care," Journal of Health Economics, Elsevier, vol. 42(C), pages 165-173.
    20. Randall W. Eberts & Christopher J. O'Leary, 2003. "A New WPRS Profiling Model for Michigan," Book chapters authored by Upjohn Institute researchers, in: Joshua Riley & Aquila Branch & Stephen Wandner & Wayne Gordon (ed.),A Compilation of Selected Papers from the Employment and Training Administration's 2003 Biennial National Research Conference, ETA Occasional Paper 20, pages 130-184, W.E. Upjohn Institute for Employment Research.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwo:uwowop:200018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://economics.uwo.ca/research/research_papers/department_working_papers.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.