IDEAS home Printed from https://ideas.repec.org/p/uwo/uwowop/200018.html
   My bibliography  Save this paper

Evaluating Profiling as a Means of Allocating Government Services

Author

Listed:

Abstract

This paper considers the use of statistical profiling to allocate persons to alternative options within government programs, or to participation or non-participation in programs. Profiling has been used in the United States to allocate unemployment insurance (UI) claimants to reemployment services based on the predicted duration of their UI claim. We place profiling in the context of the choice among alternative assignment mechanisms. Different mechanisms have different costs and benefits – any one mechanism, whether profiling or something else, may not be optimal for every program. Within profiling systems, we highlight the need for clarity regarding the objective of the assignment mechanism, e.g. equity or efficiency, and we discuss situations in which equity and efficiency goals may conflict. In relation to UI profiling in the United States, we provide empirical evidence from the state of Kentucky on two important questions. First, we demonstrate that it is possible to effectively predict the duration of UI spells, but that effectively doing so requires using more covariates than many US states presently do. This finding is important because effective prediction of the profiling variable is a necessary but not sufficient condition for the success of a profiling system. Second, we show that the impact of reemployment services does not appear to vary with expected duration of the UI spell, indicating that UI profiling in Kentucky does not advance the goal of efficiency, though it may advance equity goals.

Suggested Citation

  • Mark C. Berger & Dan Black & Jeffrey Smith, 2000. "Evaluating Profiling as a Means of Allocating Government Services," University of Western Ontario, Departmental Research Report Series 200018, University of Western Ontario, Department of Economics.
    • Handle: RePEc:uwo:uwowop:200018
    as

    Download full text from publisher

    File URL: https://ir.lib.uwo.ca/cgi/viewcontent.cgi?article=1362&context=economicsresrpt
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Machin, Stephen & Manning, Alan, 1999. "The causes and consequences of longterm unemployment in Europe," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 47, pages 3085-3139, Elsevier.
    2. Randall W. Eberts & Christopher J. O'Leary, 1996. "Design of the Worker Profiling and Reemployment Services System and Evaluation in Michigan," Upjohn Working Papers 96-41, W.E. Upjohn Institute for Employment Research.
    3. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    4. Christopher J. O'Leary & Stephen A. Wandner, 2001. "Unemployment Compensation and Older Workers," Book chapters authored by Upjohn Institute researchers, in: Peter P. Budetti & Richard V. Burkhauser & Janice M. Gregory & H. Allan Hunt (ed.), Ensuring Health and Income Security for an Aging Workforce, pages 85-133, W.E. Upjohn Institute for Employment Research.
    5. Heckman, James J & Heinrich, Carolyn & Smith, Jeffrey, 1997. "Assessing the Performance of Performance Standards in Public Bureaucracies," American Economic Review, American Economic Association, vol. 87(2), pages 389-395, May.
    6. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    7. Dan A. Black & Mark C. Berger & Jeffrey A. Smith & Brett J. Noel, 1999. "Is the Threat of Training More Effective Than Training Itself? Experimental Evidence from the UI System," University of Western Ontario, Departmental Research Report Series 9907, University of Western Ontario, Department of Economics.
    8. Charles F. Manski, 1999. "Statistical Treatment Rules for Heterogeneous Populations: With Application to Randomized Experiments," NBER Technical Working Papers 0242, National Bureau of Economic Research, Inc.
    9. James J. Heckman & Jeffrey A. Smith & Christopher Taber, 1996. "What Do Bureaucrats Do? The Effects of Performance Standards and Bureaucratic Preferences on Acceptance into the JTPA Program," NBER Working Papers 5535, National Bureau of Economic Research, Inc.
    10. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2002. "Is the Threat of Reemployment Services More Effective than the Services Themselves? Experimental Evidence from the UI System," NBER Working Papers 8825, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tuomas Takalo & Tanja Tanayama & Otto Toivanen, 2005. "Selection Or Self-Rejection? Applications Into A Treatment," Industrial Organization 0510002, University Library of Munich, Germany.
    2. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    3. Bas van der Klaauw & Sandra Vriend, 2015. "A Nonparametric Method for Predicting Survival Probabilities," Tinbergen Institute Discussion Papers 15-126/V, Tinbergen Institute.
    4. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    5. Conny Wunsch, 2007. "Optimal Use of Labour Market Policies," University of St. Gallen Department of Economics working paper series 2007 2007-26, Department of Economics, University of St. Gallen.
    6. Romain Aeberhardt & Élise Coudin & Roland Rathelot, 2017. "The heterogeneity of ethnic employment gaps," Journal of Population Economics, Springer;European Society for Population Economics, vol. 30(1), pages 307-337, January.
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Brian Bell & Richard Blundell & John Reenen, 1999. "Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 6(3), pages 339-360, August.
    9. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    10. Basu, Anirban, 2015. "Welfare implications of learning through solicitation versus diversification in health care," Journal of Health Economics, Elsevier, vol. 42(C), pages 165-173.
    11. Randall W. Eberts & Christopher J. O'Leary, 2003. "A New WPRS Profiling Model for Michigan," Book chapters authored by Upjohn Institute researchers, in: Joshua Riley & Aquila Branch & Stephen Wandner & Wayne Gordon (ed.),A Compilation of Selected Papers from the Employment and Training Administration's 2003 Biennial National Research Conference, ETA Occasional Paper 20, pages 130-184, W.E. Upjohn Institute for Employment Research.
    12. Stoye, Jörg, 2012. "Minimax regret treatment choice with covariates or with limited validity of experiments," Journal of Econometrics, Elsevier, vol. 166(1), pages 138-156.
    13. Matthew A. Masten, 2023. "Minimax-regret treatment rules with many treatments," The Japanese Economic Review, Springer, vol. 74(4), pages 501-537, October.
    14. William A. Brock & Steven N. Durlauf & Kenneth D. West, 2003. "Policy Evaluation in Uncertain Economic Environments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(1), pages 235-322.
    15. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    16. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    17. Masahiro Kato & Masaaki Imaizumi & Takuya Ishihara & Toru Kitagawa, 2022. "Best Arm Identification with Contextual Information under a Small Gap," Papers 2209.07330, arXiv.org, revised Jan 2023.
    18. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    19. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2022. "Treatment Choice with Nonlinear Regret," Papers 2205.08586, arXiv.org, revised Oct 2024.
    20. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwo:uwowop:200018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://economics.uwo.ca/research/research_papers/department_working_papers.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.